← Back to overview
Dark mode
Creative strategy

Hypothesis-driven testing framework

Every creative goes live with a written hypothesis. Every kill has a documented reason. No gut calls.

Why this matters for Beyond Driven: Julian has specifically identified gut-based creative decisions as one of the core problems with past vendors. This framework is the direct fix, it turns creative testing from opinion-based to evidence-based, and it gives Julian a clear audit trail for every spend decision.

The pain × benefit × challenge matrix

VariableOptions to testWhy it matters
Pain point Marriage distance · Loss of identity · High performer failing at home · At rock bottom / separated Different pain angles reach different awareness levels. Cold traffic almost always responds to the deepest, most specific pain.
Benefit claim Proven system · Results in 90 days · Brotherhood community · Inside-out method · Save marriage without therapy Tests which outcome the audience actually cares about most.
Creative format Tim talking head · Partnership ad · Female creator · Static text · Static scene photo · UGC testimonial Format often matters more than the copy itself. This tests the delivery channel, not just the message.
Hook angle Confrontational · Empathetic · Social proof · Pattern interrupt · Curiosity · Direct offer Determines whether someone stops scrolling before any other variable gets a chance to work.
Awareness level Problem-unaware · Problem-aware · Solution-aware · Product-aware Cold Meta traffic is mostly problem-aware. Lead with the pain, not the product.

The hypothesis template

Template
"We believe [pain angle] combined with [benefit claim] in a [format] will outperform the current control because [specific reason based on data or insight]. We'll declare a winner at [X calls] with a CAC at or below [target]."
Example, Week 1 test
"We believe the 'high performer losing at home' pain angle combined with the '90-day transformation' benefit claim in a static split-screen format will outperform Tim's talking-head control because cold traffic in this niche skews high-earning men who respond to identity contrast, not emotional vulnerability. We'll declare a winner at 10+ calls with a CAC at or below $2,000."

Kill rules

Kill immediately
CAC ≥ 1.6× target with 5+ calls and 7+ days of data. No extensions. The data is telling you something.
Watch closely
CAC between 1.0× and 1.5× target, or fewer than 5 calls with 5+ days live. Give it one more week and flag it in the Monday report with a firm decision date.
Scale and document
CAC at or below target with 8+ calls. Graduate to main prospecting, increase budget 20% weekly. Document what worked. The hypothesis, the angle, the format, so it can be replicated.

Weekly testing cadence

Mon
Launch week's new tests + weekly report to Julian
New creatives go live with their hypotheses. The report covers last week's performance, any kill or scale decisions, and what's being prioritized this week.
Wed
Mid-week check, flag anything trending badly
Quick Hyros check. If anything is burning budget at 2× CAC with no signs of improving, pause immediately. Don't wait for Monday.
Thu
Kill decisions finalized
Anything flagged on Monday gets a final decision by Thursday. This keeps the weekend spend clean.
Fri
Next week's creative brief prepared
Write hypotheses for next Monday's tests based on what the week's data showed. Send briefs to the creative team with enough lead time for weekend production if needed.