How to Choose a Paid Media Agency: What to Ask Before You Sign

Most brands pick a paid media agency the wrong way.

They review case studies, sit through a pitch, like the team, and sign. Six months later they’re frustrated because the work isn’t translating to growth — and they can’t quite articulate why. The agency is hitting channel KPIs. The reports look fine. But revenue isn’t moving the way the business needs it to.

The problem usually isn’t the agency’s execution. It’s that the relationship was built on the wrong evaluation criteria from the start.

What most agency evaluations actually measure

The standard agency evaluation process is designed to produce a comfortable decision, not a good one. You ask for case studies (which the agency curated), sit through a pitch (which the agency rehearsed), check references (which the agency selected), and compare pricing (which is usually similar across the shortlist).

None of that tells you how the agency thinks. It tells you how well they sell.

The distinction matters because the agencies that produce the best pitches are not always the agencies that produce the best results. What you actually need to evaluate is whether the agency’s operating model is capable of connecting your media investment to business outcomes — not just optimizing channels in isolation.

The real question you’re trying to answer

Before you walk into any agency conversation, get clear on what you’re actually trying to solve. The answer shapes every question you should ask.

If you’re a brand spending $50K–$500K/month on paid media, you’re typically dealing with one of three situations: you’ve hit a growth plateau and can’t figure out why performance channels aren’t scaling; you’re adding channels (CTV, programmatic, YouTube) and don’t have the infrastructure to measure them; or you’re trying to get your CFO to approve increased media investment and can’t build a convincing case.

Each of these problems requires a different kind of agency. A shop that’s great at Meta performance optimization can’t necessarily help you build a measurement framework that earns CFO trust. An agency that excels at brand campaigns might not have the technical architecture for DTC performance. Know your problem before you start the search.

The evaluation framework: seven questions that actually matter

1. How do your channel teams coordinate with each other?

This is the most revealing structural question you can ask. Most agencies have a social team, a search team, and a programmatic team — and they operate independently. Each team optimizes for its own KPIs. No one maps how the channels connect.

The consequence is predictable: when you cut awareness spend, branded search volume drops 30 days later, CPAs rise, and ROAS declines. The search team reports clean numbers right up until they don’t. By the time the problem surfaces, the connection to the awareness cut is invisible to anyone looking at channel-level reports.

What you want to hear: a specific process for cross-channel budget allocation and a clear explanation of how upper-funnel investment connects to lower-funnel outcomes. Vague answers about “alignment” and “collaboration” are not answers.

2. Walk me through how you’d handle a CFO asking to cut awareness spend.

This question separates order-takers from strategic partners. A weak agency will either comply because it’s not their job to push back, or object vaguely because “brand matters.” Neither response will help you in the room.

A strong agency will describe the data they’d pull and the case they’d build — probably involving branded search trends, geo-lift data, and modeled revenue impact. They should be able to make the argument in language a CFO understands, which means business outcomes, not media metrics.

If they can’t sketch that conversation for you, they won’t be able to have it on your behalf.

3. What measurement infrastructure do you put in place on day one?

Attribution is broken — that’s not a secret. Platform-reported ROAS double-counts, last-click models systematically mislabel what’s working, and there’s no single tool that gives you clean numbers. The question isn’t whether the agency has solved attribution (no one has). The question is how they build confidence in an imperfect environment.

The answer you want involves triangulation: efficiency metrics from platforms (directional, not gospel), incrementality testing to isolate true lift, and a system-level metric like MER (total revenue divided by total marketing spend) that reflects the whole picture. Any agency that relies on platform attribution as the primary measurement lens will eventually mismeasure your business.

4. Show me a media plan you’d recommend for a brand at our stage.

Not their biggest client. A brand roughly like yours. This tests whether their channel recommendations are driven by audience behavior and business goals, or by which platforms they’re most comfortable with and which vendors they have preferred relationships with.

Strong agencies can explain why each channel earns its place in the mix. They talk about audience behavior — where your buyers actually spend time, how they move from awareness to consideration to purchase — not just channel capabilities. They also have a point of view on sequencing: which channels should run first, which depend on others building baseline demand.

5. What does your weekly and monthly communication look like?

Clients rarely leave agencies because performance was bad. They leave because they lose confidence — and confidence erodes quietly through silence, surprise, and the feeling that nobody’s in control.

Ask specifically: how often do you hear from them proactively (not just when you ask)? What does the weekly report contain — channel metrics, or business outcomes? When something goes wrong, what’s the process? An agency with a real communication infrastructure will answer these questions specifically. An agency that doesn’t have one will describe their intentions.

6. Who will actually work on our account, and how are they structured?

This question exposes the gap between the pitch team and the execution team. Agencies often send senior strategists to win the business and junior coordinators to run it. Ask directly: who day-to-day owns our account? What’s their experience level? How many other accounts are they managing?

Also ask about structure. An agency organized by function (one person owns all social, another owns all search across all clients) produces different outcomes than one organized by client (a dedicated pod owns your account end-to-end). The pod model concentrates expertise and accountability. The functional model distributes it — and dilutes it.

7. How do you handle underperformance?

Every agency says they’re accountable. Ask them to prove it. What does accountability actually look like when results aren’t there — do they proactively surface the problem or wait for you to notice? How do they diagnose whether the issue is in the channel, the creative, the offer, or the measurement? What’s been the hardest client conversation they’ve had and how did they handle it?

Vague answers here — “we’re very transparent,” “we take full ownership” — are not answers. Specificity signals real process. Generalities signal a talking point.

Red flags that don’t show up in the pitch

A few patterns that should slow you down, even if the case studies look good:

• They lead every proposal with platform logos. Channel coverage is not strategy. An agency that organizes its pitch around “we run Meta, Google, TikTok, CTV” is selling execution, not thinking.
• Their case studies only show channel-level wins. ROAS improvements and CPA reductions are execution metrics. If they can’t connect past work to revenue growth, CAC payback, or total business outcomes, they may not have the measurement infrastructure to connect them for you.
• They agree with everything in the pitch. A strategic partner will push back on something — your timeline, your attribution setup, your channel assumptions. An agency that validates your current thinking isn’t bringing you new thinking.
• They can’t explain their measurement approach in plain English. If the measurement conversation turns into a list of tools they use, that’s a signal. Tools are not a methodology. The methodology is how they build confidence in what’s working when the data is imperfect — which it always is.

What a strong agency relationship actually looks like

The best agency relationships feel like having a senior media strategist as a member of your leadership team — someone who brings you problems before you ask, who helps you build the internal case for media investment, and who the business trusts to make budget decisions that compound over time.

That relationship requires two things on both sides: the agency needs real infrastructure (cross-channel visibility, measurement beyond platform attribution, communication systems that don’t require the client to chase), and the client needs to be willing to treat media as a system rather than a series of disconnected channel bets.

When both are in place, the conversations shift. Instead of reviewing last week’s ROAS numbers, you’re talking about what the business needs from media over the next 90 days, and whether the current mix is structured to deliver it.

The decision criterion that matters most

After running through all of it — the questions, the references, the proposals — there’s one thing worth coming back to: does this agency understand how awareness investment connects to performance outcomes, and can they prove it?

Because if they’re only optimizing channels, they’re managing tactics. And tactics, optimized in isolation, will eventually compete with each other for credit without anyone building the demand that makes all of them more efficient.

The agency you want is the one that can look at your full media picture and answer the question your CFO keeps asking: if we invest more here, what happens to the business? Not just to the channel.

If this evaluation framework surfaces questions you don’t yet have answers to, the Blueprint Session is a 45-minute working session to map exactly where the gaps live in your current media program. weareqry.com/blueprint