Hiring an appointment setting agency is a decision most companies make on a sales call and regret three months later. The pitch is polished, the case study is impressive, and the proposal leads with one number: meetings booked. You sign, you wait, and the calendar fills with calls that go nowhere.
The problem is rarely that the agency lied. It is that you did not ask the questions that would have exposed the gap between what they sell and what they deliver. A good agency answers hard questions quickly and specifically. A meeting mill hedges, deflects, or buries the answer in jargon.
Here are ten questions to ask before you sign with anyone, grouped by what they reveal. For each one, we have included what a strong answer sounds like and the red flag to watch for. Ask them all, and pay as much attention to how the agency answers as to what they say.
How to use this: Do not accept "yes, we handle that" as an answer to any of these. Ask for the specific how. Vagueness on infrastructure, data, or qualification almost always means the agency is reselling someone else's setup or booking on volume.
Infrastructure and deliverability
Who owns the sending infrastructure, and how many domains do you run for a client?
Deliverability makes or breaks cold outreach. If the agency does not control its own infrastructure, it cannot protect your sender reputation - and if it crams your volume onto too few domains, your emails land in spam and you never know why.
Good answerHow long do you warm up a new domain before it sends to my prospects?
New domains that send cold volume immediately get flagged. Proper warmup takes weeks, not days. An agency that skips it is trading your long-term deliverability for a faster launch.
Good answerData and targeting
Where do you source prospect data, and how do you verify it?
The best copy in the world cannot save a bad list. Agencies that rely on stale purchased lists are emailing burned-out contacts. You want intent data and verified, ICP-matched prospects, not a bulk export.
Good answerHow do you define and confirm my ICP before launch?
If the agency does not invest real time in defining your Ideal Customer Profile, every downstream step is aimed at the wrong people. The onboarding depth here directly predicts the quality of your meetings.
Good answerCopy and qualification
Who writes the copy, and can I approve it?
Your outreach carries your brand. If it is generic, templated, or written by whoever is free that day, it damages your name in your prospects' inboxes. You want human-written, offer-specific sequences you can sign off on.
Good answerWalk me through how you qualify a lead before booking it on my calendar.
This is the single most important question. If the agency cannot describe a clear, named framework, it is booking meetings, not qualified opportunities. A full calendar of unqualified calls costs you more than an empty one.
Good answerDig deeper on this one: Ask what percentage of booked meetings a typical client accepts as qualified. A serious operation qualifies 75 percent or more. Below 60 percent means meetings are being booked to hit a number. We cover the full distinction in Booked Meetings vs Qualified Meetings.
Reporting and handover
What does my sales rep receive before each booked call?
A calendar invite alone is not enough. Your rep should walk into every call knowing who the prospect is, what problem they have, and why they agreed to talk. Context is the difference between a warm call and a cold restart.
Good answerCan I see a real reporting dashboard from a current client?
Agencies that report transparently have nothing to hide. You want live visibility into contacts made, replies, meetings booked, and qualification - not a monthly PDF of cherry-picked wins.
Good answerCommercials and risk
What happens if you miss the targets we agree on?
Any agency will promise results on the sales call. The question is what they do when the results do not come. A real guarantee puts the agency's own time at risk, not just yours.
Good answerIf I stop working with you in six months, what do I keep?
This question separates a vendor from a partner. A vendor hands you a goodbye email. A partner has built assets - domains, warmed mailboxes, sequences, data - that were always working on your behalf.
Good answerThe quick vetting checklist
Before you sign with any appointment setting agency, make sure you have clear, specific answers to all of these:
- Who owns the sending infrastructure, and how many domains do they run per client?
- How long do they warm a domain before sending to your prospects?
- Where does the prospect data come from, and how is it verified?
- How do they define and confirm your ICP before launch?
- Who writes the copy, and do you get to approve it?
- What is their exact qualification framework before a meeting is booked?
- What does your sales rep receive before each call?
- Will they show you a real reporting dashboard?
- What happens if they miss the agreed targets?
- What do you keep if you leave?
The most expensive mistake: Choosing on price alone. A cheaper agency that books unqualified meetings wastes your sales team's hours and drags down your close rate - which costs far more than the retainer you saved.
How we would answer
We built Booked ICP to pass this exact checklist. We provision dedicated, warmed infrastructure separate from your main domain, source and verify ICP-matched data, write personalised sequences you approve, and qualify every lead against fit, need, authority, and timeline before it reaches your calendar. Your reps get full context on every prospect, you get a live dashboard, and our 90-day results guarantee means if we do not hit your agreed targets, we work for free until we do.
If you are vetting agencies right now, bring these ten questions to your call with us. Clear answers are the whole point.
Put us to the test
Bring the ten questions. We will answer every one, show you real reporting, and walk you through exactly how we qualify a meeting before it hits your calendar.
See how Booked ICP works