What AI Actually Hears on a Sales Call

TET
The Enfonica Team
25 February 2024
6 min read

AI call intelligence isn't magic — it's pattern recognition at scale. Here's what it can genuinely detect, what it can't, and why the distinction matters for how you use the data.

The phrase "AI call intelligence" gets used a lot right now. Vendors throw it around as a differentiator. Agencies hear it and nod along without always understanding what it means in practice.

Let's be specific.

What does AI actually detect in a phone call? What can it reliably infer? Where does it fall short? And — most importantly — how do you use the output to make better decisions for your clients?

The Three Layers of Call Intelligence

Modern AI call analysis works in three sequential layers, each building on the previous.

Layer 1: Transcription

The raw material is a transcript — a text version of what was said.

Modern speech-to-text AI is genuinely good at this now. Accuracy for clear English speech in a standard phone call environment is typically 90–95%. Australian accents, technical vocabulary, and background noise reduce this, but the output is almost always coherent and searchable.

What transcription gives you:

  • A full, readable record of the conversation without listening to hours of audio
  • The ability to search across all calls for specific words or phrases ("price," "competitor name," "not ready," "book an appointment")
  • A foundation for everything that follows

What it doesn't give you:

  • Tone of voice, hesitation, emotional subtext (those require the audio)
  • Perfect accuracy — misheard words are common, especially for names and technical terms

Practical use: Search all calls from a campaign for the phrase "I'll think about it" to identify the most common objection. Update landing page copy to pre-handle it.

Layer 2: Intent Classification

Once you have the transcript, AI classifies the call by intent — what the caller was trying to accomplish.

Standard intent categories for service businesses:

Qualified Lead The caller described a genuine need, is in your service area, and expressed some willingness to proceed. They're a realistic prospect.

Price Inquiry The caller's primary question was about cost. They may convert later, but they're comparison shopping. Not yet a lead — but not worthless either.

Existing Customer The caller is already a client calling for service, support, a question, or to reschedule. Valuable for operations, but should be excluded from marketing conversion reporting.

Wrong Number / Spam Misdialled calls, automated systems, telemarketers. These should be filtered from all reporting and excluded from conversion imports.

Unclassified Calls that don't fit clearly into any category. Short calls, incomplete conversations, calls where the AI had low confidence. Review these manually or accept the uncertainty.

Why this matters: If you're pushing phone calls to Google Ads as conversions, you should be pushing Qualified Lead calls — not all calls. A campaign that drives 100 calls but only 10 qualified leads is very different from one that drives 40 calls with 35 qualified leads.

Without intent classification, you're optimising for volume. With it, you're optimising for quality.

Layer 3: Summaries and Extracted Signals

Beyond classification, AI can extract specific signals from the conversation:

Outcome signals

  • Did a booking happen? Did they confirm an appointment date?
  • Did they express intent to proceed? ("I'll give you a call back," vs. "Yes, let's book that in")
  • Did they mention an objection that wasn't overcome?

Sentiment signals

  • Positive: caller expressed satisfaction, enthusiasm, or clear interest
  • Neutral: transactional, informational exchange
  • Negative: caller expressed frustration, complaint, or dissatisfaction

Competitive signals

  • Did the caller mention a competitor by name?
  • Did they reference a competing quote or price?

Topic signals

  • What service did they inquire about? (Useful for multi-service businesses)
  • Did they mention a specific campaign offer or promotion? (Validates ad creative)
  • Did they reference how they found the business? ("I saw your ad on Google")

Practical use: Filter all calls in the last 90 days where a competitor was mentioned. What were the circumstances? Were these callers who converted anyway, or did the competitive mention lead to an objection? This is intelligence that's invisible without AI — and it informs both ad copy and sales training.

What AI Genuinely Can't Do (Yet)

It's worth being honest about the limitations, because overselling AI capability damages trust in the data.

It can't replace human judgment on close calls A call classified as "Price Inquiry" might be one follow-up away from a booking. AI sees the transcript; it doesn't know the context of your client's market. High-value calls worth reviewing should still be reviewed by a human.

It struggles with complex service conversations A 25-minute conversation about a major commercial project involves nuance, contingency, and technical discussion that AI classifies less accurately than a 4-minute trade booking call. The longer and more complex the call, the more useful AI output is as a starting point rather than a final verdict.

Accents and audio quality affect accuracy Heavy accents, phone line interference, multiple speakers, and background noise all reduce transcription accuracy and downstream classification quality. For most agency clients, this is a minor issue. For businesses in loud environments (warehouses, job sites), it's worth knowing.

It can't tell you why — only what AI tells you that 40% of calls from Campaign X were price inquiries. It doesn't tell you whether that's a targeting problem, a landing page problem, or simply the nature of that market. The interpretation is still yours.

How to Use AI Call Intelligence in Client Reporting

Here's where this becomes genuinely powerful for agencies.

Make intent classification visible in reports

Don't just show call volume. Show:

  • Total calls: 120
  • Qualified leads: 68 (57%)
  • Price inquiries: 31 (26%)
  • Existing customers: 14 (12%)
  • Spam / wrong number: 7 (6%)

This breakdown does two things: it proves the marketing is working (68 qualified leads is a strong month), and it identifies where improvement is possible (the 31 price inquiries might convert better with different landing page copy).

Use summaries to build the case

For key calls — the ones that represent good leads or notable outcomes — pull the AI summary and include it in the reporting pack.

"On 14 February at 11:42am, a caller inquired about a full bathroom renovation. AI summary: Caller described scope, asked about timeline, requested a quote. Qualified intent confirmed."

This kind of specificity in a client report is extraordinary. It turns abstract data into real evidence. The client reads a summary of their own leads and suddenly the campaign is no longer abstract — it's driving conversations like the one they just read.

Feed quality signals back to Google Ads

Push only Qualified Lead calls to Google Ads as conversions. Let Smart Bidding optimise for the calls that actually matter.

This is the full loop: AI classifies the call quality → quality signal feeds the bidding algorithm → bidding algorithm finds more high-quality calls → you drive better results for less spend.

The Efficiency Argument

Here's the practical business case for AI call intelligence from an agency operations perspective.

Without AI, reviewing call quality requires listening to recordings. A busy service business generates 80–150 calls per month. At an average of 4 minutes per call, that's 5–10 hours of audio — for one client.

No agency reviews all their clients' calls manually. It's not possible.

AI makes this possible at scale. You get quality signals for every call, across every client, without human review. You identify outliers — the calls worth listening to, the transcripts worth reading — and spend your human review time on those.

The result: you know what's happening in your clients' phone conversations, at scale, without building a team to listen to hundreds of hours of audio every month.

That's not magic. It's leverage.


See AI Call Insights in action. Learn how Enfonica's intent classification turns call recordings into campaign intelligence your clients can actually act on.