Skip to content
All tool news

Tool desk · Updated daily

Tool news·Intercom·

Intercom Launches Monitors to Give Teams Control Over AI Conversation Quality.

Intercom's new Monitors feature continuously evaluates conversation quality across AI and human support to ensure every interaction meets standards.

CW

Create With tool desk

1 source checked · 2 min read · 3 sections

ShareLinkedIn
Intercom Launches Monitors to Give Teams Control Over AI Conversation Quality

Intercom Introduces Monitors for Quality Control

Intercom has launched Monitors in Fin, a new quality control layer designed to continuously evaluate conversations against company-defined standards. The feature addresses a persistent challenge in AI-powered customer support: ensuring automated responses maintain the same quality and brand voice as human agents.

Monitors works across both Fin AI conversations and human agent interactions, scanning for adherence to quality metrics set by support teams. The system operates in real-time, flagging conversations that fall short of established benchmarks and providing visibility into how well AI agents handle customer queries.

Liz Moy, from Intercom's product team, demonstrated Monitors at Fin Labs Paris, showing how support leaders can define quality criteria and track performance across their entire conversation volume.

Opening the AI Black Box

The announcement follows Intercom's March launch of the Apex model, their custom-trained AI specifically built for customer service. While Apex improved response accuracy, Monitors tackles the next logical challenge: verification and oversight.

According to Intercom's official blog post titled "Announcing Monitors: Opening the AI black box", the feature fits into their broader "Fin Flywheel" approach, which includes training, testing, deployment, and analysis stages. Monitors occupies the analysis phase, working alongside Insights and Recommendations to give teams complete visibility into their AI operations.

The system lets support leaders set specific quality standards, whether that's tone of voice, accuracy thresholds, or adherence to company policies. Once configured, Monitors continuously scans conversations and surfaces those that deviate from expectations, enabling teams to refine their AI agent's behavior over time.

Scaling Support Without Sacrificing Quality

For teams already using Fin to automate portions of their support workload, Monitors provides the confidence to expand AI coverage. The feature addresses a common concern: as companies hand more conversations to AI agents, how do they ensure quality doesn't degrade?

Intercom positions Monitors as the answer to this question. By making AI behavior transparent and measurable, support teams can identify patterns in low-quality responses, understand where human intervention is still necessary, and gradually improve their AI agent's performance through targeted training.

The feature competes with similar quality assurance tools offered by platforms like Zendesk and Freshdesk, though Intercom's tight integration with Fin gives it native access to AI conversation data that third-party QA tools lack.

Monitors is available now to Intercom customers using Fin. The company has not disclosed pricing details, though it appears to be included with existing Fin subscriptions rather than sold as a separate add-on. Teams interested in the feature can access it through their Intercom dashboard settings.

As support organizations increasingly rely on AI to handle routine queries, tools like Monitors represent a necessary evolution in the category. The question is no longer whether AI can handle customer conversations, but how companies ensure those conversations meet their standards at scale.

Sources

1 checked

How we cover tool news: Create With's tool desk drafts these reports with AI from the sources listed above and checks them against those sources before publishing.

Worth passing on?

ShareLinkedIn

Latest tool news

What else changed this week.

All tool news

The Create With Briefing

Don't watch forty changelogs. Read one email.

Every Tuesday: the tool changes worth knowing, real business use cases, and what's on near you. Free, unsubscribe any time.