Skip to content
All tool news

Tool desk · Updated daily

Tool news·Notion·

Notion Rolls Out Custom Agent Insights for Full Visibility Into Agent Runs.

Notion launches Custom Agent Insights, giving teams complete transparency into what their AI agents are doing during every execution.

CW

Create With tool desk

1 source checked · 2 min read · 3 sections

ShareLinkedIn
Notion Rolls Out Custom Agent Insights for Full Visibility Into Agent Runs

Notion is addressing one of the biggest pain points in AI agent deployment: knowing what your agents are actually doing. The company announced Custom Agent Insights this week, a new capability that provides complete visibility into agent activity during every run.

The update tackles a common problem for teams using autonomous AI agents. When agents handle workflows on their own, teams often lack insight into the decision-making process, making it difficult to debug issues, verify outputs, or understand why an agent took a particular action. Custom Agent Insights aims to eliminate that uncertainty.

What Teams Get

The new insights feature provides runtime visibility into agent behavior. Teams can now see the full sequence of actions an agent takes, from initial trigger to final output. This includes which tools the agent accessed, what data it pulled, and how it processed information to complete a task.

For organizations running Custom Agents, this means better oversight of autonomous workflows. Rather than treating agents as black boxes, teams can inspect each step of execution. If an agent produces an unexpected result or fails to complete a workflow, the insights make it easier to identify where things went wrong.

The rollout comes as Notion continues building out its AI infrastructure. Earlier this year, the company launched its Developer Platform, giving developers tools to extend agent capabilities with custom workers and integrations.

Why Transparency Matters

Agent transparency has become critical as teams deploy AI for more consequential workflows. When agents handle customer data, generate content, or make operational decisions, teams need audit trails. Custom Agent Insights provides that paper trail, showing exactly what happened during each run.

This matters particularly for regulated industries or teams with compliance requirements. Being able to trace an agent's actions from start to finish helps meet documentation standards and provides evidence of proper handling.

The feature also supports iterative improvement. Teams can review agent runs to identify patterns, spot inefficiencies, or find opportunities to optimize workflows. Rather than guessing why an agent behaves a certain way, they can see the actual execution path.

Broader Context

Notion has been moving aggressively into the AI agent space. Custom Agents, currently in beta, allow teams to build autonomous workflows that handle repetitive tasks without human intervention. Recent case studies show companies like Vercel using these agents to accelerate shipping cycles.

The Developer Platform extends agent capabilities further, letting teams connect agents to external data sources, build custom tools, and sync information across systems. Custom Agent Insights fits into this ecosystem by making agent behavior observable and debuggable.

The feature is rolling out now to teams with access to Custom Agents. Notion has not specified whether insights will be available across all plan tiers or limited to enterprise customers.

Sources

1 checked

How we cover tool news: Create With's tool desk drafts these reports with AI from the sources listed above and checks them against those sources before publishing.

Worth passing on?

ShareLinkedIn

Go deeper on Notion

Related reading, watching and going.

Everything on Notion →

The briefing

19 May 2026

How to Migrate Your App from Lovable to Claude Code in 2025

Step-by-step guide to migrating your Lovable app to Claude Code. Learn how to move from Lovable's managed platform to a stack you own and control.

Read →

The briefing

31 Mar 2026

Vibe Marketing Review: Can AI Agents Really Automate Marketing?

An honest review of vibe marketing with AI agents. Learn if automated marketing actually works for solo founders and small teams. Plus: Claude Code leak, Factory Missions.

Read →

The briefing

3 Mar 2026

Perplexity Computer Platform & Notion AI Agents Review 2025

Perplexity's 19-model AI platform, Claude Code mobile control, iPhone offline AI with Qwen 3.5, and Notion's custom agents are transforming AI automation.

Read →
39 min

Conference

The Biggest AI Opportunities for Non-Technical Builders in 2026

A closing panel discussion from Create With featuring leaders from Glide, Softr, Bubble, Momen, and TechFoundHer examining how AI and no-code platforms are democratizing software development. The panelists explore what non-technical builders can now create, how AI is transforming service businesses, and where expertise still matters when prototypes become production applications.

Watch now ↗
31 min

Conference

How to Get Your Product Recommended by Google and ChatGPT

Tanya Van Gastel presents the APEX framework for making products discoverable in AI-powered search engines like ChatGPT and Google's AI Overviews. She explains how AI is fundamentally changing product discovery and buyer behavior, then breaks down five critical components: Authority (being cited as a solution), Presence (visibility across search platforms), Expertise (creating high-quality money pages), Endorsements (off-site validation), and Extractability (making content easy for AI to process). The talk emphasizes quality over quantity, with data showing 50% of SaaS SEO revenue comes from fewer than 10 high-performing pages.

Watch now ↗
55 min

Tutorial

I Built a Personal AI Assistant for £10/month — Here's How To Do The Same

Tanveer Mohammed provides a comprehensive tutorial on building a personal AI assistant using OpenClaw for approximately £10/month. The walkthrough covers VPS setup on Hostinger, API configuration through OpenRouter, app integration via Composio, Telegram setup, skill creation, cron job scheduling, and real-world applications including health tracking, trading alerts, and business management.

Watch now ↗

Latest tool news

What else changed this week.

All tool news
VercelDigest

What Vercel Shipped in Late October

Vercel shipped quicker static deployments, four AI Gateway models, more free domain choices and new CLI controls in late October. The changes cover developers testing sites…

Vercel

Vercel Adds Submit_feedback to Its MCP

submitfeedback is a new Vercel MCP tool that lets agents and harnesses send bug reports, friction reports and feature requests directly to the Vercel team. Feedback can include…

The Create With Briefing

Don't watch forty changelogs. Read one email.

Every Tuesday: the tool changes worth knowing, real business use cases, and what's on near you. Free, unsubscribe any time.