Run automated tests on your AI agent
You can now run automated test conversations against your AI agent to make sure it behaves as expected.
Run tests anytime, especially after updating your agent’s instructions, model, data sources, procedures, or actions, to catch issues before they reach customers.
For actions, you can:
- Check expected actions: Optionally verify that the agent called exactly the actions you listed.
- Mock responses: Return your own data or an error to see how the agent responds to different scenarios.
- Run live actions: Call supported read-only actions, such as Shopify product lookups or web search. Write actions and custom actions can’t run live.
Every paid plan includes free monthly test credits: 200 on Hobby, 500 on Standard, and 1,000 on Pro and Enterprise. On the Free plan, tests use message credits.
The world’s best customer experiences run on Chatbase
Join thousands of teams using Chatbase to build AI agents that deliver exceptional support at scale — across chat, email, and voice.