Hallucination Detection

See when your agent states something the conversation does not support, and suppress known-safe statements you do not want flagged.

What hallucination detection is

After a test conversation finishes, Voxli reads the agent’s messages and pulls out the factual claims they make. It then checks each claim against the conversation - the tool calls, events, and earlier messages the agent had to work with - and labels whether the claim was backed up.

This catches a common failure mode: an agent that sounds confident but states something it was never told. You see these results on the test result, alongside the assertion outcomes.

This is an experimental feature and is enabled per workspace. If you don’t see the Hallucinations section on a test result or the Settings > Hallucination tab, it isn’t switched on for your workspace yet.

Reading claims on a test result

Open a test result and find the Hallucinations section on the left, beneath the assertion checks. Extracted claims are grouped by how well the conversation supported them:

Supported - the conversation backs up the claim.
Unsupported - nothing in the conversation supports the claim.
Contradicted - the claim goes directly against the conversation.
Unverified - the claim was not checked against the conversation.
Dropped - the claim was skipped by an exclusion rule (see below).

Contradicted and unsupported claims are the ones to worry about - both mean the statement should not be trusted. Each claim row can expand to show the evidence behind its verdict, and selecting a claim highlights the related messages in the conversation transcript on the right, the same way assertions do.

Suppressing known-safe claims with exclusion rules

Detection is deliberately strict, so it sometimes flags a statement that is actually fine - for example, a support agent correctly saying “we have no information on that.” Exclusion rules tell Voxli to stop flagging statements like that, without weakening detection everywhere else.

A rule is a short, free-text description of the kind of claim to skip. On the next run, any claim that matches an active rule is dropped from detection instead of being flagged. Existing results keep the verdicts they already have - rules only affect future runs.

Creating a rule from a flagged claim

The quickest way to add a rule is straight from a claim you disagree with.

On a test result, find the flagged claim in the Hallucinations section.
Click the thumbs-down on the claim - Create an exclusion rule from this claim.
The Create exclusion rule dialog opens. Write a short Rule describing the kind of claim to skip (for example, “Information about pricing”).
Optionally click Run preview to see which of this result’s unsupported claims the rule would affect - each is marked Keep or Would drop.
Click Create rule.

Managing rules in Settings

All your rules live under Settings > Hallucination. To get there, click your workspace name in the top left corner, choose Settings, then open Hallucination.

Click Create rule to write one from scratch.
The table lists each rule with its author and when it was created. Use the row actions to Edit rule or Delete rule.
Deleting a rule means matching claims are flagged again on future runs.

If you have no rules yet, the page explains that you can click thumbs-down on an extracted claim to create one, or write one from scratch.

What’s next

Results - inspect a test result and its conversation transcript.
Assertions - the other half of how a test result is judged.