Scheduled Runs

Automate your testing by scheduling scenarios to run on a recurring basis.

What scheduled runs are

A scheduled run executes a scenario against an agent automatically on a schedule you define. Instead of clicking Run manually, Voxli runs your tests at the times you set - every morning, every weekday, or whatever cadence makes sense for your workflow.

Use scheduled runs to catch regressions without manual testing. If something breaks, you find out on the next scheduled run - not the next time a customer runs into it.

Setting up a scheduled run

1. Go to the Scheduled Runs page in the left sidebar.
2. Click Schedule new.
3. Fill in the form:
   • Name - a label for this schedule (e.g., “Monday morning”).
   • Scenario - which scenario to run.
   • Agent - which agent to test with.
   • Personality - optionally select a personality. Defaults to Neutral.
   • Schedule - describe when to run in natural language (e.g., “Every Monday morning at 8 AM” or “Every weekday at 9am”). Voxli interprets this and sets up the schedule.
   • Timezone - select the appropriate timezone.
4. Click Create Schedule.

Managing schedules

Each scheduled run shows as a card on the Scheduled Runs page. The card displays the schedule name, linked scenario and agent, the schedule description, and when the next run will execute.

You can:

• Enable or disable a schedule without deleting it. Disabled schedules keep their configuration but don’t execute.
• Edit a schedule to change its settings.
• Archive a schedule to remove it.

Notifications

Get alerted when a scheduled run fails. Voxli can notify you via email, Slack, or both. Open the Notifications page from the left sidebar and create a notification for any scheduled run.

Each notification is tied to one scheduled run and has a failure threshold that controls which severity level triggers an alert - blocker failures only, medium and above, or any failure. See Assertions for how severities work.

Email

Toggle Notify via Email in the notification form, then add one or more recipient addresses. Voxli sends a summary email when a scheduled run finishes with at least one failure that meets your threshold.

Slack

Toggle Notify via Slack in the notification form, then enter the channel name (for example, general - no # prefix). Voxli posts a formatted message into that channel when a scheduled run finishes with at least one failure that meets your threshold.

The Slack toggle is only available once you have connected Slack under Settings > Integrations. See Slack Integration for the connection steps.

The Voxli bot must be invited to the channel before it can post. In the channel, type /invite @Voxli. Use the Test button next to the channel name field to verify the connection works before saving.

What’s next

• Run a Test - the manual run workflow.
• Comparing Agents - A/B test two agent configurations.