- On every plan: use your own AI agent connected to the Checkly MCP Server.
- On Trial, Starter, Team, and Enterprise plans: you can also use the AI Assistant in Checkly.
Prerequisites
Prerequisites
- Permission to create and edit checks
- Access to each Agentic Check’s prompt, schedule, locations, alert settings, and any variables or secrets it uses
- For your own agent: an MCP client connected to the Checkly MCP Server. See Set up the MCP server.
- For the AI Assistant: a Trial, Starter, Team, or Enterprise plan, with Rocky AI enabled for the account. An account owner can enable it in the AI settings.
If a Checkly CLI project manages the Agentic Check, create the replacement in that project instead: replace the
AgenticCheck construct with a BrowserCheck or MultiStepCheck construct and deploy. Checkly Skills help your agent write and test the check. Changes made in the Checkly app or through the MCP Server to a check that a CLI project manages are overwritten by its next deploy.Create the replacement with your own AI agent
- Open the Agentic Check and select Copy prompt. Note its frequency, locations, alert channels, referenced variables or secrets, and any custom skills.
- In your MCP client, ask your agent to create the replacement through the Checkly MCP Server. Give it the copied prompt, the check type, and the original schedule and locations:
Prompt
- Open the new check in Checkly and inspect its script, assertions, and settings. Confirm that important outcomes and guardrails from the original prompt are present. If the Agentic Check used custom skills, verify that the replacement script covers the behavior you still need.
Create the replacement with the AI Assistant
Available on Trial, Starter, Team, and Enterprise plans.- Open the Agentic Check and select Copy prompt. Note its frequency, locations, alert channels, referenced variables or secrets, and any custom skills.
- Select Open AI assistant, paste the prompt, and ask for a check for the same journey. Include the pass and fail criteria. Choose a Browser Check for a web journey or a Multistep Check for an API workflow.
- Review the proposed plan and select Create checks. Inspect the generated script, assertions, settings, and check intent. Confirm that important outcomes and guardrails from the original prompt are present. If the Agentic Check used custom skills, verify that the replacement script covers the behavior you still need.
Verify and switch over
- Run the replacement check and confirm it reports the expected result. Correct the script or settings if needed. Match the original check’s frequency, locations, and alerting before relying on the replacement.
- In the replacement check’s Automatic Repair settings, review its intent, select On under Automatic repair behavior, and save. If the check has no intent yet, select Initialize from saved check first. Learn how automatic repair works.
- Once the replacement is running as expected, deactivate the Agentic Check. Keep it for its existing configuration and history, or remove it later according to your retention needs.