Skip to content

Building Automations

Automations let you set up hands-off workflows that respond to events like GitHub issues or webhooks. This guide walks through creating your first automation.

  1. Navigate to Automations in the sidebar
  2. Click Create Automation
  3. Follow the automation builder wizard

Give your automation a clear, descriptive name:

“Auto-triage bug reports”

“PR code review on feature branches”

“Generate docs on merge”

Choose what event starts your automation.

Triggers when issues are created or updated:

  1. Select GitHub Issue as trigger type
  2. Choose the repository to monitor
  3. Optionally filter by labels (e.g., only bug or automate)

Triggers on PR events:

  1. Select GitHub Pull Request as trigger type
  2. Choose the repository
  3. Configure which events trigger (opened, updated, merged)

See Event Triggers for detailed configuration options.

Define what happens when the trigger fires.

Creates a new AI session:

  1. Select Start Session as action type
  2. Choose an agent/prompt template
  3. Select the AI model
  4. Configure context passing (issue body, PR diff, etc.)

See Actions for detailed configuration options.

Review your automation configuration:

  • Trigger conditions
  • Action settings
  • Test with a dry run if available

Click Create Automation to save and activate.

Let’s build an automation that triages new bug reports:

SettingValue
NameAuto-triage bug reports
TriggerGitHub Issue
Repositorymy-org/my-app
Label Filterbug
ActionStart Session
AgentBug Analyzer
ModelClaude 3.5 Sonnet

When someone opens an issue with the bug label:

  1. Cheffed detects the new issue via GitHub webhook
  2. Automation trigger conditions match
  3. A new session starts with the Bug Analyzer agent
  4. The agent receives the issue title, body, and metadata
  5. The agent analyzes the bug and posts findings as a comment

Before relying on an automation:

  1. Create a test issue with your trigger conditions
  2. Monitor the automation on the Automations page
  3. Check the session that gets created
  4. Review the output to ensure it meets expectations
  5. Iterate on the agent prompt if needed

Toggle automations on/off without deleting them:

  1. Go to the Automations page
  2. Find your automation
  3. Use the toggle switch to enable/disable

Disabled automations won’t respond to events but keep their configuration.

Begin with a basic automation and add complexity over time:

  1. Single trigger condition
  2. One action
  3. Clear, focused agent prompt

Narrow triggers prevent unwanted executions:

  • Filter by specific labels
  • Target specific repositories
  • Limit to certain branches

Check automation results regularly:

  • Review execution history
  • Examine session outputs
  • Refine agent prompts based on results

Use clear names and descriptions so team members understand what each automation does.