Skip to main content

Triage Categories

When a workflow run fails, Nota AI automatically analyzes the failure and assigns it to one of six triage categories. This helps your team focus on real bugs instead of spending time manually investigating every failure.

How It Works

After a run completes with a failure, the triage agent examines the error context โ€” including screenshots, logs, and the test steps โ€” and classifies the failure into one of the categories below. Each classification includes a confidence score so you know how reliable the assessment is.

The Six Categories

CategoryColorWhat It MeansRecommended Action
Real BugRedA genuine application defect was detected.File a bug report with the error details and screenshots.
Stale SelectorAmberThe page loaded correctly but the target element was not found โ€” an element reference changed.Update the test prompt to use the new element identifier.
UI RedesignAmberThe feature works but the navigation path or UI flow changed.Update the test workflow steps to match the new UI flow.
Environment IssuePurpleInfrastructure problem (network, auth, DNS) โ€” not a test or application issue.Retry when the environment is stable.
Agent LimitationGrayThe agent could not perform a required browser interaction (e.g., double-click, drag).Simplify the test step or break it into smaller actions.
Precondition Not MetOrangeThe application was not in the expected state (e.g., missing data, empty list).Check test data setup or run order.

Confidence Tiers

Each triage assignment includes a confidence score displayed as a colored bar:
  • High (85%+) โ€” Green bar, solid border. The agent is confident in its classification.
  • Medium (70โ€“85%) โ€” Amber bar, solid border. Likely correct but worth a quick review.
  • Low (below 70%) โ€” Red bar, dashed border. Manual review recommended.

Where Triage Appears in the UI

In the Run History sidebar, each workflow group displays small color-coded dots representing the triage breakdown of its failed runs. This gives you a quick visual summary without opening individual runs. Sidebar: triage color dots and aggregated counts The sidebar filters panel includes a Triage Category dropdown. Select one or more categories to narrow down the visible runs โ€” for example, show only โ€œReal Bugโ€ failures to focus on genuine defects. Sidebar: triage category filter dropdown

Run Items โ€” Triage Badge

Individual run items in the artifacts list display a triage category badge with the category name and confidence indicator. Run Items: a triage category badge on a run item

Result Status Types

Runs now have four possible result statuses that work alongside triage categories:
  • Passed โ€” The workflow completed successfully.
  • Failed โ€” The workflow failed (may have a triage category assigned).
  • Failed (Bug) โ€” The workflow failed and was triaged as a Real Bug.
  • Env Failure โ€” The workflow failed due to an environment issue.

Notification Emails

When scheduled runs complete, notification emails include a Triage Breakdown section showing the count of Real Bugs and Environment Failures, helping you prioritize which failures need immediate attention.

Quick Actions

Some triage categories offer quick actions to help you resolve the issue faster:
  • Real Bug โ€” โ€œCopy Bug Reportโ€ generates a summary with error details you can paste into your issue tracker.
  • Stale Selector โ€” โ€œAccept Healed Promptโ€ applies the suggested prompt update to match the new element.
  • Environment Issue / Precondition Not Met โ€” โ€œRetryโ€ re-runs the workflow.