Skip to content

FailureCategory

reference
1 min readUpdated

Kind: Type

Source: atloria-monorepo/libs/agent-core/src/benchmark/types.ts

Classified reason for task failure.

Definition

ts
| 'timeout'           // Task exceeded time limit
  | 'no_changes'        // Agent didn't modify any files
  | 'test_failure'      // Changes made but tests still fail
  | 'setup_error'       // Workspace setup failed (clone, patch, install)
  | 'agent_error'       // Agent runtime error
  | 'wrong_…

Was this page helpful?

Download as PDF