Skip to content

buildEvalCommand

reference
1 min readUpdated

Kind: Function

Source: atloria-monorepo/libs/agent-core/src/benchmark/swebench-evaluator.ts

Build the CLI command for running the official SWE-bench evaluation harness.

Requires:

  • Docker installed and running
  • swebench Python package installed (pip install swebench)
  • Pre-built Docker images available (auto-pulled by harness)

Signature

ts
function buildEvalCommand(options: EvalCommandOptions): string

Parameters

NameType
optionsEvalCommandOptions

Returns: string

Was this page helpful?

Download as PDF