Kind: Interface
Source: atloria-monorepo/libs/agent-core/src/benchmark/types.ts
Configuration for a full benchmark run.
Properties
| Property | Type |
|---|---|
suite | BenchmarkTask['suite'] |
taskIds | string[] |
maxTasks | number |
shuffle | boolean |
repoBaseDir | string |
outputDir | string |
model | `{ |
endpoint: string; apiKey: string; apiVersion: string; model: string;
}| |maxTurns|number| |timeoutSec|number| |braveApiKey|string| |embedding|{
endpoint: string;
apiKey: string;
model: string;
}| |parallelism|number| |costPerMInputTokens|number| |costPerMOutputTokens|number| |attemptsPerTask|number| |preset|'starter' | 'full'| |useDockerEval|boolean| |costLimitPerTask|number| |onEvent|(event: BenchmarkEvent) => void| |modelProvider|import('@openai/agents').ModelProvider` |
Was this page helpful?