Cancel an in-progress test run.
Poll the status of a test run until the tests are complete or the timeout is reached.
Initiates a test run (i.e., AI evaluation).
The name of the AI evaluation definition to run.
Promise that resolves with the response from starting the test.
A service for testing agents using
AiEvaluationDefinitionmetadata. Start asynchronous test runs, get or poll for test status, and get detailed test results.Examples
Create an instance of the service:
const agentTester = new AgentTester(connection);Start a test run:
const startResponse = await agentTester.start(aiEvalDef);Get the status for a test run:
const status = await agentTester.status(startResponse.runId);Get detailed results for a test run:
const results = await agentTester.results(startResponse.runId);