Package dev.dokimos.core.evaluators.agents

Class AgentEvalCase

java.lang.Object

dev.dokimos.core.evaluators.agents.AgentEvalCase

public final class AgentEvalCase
extends Object

Typed entry point for building an EvalTestCase for the agent evaluators.

The agent evaluators in this package read their inputs from fixed string keys: tool calls from "toolCalls" in actual outputs, available tools from "tools" in metadata, the task list from "tasks" in metadata, and expected tool calls from "toolCalls" in expected outputs. This builder lets callers populate those slots with typed values instead of hand-placing the keys.

Only the slots that are set are written, so the resulting test case carries exactly the keys the configured evaluators require.

 EvalTestCase testCase = AgentEvalCase.builder()
         .input("What's the weather in Paris?")
         .toolCalls(actualCalls)
         .tools(availableTools)
         .build();

 EvalResult result = ToolCallValidityEvaluator.builder().build().evaluate(testCase);
 

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final class	AgentEvalCase.Builder	Builder for constructing an EvalTestCase that targets the agent evaluators.

Method Summary

Modifier and Type	Method	Description
static AgentEvalCase.Builder	builder()	Creates a new builder for constructing an agent EvalTestCase.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

builder

public static AgentEvalCase.Builder builder()

Creates a new builder for constructing an agent EvalTestCase.

Returns:

a new builder