Package dev.dokimos.core.evaluators.agents

Class AgentEvalCase.Builder

java.lang.Object

dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder

Enclosing class:

AgentEvalCase

public static final class AgentEvalCase.Builder
extends Object

Builder for constructing an EvalTestCase that targets the agent evaluators.

Method Summary

Modifier and Type	Method	Description
EvalTestCase	build()	Builds the test case, writing only the slots that were set.
AgentEvalCase.Builder	expectedToolCalls(List<ToolCall> expectedToolCalls)	Sets the expected tool calls (the "toolCalls" key in expected outputs).
AgentEvalCase.Builder	input(String input)	Sets the primary input value (the "input" key).
AgentEvalCase.Builder	tasks(List<String> tasks)	Sets the tasks the agent was asked to complete (the "tasks" key in metadata).
AgentEvalCase.Builder	toolCalls(List<ToolCall> toolCalls)	Sets the actual tool calls the agent made (the "toolCalls" key in actual outputs).
AgentEvalCase.Builder	tools(List<ToolDefinition> tools)	Sets the tools available to the agent (the "tools" key in metadata).

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

input

public AgentEvalCase.Builder input(String input)

Sets the primary input value (the "input" key).

Parameters:

input - the input value

Returns:

this builder

toolCalls

public AgentEvalCase.Builder toolCalls(List<ToolCall> toolCalls)

Sets the actual tool calls the agent made (the "toolCalls" key in actual outputs).

Parameters:

toolCalls - the tool calls

Returns:

this builder

tools

public AgentEvalCase.Builder tools(List<ToolDefinition> tools)

Sets the tools available to the agent (the "tools" key in metadata).

Parameters:

tools - the tool definitions

Returns:

this builder

expectedToolCalls

public AgentEvalCase.Builder expectedToolCalls(List<ToolCall> expectedToolCalls)

Sets the expected tool calls (the "toolCalls" key in expected outputs).

Parameters:

expectedToolCalls - the expected tool calls

Returns:

this builder

tasks

public AgentEvalCase.Builder tasks(List<String> tasks)

Sets the tasks the agent was asked to complete (the "tasks" key in metadata).

Parameters:

tasks - the task descriptions

Returns:

this builder

build

public EvalTestCase build()

Builds the test case, writing only the slots that were set.

Returns:

a new test case populated with the keys the agent evaluators read