Package dev.dokimos.core.evaluators.agents

Class ToolCallValidityEvaluator.Builder

java.lang.Object

dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder

Enclosing class:

ToolCallValidityEvaluator

public static class ToolCallValidityEvaluator.Builder
extends Object

Builder for constructing the evaluator.

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
ToolCallValidityEvaluator	build()	Builds the evaluator.
ToolCallValidityEvaluator.Builder	evaluationParams(List<EvalTestCaseParam> params)	Sets which test case parameters to validate.
ToolCallValidityEvaluator.Builder	name(String name)	Sets the evaluator name.
ToolCallValidityEvaluator.Builder	strictMode(boolean strictMode)	Enables strict mode which fails on any unexpected parameter.
ToolCallValidityEvaluator.Builder	threshold(double threshold)	Sets the minimum score threshold for success.
ToolCallValidityEvaluator.Builder	toolCallsKey(String toolCallsKey)	Sets the key used to retrieve tool calls from actualOutputs.
ToolCallValidityEvaluator.Builder	toolsKey(String toolsKey)	Sets the key used to retrieve tool definitions from metadata.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

name

public ToolCallValidityEvaluator.Builder name(String name)

Sets the evaluator name.

Parameters:

name - the evaluator name

Returns:

this builder

threshold

public ToolCallValidityEvaluator.Builder threshold(double threshold)

Sets the minimum score threshold for success.

Parameters:

threshold - the threshold value

Returns:

this builder

evaluationParams

public ToolCallValidityEvaluator.Builder evaluationParams(List<EvalTestCaseParam> params)

Sets which test case parameters to validate.

Parameters:

params - the parameters

Returns:

this builder

toolCallsKey

public ToolCallValidityEvaluator.Builder toolCallsKey(String toolCallsKey)

Sets the key used to retrieve tool calls from actualOutputs.

Parameters:

toolCallsKey - the key

Returns:

this builder

toolsKey

public ToolCallValidityEvaluator.Builder toolsKey(String toolsKey)

Sets the key used to retrieve tool definitions from metadata.

Parameters:

toolsKey - the key

Returns:

this builder

strictMode

public ToolCallValidityEvaluator.Builder strictMode(boolean strictMode)

Enables strict mode which fails on any unexpected parameter.

Parameters:

strictMode - true to enable strict mode

Returns:

this builder

build

public ToolCallValidityEvaluator build()

Builds the evaluator.

Returns:

a new evaluator