Class ToolCorrectnessEvaluator.Builder
java.lang.Object
dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
- Enclosing class:
ToolCorrectnessEvaluator
Builder for constructing the evaluator.
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbuild()Builds the evaluator.evaluationParams(List<EvalTestCaseParam> params) Sets which test case parameters to validate.expectedToolCallsKey(String expectedToolCallsKey) Sets the key used to retrieve expected tool calls from expectedOutputs.matchMode(ToolCorrectnessEvaluator.MatchMode matchMode) Sets the match mode for comparing tool calls.Sets the evaluator name.threshold(double threshold) Sets the minimum score threshold for success.toolCallsKey(String toolCallsKey) Sets the key used to retrieve actual tool calls from actualOutputs.
-
Constructor Details
-
Builder
public Builder()
-
-
Method Details
-
name
Sets the evaluator name.- Parameters:
name- the evaluator name- Returns:
- this builder
-
threshold
Sets the minimum score threshold for success.- Parameters:
threshold- the threshold value- Returns:
- this builder
-
evaluationParams
Sets which test case parameters to validate.- Parameters:
params- the parameters- Returns:
- this builder
-
toolCallsKey
Sets the key used to retrieve actual tool calls from actualOutputs.- Parameters:
toolCallsKey- the key- Returns:
- this builder
-
expectedToolCallsKey
Sets the key used to retrieve expected tool calls from expectedOutputs.- Parameters:
expectedToolCallsKey- the key- Returns:
- this builder
-
matchMode
Sets the match mode for comparing tool calls.- Parameters:
matchMode- the match mode- Returns:
- this builder
-
build
Builds the evaluator.- Returns:
- a new evaluator
-