Class ToolDescriptionReliabilityEvaluator.Builder
java.lang.Object
dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
- Enclosing class:
ToolDescriptionReliabilityEvaluator
Builder for constructing the evaluator.
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbuild()Builds the evaluator.evaluationParams(List<EvalTestCaseParam> params) Sets which test case parameters to validate.Sets an optional judge LLM for semantic checks.maxInputArgs(int maxInputArgs) Sets the maximum number of total input parameters allowed per tool.maxOptionalArgs(int maxOptionalArgs) Sets the maximum number of optional parameters allowed per tool.Sets the evaluator name.threshold(double threshold) Sets the minimum score threshold for success.Sets the metadata key for tool definitions.
-
Constructor Details
-
Builder
public Builder()
-
-
Method Details
-
name
Sets the evaluator name.- Parameters:
name- the evaluator name- Returns:
- this builder
-
threshold
Sets the minimum score threshold for success.- Parameters:
threshold- the threshold value- Returns:
- this builder
-
evaluationParams
Sets which test case parameters to validate.- Parameters:
params- the parameters- Returns:
- this builder
-
toolsKey
Sets the metadata key for tool definitions.- Parameters:
toolsKey- the key- Returns:
- this builder
-
judge
Sets an optional judge LLM for semantic checks. Without a judge, only rule-based checks run (4 out of 13).- Parameters:
judge- the judge LLM- Returns:
- this builder
-
maxOptionalArgs
Sets the maximum number of optional parameters allowed per tool. Default: 3.- Parameters:
maxOptionalArgs- the maximum count- Returns:
- this builder
-
maxInputArgs
Sets the maximum number of total input parameters allowed per tool. Default: 5.- Parameters:
maxInputArgs- the maximum count- Returns:
- this builder
-
build
Builds the evaluator.- Returns:
- a new evaluator
-