Package dev.dokimos.core.evaluators.agents

Class ToolEfficiencyEvaluator.Builder

java.lang.Object

dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder

Enclosing class:

ToolEfficiencyEvaluator

public static class ToolEfficiencyEvaluator.Builder
extends Object

Builder for constructing the evaluator.

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
ToolEfficiencyEvaluator.Builder	argumentMatcher(ArgumentMatcher argumentMatcher)	Sets the argument matcher used to decide whether two calls are duplicates.
ToolEfficiencyEvaluator	build()	Builds the evaluator.
ToolEfficiencyEvaluator.Builder	evaluationParams(List<EvalTestCaseParam> params)	Sets which test case parameters to validate.
ToolEfficiencyEvaluator.Builder	name(String name)	Sets the evaluator name.
ToolEfficiencyEvaluator.Builder	threshold(double threshold)	Sets the minimum score threshold for success.
ToolEfficiencyEvaluator.Builder	toolCallsKey(String toolCallsKey)	Sets the key used to retrieve tool calls from actualOutputs.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

name

public ToolEfficiencyEvaluator.Builder name(String name)

Sets the evaluator name.

Parameters:

name - the evaluator name

Returns:

this builder

threshold

public ToolEfficiencyEvaluator.Builder threshold(double threshold)

Sets the minimum score threshold for success.

Parameters:

threshold - the threshold value

Returns:

this builder

evaluationParams

public ToolEfficiencyEvaluator.Builder evaluationParams(List<EvalTestCaseParam> params)

Sets which test case parameters to validate.

Parameters:

params - the parameters

Returns:

this builder

toolCallsKey

public ToolEfficiencyEvaluator.Builder toolCallsKey(String toolCallsKey)

Sets the key used to retrieve tool calls from actualOutputs.

Parameters:

toolCallsKey - the key

Returns:

this builder

argumentMatcher

public ToolEfficiencyEvaluator.Builder argumentMatcher(ArgumentMatcher argumentMatcher)

Sets the argument matcher used to decide whether two calls are duplicates.

Parameters:

argumentMatcher - the argument matcher (default ArgumentMatcher.tolerant())

Returns:

this builder

build

public ToolEfficiencyEvaluator build()

Builds the evaluator.

Returns:

a new evaluator