Package dev.dokimos.core.evaluators.agents

Class TaskCompletionEvaluator.Builder

java.lang.Object

dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder

Enclosing class:

TaskCompletionEvaluator

public static class TaskCompletionEvaluator.Builder
extends Object

Builder for constructing the evaluator.

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
TaskCompletionEvaluator	build()	Builds the evaluator.
TaskCompletionEvaluator.Builder	constraintsKey(String constraintsKey)	Sets the metadata key for product constraints.
TaskCompletionEvaluator.Builder	dialogKey(String dialogKey)	Sets the inputs key for the dialog.
TaskCompletionEvaluator.Builder	evaluationParams(List<EvalTestCaseParam> params)	Sets which test case parameters to validate.
TaskCompletionEvaluator.Builder	judge(JudgeLM judge)	Sets the judge LLM for evaluating task completion.
TaskCompletionEvaluator.Builder	name(String name)	Sets the evaluator name.
TaskCompletionEvaluator.Builder	tasksKey(String tasksKey)	Sets the metadata key for the task list.
TaskCompletionEvaluator.Builder	threshold(double threshold)	Sets the minimum score threshold for success.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

name

public TaskCompletionEvaluator.Builder name(String name)

Sets the evaluator name.

Parameters:

name - the evaluator name

Returns:

this builder

threshold

public TaskCompletionEvaluator.Builder threshold(double threshold)

Sets the minimum score threshold for success.

Parameters:

threshold - the threshold value

Returns:

this builder

evaluationParams

public TaskCompletionEvaluator.Builder evaluationParams(List<EvalTestCaseParam> params)

Sets which test case parameters to validate.

Parameters:

params - the parameters

Returns:

this builder

judge

public TaskCompletionEvaluator.Builder judge(JudgeLM judge)

Sets the judge LLM for evaluating task completion.

Parameters:

judge - the judge LLM

Returns:

this builder

tasksKey

public TaskCompletionEvaluator.Builder tasksKey(String tasksKey)

Sets the metadata key for the task list.

Parameters:

tasksKey - the key

Returns:

this builder

constraintsKey

public TaskCompletionEvaluator.Builder constraintsKey(String constraintsKey)

Sets the metadata key for product constraints.

Parameters:

constraintsKey - the key

Returns:

this builder

dialogKey

public TaskCompletionEvaluator.Builder dialogKey(String dialogKey)

Sets the inputs key for the dialog.

Parameters:

dialogKey - the key

Returns:

this builder

build

public TaskCompletionEvaluator build()

Builds the evaluator.

Returns:

a new evaluator

Throws:

IllegalStateException - if judge is not set