Package dev.dokimos.core.evaluators.agents

Class TaskCompletionEvaluator

java.lang.Object

dev.dokimos.core.BaseEvaluator

dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator

All Implemented Interfaces:

Evaluator

public class TaskCompletionEvaluator
extends BaseEvaluator

Evaluates whether an AI agent completed the user's requested tasks.

This is a black-box evaluator that uses a judge LLM to analyze the dialog between user and agent, comparing against a predefined task list. The score is the fraction of completed tasks (0.0–1.0).

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	TaskCompletionEvaluator.Builder	Builder for constructing the evaluator.

Method Summary

Modifier and Type	Method	Description
static TaskCompletionEvaluator.Builder	builder()	Creates a new builder for constructing the evaluator.

Methods inherited from class dev.dokimos.core.BaseEvaluator

evaluate, evaluateAsync, evaluateAsync, name, threshold

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

builder

public static TaskCompletionEvaluator.Builder builder()

Creates a new builder for constructing the evaluator.

Returns:

a new builder