Uses of Package
dev.dokimos.core.evaluators.agents
Packages that use dev.dokimos.core.evaluators.agents
-
Classes in dev.dokimos.core.evaluators.agents used by dev.dokimos.core.evaluators.agentsClassDescriptionBuilder for constructing an
EvalTestCasethat targets the agent evaluators.Controls how a tool call's arguments are compared against the expected arguments.Strategy for comparing a tool call's actual arguments against the expected arguments.Evaluates whether an AI agent completed the user's requested tasks.Builder for constructing the evaluator.DefaultArgumentMatcherthat compares arguments structurally with a few deliberate tolerances.Builder for constructing the matcher.Uses a judge LLM to assess whether tool call argument values are factually grounded in the user's input and preceding tool call results.Builder for constructing the evaluator.Validates that tool calls are syntactically correct per their JSON schema definitions.Builder for constructing the evaluator.Checks whether the agent used the expected set of tools.Builder for constructing the evaluator.The comparison mode for evaluating tool correctness.Evaluates tool description quality using a mix of rule-based checks and optional LLM checks.Builder for constructing the evaluator.Measures how efficiently an agent used its tools by detecting redundant calls.Builder for constructing the evaluator.Detects tool execution failures by inspectingToolCall.result().Builder for constructing the evaluator.Evaluates tool naming quality using a mix of rule-based checks and optional LLM checks.Builder for constructing the evaluator.Evaluates an agent's tool-call trajectory against an expected trajectory using a selectable match mode.Builder for constructing the evaluator.The comparison mode for evaluating a trajectory.