Class ToolCallValidityEvaluator

java.lang.Object
dev.dokimos.core.BaseEvaluator
dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator
All Implemented Interfaces:
Evaluator

public class ToolCallValidityEvaluator extends BaseEvaluator
Validates that tool calls are syntactically correct per their JSON schema definitions.

This is a glass-box evaluator for tool proficiency that checks:

  • Tool name exists in available tools
  • All required parameters are present
  • No unexpected parameters (if strict mode or additionalProperties: false)
  • Parameter types match schema types
  • Enum values match if specified
No LLM is required for this evaluator.