Package dev.dokimos.core.evaluators.agents

Class ToolNameReliabilityEvaluator

java.lang.Object

dev.dokimos.core.BaseEvaluator

dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator

All Implemented Interfaces:

Evaluator

public class ToolNameReliabilityEvaluator
extends BaseEvaluator

Evaluates tool naming quality using a mix of rule-based checks and optional LLM checks.

Checks performed:

• snakecase_format (rule): Name uses strict snake_case
• clarity (LLM): Purpose is clear from the name alone
• conciseness (rule): Name has at most 7 underscore-separated segments
• name_order (LLM): Name follows operation_system_entity_data ordering
• intent_over_implementation (mixed): Name communicates what, not how

Without a judge LLM, only rule-based checks (snakecase_format, conciseness, and the blocklist portion of intent_over_implementation) run. Score is based on checks that actually ran.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ToolNameReliabilityEvaluator.Builder	Builder for constructing the evaluator.

Method Summary

Modifier and Type	Method	Description
static ToolNameReliabilityEvaluator.Builder	builder()	Creates a new builder for constructing the evaluator.

Methods inherited from class dev.dokimos.core.BaseEvaluator

evaluate, evaluateAsync, evaluateAsync, name, threshold

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

builder

public static ToolNameReliabilityEvaluator.Builder builder()

Creates a new builder for constructing the evaluator.

Returns:

a new builder