Uses of Class
dev.dokimos.core.BaseEvaluator
Packages that use BaseEvaluator
Package
Description
-
Uses of BaseEvaluator in dev.dokimos.core.conversation
Subclasses of BaseEvaluator in dev.dokimos.core.conversationModifier and TypeClassDescriptionclassEvaluates complete conversation trajectories using LLM-as-judge patterns. -
Uses of BaseEvaluator in dev.dokimos.core.evaluators
Subclasses of BaseEvaluator in dev.dokimos.core.evaluatorsModifier and TypeClassDescriptionclassEvaluator that measures how relevant retrieved context chunks are to a user's input query.classEvaluator that checks for exact string match between actual and expected outputs.classEvaluator that uses an LLM to check how much of the actual output is backed by the given context.classEvaluator that uses an LLM to detect hallucinations in the actual output.classEvaluator that uses an LLM to evaluate outputs based on the specified criteria.classEvaluator that measures retrieval precision.classEvaluator that measures retrieval recall.classEvaluator that checks if the actual output matches a regular expression pattern. -
Uses of BaseEvaluator in dev.dokimos.core.evaluators.agents
Subclasses of BaseEvaluator in dev.dokimos.core.evaluators.agentsModifier and TypeClassDescriptionclassEvaluates whether an AI agent completed the user's requested tasks.classUses a judge LLM to assess whether tool call argument values are factually grounded in the user's input and preceding tool call results.classValidates that tool calls are syntactically correct per their JSON schema definitions.classChecks whether the agent used the expected set of tools.classEvaluates tool description quality using a mix of rule-based checks and optional LLM checks.classEvaluates tool naming quality using a mix of rule-based checks and optional LLM checks.