Uses of Record Class
dev.dokimos.core.EvalTestCase
Packages that use EvalTestCase
Package
Description
-
Uses of EvalTestCase in dev.dokimos.core
Methods in dev.dokimos.core that return EvalTestCaseModifier and TypeMethodDescriptionEvalTestCase.Builder.build()Builds the test case.static EvalTestCaseCreates a test case with a single input and actual output.static EvalTestCaseCreates a test case with input, actual output, and expected output.Example.toTestCase(String actualOutput) Converts this example to a test case with a single actual output.Example.toTestCase(Map<String, Object> actualOutputs) Converts this example to a test case with the given actual outputs.ItemResult.toTestCase()Methods in dev.dokimos.core with parameters of type EvalTestCaseModifier and TypeMethodDescriptionstatic voidAssertions.assertEval(EvalTestCase testCase, Evaluator... evaluators) Asserts that the test case passes all evaluators.static voidAssertions.assertEval(EvalTestCase testCase, List<Evaluator> evaluators) Asserts that the test case passes all evaluators.final EvalResultBaseEvaluator.evaluate(EvalTestCase testCase) Evaluator.evaluate(EvalTestCase testCase) Evaluates the test case and returns a scored result.BaseEvaluator.evaluateAsync(EvalTestCase testCase) Evaluates the test case asynchronously using the common fork-join pool.BaseEvaluator.evaluateAsync(EvalTestCase testCase, ExecutorService executor) Evaluates the test case asynchronously using the provided executor. -
Uses of EvalTestCase in dev.dokimos.core.agents
Methods in dev.dokimos.core.agents that return EvalTestCaseModifier and TypeMethodDescriptionAgentTrace.toTestCase(String input) Builds anEvalTestCasefrom this trace for the given user input.AgentTrace.toTestCase(String input, List<ToolDefinition> tools) Builds anEvalTestCasefrom this trace, also wiring the available tool definitions into metadata.AgentTrace.toTestCase(String input, List<ToolDefinition> tools, List<String> tasks) Builds anEvalTestCasefrom this trace with everything the agent evaluators need in one call. -
Uses of EvalTestCase in dev.dokimos.core.conversation
Methods in dev.dokimos.core.conversation that return EvalTestCaseModifier and TypeMethodDescriptionConversationTrajectory.toTestCase()Builds a test case for the deterministic tool-call evaluators, using the last user message as input.ConversationTrajectory.toTestCase(List<ToolDefinition> tools) Builds a test case for the deterministic tool-call and tool-definition evaluators, adding the tools the agent could call.ConversationTrajectory.toTestCase(List<ToolDefinition> tools, List<String> tasks) Builds a test case for the judge-based evaluators (TaskCompletionEvaluator,ToolArgumentHallucinationEvaluator). -
Uses of EvalTestCase in dev.dokimos.core.evaluators.agents
Methods in dev.dokimos.core.evaluators.agents that return EvalTestCaseModifier and TypeMethodDescriptionAgentEvalCase.Builder.build()Builds the test case, writing only the slots that were set. -
Uses of EvalTestCase in dev.dokimos.springai
Methods in dev.dokimos.springai that return EvalTestCaseModifier and TypeMethodDescriptionstatic EvalTestCaseSpringAiSupport.toTestCase(org.springframework.ai.evaluation.EvaluationRequest request) Converts a Spring AIEvaluationRequestto a DokimosEvalTestCase.