Package dev.dokimos.core
package dev.dokimos.core
-
ClassDescriptionAssertion utilities for evaluation-based testing.Base class for implementing concrete evaluators.A collection of examples for evaluation.Builder for constructing datasets.Thrown when a dataset cannot be correctly resolved or loading fails.Resolves a dataset URI to a
Dataset.Singleton registry for dataset resolvers.The result of an evaluation.Builder for constructing evaluation results.A test case for evaluation.Builder for constructing test cases with multiple inputs and outputs.Evaluates test cases and produces scored results.A dataset example with inputs, expected outputs, and metadata.Builder for constructing examples with multiple inputs and outputs.An evaluation experiment that runs a task against a dataset and evaluates the results.Aggregated results from an experiment.Resolves datasets from the filesystem.A language model used for evaluation.Utility methods for processing LLM responses.Strategy for determining if a retrieved item matches an expected item.A no-op implementation ofReporterthat does nothing.Interface for reporting experiment results to an external system.A handle representing an active experiment run.Results from a single run of an experiment.Status of an experiment run.