Package dev.dokimos.core
Class Experiment
java.lang.Object
dev.dokimos.core.Experiment
An evaluation experiment that runs a task against a dataset and evaluates the
results.
Experiments coordinate the execution of a task across dataset examples, apply evaluators to the outputs, and aggregate results.
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionstatic Experiment.Builderbuilder()run()Runs the experiment and returns the aggregated results.
-
Method Details
-
builder
-
run
Runs the experiment and returns the aggregated results.If multiple runs are configured, the experiment executes each run sequentially and aggregates results across all runs. If parallelism is greater than 1, examples within each run are processed concurrently.
- Returns:
- the experiment results
-