Class Experiment

java.lang.Object
dev.dokimos.core.Experiment

public class Experiment extends Object
An evaluation experiment that runs a task against a dataset and evaluates the results.

Experiments coordinate the execution of a task across dataset examples, apply evaluators to the outputs, and aggregate results.

  • Method Details

    • builder

      public static Experiment.Builder builder()
    • run

      public ExperimentResult run()
      Runs the experiment and returns the aggregated results.

      If multiple runs are configured, the experiment executes each run sequentially and aggregates results across all runs. If parallelism is greater than 1, examples within each run are processed concurrently.

      Returns:
      the experiment results