Uses of Class
dev.dokimos.server.entity.ExperimentRun
Packages that use ExperimentRun
Package
Description
-
Uses of ExperimentRun in dev.dokimos.server.entity
Methods in dev.dokimos.server.entity that return ExperimentRunMethods in dev.dokimos.server.entity that return types with arguments of type ExperimentRunConstructors in dev.dokimos.server.entity with parameters of type ExperimentRunModifierConstructorDescriptionEvalJob(ExperimentRun run, LlmConnection connection, String evaluatorName, String criteria) ItemResult(ExperimentRun run, Map<String, Object> input, Map<String, Object> expectedOutput, Map<String, Object> actualOutput, Map<String, Object> metadata) -
Uses of ExperimentRun in dev.dokimos.server.repository
Methods in dev.dokimos.server.repository that return types with arguments of type ExperimentRunModifier and TypeMethodDescriptionExperimentRunRepositoryFragment.findBaselineCandidates(Experiment experiment, UUID candidateId, UUID datasetVersionId, String branch, org.springframework.data.domain.Pageable pageable, TenantScope scope) SUCCESS baseline candidates for automatic gate resolution, within the scope, newest first.ExperimentRunRepositoryFragmentImpl.findBaselineCandidates(Experiment experiment, UUID candidateId, UUID datasetVersionId, String branch, org.springframework.data.domain.Pageable pageable, TenantScope scope) ExperimentRunRepositoryFragment.findByExperiment(Experiment experiment, TenantScope scope) Lists an experiment's runs newest first, within the scope.ExperimentRunRepositoryFragmentImpl.findByExperiment(Experiment experiment, TenantScope scope) ExperimentRunRepositoryFragment.findByIdForUpdate(UUID id, TenantScope scope) Loads a run by id within the scope under a write lock, to serialize ingestion against completion.ExperimentRunRepositoryFragmentImpl.findByIdForUpdate(UUID id, TenantScope scope) ExperimentRunRepositoryFragment.findCompletedRunsByExperiment(Experiment experiment, org.springframework.data.domain.Pageable pageable, TenantScope scope) Returns an experiment's terminal (SUCCESS or FAILED) runs newest first, within the scope.ExperimentRunRepositoryFragmentImpl.findCompletedRunsByExperiment(Experiment experiment, org.springframework.data.domain.Pageable pageable, TenantScope scope) ExperimentRunRepositoryFragment.findFirstByExperiment(Experiment experiment, TenantScope scope) Returns the most recent run of an experiment within the scope.ExperimentRunRepositoryFragmentImpl.findFirstByExperiment(Experiment experiment, TenantScope scope) Methods in dev.dokimos.server.repository with parameters of type ExperimentRunModifier and TypeMethodDescriptionItemResultRepository.avgLatencyByRun(ExperimentRun run) Averages the call latency across a run's items.longItemResultRepository.countByRun(ExperimentRun run) longItemResultRepository.countItemsWithAllEvalsPassed(ExperimentRun run) longItemResultRepository.countPricedItemsByRun(ExperimentRun run) Counts the run's items that carry a non-null cost, i.e. the items that contributed toItemResultRepository.sumCostByRun(ExperimentRun).longItemResultRepository.countTokenizedItemsByRun(ExperimentRun run) Counts the run's items that carry a non-null prompt-token count, used as the denominator of the cost-coverage signal: an item with tokens but no cost is one aPriceTablecould not price (unknown model or null token count), which is exactly the gap the signal reports.booleanEvalJobRepository.existsByRunAndEvaluatorName(ExperimentRun run, String evaluatorName) EvalJobRepository.findByRunOrderByCreatedAtAsc(ExperimentRun run) org.springframework.data.domain.Page<ItemResult> ItemResultRepository.findByRunOrderByCreatedAtAsc(ExperimentRun run, org.springframework.data.domain.Pageable pageable) ItemResultRepository.findByRunWithEvals(ExperimentRun run) Loads all item results for a run with their eval results and dataset-item link fetch-joined in one query, avoiding the N+1 the lazyevalResultscollection would otherwise trigger when building a coreRunResultfor the gate comparison.ItemResultRepository.sumCostByRun(ExperimentRun run) Sums the call cost across a run's items.ItemResultRepository.sumTokensInByRun(ExperimentRun run) Sums the prompt tokens across a run's items.ItemResultRepository.sumTokensOutByRun(ExperimentRun run) Sums the completion tokens across a run's items. -
Uses of ExperimentRun in dev.dokimos.server.service
Methods in dev.dokimos.server.service that return ExperimentRunModifier and TypeMethodDescriptionRunService.createRun(Experiment experiment, CreateRunRequest request, TenantScope scope) Creates a run and persists its provenance fields (name, git SHA, branch, triggered_by) plus an optional link to the dataset version it executed against.RunService.createRun(Experiment experiment, Map<String, Object> config) ComparisonSupport.getRunInExperiment(UUID runId, Experiment experiment, String label, ExperimentRunRepository runRepository, TenantScope scope) Loads a run by id and asserts it belongs to the given experiment.Methods in dev.dokimos.server.service with parameters of type ExperimentRunModifier and TypeMethodDescriptionComparisonSupport.compare(ExperimentRun baseline, ExperimentRun candidate) Compares a baseline run against a candidate run with the core engine, deciding the pairing strategy from the runs' dataset versions and item links.ComparisonSupport.datasetVersionId(ExperimentRun run) The dataset version id of a run, or null for ad-hoc runs.voidRegressionAlertService.evaluateOnCompletion(ExperimentRun run) Evaluates a completed run for a significant pass-rate regression and, if found, publishes a regression alert event.voidComparisonSupport.requireTerminal(ExperimentRun run, String label) A run can be gated, diffed, or used as a baseline only once it has reached a terminal status.ComparisonSupport.toRunResult(ExperimentRun run) Converts a server run plus its item and eval results into a single coreRunResultat run index 0.