Index

A B C D E F G H I J K L M N O P R S T U V W 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

AbstractScopedRepository<T> - Class in dev.dokimos.server.tenant
Base implementation of ScopedRepository.
accept(DatasetSource) - Method in class dev.dokimos.junit.DatasetArgumentsProvider
 
acceptedSpans() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
Returns the value of the acceptedSpans record component.
ACTUAL_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
 
actualOutput() - Method in record class dev.dokimos.core.EvalTestCase
Gets the primary actual output value.
actualOutput() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns the value of the actualOutput record component.
actualOutput() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the actualOutput record component.
actualOutput() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the actualOutput record component.
actualOutput() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Returns the value of the actualOutput record component.
actualOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder
Sets the primary actual output value.
actualOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds an actual output with the given key and value.
actualOutput(String, Object) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
Records a single actual output under the given key.
actualOutputAs(OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the primary actual output ("output") converted to the given generic type.
actualOutputAs(Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the primary actual output ("output") converted to the given type.
actualOutputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the actual output under key converted to the given generic type.
actualOutputAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the actual output under key converted to the given type.
actualOutputs() - Method in record class dev.dokimos.core.EvalTestCase
Returns the value of the actualOutputs record component.
actualOutputs() - Method in record class dev.dokimos.core.ItemResult
Returns the value of the actualOutputs record component.
actualOutputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the actualOutputs record component.
actualOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds all entries from the given actual outputs map.
actualOutputs(Map<String, Object>) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
Records multiple actual outputs, merging them with any already recorded.
ADDED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
The item exists only in the candidate.
addedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the addedCount record component.
addedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the addedCount record component.
addedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the addedCount record component.
addedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the addedCount record component.
addEvalResult(EvalResult) - Method in class dev.dokimos.server.entity.ItemResult
 
addExample(Example) - Method in class dev.dokimos.core.Dataset.Builder
Adds an example to the dataset.
addExamples(List<Example>) - Method in class dev.dokimos.core.Dataset.Builder
Adds multiple examples to the dataset.
addItems(UUID, AddItemsRequest, String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
 
addItems(UUID, AddItemsRequest, String, TenantScope) - Method in class dev.dokimos.server.service.RunService
Adds item results to a run; only allowed while the run is RUNNING.
AddItemsRequest - Record Class in dev.dokimos.server.dto.v1
 
AddItemsRequest(List<AddItemsRequest.ItemData>) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest
Creates an instance of a AddItemsRequest record class.
AddItemsRequest.EvalData - Record Class in dev.dokimos.server.dto.v1
 
AddItemsRequest.ItemData - Record Class in dev.dokimos.server.dto.v1
 
addReasoningStep(String) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Adds a reasoning step.
addResourceHandlers(ResourceHandlerRegistry) - Method in class dev.dokimos.server.config.SpaResourceConfig
 
addSpan(TraceSpan) - Method in class dev.dokimos.server.entity.Trace
Attaches a span to this trace and keeps both ends of the association consistent.
addToolCall(ToolCall) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Adds a tool call to the trace.
ADMIN - Enum constant in enum class dev.dokimos.server.filter.Role
 
adversarialUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated adversarial user who tries to manipulate the system.
afterEach(ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
 
AgentEvalCase - Class in dev.dokimos.core.evaluators.agents
Typed entry point for building an EvalTestCase for the agent evaluators.
AgentEvalCase.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing an EvalTestCase that targets the agent evaluators.
Agent Evaluation - Search tag in class dev.dokimos.openai.OpenAiSupport
Section
AgentTrace - Record Class in dev.dokimos.core.agents
Wraps a complete agent execution trace for evaluation.
AgentTrace(String, List<ToolCall>, List<String>, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.AgentTrace
Creates an instance of a AgentTrace record class.
AgentTrace.Builder - Class in dev.dokimos.core.agents
Builder for constructing agent traces.
aggregate(List<Map.Entry<EvaluationCriterion, Double>>) - Method in enum class dev.dokimos.core.conversation.AggregationStrategy
Aggregates the given criterion scores into a single score.
aggregationStrategy(AggregationStrategy) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets the score aggregation strategy.
AggregationStrategy - Enum Class in dev.dokimos.core.conversation
Strategies for aggregating scores from multiple evaluation criteria.
aggressiveCustomer(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated aggressive customer who is frustrated and demanding.
agreedCount() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns the value of the agreedCount record component.
AlertWebhook - Class in dev.dokimos.server.entity
A configured HTTP endpoint that receives a JSON alert when a completed run of one of its project's experiments shows a significant pass-rate regression against its baseline.
AlertWebhook(Project, String, String, boolean) - Constructor for class dev.dokimos.server.entity.AlertWebhook
 
AlertWebhookController - Class in dev.dokimos.server.controller.v1
CRUD over a project's regression-alert webhooks.
AlertWebhookController(AlertWebhookService) - Constructor for class dev.dokimos.server.controller.v1.AlertWebhookController
 
AlertWebhookDispatcher - Class in dev.dokimos.server.service
Delivers regression alerts to a project's enabled webhooks.
AlertWebhookDispatcher(AlertWebhookRepository, ObjectMapper) - Constructor for class dev.dokimos.server.service.AlertWebhookDispatcher
 
AlertWebhookRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for AlertWebhook.
AlertWebhookRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for AlertWebhook.
AlertWebhookRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the AlertWebhook finders.
AlertWebhookRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.AlertWebhookRepositoryFragmentImpl
 
AlertWebhookService - Class in dev.dokimos.server.service
Manages a project's regression-alert webhooks.
AlertWebhookService(AlertWebhookRepository, ProjectRepository) - Constructor for class dev.dokimos.server.service.AlertWebhookService
 
AlertWebhookView - Record Class in dev.dokimos.server.dto.v1
Public view of an AlertWebhook.
AlertWebhookView(UUID, UUID, String, boolean, boolean, Instant) - Constructor for record class dev.dokimos.server.dto.v1.AlertWebhookView
Creates an instance of a AlertWebhookView record class.
AlibabaAgentResponse(String, Integer, Integer) - Constructor for record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Creates an instance of a AlibabaAgentResponse record class.
alignment(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlignmentController
Returns the judge-human alignment breakdown for a run.
AlignmentController - Class in dev.dokimos.server.controller.v1
Exposes the per-evaluator judge-human alignment for a run: the agreement rate between automated evaluator verdicts and human annotations.
AlignmentController(AlignmentService) - Constructor for class dev.dokimos.server.controller.v1.AlignmentController
 
alignmentRate() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns the value of the alignmentRate record component.
AlignmentService - Class in dev.dokimos.server.service
Computes per-run, per-evaluator agreement between automated evaluator verdicts and human annotations.
AlignmentService(ExperimentRunRepository, ItemResultRepository, AnnotationRepository) - Constructor for class dev.dokimos.server.service.AlignmentService
 
AlignmentView - Record Class in dev.dokimos.server.dto.v1
Per-run, per-evaluator agreement between automated evaluator verdicts and human annotations.
AlignmentView(int, List<AlignmentView.EvaluatorAlignment>) - Constructor for record class dev.dokimos.server.dto.v1.AlignmentView
Creates an instance of a AlignmentView record class.
AlignmentView.EvaluatorAlignment - Record Class in dev.dokimos.server.dto.v1
Agreement breakdown for a single evaluator across a run's annotated items.
allItemsLinked(RunResult) - Method in class dev.dokimos.server.service.ComparisonSupport
True when every item in the run carries a non-null dataset item id.
allOf(MatchingStrategy...) - Static method in interface dev.dokimos.core.MatchingStrategy
Creates a composite strategy that matches only if ALL strategies match.
alpha() - Method in class dev.dokimos.core.gate.GateConfig
 
alpha(double) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
Significance threshold; a change is significant when its p-value is below alpha.
alpha(double) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
annotatedItems() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
Returns the value of the annotatedItems record component.
annotation() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the annotation record component.
Annotation - Class in dev.dokimos.server.entity
A human reviewer's verdict on a single ItemResult.
Annotation(ItemResult, AnnotationVerdict) - Constructor for class dev.dokimos.server.entity.Annotation
 
AnnotationController - Class in dev.dokimos.server.controller.v1
Endpoints for the single human review annotation on a run item result.
AnnotationController(AnnotationService) - Constructor for class dev.dokimos.server.controller.v1.AnnotationController
 
AnnotationRepository - Interface in dev.dokimos.server.repository
 
AnnotationRequest - Record Class in dev.dokimos.server.dto.v1
Payload for creating or updating the annotation on a run item result.
AnnotationRequest(AnnotationVerdict, Map<String, Object>, String) - Constructor for record class dev.dokimos.server.dto.v1.AnnotationRequest
Creates an instance of a AnnotationRequest record class.
AnnotationService - Class in dev.dokimos.server.service
Service for human review annotations on run item results.
AnnotationService(AnnotationRepository, ItemResultRepository, ExperimentRunRepository) - Constructor for class dev.dokimos.server.service.AnnotationService
 
AnnotationVerdict - Enum Class in dev.dokimos.server.entity
A human reviewer's verdict on a single run item result.
AnnotationView - Record Class in dev.dokimos.server.dto.v1
Read model for an annotation on a run item result.
AnnotationView(UUID, AnnotationVerdict, Map<String, Object>, String, String, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.AnnotationView
Creates an instance of a AnnotationView record class.
anonymous() - Static method in record class dev.dokimos.server.filter.Principal
Principal for an unauthenticated reader in an authenticated deployment.
ANY_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Order-independent overlap; graded.
anyOf(MatchingStrategy...) - Static method in interface dev.dokimos.core.MatchingStrategy
Creates a composite strategy that matches if ANY of the strategies match.
API_KEYS_PATH_PREFIX - Static variable in class dev.dokimos.server.filter.ApiKeyAuthFilter
Path prefix for the API key management endpoints, which require ADMIN.
apiKey() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
Returns the value of the apiKey record component.
apiKey() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns the value of the apiKey record component.
apiKey() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns the value of the apiKey record component.
apiKey(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
Bearer API key for authentication.
ApiKey - Class in dev.dokimos.server.entity
A scoped API key used to authenticate write requests against /api/v1/**.
ApiKey(String, String, Role, String) - Constructor for class dev.dokimos.server.entity.ApiKey
Creates an enabled key.
ApiKeyAuthenticator - Class in dev.dokimos.server.filter
Authenticator backed by two credential sources that coexist for backward compatibility: the single legacy key configured via DOKIMOS_API_KEY (which maps to Role.ADMIN), and the scoped keys stored in api_keys (each hashed, each carrying its own role and tenant).
ApiKeyAuthenticator(ApiKeyProperties, ApiKeyRepository) - Constructor for class dev.dokimos.server.filter.ApiKeyAuthenticator
 
ApiKeyAuthFilter - Class in dev.dokimos.server.filter
Servlet filter that authenticates /api/v1/** by delegating credential resolution to an Authenticator, then enforces role-based authorization on the resolved Principal.
ApiKeyAuthFilter(Authenticator, ObjectMapper) - Constructor for class dev.dokimos.server.filter.ApiKeyAuthFilter
 
ApiKeyController - Class in dev.dokimos.server.controller.v1
Manages scoped API keys.
ApiKeyController(ApiKeyService) - Constructor for class dev.dokimos.server.controller.v1.ApiKeyController
 
ApiKeyHasher - Class in dev.dokimos.server.filter
Hashes raw API keys to the SHA-256 hex form stored in the database.
ApiKeyProperties - Class in dev.dokimos.server.config
Configuration properties for API key authentication.
ApiKeyProperties() - Constructor for class dev.dokimos.server.config.ApiKeyProperties
 
ApiKeyRepository - Interface in dev.dokimos.server.repository
 
ApiKeyService - Class in dev.dokimos.server.service
Mints and manages scoped API keys.
ApiKeyService(ApiKeyRepository) - Constructor for class dev.dokimos.server.service.ApiKeyService
 
ApiKeyView - Record Class in dev.dokimos.server.dto.v1
Metadata view of an ApiKey.
ApiKeyView(UUID, String, Role, String, boolean, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ApiKeyView
Creates an instance of a ApiKeyView record class.
apiVersion(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
API version, e.g.
application(ConversationalApplication) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Sets the application under test.
ArgMatchMode - Enum Class in dev.dokimos.core.evaluators.agents
Controls how a tool call's arguments are compared against the expected arguments.
argument(String, Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Adds an argument.
argumentMatcher(ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets the argument matcher used by ToolCorrectnessEvaluator.MatchMode.NAMES_AND_ARGS.
argumentMatcher(ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
Sets the argument matcher used to decide whether two calls are duplicates.
argumentMatcher(ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets the default argument matcher applied to every tool unless overridden.
argumentMatcher(String, ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Overrides the argument matcher for a specific tool by name.
ArgumentMatcher - Interface in dev.dokimos.core.evaluators.agents
Strategy for comparing a tool call's actual arguments against the expected arguments.
arguments() - Method in record class dev.dokimos.core.agents.ToolCall
Returns the value of the arguments record component.
arguments(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Sets all arguments.
argumentsAs(OutputType<T>) - Method in record class dev.dokimos.core.agents.ToolCall
Converts this tool call's arguments map into a generic target captured by an OutputType token, for example new OutputType<List<String>>() {}.
argumentsAs(Class<T>) - Method in record class dev.dokimos.core.agents.ToolCall
Converts this tool call's arguments map into an instance of type.
asJudge(OpenAIClient, ChatModel) - Static method in class dev.dokimos.openai.OpenAiSupport
Creates a JudgeLM from an OpenAI OpenAIClient and a specific ChatModel.
asJudge(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a JudgeLM from a LangChain4j ChatModel.
asJudge(ChatClient.Builder) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates a JudgeLM from a Spring AI ChatClient.Builder.
asJudge(ChatModel) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates a JudgeLM from a Spring AI ChatModel.
assertEval(EvalTestCase, Evaluator...) - Static method in class dev.dokimos.core.Assertions
Asserts that the test case passes all evaluators.
assertEval(EvalTestCase, List<Evaluator>) - Static method in class dev.dokimos.core.Assertions
Asserts that the test case passes all evaluators.
Assertions - Class in dev.dokimos.core
Assertion utilities for evaluation-based testing.
assertNoRegression(ExperimentResult) - Static method in class dev.dokimos.core.Assertions
Asserts that the candidate has not regressed against its committed baseline, resolving the baseline from the experiment name.
assertNoRegression(ExperimentResult, String) - Static method in class dev.dokimos.core.Assertions
Asserts that the candidate has not regressed against the baseline named baselineName.
assertNoRegression(ExperimentResult, String, GateConfig) - Static method in class dev.dokimos.core.Assertions
Asserts that the candidate has not regressed against the baseline named baselineName, using the supplied configuration.
assertNoRegression(ExperimentResult, Path) - Static method in class dev.dokimos.core.Assertions
Asserts that the candidate has not regressed against the baseline at the given path.
assertNoRegression(ExperimentResult, Path, GateConfig) - Static method in class dev.dokimos.core.Assertions
Asserts that the candidate has not regressed against the baseline at the given path, using the supplied configuration.
assistant(String) - Static method in record class dev.dokimos.core.conversation.Message
Creates an assistant message.
assistant(String, List<ToolCall>) - Static method in record class dev.dokimos.core.conversation.Message
Creates an assistant message carrying the tool calls it made on this turn.
ASSISTANT - Enum constant in enum class dev.dokimos.core.conversation.Message.Role
A message from the assistant.
assistantMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds an assistant message to the trajectory.
assistantMessage(String, List<ToolCall>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds an assistant message carrying the tool calls it made.
assistantMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns only the assistant messages from the conversation.
asyncRagTask(Function<String, Result<String>>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates an AsyncTask for RAG evaluation from a function that returns Result.
asyncRagTask(Function<String, Result<String>>, String, String, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates an AsyncTask for RAG evaluation with custom key names.
asyncRagTask(Function<String, Result<String>>, String, String, String, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates an AsyncTask for RAG evaluation that dispatches each blocking assistant call on the supplied Executor (or the common ForkJoinPool when executor is null).
asyncRagTask(Function<String, Result<String>>, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates an AsyncTask for RAG evaluation with default key names, dispatching each blocking assistant call on the supplied Executor so you control and isolate concurrency.
asyncTask(AsyncTask) - Method in class dev.dokimos.core.Experiment.Builder
Sets an asynchronous task that produces a TaskResult as a CompletableFuture.
asyncTask(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a simple AsyncTask for Q&A evaluation from a LangChain4j ChatModel.
asyncTask(ChatModel, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a simple AsyncTask for Q&A evaluation that writes the response under a caller-chosen key.
asyncTask(ChatModel, String, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a simple AsyncTask for Q&A evaluation that dispatches each blocking model.chat(...) call on the supplied Executor (or the common ForkJoinPool when executor is null).
asyncTask(ChatModel, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a simple AsyncTask for Q&A evaluation with the default output key, dispatching each blocking model.chat(...) call on the supplied Executor so you control and isolate concurrency.
asyncTask(ChatClient) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates an AsyncTask that calls a Spring AI ChatClient off the calling thread and writes the response under the default output key.
asyncTask(ChatClient, String, String) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates an AsyncTask that calls a Spring AI ChatClient off the calling thread using caller-chosen input and output keys.
asyncTask(ChatClient, String, String, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates an AsyncTask that calls a Spring AI ChatClient using caller-chosen input and output keys, dispatching each blocking call on the supplied Executor (or the common ForkJoinPool when executor is null).
asyncTask(ChatClient, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates an AsyncTask that calls a Spring AI ChatClient on the supplied Executor, with default input and output keys.
AsyncTask - Interface in dev.dokimos.core
A non-blocking task that produces a TaskResult asynchronously.
atLeast(Role) - Method in enum class dev.dokimos.server.filter.Role
Returns true when this role is at least as privileged as the required role.
attach(AgentInvocation.Builder) - Static method in class dev.dokimos.embabel.EmbabelSupport
Creates a fresh collector and registers it on a default ProcessOptions.
attach(ProcessOptions, EmbabelTraceCollector) - Static method in class dev.dokimos.embabel.EmbabelSupport
Registers the given collector as a listener on a copy of the supplied ProcessOptions.
attemptCount() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the attemptCount record component.
attemptCount() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the attemptCount record component.
ATTRIBUTE - Enum constant in enum class dev.dokimos.server.entity.TraceMatchType
 
attributes() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
Returns the value of the attributes record component.
attributes() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the attributes record component.
attributes() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the attributes record component.
attributes() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the attributes record component.
authenticate(String, String) - Method in class dev.dokimos.server.filter.ApiKeyAuthenticator
 
authenticate(String, String) - Method in interface dev.dokimos.server.filter.Authenticator
Resolves the principal for a request based on its method and credential.
Authenticator - Interface in dev.dokimos.server.filter
Strategy that resolves the Principal behind an incoming request from its credential.
AUTO - Enum constant in enum class dev.dokimos.core.gate.GateConfig.Pairing
Pair by datasetItemId when every item carries one, else positionally.
autoCloseReporter(boolean) - Method in class dev.dokimos.core.Experiment.Builder
Controls whether Experiment.run() closes the reporter after the run completes.
averageScore(String) - Method in record class dev.dokimos.core.ExperimentResult
Returns the average score for the specified evaluator across all runs.
averageScore(String) - Method in record class dev.dokimos.core.RunResult
Returns the average score for the specified evaluator across all items in this run.
averageScores() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the averageScores record component.
avgLatencyByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Averages the call latency across a run's items.
avgLatencyMs() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the avgLatencyMs record component.
avgLatencyMs() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the avgLatencyMs record component.

B

BaseEvaluator - Class in dev.dokimos.core
Base class for implementing concrete evaluators.
baselineBranch() - Method in record class dev.dokimos.server.dto.v1.GateRequest
Returns the value of the baselineBranch record component.
BaselineFile - Record Class in dev.dokimos.core.gate
The committed regression-gate baseline (format v1).
BaselineFile(int, String, BaselineFile.DatasetInfo, String, int, List<BaselineFile.BaselineItem>, BaselineFile.Provenance) - Constructor for record class dev.dokimos.core.gate.BaselineFile
Creates an instance of a BaselineFile record class.
BaselineFile.BaselineItem - Record Class in dev.dokimos.core.gate
One item's projection.
BaselineFile.DatasetInfo - Record Class in dev.dokimos.core.gate
Dataset summary metadata (advisory; never used for pairing).
BaselineFile.EvaluatorEntry - Record Class in dev.dokimos.core.gate
One evaluator's recorded outcome for an item.
BaselineFile.JudgeInfo - Record Class in dev.dokimos.core.gate
Judge provenance (advisory).
BaselineFile.Provenance - Record Class in dev.dokimos.core.gate
Build/judge context, kept separate from the measured signal and excluded from the byte-stability guarantee.
BaselineItem(String, String, List<BaselineFile.EvaluatorEntry>) - Constructor for record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Creates an instance of a BaselineItem record class.
baselineItems() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Returns the value of the baselineItems record component.
baselineMean() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns the value of the baselineMean record component.
baselineMean() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Returns the value of the baselineMean record component.
baselineMean() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns the value of the baselineMean record component.
baselineMean() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns the value of the baselineMean record component.
baselineMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Returns the value of the baselineMean record component.
baselineMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns the value of the baselineMean record component.
baselinePassProbability() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns the value of the baselinePassProbability record component.
baselinePassRate() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the baselinePassRate record component.
baselinePassRate() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the baselinePassRate record component.
baselinePassRate() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the baselinePassRate record component.
baselinePassRate() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the baselinePassRate record component.
baselinePassRate() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the baselinePassRate record component.
baselineRunId() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the baselineRunId record component.
baselineRunId() - Method in record class dev.dokimos.server.dto.v1.GateRequest
Returns the value of the baselineRunId record component.
baselineRunId() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the baselineRunId record component.
baselineRunId() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the baselineRunId record component.
BaselineStore - Class in dev.dokimos.core.gate
Reads and writes the regression-gate baseline file, and reconstructs comparison-ready RunResults from it.
baseUrl() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns the value of the baseUrl record component.
baseUrl() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the baseUrl record component.
baseUrl() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns the value of the baseUrl record component.
beforeEach(ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
 
behaviorGuidelines(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Sets additional behavior guidelines for the simulated user.
binary() - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Switches scoring to binary: 1.0 when the structures match completely, 0.0 otherwise.
boolValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns the value of the boolValue record component.
bootstrapIterations() - Method in class dev.dokimos.core.gate.GateConfig
 
bootstrapIterations(int) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
Bootstrap iteration count.
bootstrapIterations(int) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
bootstrapPasses() - Method in class dev.dokimos.core.gate.GateConfig
Whether a missing-baseline bootstrap writes the file and passes (the default), versus the strict approval-test stance that writes it but fails once so the run is red until the new baseline is reviewed and committed.
bootstrapPasses(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
build() - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Builds the agent trace.
build() - Method in class dev.dokimos.core.agents.ToolCall.Builder
Builds the tool call.
build() - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
Builds the tool definition.
build() - Method in class dev.dokimos.core.comparison.RunComparison.Builder
 
build() - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Builds the conversation simulator.
build() - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Builds the conversation trajectory.
build() - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Builds the LLM simulated user.
build() - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Builds the trajectory evaluator.
build() - Method in class dev.dokimos.core.Dataset.Builder
Builds the dataset.
build() - Method in class dev.dokimos.core.EvalResult.Builder
Builds the result.
build() - Method in class dev.dokimos.core.EvalTestCase.Builder
Builds the test case.
build() - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
Builds the test case, writing only the slots that were set.
build() - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
Builds the matcher.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Builds the ContextualRelevanceEvaluator.
build() - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
 
build() - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
 
build() - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
 
build() - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Builds the PrecisionEvaluator.
build() - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Builds the RecallEvaluator.
build() - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Builds the evaluator.
build() - Method in class dev.dokimos.core.Example.Builder
 
build() - Method in class dev.dokimos.core.Experiment.Builder
Builds the experiment.
build() - Method in class dev.dokimos.core.gate.GateConfig.Builder
Builds the configuration.
build() - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
 
builder() - Static method in record class dev.dokimos.core.agents.AgentTrace
Creates a new builder for constructing agent traces.
builder() - Static method in record class dev.dokimos.core.agents.ToolCall
Creates a new builder for constructing tool calls.
builder() - Static method in record class dev.dokimos.core.agents.ToolDefinition
Creates a new builder for constructing tool definitions.
builder() - Static method in class dev.dokimos.core.comparison.RunComparison
New builder with default configuration.
builder() - Static method in class dev.dokimos.core.conversation.ConversationSimulator
Creates a new builder for constructing a conversation simulator.
builder() - Static method in record class dev.dokimos.core.conversation.ConversationTrajectory
Creates a new builder for constructing trajectories.
builder() - Static method in class dev.dokimos.core.conversation.LLMSimulatedUser
Creates a new builder for constructing an LLM simulated user.
builder() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluator
Creates a new builder for constructing a trajectory evaluator.
builder() - Static method in record class dev.dokimos.core.Dataset
Creates a new builder for constructing datasets.
builder() - Static method in record class dev.dokimos.core.EvalResult
Creates a new builder for constructing results.
builder() - Static method in record class dev.dokimos.core.EvalTestCase
Creates a new builder for constructing test cases.
builder() - Static method in class dev.dokimos.core.evaluators.agents.AgentEvalCase
Creates a new builder for constructing an agent EvalTestCase.
builder() - Static method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher
Creates a new builder for constructing the matcher.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator
Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator
Creates a new builder for constructing the contextual relevance evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.ExactMatchEvaluator
Creates a new builder for constructing exact match evaluators.
builder() - Static method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator
Creates a new builder for constructing the faithfulness evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.HallucinationEvaluator
Creates a new builder for constructing the hallucination evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator
 
builder() - Static method in class dev.dokimos.core.evaluators.PrecisionEvaluator
Creates a new builder for constructing the precision evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.RecallEvaluator
Creates a new builder for constructing the recall evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.RegexEvaluator
 
builder() - Static method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator
Creates a new builder for constructing structural match evaluators.
builder() - Static method in record class dev.dokimos.core.Example
Creates a new builder for constructing examples.
builder() - Static method in class dev.dokimos.core.Experiment
 
builder() - Static method in class dev.dokimos.core.gate.GateConfig
Creates a new builder.
builder() - Static method in class dev.dokimos.server.client.DokimosServerReporter
New builder for DokimosServerReporter.
Builder() - Constructor for class dev.dokimos.core.agents.AgentTrace.Builder
 
Builder() - Constructor for class dev.dokimos.core.agents.ToolCall.Builder
 
Builder() - Constructor for class dev.dokimos.core.agents.ToolDefinition.Builder
 
Builder() - Constructor for class dev.dokimos.core.comparison.RunComparison.Builder
 
Builder() - Constructor for class dev.dokimos.core.conversation.ConversationSimulator.Builder
 
Builder() - Constructor for class dev.dokimos.core.conversation.ConversationTrajectory.Builder
 
Builder() - Constructor for class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
 
Builder() - Constructor for class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.Dataset.Builder
 
Builder() - Constructor for class dev.dokimos.core.EvalResult.Builder
 
Builder() - Constructor for class dev.dokimos.core.EvalTestCase.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.RecallEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.RegexEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
 
Builder() - Constructor for class dev.dokimos.core.Example.Builder
 
Builder() - Constructor for class dev.dokimos.core.Experiment.Builder
 
Builder() - Constructor for class dev.dokimos.core.gate.GateConfig.Builder
 
byContainment(boolean) - Static method in interface dev.dokimos.core.MatchingStrategy
Matches string items by checking if one contains the other.
byEquality() - Static method in interface dev.dokimos.core.MatchingStrategy
Matches items using Objects.equals(Object, Object).
byField(String) - Static method in interface dev.dokimos.core.MatchingStrategy
Matches Map items by comparing a specific field.
byFields(String...) - Static method in interface dev.dokimos.core.MatchingStrategy
Matches Map items by comparing multiple fields.
byIdentifier(Function<Object, Object>) - Static method in interface dev.dokimos.core.MatchingStrategy
Matches items by extracting an identifier and comparing with equality.

C

callMetrics() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Returns the CallMetrics captured from the completed run, with no price fallback.
callMetrics(String, PriceTable) - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Returns the CallMetrics captured from the completed run, lighting up the run's metrics cards.
CallMetrics - Record Class in dev.dokimos.core
Optional metrics describing the LLM call that produced an item result.
CallMetrics(Integer, Integer, Double, Long) - Constructor for record class dev.dokimos.core.CallMetrics
Creates an instance of a CallMetrics record class.
CANCELLED - Enum constant in enum class dev.dokimos.core.RunStatus
The run was cancelled before completion.
CANCELLED - Enum constant in enum class dev.dokimos.server.entity.RunStatus
 
candidateItems() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Returns the value of the candidateItems record component.
candidateMean() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns the value of the candidateMean record component.
candidateMean() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Returns the value of the candidateMean record component.
candidateMean() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns the value of the candidateMean record component.
candidateMean() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns the value of the candidateMean record component.
candidateMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Returns the value of the candidateMean record component.
candidateMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns the value of the candidateMean record component.
candidatePassProbability() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns the value of the candidatePassProbability record component.
candidatePassRate() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the candidatePassRate record component.
candidatePassRate() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the candidatePassRate record component.
candidatePassRate() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the candidatePassRate record component.
candidatePassRate() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the candidatePassRate record component.
candidatePassRate() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the candidatePassRate record component.
candidateRunId() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the candidateRunId record component.
candidateRunId() - Method in record class dev.dokimos.server.dto.v1.GateRequest
Returns the value of the candidateRunId record component.
candidateRunId() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the candidateRunId record component.
caseInsensitive() - Static method in interface dev.dokimos.core.MatchingStrategy
Matches string items case-insensitively.
caseInsensitive(boolean) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
Compares strings case-insensitively.
cases() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the cases record component.
cases() - Method in record class dev.dokimos.server.dto.v1.DiffView
Returns the value of the cases record component.
cases() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the cases record component.
casesTruncated() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the casesTruncated record component.
casesTruncated() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the casesTruncated record component.
CHAT_COMPLETIONS - Enum constant in enum class dev.dokimos.server.entity.LlmConnectionProtocol
The older Chat Completions API (POST {baseUrl}/chat/completions, messages, choices).
ci() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
 
ciHigh() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns the value of the ciHigh record component.
ciLow() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns the value of the ciLow record component.
CLAIMED - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
 
CLAIMED - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
 
claimedAt() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the claimedAt record component.
ClaimedJob(TraceEvalJob, String, String) - Constructor for record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Creates an instance of a ClaimedJob record class.
claimNext(int) - Method in interface dev.dokimos.server.repository.EvalJobRepository
Atomically claims the oldest pending job below the retry ceiling using FOR UPDATE SKIP LOCKED, so multiple worker instances each pick a distinct job instead of blocking on, or double-processing, the same row.
claimNext(int) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
Atomically claims the oldest pending job below the retry ceiling using FOR UPDATE SKIP LOCKED, so multiple worker instances each pick a distinct job instead of blocking on, or double-processing, the same row.
claimNextJob(int) - Method in class dev.dokimos.server.service.JudgeJobTransactions
Claims the oldest pending job below the retry ceiling: locks its row, marks it CLAIMED, stamps the claim time, and increments the attempt count.
claimNextJob(int) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
Claims the oldest pending job below the retry ceiling: locks its row, marks it CLAIMED, stamps the claim time, and increments the attempt count.
clarity() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating clarity of communication.
ClasspathDatasetResolver - Class in dev.dokimos.core
 
ClasspathDatasetResolver() - Constructor for class dev.dokimos.core.ClasspathDatasetResolver
 
close() - Method in class dev.dokimos.core.NoOpReporter
 
close() - Method in interface dev.dokimos.core.Reporter
Flushes pending items and releases resources.
close() - Method in class dev.dokimos.server.client.DokimosServerReporter
 
code() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
Returns the value of the code record component.
coerce(Object) - Static method in class dev.dokimos.core.agents.ToolCalls
Coerces a value into a typed List<ToolCall>.
compactWriter() - Static method in class dev.dokimos.core.internal.Json
A thread-safe writer producing compact (single-line) JSON.
comparableCount() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns the value of the comparableCount record component.
compare(ExperimentRun, ExperimentRun) - Method in class dev.dokimos.server.service.ComparisonSupport
Compares a baseline run against a candidate run with the core engine, deciding the pairing strategy from the runs' dataset versions and item links.
compare(List<RunResult>, List<RunResult>) - Method in class dev.dokimos.core.comparison.RunComparison
Compares baseline runs against candidate runs.
comparedPass() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the comparedPass record component.
ComparisonOutcome(RunComparisonResult, String, List<ItemResult>, List<ItemResult>) - Constructor for record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Creates an instance of a ComparisonOutcome record class.
comparisonReader() - Static method in class dev.dokimos.core.internal.Json
A thread-safe reader configured for structural comparison: strict duplicate-key detection is enabled so {"x":1,"x":2} fails rather than silently collapsing.
ComparisonStatus - Enum Class in dev.dokimos.core.comparison
Classification of how a metric or item changed between a baseline and a candidate.
ComparisonSupport - Class in dev.dokimos.server.service
Shared entity-to-core conversion and run-comparison invocation for the regression gate and the per-case diff view.
ComparisonSupport(ItemResultRepository) - Constructor for class dev.dokimos.server.service.ComparisonSupport
 
ComparisonSupport.ComparisonOutcome - Record Class in dev.dokimos.server.service
Result of comparing two runs: the engine output, the pairing strategy, and the runs' loaded item entities so callers (the diff view) can derive per-case input text without re-querying.
completedAt() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the completedAt record component.
completedAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the completedAt record component.
completedAt() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the completedAt record component.
completedAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the completedAt record component.
completeRun(RunHandle, RunStatus) - Method in class dev.dokimos.core.NoOpReporter
 
completeRun(RunHandle, RunStatus) - Method in interface dev.dokimos.core.Reporter
Marks a run as complete.
completeRun(RunHandle, RunStatus) - Method in class dev.dokimos.server.client.DokimosServerReporter
 
config() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the config record component.
config() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the config record component.
confusedUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated confused user who struggles to understand.
connectionId() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the connectionId record component.
connectionId() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the connectionId record component.
connectionId() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the connectionId record component.
connectionId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the connectionId record component.
consistency() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating consistency.
constraintsKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets the metadata key for product constraints.
content() - Method in record class dev.dokimos.core.conversation.Message
Returns the value of the content record component.
content() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the content record component.
context() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Returns the value of the context record component.
CONTEXT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport
Default key for additional context in evaluation results.
CONTEXT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport
Default key for additional context in evaluation results.
contextKey(String) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Sets the context key to use.
contextKey(String) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Sets the context key to use.
ContextScore(String, double, String) - Constructor for record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Creates an instance of a ContextScore record class.
ContextualRelevanceEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that measures how relevant retrieved context chunks are to a user's input query.
ContextualRelevanceEvaluator.Builder - Class in dev.dokimos.core.evaluators
Builder for constructing ContextualRelevanceEvaluator instances.
ContextualRelevanceEvaluator.ContextScore - Record Class in dev.dokimos.core.evaluators
Represents the relevance score for a single context chunk.
ConversationalApplication - Interface in dev.dokimos.core.conversation
Functional interface representing an application that can engage in multi-turn conversations.
conversationQuality() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating conversation quality.
ConversationSimulator - Class in dev.dokimos.core.conversation
Orchestrates multi-turn conversations between a simulated user and an application.
ConversationSimulator.Builder - Class in dev.dokimos.core.conversation
Builder for constructing conversation simulators.
ConversationTrajectory - Record Class in dev.dokimos.core.conversation
Represents a complete conversation trajectory between a simulated user and an application.
ConversationTrajectory(List<Message>, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.conversation.ConversationTrajectory
Compact constructor ensuring immutability.
ConversationTrajectory.Builder - Class in dev.dokimos.core.conversation
Builder for constructing conversation trajectories.
convert(Object, JavaType) - Static method in class dev.dokimos.core.internal.Json
Converts a value into an instance described by a Jackson JavaType, supporting generic targets such as List<Foo>.
convert(Object, Class<T>) - Static method in class dev.dokimos.core.internal.Json
Converts a value into an instance of type without an intermediate textual round-trip.
Converting Spring AI Evaluation Objects - Search tag in class dev.dokimos.springai.SpringAiSupport
Section
CORRECT - Enum constant in enum class dev.dokimos.server.entity.AnnotationVerdict
 
costUsd() - Method in record class dev.dokimos.core.CallMetrics
Returns the value of the costUsd record component.
costUsd() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the costUsd record component.
costUsd() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the costUsd record component.
costUsd(String, Integer, Integer) - Method in interface dev.dokimos.core.PriceTable
Computes the USD cost of a single call.
count(TenantScope) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
 
count(TenantScope) - Method in interface dev.dokimos.server.tenant.ScopedRepository
Counts the entities visible under the scope.
count(TenantScope) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Counts the entities visible under the scope.
countByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
 
countCovered(Collection<?>, Collection<?>) - Method in interface dev.dokimos.core.MatchingStrategy
Counts how many distinct expected items are covered by any retrieved item.
countItemsWithAllEvalsPassed(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
 
countMatches(Collection<?>, Collection<?>) - Method in interface dev.dokimos.core.MatchingStrategy
Counts how many distinct retrieved items match any expected item.
countPricedItemsByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Counts the run's items that carry a non-null cost, i.e. the items that contributed to ItemResultRepository.sumCostByRun(ExperimentRun).
countTokenizedItemsByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Counts the run's items that carry a non-null prompt-token count, used as the denominator of the cost-coverage signal: an item with tokens but no cost is one a PriceTable could not price (unknown model or null token count), which is exactly the gap the signal reports.
create() - Static method in class dev.dokimos.core.comparison.RunComparison
Engine with default settings.
create(CreateLlmConnectionRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
Registers an LLM connection.
create(CreateApiKeyRequest) - Method in class dev.dokimos.server.service.ApiKeyService
Generates a key, stores its hash, and returns the raw key exactly once.
create(CreateLlmConnectionRequest, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
Registers a connection.
create(UUID, CreateAlertWebhookRequest, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
Registers a webhook for a project, stamped with the project's tenant.
create(UUID, CreateTraceEvalRuleRequest, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
Creates a rule for a project, stamped with the project's tenant.
createAlertWebhook(UUID, CreateAlertWebhookRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
Registers a webhook for the project.
CreateAlertWebhookRequest - Record Class in dev.dokimos.server.dto.v1
Request to register an alert webhook for a project.
CreateAlertWebhookRequest(String, String, Boolean) - Constructor for record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Creates an instance of a CreateAlertWebhookRequest record class.
createApiKey(CreateApiKeyRequest) - Method in class dev.dokimos.server.controller.v1.ApiKeyController
Mints a key.
CreateApiKeyRequest - Record Class in dev.dokimos.server.dto.v1
Request to mint a scoped API key.
CreateApiKeyRequest(String, Role, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Creates an instance of a CreateApiKeyRequest record class.
CreatedApiKeyView - Record Class in dev.dokimos.server.dto.v1
Response returned exactly once when a key is minted.
CreatedApiKeyView(String, ApiKeyView) - Constructor for record class dev.dokimos.server.dto.v1.CreatedApiKeyView
Creates an instance of a CreatedApiKeyView record class.
createdAt() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the createdAt record component.
createDataset(CreateDatasetRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Creates a dataset shell with no versions.
createDataset(String, String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Creates a dataset whose name is unique within the scope, stamped with the scope's tenant.
CreateDatasetRequest - Record Class in dev.dokimos.server.dto.v1
 
CreateDatasetRequest(String, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateDatasetRequest
Creates an instance of a CreateDatasetRequest record class.
createdBy() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the createdBy record component.
createdBy() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns the value of the createdBy record component.
createdBy() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the createdBy record component.
CreateLlmConnectionRequest - Record Class in dev.dokimos.server.dto.v1
Request to register an OpenAI-compatible LLM connection.
CreateLlmConnectionRequest(String, String, String, LlmConnectionProtocol, String, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Creates an instance of a CreateLlmConnectionRequest record class.
createRun(Experiment, CreateRunRequest, TenantScope) - Method in class dev.dokimos.server.service.RunService
Creates a run and persists its provenance fields (name, git SHA, branch, triggered_by) plus an optional link to the dataset version it executed against.
createRun(Experiment, Map<String, Object>) - Method in class dev.dokimos.server.service.RunService
 
createRun(String, CreateRunRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
 
CreateRunRequest - Record Class in dev.dokimos.server.dto.v1
 
CreateRunRequest(String, Map<String, Object>, String, String, String, String, String, Integer) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunRequest
Creates an instance of a CreateRunRequest record class.
CreateRunRequest(String, Map<String, Object>, String, String, String, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunRequest
Backwards-compatible 6-arg constructor for callers that predate the dataset linkage.
CreateRunResponse - Record Class in dev.dokimos.server.dto.v1
 
CreateRunResponse(UUID) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunResponse
Creates an instance of a CreateRunResponse record class.
createTraceEvalRule(UUID, CreateTraceEvalRuleRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
Creates a rule.
CreateTraceEvalRuleRequest - Record Class in dev.dokimos.server.dto.v1
Request to create or replace a trace eval rule.
CreateTraceEvalRuleRequest(String, Boolean, TraceMatchType, String, String, UUID, String, String, double, double, Double) - Constructor for record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Creates an instance of a CreateTraceEvalRuleRequest record class.
createVersion(String, CreateVersionRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Appends a new immutable version to the dataset with the supplied items.
createVersion(String, String, List<CreateVersionRequest.ItemPayload>, String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Creates a new immutable version of the dataset visible under the scope and inserts all items in one transaction.
CreateVersionRequest - Record Class in dev.dokimos.server.dto.v1
 
CreateVersionRequest(String, List<CreateVersionRequest.ItemPayload>) - Constructor for record class dev.dokimos.server.dto.v1.CreateVersionRequest
Creates an instance of a CreateVersionRequest record class.
CreateVersionRequest.ItemPayload - Record Class in dev.dokimos.server.dto.v1
 
credentialRef() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns the value of the credentialRef record component.
credentialRef() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the credentialRef record component.
credentialRef() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns the value of the credentialRef record component.
criteria() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the criteria record component.
criteria() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the criteria record component.
criteria() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the criteria record component.
criteria(String) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Sets the evaluation criteria.
criteria(List<EvaluationCriterion>) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets all evaluation criteria.
criterion(EvaluationCriterion) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Adds an evaluation criterion.
CURRENT_VERSION - Static variable in record class dev.dokimos.core.gate.BaselineFile
The current supported format version.
currentVerdict() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the currentVerdict record component.
custom(JudgeLM, String, String) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a custom simulated user with the specified persona and guidelines.
custom(String, String) - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a custom evaluation criterion.
custom(String, String, double) - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a custom evaluation criterion with specified weight.
custom(BiPredicate<Object, Object>) - Static method in interface dev.dokimos.core.MatchingStrategy
Matches items using a custom predicate.
customTask(Task) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a flexible Task that allows full control over output mapping.

D

dataset() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the dataset record component.
dataset(Dataset) - Method in class dev.dokimos.core.Experiment.Builder
Sets the dataset.
Dataset - Class in dev.dokimos.server.entity
A named container that owns one or more immutable DatasetVersions.
Dataset - Record Class in dev.dokimos.core
A collection of examples for evaluation.
Dataset(String, String) - Constructor for class dev.dokimos.server.entity.Dataset
 
Dataset(String, String, List<Example>) - Constructor for record class dev.dokimos.core.Dataset
Creates an instance of a Dataset record class.
DATASET_ITEM_ID - Enum constant in enum class dev.dokimos.core.gate.GateConfig.Pairing
Always pair by datasetItemId (fails if any item lacks one).
Dataset.Builder - Class in dev.dokimos.core
Builder for constructing datasets.
DatasetArgumentsProvider - Class in dev.dokimos.junit
JUnit ArgumentsProvider that loads Examples from a Dataset.
DatasetArgumentsProvider() - Constructor for class dev.dokimos.junit.DatasetArgumentsProvider
 
DatasetController - Class in dev.dokimos.server.controller.v1
 
DatasetController(DatasetService) - Constructor for class dev.dokimos.server.controller.v1.DatasetController
 
DatasetDetails - Record Class in dev.dokimos.server.dto.v1
 
DatasetDetails(UUID, String, String, Instant, Instant, List<DatasetDetails.VersionSummary>) - Constructor for record class dev.dokimos.server.dto.v1.DatasetDetails
Creates an instance of a DatasetDetails record class.
DatasetDetails.VersionSummary - Record Class in dev.dokimos.server.dto.v1
 
DatasetInfo(String, int) - Constructor for record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
Creates an instance of a DatasetInfo record class.
DatasetItem - Class in dev.dokimos.server.entity
A single example within a DatasetVersion.
DatasetItem(DatasetVersion, int, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.DatasetItem
 
datasetItemId() - Method in record class dev.dokimos.core.Example
Returns the value of the datasetItemId record component.
datasetItemId() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Returns the value of the datasetItemId record component.
datasetItemId() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the datasetItemId record component.
datasetItemId() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns the value of the datasetItemId record component.
datasetItemId() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Returns the value of the datasetItemId record component.
datasetItemId() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the datasetItemId record component.
datasetItemId(String) - Method in class dev.dokimos.core.Example.Builder
Sets the stable dataset item id this example originates from.
DatasetItemRecorder() - Constructor for class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
 
DatasetItemRepository - Interface in dev.dokimos.server.repository
 
DatasetItemView - Record Class in dev.dokimos.server.dto.v1
 
DatasetItemView(UUID, int, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.DatasetItemView
Creates an instance of a DatasetItemView record class.
datasetName() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the datasetName record component.
datasetName() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the datasetName record component.
datasetName() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the datasetName record component.
datasetName() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
Returns the value of the datasetName record component.
DatasetParser - Class in dev.dokimos.core
 
datasetPath() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the datasetPath record component.
DatasetReporter - Annotation Interface in dev.dokimos.junit
Marks a static field that supplies the Reporter for DatasetSource tests.
DatasetRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for Dataset.
DatasetRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for Dataset.
DatasetRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the Dataset finders.
DatasetRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
 
DatasetResolutionException - Exception Class in dev.dokimos.core
Thrown when a dataset cannot be correctly resolved or loading fails.
DatasetResolutionException(String) - Constructor for exception class dev.dokimos.core.DatasetResolutionException
 
DatasetResolutionException(String, Throwable) - Constructor for exception class dev.dokimos.core.DatasetResolutionException
 
DatasetResolver - Interface in dev.dokimos.core
Resolves a dataset URI to a Dataset.
DatasetResolverRegistry - Class in dev.dokimos.core
Singleton registry for dataset resolvers.
DatasetResolverRegistry() - Constructor for class dev.dokimos.core.DatasetResolverRegistry
Creates a fresh, independent registry.
DatasetRunExtension - Class in dev.dokimos.junit
Opens and reports a Reporter run for each DatasetSource test method.
DatasetRunExtension() - Constructor for class dev.dokimos.junit.DatasetRunExtension
 
DatasetRunExtension.DatasetItemRecorder - Class in dev.dokimos.junit
Collects the actual outputs and evaluation results a DatasetSource test body produced for one parameterized invocation.
DatasetService - Class in dev.dokimos.server.service
Service for server-owned versioned datasets.
DatasetService(DatasetRepository, DatasetVersionRepository, DatasetItemRepository, ItemResultRepository) - Constructor for class dev.dokimos.server.service.DatasetService
 
DatasetSource - Annotation Interface in dev.dokimos.junit
Provides Examples from a Dataset as arguments to a parameterized test.
DatasetSummary - Record Class in dev.dokimos.server.dto.v1
 
DatasetSummary(UUID, String, String, Integer, Integer, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.DatasetSummary
Creates an instance of a DatasetSummary record class.
datasetVersion() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the datasetVersion record component.
datasetVersion() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the datasetVersion record component.
datasetVersion() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the datasetVersion record component.
DatasetVersion - Class in dev.dokimos.server.entity
An immutable snapshot of a Dataset.
DatasetVersion(Dataset, int, String, String, int) - Constructor for class dev.dokimos.server.entity.DatasetVersion
 
DatasetVersionDetails - Record Class in dev.dokimos.server.dto.v1
 
DatasetVersionDetails(UUID, String, int, String, int, Instant, String) - Constructor for record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Creates an instance of a DatasetVersionDetails record class.
datasetVersionId() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the datasetVersionId record component.
datasetVersionId() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the datasetVersionId record component.
datasetVersionId(ExperimentRun) - Method in class dev.dokimos.server.service.ComparisonSupport
The dataset version id of a run, or null for ad-hoc runs.
DatasetVersionRepository - Interface in dev.dokimos.server.repository
 
DEFAULT_API_VERSION - Static variable in class dev.dokimos.server.client.DokimosServerReporter
Default API version when none is specified.
DEFAULT_MODEL - Static variable in class dev.dokimos.mcp.ToolHandlers
Default OpenAI model used when a run_evaluation call does not specify one.
defaults() - Static method in class dev.dokimos.core.gate.GateConfig
Returns a configuration with all defaults.
delete(UUID) - Method in class dev.dokimos.server.service.ApiKeyService
Permanently deletes a key.
delete(UUID, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
Deletes a connection along with its judge job queue records.
delete(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
Deletes a connection.
delete(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
Deletes one of a project's webhooks.
delete(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AnnotationService
Removes the annotation for the given run item result if one exists.
delete(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
Deletes a rule.
delete(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AnnotationController
Removes the annotation for the item result.
delete(T) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
 
delete(T) - Method in interface dev.dokimos.server.tenant.ScopedRepository
Removes an entity.
deleteAlertWebhook(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
Deletes a webhook.
deleteApiKey(UUID) - Method in class dev.dokimos.server.controller.v1.ApiKeyController
Permanently deletes a key.
deleteByConnectionId(UUID) - Method in interface dev.dokimos.server.repository.EvalJobRepository
Removes the queue records for a connection.
deleteByItemResultId(UUID) - Method in interface dev.dokimos.server.repository.AnnotationRepository
 
deleteDataset(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Deletes a dataset visible under the scope.
deleteDataset(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Deletes a dataset and its versions; runs that referenced any version become unlinked.
deleteExperiment(UUID, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
Deletes an experiment visible under the scope; FKs cascade to its runs, items, and evals.
deleteExperiment(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ExperimentController
 
deleteExpired(Instant) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
Deletes traces whose retention window has closed, across all tenants; spans and trace eval jobs cascade.
deleteExpired(Instant) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
 
deleteProject(String, TenantScope) - Method in class dev.dokimos.server.service.ProjectService
Deletes a project visible under the scope; FKs cascade to its experiments, runs, items, and evals.
deleteProject(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
 
deleteRun(UUID, TenantScope) - Method in class dev.dokimos.server.service.RunService
Deletes a run visible under the scope; FKs cascade to its item and eval results.
deleteRun(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
 
deleteTraceEvalRule(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
Deletes a rule.
delta() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns the value of the delta record component.
delta() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Returns the value of the delta record component.
delta() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns the value of the delta record component.
delta() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns the value of the delta record component.
delta() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Returns the value of the delta record component.
delta() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns the value of the delta record component.
description() - Method in record class dev.dokimos.core.agents.ToolDefinition
Returns the value of the description record component.
description() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Returns the value of the description record component.
description() - Method in record class dev.dokimos.core.Dataset
Returns the dataset's description.
description() - Method in record class dev.dokimos.core.ExperimentResult
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the description record component.
description() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
Returns the value of the description record component.
description(String) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
Sets the tool description.
description(String) - Method in class dev.dokimos.core.Dataset.Builder
Sets the dataset description.
description(String) - Method in class dev.dokimos.core.Experiment.Builder
Sets the description.
detectJsonErrorField(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Controls whether a JSON object with a top-level "error" field counts as an error.
dev.dokimos.core - package dev.dokimos.core
 
dev.dokimos.core.agents - package dev.dokimos.core.agents
 
dev.dokimos.core.comparison - package dev.dokimos.core.comparison
 
dev.dokimos.core.conversation - package dev.dokimos.core.conversation
 
dev.dokimos.core.evaluators - package dev.dokimos.core.evaluators
 
dev.dokimos.core.evaluators.agents - package dev.dokimos.core.evaluators.agents
 
dev.dokimos.core.exceptions - package dev.dokimos.core.exceptions
 
dev.dokimos.core.export - package dev.dokimos.core.export
 
dev.dokimos.core.gate - package dev.dokimos.core.gate
 
dev.dokimos.core.internal - package dev.dokimos.core.internal
 
dev.dokimos.embabel - package dev.dokimos.embabel
 
dev.dokimos.junit - package dev.dokimos.junit
 
dev.dokimos.langchain4j - package dev.dokimos.langchain4j
 
dev.dokimos.mcp - package dev.dokimos.mcp
 
dev.dokimos.mcp.store - package dev.dokimos.mcp.store
 
dev.dokimos.openai - package dev.dokimos.openai
 
dev.dokimos.server - package dev.dokimos.server
 
dev.dokimos.server.client - package dev.dokimos.server.client
 
dev.dokimos.server.config - package dev.dokimos.server.config
 
dev.dokimos.server.controller - package dev.dokimos.server.controller
 
dev.dokimos.server.controller.v1 - package dev.dokimos.server.controller.v1
 
dev.dokimos.server.dto.v1 - package dev.dokimos.server.dto.v1
 
dev.dokimos.server.dto.v1.otlp - package dev.dokimos.server.dto.v1.otlp
 
dev.dokimos.server.entity - package dev.dokimos.server.entity
 
dev.dokimos.server.filter - package dev.dokimos.server.filter
 
dev.dokimos.server.judge - package dev.dokimos.server.judge
 
dev.dokimos.server.repository - package dev.dokimos.server.repository
 
dev.dokimos.server.service - package dev.dokimos.server.service
 
dev.dokimos.server.tenant - package dev.dokimos.server.tenant
 
dev.dokimos.springai - package dev.dokimos.springai
 
dev.dokimos.springai.alibaba - package dev.dokimos.springai.alibaba
 
dialogKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets the inputs key for the dialog.
diff(UUID, UUID, UUID, String, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DiffController
Returns the per-case diff between a candidate run and an explicit baseline run.
DiffCase - Record Class in dev.dokimos.server.dto.v1
One row of the per-case run-diff table: a single item compared across baseline and candidate, with its per-evaluator old-to-new deltas.
DiffCase(String, String, String, boolean, String, List<DiffCase.EvaluatorDiff>) - Constructor for record class dev.dokimos.server.dto.v1.DiffCase
Creates an instance of a DiffCase record class.
DiffCase.EvaluatorDiff - Record Class in dev.dokimos.server.dto.v1
A single evaluator's change on one item between baseline and candidate.
DiffController - Class in dev.dokimos.server.controller.v1
Exposes the per-case run-diff view: the same comparison the CI gate runs, presented as a full, paginated table of every case with per-evaluator deltas.
DiffController(DiffService) - Constructor for class dev.dokimos.server.controller.v1.DiffController
 
DiffService - Class in dev.dokimos.server.service
Builds the per-case run-diff view for the UI.
DiffService(ExperimentRepository, ExperimentRunRepository, ComparisonSupport) - Constructor for class dev.dokimos.server.service.DiffService
 
DiffSummary - Record Class in dev.dokimos.server.dto.v1
Whole-run summary of a per-case run diff.
DiffSummary(String, UUID, UUID, Double, Double, Double, boolean, int, int, int, int, int) - Constructor for record class dev.dokimos.server.dto.v1.DiffSummary
Creates an instance of a DiffSummary record class.
DiffView - Record Class in dev.dokimos.server.dto.v1
Combined per-case run-diff payload: the whole-run summary plus the first (or requested) page of cases.
DiffView(DiffSummary, PageResponse<DiffCase>) - Constructor for record class dev.dokimos.server.dto.v1.DiffView
Creates an instance of a DiffView record class.
disable() - Method in class dev.dokimos.server.entity.ApiKey
Disables the key so future authentication attempts with it are rejected.
disable(UUID) - Method in class dev.dokimos.server.service.ApiKeyService
Disables a key so future authentication attempts with it are rejected, keeping its record for audit.
disableApiKey(UUID) - Method in class dev.dokimos.server.controller.v1.ApiKeyController
Disables a key so it can no longer authenticate.
DokimosMcpServer - Class in dev.dokimos.mcp
MCP server that exposes dokimos evaluation tools over stdio transport.
DokimosMcpServer() - Constructor for class dev.dokimos.mcp.DokimosMcpServer
 
DokimosServerApplication - Class in dev.dokimos.server
 
DokimosServerApplication() - Constructor for class dev.dokimos.server.DokimosServerApplication
 
DokimosServerReporter - Class in dev.dokimos.server.client
Async HTTP Reporter that sends experiment results to a Dokimos server.
DokimosServerReporter.Builder - Class in dev.dokimos.server.client
DokimosServerReporter.ItemDeliveryFailure - Record Class in dev.dokimos.server.client
Describes a batch of items permanently dropped after all delivery retries were exhausted.
DokimosTypeConversionException - Exception Class in dev.dokimos.core.exceptions
Thrown when a stored output value cannot be converted to the requested type by one of the typed read accessors (for example EvalTestCase.actualOutputAs(Class) or Example.expectedOutputAs(dev.dokimos.core.OutputType)).
DokimosTypeConversionException(String) - Constructor for exception class dev.dokimos.core.exceptions.DokimosTypeConversionException
Creates an exception with the given detail message.
DokimosTypeConversionException(String, Throwable) - Constructor for exception class dev.dokimos.core.exceptions.DokimosTypeConversionException
Creates an exception with the given detail message and underlying cause.
dokimosVersion() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
Returns the value of the dokimosVersion record component.
doubleValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns the value of the doubleValue record component.

E

EDITOR - Enum constant in enum class dev.dokimos.server.filter.Role
 
EmbabelSupport - Class in dev.dokimos.embabel
Entry point for evaluating Embabel agent runs with Dokimos.
EmbabelTraceCollector - Class in dev.dokimos.embabel
Accumulates an Embabel agent's tool calls into a Dokimos AgentTrace.
EmbabelTraceCollector() - Constructor for class dev.dokimos.embabel.EmbabelTraceCollector
Creates a fresh collector with no captured events.
empty() - Static method in record class dev.dokimos.core.conversation.ConversationTrajectory
Creates an empty trajectory with no messages.
empty() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the empty record component.
empty() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Returns the value of the empty record component.
enabled() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns the value of the enabled record component.
enabled() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the enabled record component.
enabled() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Returns the value of the enabled record component.
enabled() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the enabled record component.
enabled() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the enabled record component.
enabled() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Returns the value of the enabled record component.
enabledOrDefault() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
 
encryptInlineKey(LlmConnection, String) - Method in class dev.dokimos.server.service.LlmCredentialService
Returns a copy of the connection with its inline key encrypted.
endTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the endTimeUnixNano record component.
endTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the endTimeUnixNano record component.
endTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the endTimeUnixNano record component.
endTimeUnixNano() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the endTimeUnixNano record component.
enqueue(UUID, EnqueueJudgeRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.EvalJobController
Enqueues server-side scoring for a run.
enqueue(UUID, EnqueueJudgeRequest, TenantScope) - Method in class dev.dokimos.server.service.EvalJobService
Enqueues a judge job for a run and moves the run into the evaluating state.
enqueueForTrace(Trace) - Method in class dev.dokimos.server.service.TraceEvalEnqueuer
Enqueues online eval jobs for a persisted trace.
EnqueueJudgeRequest - Record Class in dev.dokimos.server.dto.v1
Request to enqueue a server-side judge job for a run.
EnqueueJudgeRequest(UUID, String, String, List<String>, double, double, Double) - Constructor for record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Creates an instance of a EnqueueJudgeRequest record class.
entries() - Element in annotation interface dev.dokimos.junit.DatasetSource
Run metadata as typed key-value entries (for example {@MetadataEntry(key = "model", value = "gpt-4")}).
epsilon(double) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
Minimum absolute delta below which a change counts as UNCHANGED.
equals(Object) - Method in record class dev.dokimos.core.agents.AgentTrace
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.agents.ToolCall
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.agents.ToolDefinition
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.CallMetrics
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.comparison.ItemComparison
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.comparison.SignificanceResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.conversation.Message
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.Dataset
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.EvalResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.EvalTestCase
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.Example
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.ExperimentResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.ItemResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in class dev.dokimos.core.OutputType
 
equals(Object) - Method in record class dev.dokimos.core.RunHandle
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.RunResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.TaskResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.mcp.store.RunRecord
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AlignmentView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffCase
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.PageResponse
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.SpanView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TrendData
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
 
equals(Object) - Method in record class dev.dokimos.server.filter.Principal
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.RegressionAlertEvent
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.tenant.TenantScope
Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Indicates whether some other object is "equal to" this one.
errorDetector(Predicate<String>) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Sets a custom predicate that flags a result string as an error.
Eval() - Constructor for class dev.dokimos.server.config.TraceProperties.Eval
 
EvalData(String, double, Double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Creates an instance of a EvalData record class.
EvalDetail(String, double, boolean, String) - Constructor for record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Creates an instance of a EvalDetail record class.
EvalJob - Class in dev.dokimos.server.entity
A unit of server-side scoring work: score every not-yet-evaluated item of a run with a single evaluator configuration, using a registered LlmConnection.
EvalJob(ExperimentRun, LlmConnection, String, String) - Constructor for class dev.dokimos.server.entity.EvalJob
 
EvalJobController - Class in dev.dokimos.server.controller.v1
 
EvalJobController(EvalJobService) - Constructor for class dev.dokimos.server.controller.v1.EvalJobController
 
EvalJobRepository - Interface in dev.dokimos.server.repository
 
evalJobs() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the evalJobs record component.
EvalJobService - Class in dev.dokimos.server.service
Enqueues server-side judge jobs and reads the jobs registered for a run.
EvalJobService(EvalJobRepository, ExperimentRunRepository, LlmConnectionRepository) - Constructor for class dev.dokimos.server.service.EvalJobService
 
EvalJobStatus - Enum Class in dev.dokimos.server.entity
Lifecycle state of an EvalJob.
EvalJobView - Record Class in dev.dokimos.server.dto.v1
Public view of an EvalJob, returned by the enqueue endpoint and the per-run job listing.
EvalJobView(UUID, UUID, UUID, String, EvalJobStatus, int, String, Instant, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.EvalJobView
Creates an instance of a EvalJobView record class.
evalResult() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
Returns the value of the evalResult record component.
evalResult(EvalResult) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
Records a single evaluation result.
EvalResult - Class in dev.dokimos.server.entity
 
EvalResult - Record Class in dev.dokimos.core
The result of an evaluation.
EvalResult(String, double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult
Creates an EvalResult without a threshold (for backwards compatibility).
EvalResult(String, double, Double, boolean, String) - Constructor for class dev.dokimos.server.entity.EvalResult
 
EvalResult(String, double, Double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult
Creates an instance of a EvalResult record class.
EvalResult.Builder - Class in dev.dokimos.core
Builder for constructing evaluation results.
EvalResultRepository - Interface in dev.dokimos.server.repository
 
evalResults() - Method in record class dev.dokimos.core.ItemResult
Returns the value of the evalResults record component.
evalResults() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the evalResults record component.
evalResults() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the evalResults record component.
evalResults() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the evalResults record component.
evalResults(List<EvalResult>) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
Records multiple evaluation results.
EvalSummary(UUID, String, double, Double, boolean, String) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Creates an instance of a EvalSummary record class.
EvalTestCase - Record Class in dev.dokimos.core
A test case for evaluation.
EvalTestCase(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalTestCase
Creates an instance of a EvalTestCase record class.
EvalTestCase.Builder - Class in dev.dokimos.core
Builder for constructing test cases with multiple inputs and outputs.
EvalTestCaseParam - Enum Class in dev.dokimos.core
 
evaluate(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator
 
evaluate(EvalTestCase) - Method in interface dev.dokimos.core.Evaluator
Evaluates the test case and returns a scored result.
evaluate(ExperimentResult, BaselineFile, GateConfig) - Static method in class dev.dokimos.core.gate.RegressionGate
Compares a candidate against a baseline and returns the gate verdict.
evaluateAsync(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator
Evaluates the test case asynchronously using the common fork-join pool.
evaluateAsync(EvalTestCase, ExecutorService) - Method in class dev.dokimos.core.BaseEvaluator
Evaluates the test case asynchronously using the provided executor.
evaluateGate(UUID, GateRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.GateController
Evaluates the regression gate for a candidate run.
evaluateGate(UUID, GateRequest, TenantScope) - Method in class dev.dokimos.server.service.GateService
Evaluates the regression gate for a candidate run within an experiment.
evaluateOnCompletion(ExperimentRun) - Method in class dev.dokimos.server.service.RegressionAlertService
Evaluates a completed run for a significant pass-rate regression and, if found, publishes a regression alert event.
EVALUATING - Enum constant in enum class dev.dokimos.server.entity.RunStatus
 
EvaluationCriterion - Record Class in dev.dokimos.core.conversation
Defines a single evaluation dimension for trajectory evaluation.
EvaluationCriterion(String, String, double) - Constructor for record class dev.dokimos.core.conversation.EvaluationCriterion
Compact constructor with validation.
EvaluationException - Exception Class in dev.dokimos.core.evaluators
Thrown when an evaluation cannot be executed successfully.
EvaluationException(String) - Constructor for exception class dev.dokimos.core.evaluators.EvaluationException
 
EvaluationException(String, Throwable) - Constructor for exception class dev.dokimos.core.evaluators.EvaluationException
 
evaluationParams() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the evaluationParams record component.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Sets which test case parameters to validate before evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
Sets which test case parameters to use for the evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Sets which test case parameters to use for the evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Sets which test case parameters to use for the evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Sets which test case parameters to include in the prompt.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Sets which test case parameters to validate before evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Sets which test case parameters to validate before evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Sets which test case parameters to evaluate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Sets which test case parameters to validate.
evaluations() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns the value of the evaluations record component.
evaluator() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Returns the value of the evaluator record component.
evaluator() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns the value of the evaluator record component.
evaluator() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Returns the value of the evaluator record component.
evaluator() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Returns the value of the evaluator record component.
evaluator() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns the value of the evaluator record component.
evaluator(Evaluator) - Method in class dev.dokimos.core.Experiment.Builder
Adds a single evaluator to the experiment.
Evaluator - Interface in dev.dokimos.core
Evaluates test cases and produces scored results.
EvaluatorAlignment(String, int, int, int, Double) - Constructor for record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Creates an instance of a EvaluatorAlignment record class.
EvaluatorDelta - Record Class in dev.dokimos.core.comparison
Change in a single evaluator's mean score between baseline and candidate.
EvaluatorDelta(String, Double, Double, double, ComparisonStatus, SignificanceResult) - Constructor for record class dev.dokimos.core.comparison.EvaluatorDelta
Creates an instance of a EvaluatorDelta record class.
evaluatorDeltas() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns the value of the evaluatorDeltas record component.
evaluatorDeltas() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the evaluatorDeltas record component.
EvaluatorDiff(String, Double, Double, double, String, boolean) - Constructor for record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Creates an instance of a EvaluatorDiff record class.
EvaluatorDrop(String, Double, Double, double) - Constructor for record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Creates an instance of a EvaluatorDrop record class.
EvaluatorDrop(String, Double, Double, double) - Constructor for record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Creates an instance of a EvaluatorDrop record class.
evaluatorDrops() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Returns the value of the evaluatorDrops record component.
evaluatorDrops() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Returns the value of the evaluatorDrops record component.
EvaluatorEntry(String, double, Double, boolean) - Constructor for record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Creates an instance of a EvaluatorEntry record class.
evaluatorName() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the evaluatorName record component.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the evaluatorName record component.
evaluatorNames() - Method in record class dev.dokimos.core.ExperimentResult
Returns the names of all evaluators used in this experiment.
evaluators() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Returns the value of the evaluators record component.
evaluators() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
Returns the value of the evaluators record component.
evaluators() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns the value of the evaluators record component.
evaluators(List<Evaluator>) - Method in class dev.dokimos.core.Experiment.Builder
Adds multiple evaluators to the experiment.
EXACT - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
Same key set as expected, all values match.
ExactMatchEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that checks for exact string match between actual and expected outputs.
ExactMatchEvaluator.Builder - Class in dev.dokimos.core.evaluators
 
example() - Method in record class dev.dokimos.core.ItemResult
Returns the value of the example record component.
Example - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Section
Example - Record Class in dev.dokimos.core
A dataset example with inputs, expected outputs, and metadata.
Example(Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.Example
Creates an example with no dataset item id.
Example(Map<String, Object>, Map<String, Object>, Map<String, Object>, String) - Constructor for record class dev.dokimos.core.Example
Compact constructor that creates immutable copies of all maps.
Example.Builder - Class in dev.dokimos.core
Builder for constructing examples with multiple inputs and outputs.
examples() - Method in record class dev.dokimos.core.Dataset
Returns the examples in the dataset.
excludedUnsure() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns the value of the excludedUnsure record component.
existsByEnabledTrue() - Method in interface dev.dokimos.server.repository.ApiKeyRepository
Returns true when at least one enabled key exists, which puts the deployment in authenticated mode.
existsByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
Returns whether a dataset with the name exists within the scope.
existsByName(String, TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
 
existsByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.LlmConnectionRepositoryFragment
Returns whether a connection with the name exists within the scope.
existsByName(String, TenantScope) - Method in class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
 
existsByProjectIdAndName(UUID, String, TenantScope) - Method in interface dev.dokimos.server.repository.TraceEvalRuleRepositoryFragment
Returns whether a rule of the name already exists in the project, within the scope.
existsByProjectIdAndName(UUID, String, TenantScope) - Method in class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
 
existsByRunAndEvaluatorName(ExperimentRun, String) - Method in interface dev.dokimos.server.repository.EvalJobRepository
 
existsByRunIdAndIdempotencyKey(UUID, String) - Method in interface dev.dokimos.server.repository.IngestedBatchRepository
Checks whether a batch with the given idempotency key has already been committed for the run.
EXPECTED_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
 
expectedKey(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Sets the key for expected (relevant) items in expectedOutputs.
expectedKey(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Sets the key for expected (relevant) items in expectedOutputs.
expectedOutput() - Method in record class dev.dokimos.core.EvalTestCase
Gets the primary expected output value.
expectedOutput() - Method in record class dev.dokimos.core.Example
Returns the primary expected output value.
expectedOutput() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns the value of the expectedOutput record component.
expectedOutput() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the expectedOutput record component.
expectedOutput() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the expectedOutput record component.
expectedOutput() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Returns the value of the expectedOutput record component.
expectedOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder
Sets the primary expected output value.
expectedOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds an expected output with the given key and value.
expectedOutput(String, Object) - Method in class dev.dokimos.core.Example.Builder
Adds an expected output with the given key and value.
expectedOutputAs(OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the primary expected output ("output") converted to the given generic type.
expectedOutputAs(OutputType<T>) - Method in record class dev.dokimos.core.Example
Reads the primary expected output ("output") converted to the given generic type.
expectedOutputAs(Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the primary expected output ("output") converted to the given type.
expectedOutputAs(Class<T>) - Method in record class dev.dokimos.core.Example
Reads the primary expected output ("output") converted to the given type.
expectedOutputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the expected output under key converted to the given generic type.
expectedOutputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.Example
Reads the expected output under key converted to the given generic type.
expectedOutputAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the expected output under key converted to the given type.
expectedOutputAs(String, Class<T>) - Method in record class dev.dokimos.core.Example
Reads the expected output under key converted to the given type.
expectedOutputs() - Method in record class dev.dokimos.core.EvalTestCase
Returns the value of the expectedOutputs record component.
expectedOutputs() - Method in record class dev.dokimos.core.Example
Returns the value of the expectedOutputs record component.
expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the expectedOutputs record component.
expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Returns the value of the expectedOutputs record component.
expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns the value of the expectedOutputs record component.
expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds all entries from the given expected outputs map.
expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder
Adds all entries from the given expected outputs map.
expectedToolCalls(List<ToolCall>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
Sets the expected tool calls (the "toolCalls" key in expected outputs).
expectedToolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets the key used to retrieve expected tool calls from expectedOutputs.
expectedToolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets the key used to retrieve expected tool calls from expectedOutputs.
experiment() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the experiment record component.
Experiment - Class in dev.dokimos.core
An evaluation experiment that runs a task against a dataset and evaluates the results.
Experiment - Class in dev.dokimos.server.entity
 
Experiment(Project, String) - Constructor for class dev.dokimos.server.entity.Experiment
 
Experiment.Builder - Class in dev.dokimos.core
 
ExperimentController - Class in dev.dokimos.server.controller.v1
 
ExperimentController(ExperimentService, RunService) - Constructor for class dev.dokimos.server.controller.v1.ExperimentController
 
experimentCount() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Returns the value of the experimentCount record component.
experimentId() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the experimentId record component.
experimentId() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the experimentId record component.
experimentId() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the experimentId record component.
experimentName() - Element in annotation interface dev.dokimos.junit.DatasetSource
Name of the run opened when a DatasetReporter field is present.
experimentName() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.TrendData
Returns the value of the experimentName record component.
ExperimentRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for Experiment.
ExperimentRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for Experiment.
ExperimentRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the Experiment finders.
ExperimentRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.ExperimentRepositoryFragmentImpl
 
ExperimentResult - Record Class in dev.dokimos.core
Aggregated results from an experiment.
ExperimentResult(String, String, Map<String, Object>, List<RunResult>) - Constructor for record class dev.dokimos.core.ExperimentResult
Creates an instance of a ExperimentResult record class.
ExperimentResultExporter - Class in dev.dokimos.core.export
Utility class for exporting ExperimentResult to various formats.
ExperimentRun - Class in dev.dokimos.server.entity
 
ExperimentRun(Experiment, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.ExperimentRun
 
ExperimentRunRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for ExperimentRun.
ExperimentRunRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for ExperimentRun.
ExperimentRunRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the ExperimentRun finders.
ExperimentRunRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
 
ExperimentService - Class in dev.dokimos.server.service
 
ExperimentService(ExperimentRepository, ExperimentRunRepository) - Constructor for class dev.dokimos.server.service.ExperimentService
 
ExperimentSummary - Record Class in dev.dokimos.server.dto.v1
 
ExperimentSummary(UUID, String, Instant, ExperimentSummary.LatestRunInfo) - Constructor for record class dev.dokimos.server.dto.v1.ExperimentSummary
Creates an instance of a ExperimentSummary record class.
ExperimentSummary.LatestRunInfo - Record Class in dev.dokimos.server.dto.v1
 
expiresAt() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the expiresAt record component.
expiresAt() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the expiresAt record component.
exportCsv(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to a CSV file.
exportCsv(Path) - Method in record class dev.dokimos.core.ExperimentResult
Exports the experiment result to a CSV file.
exportHtml(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to an HTML file.
exportHtml(Path) - Method in record class dev.dokimos.core.ExperimentResult
Exports the experiment result to an HTML file.
exportJson(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to a JSON file.
exportJson(Path) - Method in record class dev.dokimos.core.ExperimentResult
Exports the experiment result to a JSON file.
exportMarkdown(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to a Markdown file.
exportMarkdown(Path) - Method in record class dev.dokimos.core.ExperimentResult
Exports the experiment result to a Markdown file.
extractJson(String) - Static method in class dev.dokimos.core.LlmResponseUtils
Extracts the JSON payload from an LLM response.
extractTexts(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Extracts text content from a list of LangChain4j Content objects.
extractTextsWithMetadata(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Extracts text content with metadata from a list of LangChain4j Content objects.

F

FAIL - Enum constant in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
Fail the gate: a dropped evaluator is indistinguishable from hiding a regression.
failCount() - Method in record class dev.dokimos.core.ExperimentResult
Returns the average number of items that failed across all runs.
failCount() - Method in record class dev.dokimos.core.RunResult
Returns the number of items that failed at least one evaluation in this run.
failCount() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the failCount record component.
FAILED - Enum constant in enum class dev.dokimos.core.RunStatus
The run failed due to an error.
FAILED - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
 
FAILED - Enum constant in enum class dev.dokimos.server.entity.RunStatus
 
FAILED - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
 
failEvaluatedRun(UUID) - Method in class dev.dokimos.server.service.RunService
Moves an evaluating run to FAILED when its judge job has terminally failed, so the run does not stay stuck in EVALUATING.
failOnRegression() - Method in class dev.dokimos.core.gate.GateConfig
 
failOnRegression(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
failOnRemovedItems() - Method in class dev.dokimos.core.gate.GateConfig
 
failOnRemovedItems(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
failure(String, double, String) - Static method in record class dev.dokimos.core.EvalResult
Creates a failed result.
FaithfulnessEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that uses an LLM to check how much of the actual output is backed by the given context.
FaithfulnessEvaluator.Builder - Class in dev.dokimos.core.evaluators
 
FileDatasetResolver - Class in dev.dokimos.core
Resolves datasets from the filesystem.
FileDatasetResolver() - Constructor for class dev.dokimos.core.FileDatasetResolver
 
finalizeEvaluatedRun(UUID) - Method in class dev.dokimos.server.service.RunService
Finalizes a run whose judge job has finished scoring: re-computes the materialized pass-rate fields and moves the run to SUCCESS.
finalResponse() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns the value of the finalResponse record component.
finalResponse(String) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Sets the agent's final text response.
findAll(TenantScope) - Method in class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
 
findAll(TenantScope) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
 
findAll(TenantScope) - Method in interface dev.dokimos.server.tenant.ScopedRepository
Lists every entity visible under the scope.
findAll(TenantScope, BiFunction<CriteriaBuilder, Root<T>, List<Order>>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Lists every entity visible under the scope, with an optional order.
findAllOrdered(TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
Lists datasets visible under the scope, newest first.
findAllOrdered(TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
 
findAllOrdered(TenantScope) - Method in interface dev.dokimos.server.repository.LlmConnectionRepositoryFragment
Lists connections visible under the scope, newest first.
findAllOrdered(TenantScope) - Method in class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
 
findAllOrdered(Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
Lists traces newest first within the scope, paginated.
findAllOrdered(Pageable, TenantScope) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
 
findAllWithEvalsByIdIn(Collection<UUID>) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Loads the given items with their eval results fetch-joined, used to initialize the lazy evalResults collection on a page of items in one query rather than per row.
findAllWithExperimentCount(TenantScope) - Method in interface dev.dokimos.server.repository.ProjectRepositoryFragment
Returns each visible project paired with its experiment count, newest first, as [Project, Long] rows.
findAllWithExperimentCount(TenantScope) - Method in class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
 
findBaselineCandidates(Experiment, UUID, UUID, String, Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
SUCCESS baseline candidates for automatic gate resolution, within the scope, newest first.
findBaselineCandidates(Experiment, UUID, UUID, String, Pageable, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
 
findByDatasetAndVersion(Dataset, int) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
 
findByDatasetOrderByVersionDesc(Dataset) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
 
findByDatasetVersionOrderByOrdinalAsc(DatasetVersion, Pageable) - Method in interface dev.dokimos.server.repository.DatasetItemRepository
 
findByExperiment(Experiment, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
Lists an experiment's runs newest first, within the scope.
findByExperiment(Experiment, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
 
findById(UUID, TenantScope) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
 
findById(UUID, TenantScope) - Method in interface dev.dokimos.server.tenant.ScopedRepository
Loads an entity by id only if it is visible under the scope.
findById(UUID, TenantScope) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Loads an entity by id under the scope; a row of another tenant returns empty, never leaking existence.
findByIdForUpdate(UUID, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
Loads a run by id within the scope under a write lock, to serialize ingestion against completion.
findByIdForUpdate(UUID, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
 
findByIdForUpdate(UUID, TenantScope) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Loads an entity by id under the scope and a pessimistic write lock, to serialize concurrent writers.
findByItemResultId(UUID) - Method in interface dev.dokimos.server.repository.AnnotationRepository
 
findByItemResultIdIn(Collection<UUID>) - Method in interface dev.dokimos.server.repository.AnnotationRepository
 
findByKeyHashAndEnabledTrue(String) - Method in interface dev.dokimos.server.repository.ApiKeyRepository
Looks up an enabled key by its SHA-256 hex hash.
findByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
Finds a dataset by name within the scope.
findByName(String, TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
 
findByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.LlmConnectionRepositoryFragment
Finds a connection by name within the scope.
findByName(String, TenantScope) - Method in class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
 
findByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.ProjectRepositoryFragment
Looks up a project by name within the scope.
findByName(String, TenantScope) - Method in class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
 
findByNameForUpdate(String, TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
Finds a dataset by name within the scope under a pessimistic write lock, for version creation.
findByNameForUpdate(String, TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
 
findByProject(Project, TenantScope) - Method in interface dev.dokimos.server.repository.AlertWebhookRepositoryFragment
Lists a project's webhooks oldest first, within the scope.
findByProject(Project, TenantScope) - Method in class dev.dokimos.server.repository.AlertWebhookRepositoryFragmentImpl
 
findByProject(Project, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRepositoryFragment
Lists a project's experiments newest first, within the scope.
findByProject(Project, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRepositoryFragmentImpl
 
findByProjectAndName(Project, String, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRepositoryFragment
Finds an experiment of a project by name within the scope.
findByProjectAndName(Project, String, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRepositoryFragmentImpl
 
findByProjectId(UUID, TenantScope) - Method in interface dev.dokimos.server.repository.TraceEvalRuleRepositoryFragment
Lists a project's rules oldest first, within the scope.
findByProjectId(UUID, TenantScope) - Method in class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
 
findByProjectId(UUID, Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
Lists a project's traces newest first within the scope, paginated.
findByProjectId(UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
 
findByProjectIdAndEnabledTrue(UUID) - Method in interface dev.dokimos.server.repository.AlertWebhookRepositoryFragment
Enabled webhooks of a project regardless of tenant, the set dispatched to on a regressing run.
findByProjectIdAndEnabledTrue(UUID) - Method in class dev.dokimos.server.repository.AlertWebhookRepositoryFragmentImpl
 
findByProjectIdAndEnabledTrue(UUID) - Method in interface dev.dokimos.server.repository.TraceEvalRuleRepositoryFragment
Enabled rules for a project regardless of tenant, used by ingestion to decide which spans to enqueue.
findByProjectIdAndEnabledTrue(UUID) - Method in class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
 
findByRunIdWithEvals(UUID) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Loads all item results for a run with their eval results fetch-joined in one query.
findByRunOrderByCreatedAtAsc(ExperimentRun) - Method in interface dev.dokimos.server.repository.EvalJobRepository
 
findByRunOrderByCreatedAtAsc(ExperimentRun, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
 
findByRunWithEvals(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Loads all item results for a run with their eval results and dataset-item link fetch-joined in one query, avoiding the N+1 the lazy evalResults collection would otherwise trigger when building a core RunResult for the gate comparison.
findByStatus(EvalJobStatus) - Method in interface dev.dokimos.server.repository.EvalJobRepository
 
findByStatus(TraceEvalJobStatus) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
 
findByTrace_IdOrderByStartTimeUnixNanoAsc(UUID) - Method in interface dev.dokimos.server.repository.TraceSpanRepository
Returns the spans of a trace ordered by start time, nulls last for spans missing a timestamp.
findByTraceId(String) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
Looks up a trace by its OTLP trace id regardless of tenant.
findByTraceId(String) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
 
findByTracePk(UUID) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
Jobs for the spans of one trace, used by the per-trace detail view.
findCompletedRunsByExperiment(Experiment, Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
Returns an experiment's terminal (SUCCESS or FAILED) runs newest first, within the scope.
findCompletedRunsByExperiment(Experiment, Pageable, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
 
findFirst(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>, BiFunction<CriteriaBuilder, Root<T>, List<Order>>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Returns the first entity matching extra and visible under the scope, with an optional order.
findFirstByDatasetOrderByVersionDesc(Dataset) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
 
findFirstByExperiment(Experiment, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
Returns the most recent run of an experiment within the scope.
findFirstByExperiment(Experiment, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
 
findFirstForUpdate(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Returns the first entity matching extra under the scope and a pessimistic write lock.
findItemsNeedingReview(String, UUID, UUID, boolean, String, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Page of items still awaiting a human verdict, optionally scoped to a project, experiment, or run.
findItemsNotYetEvaluated(UUID, String, UUID, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Seek-based page of run items that carry no eval result for the given evaluator yet.
findLatestPerDataset(List<Dataset>) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
Returns the latest version row for every supplied dataset in a single query.
findMaxVersion(Dataset) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
Returns the current maximum version number for the dataset, or null if no versions exist.
findPage(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>, BiFunction<CriteriaBuilder, Root<T>, List<Order>>, Pageable) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Returns a page of entities matching extra and visible under the scope.
findWhere(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>, BiFunction<CriteriaBuilder, Root<T>, List<Order>>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
Lists entities matching extra and visible under the scope, with an optional order.
first() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the first record component.
fixedResponse(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Adds a fixed response to use before generating dynamic responses.
fixedResponses(List<String>) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Sets all fixed responses at once.
flush() - Method in class dev.dokimos.core.NoOpReporter
 
flush() - Method in interface dev.dokimos.core.Reporter
Blocks until all pending items are sent.
flush() - Method in class dev.dokimos.server.client.DokimosServerReporter
 
formatVersion() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the formatVersion record component.
forScope(CriteriaBuilder, Path<String>, TenantScope) - Static method in class dev.dokimos.server.tenant.TenantPredicate
Builds the criteria predicate for the scope over the given tenant_id path.
from(AlertWebhook) - Static method in record class dev.dokimos.server.dto.v1.AlertWebhookView
 
from(Annotation) - Static method in record class dev.dokimos.server.dto.v1.AnnotationView
 
from(ApiKey) - Static method in record class dev.dokimos.server.dto.v1.ApiKeyView
 
from(EvalJob) - Static method in record class dev.dokimos.server.dto.v1.EvalJobView
 
from(LlmConnection) - Static method in record class dev.dokimos.server.dto.v1.LlmConnectionView
 
from(Trace) - Static method in record class dev.dokimos.server.dto.v1.TraceSummary
 
from(TraceEvalJob) - Static method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
 
from(TraceEvalRule) - Static method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
 
from(TraceSpan) - Static method in record class dev.dokimos.server.dto.v1.SpanView
 
fromCsv(String, String) - Static method in record class dev.dokimos.core.Dataset
Parses a dataset from a CSV string.
fromCsv(Path) - Static method in record class dev.dokimos.core.Dataset
Loads a dataset from a CSV file.
fromEnvironment() - Static method in class dev.dokimos.server.client.DokimosServerReporter
Creates a reporter from environment variables: DOKIMOS_SERVER_URL and DOKIMOS_PROJECT_NAME are required; DOKIMOS_API_KEY and DOKIMOS_API_VERSION are optional.
fromJson(String) - Static method in record class dev.dokimos.core.Dataset
Parses a dataset from a JSON string.
fromJson(Path) - Static method in record class dev.dokimos.core.Dataset
Loads a dataset from a JSON file.
fromJsonl(String) - Static method in record class dev.dokimos.core.Dataset
Parses a dataset from a JSONL string with a default name.
fromJsonl(String, String) - Static method in record class dev.dokimos.core.Dataset
Parses a dataset from a JSONL string.
fromJsonl(Path) - Static method in record class dev.dokimos.core.Dataset
Loads a dataset from a JSONL file, streaming line-by-line from disk without loading the entire file into memory.
fromMap(Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolCall
Creates a tool call from a map, typically when deserializing from a JSON dataset.
fromMap(Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolDefinition
Creates a tool definition from a map, typically when deserializing from a JSON dataset.

G

GateConfig - Class in dev.dokimos.core.gate
Configuration for the server-free regression gate.
GateConfig.Builder - Class in dev.dokimos.core.gate
Builder for GateConfig.
GateConfig.Pairing - Enum Class in dev.dokimos.core.gate
How baseline and candidate items are paired.
GateConfig.RemovedEvaluatorPolicy - Enum Class in dev.dokimos.core.gate
What to do when an evaluator present in the baseline is missing from the candidate.
GateController - Class in dev.dokimos.server.controller.v1
Exposes the CI regression gate.
GateController(GateService) - Constructor for class dev.dokimos.server.controller.v1.GateController
 
GateRequest - Record Class in dev.dokimos.server.dto.v1
Request to evaluate a CI regression gate for an already-ingested candidate run.
GateRequest(UUID, UUID, String) - Constructor for record class dev.dokimos.server.dto.v1.GateRequest
Creates an instance of a GateRequest record class.
GateResult - Record Class in dev.dokimos.server.dto.v1
Verdict of a CI regression gate.
GateResult(String, boolean, UUID, UUID, String, Double, double, Double, boolean, int, int, int, int, int, List<GateResult.RegressedEvaluator>, List<GateResult.RegressedCase>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.GateResult
Creates an instance of a GateResult record class.
GateResult.EvaluatorDrop - Record Class in dev.dokimos.server.dto.v1
A per-item evaluator score drop.
GateResult.RegressedCase - Record Class in dev.dokimos.server.dto.v1
A single regressed item, identified by its dataset item id when paired by id or by its positional index otherwise.
GateResult.RegressedEvaluator - Record Class in dev.dokimos.server.dto.v1
A single evaluator's regression between baseline and candidate.
GateService - Class in dev.dokimos.server.service
Evaluates a CI regression gate by comparing an already-ingested candidate run against a resolved baseline run with the core RunComparison engine and returning a pass/fail verdict.
GateService(ExperimentRepository, ExperimentRunRepository, ComparisonSupport) - Constructor for class dev.dokimos.server.service.GateService
 
GateVerdict - Record Class in dev.dokimos.core.gate
The result of a regression-gate comparison: the overall status, the pass-rate move, the regressed evaluators and cases, and any coverage-loss or threshold-drift warnings.
GateVerdict(String, boolean, String, Double, double, Double, boolean, int, int, int, int, int, int, List<GateVerdict.RegressedEvaluator>, List<GateVerdict.RegressedCase>, boolean, boolean, List<String>) - Constructor for record class dev.dokimos.core.gate.GateVerdict
Creates an instance of a GateVerdict record class.
GateVerdict.EvaluatorDrop - Record Class in dev.dokimos.core.gate
A per-item evaluator score drop.
GateVerdict.RegressedCase - Record Class in dev.dokimos.core.gate
A single regressed item, identified by its dataset item id when paired by id or by its positional index otherwise.
GateVerdict.RegressedEvaluator - Record Class in dev.dokimos.core.gate
A single evaluator's significant regression between baseline and candidate.
generate(String) - Method in interface dev.dokimos.core.JudgeLM
 
generate(String) - Method in class dev.dokimos.server.judge.OpenAiCompatibleJudge
 
generate(String) - Method in class dev.dokimos.server.judge.OpenResponsesJudge
 
generateMessage(ConversationTrajectory) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser
 
generateMessage(ConversationTrajectory) - Method in interface dev.dokimos.core.conversation.SimulatedUser
Generates the next user message based on the current conversation state.
get(int) - Method in record class dev.dokimos.core.Dataset
Returns the example at the specified index.
get(String) - Method in class dev.dokimos.mcp.store.JsonResultStore
 
get(String) - Method in interface dev.dokimos.mcp.store.ResultStore
Returns a run by ID, or empty if not found.
get(UUID, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
Returns a connection by id, visible under the scope.
get(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
Returns a single connection by id, or 404 if it does not exist or belongs to another tenant.
get(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
Returns one of a project's webhooks.
get(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AnnotationService
Returns the annotation for the given run item result, scoped to the caller's tenant.
get(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AnnotationController
Returns the annotation for the item result.
getActualOutput() - Method in class dev.dokimos.server.entity.ItemResult
 
getAlertWebhook(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
Returns one webhook, or 404 if the project or webhook does not exist or belongs to another tenant.
getAlignment(UUID, TenantScope) - Method in class dev.dokimos.server.service.AlignmentService
Computes the judge-human alignment breakdown for a run.
getApiKey() - Method in class dev.dokimos.server.config.ApiKeyProperties
 
getAttemptCount() - Method in class dev.dokimos.server.entity.EvalJob
 
getAttemptCount() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getAttributes() - Method in class dev.dokimos.server.entity.TraceSpan
 
getAvgLatencyMs() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getBaseUrl() - Method in class dev.dokimos.server.entity.LlmConnection
 
getClaimedAt() - Method in class dev.dokimos.server.entity.EvalJob
 
getClaimedAt() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getClaimTimeoutMs() - Method in class dev.dokimos.server.config.JudgeProperties
 
getClaimTimeoutMs() - Method in class dev.dokimos.server.config.TraceProperties.Eval
 
getCompletedAt() - Method in class dev.dokimos.server.entity.EvalJob
 
getCompletedAt() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getCompletedAt() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getConfig() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getConnection() - Method in class dev.dokimos.server.entity.EvalJob
 
getConnection() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getConnection() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getCostUsd() - Method in class dev.dokimos.server.entity.ItemResult
 
getCreatedAt() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getCreatedAt() - Method in class dev.dokimos.server.entity.Annotation
 
getCreatedAt() - Method in class dev.dokimos.server.entity.ApiKey
 
getCreatedAt() - Method in class dev.dokimos.server.entity.Dataset
 
getCreatedAt() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getCreatedAt() - Method in class dev.dokimos.server.entity.EvalJob
 
getCreatedAt() - Method in class dev.dokimos.server.entity.Experiment
 
getCreatedAt() - Method in class dev.dokimos.server.entity.IngestedBatch
 
getCreatedAt() - Method in class dev.dokimos.server.entity.ItemResult
 
getCreatedAt() - Method in class dev.dokimos.server.entity.LlmConnection
 
getCreatedAt() - Method in class dev.dokimos.server.entity.Project
 
getCreatedAt() - Method in class dev.dokimos.server.entity.Trace
 
getCreatedAt() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getCreatedAt() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getCreatedAt() - Method in class dev.dokimos.server.entity.TraceSpan
 
getCreatedBy() - Method in class dev.dokimos.server.entity.Annotation
 
getCreatedBy() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getCredentialRef() - Method in class dev.dokimos.server.entity.LlmConnection
 
getCriteria() - Method in class dev.dokimos.server.entity.EvalJob
 
getCriteria() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getCriteria() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getDataset() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getDataset(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Returns the dataset with the given name, visible under the scope.
getDataset(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Returns the dataset and every one of its versions, newest first.
getDatasetDetails(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Returns full dataset details including the version list, newest first.
getDatasetItem() - Method in class dev.dokimos.server.entity.ItemResult
 
getDatasetVersion() - Method in class dev.dokimos.server.entity.DatasetItem
 
getDatasetVersion() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getDescription() - Method in class dev.dokimos.server.entity.Dataset
 
getDescription() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getEncryptedApiKey() - Method in class dev.dokimos.server.entity.LlmConnection
 
getEncryptionKey() - Method in class dev.dokimos.server.config.ApiKeyProperties
Returns the master key used to encrypt inline connection API keys at rest, or null when unset.
getEndTimeUnixNano() - Method in class dev.dokimos.server.entity.Trace
 
getEndTimeUnixNano() - Method in class dev.dokimos.server.entity.TraceSpan
 
getEval() - Method in class dev.dokimos.server.config.TraceProperties
 
getEvalResults() - Method in class dev.dokimos.server.entity.ItemResult
 
getEvaluationParams() - Method in class dev.dokimos.server.entity.EvalJob
 
getEvaluatorName() - Method in class dev.dokimos.server.entity.EvalJob
 
getEvaluatorName() - Method in class dev.dokimos.server.entity.EvalResult
 
getEvaluatorName() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getEvaluatorName() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getExpectedOutput() - Method in class dev.dokimos.server.entity.ItemResult
 
getExpectedOutputs() - Method in class dev.dokimos.server.entity.DatasetItem
 
getExperiment() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getExperiment(UUID, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
 
getExperiments() - Method in class dev.dokimos.server.entity.Project
 
getExpiresAt() - Method in class dev.dokimos.server.entity.Trace
 
getFailedItemCount() - Method in class dev.dokimos.server.client.DokimosServerReporter
Number of items permanently dropped after exhausting all delivery retries.
getGitBranch() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getGitSha() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getHttpStatus() - Method in exception class dev.dokimos.server.judge.JudgeCallException
 
getId() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getId() - Method in class dev.dokimos.server.entity.Annotation
 
getId() - Method in class dev.dokimos.server.entity.ApiKey
 
getId() - Method in class dev.dokimos.server.entity.Dataset
 
getId() - Method in class dev.dokimos.server.entity.DatasetItem
 
getId() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getId() - Method in class dev.dokimos.server.entity.EvalJob
 
getId() - Method in class dev.dokimos.server.entity.EvalResult
 
getId() - Method in class dev.dokimos.server.entity.Experiment
 
getId() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getId() - Method in class dev.dokimos.server.entity.ItemResult
 
getId() - Method in class dev.dokimos.server.entity.LlmConnection
 
getId() - Method in class dev.dokimos.server.entity.Project
 
getId() - Method in class dev.dokimos.server.entity.Trace
 
getId() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getId() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getId() - Method in class dev.dokimos.server.entity.TraceSpan
 
getIdempotencyKey() - Method in class dev.dokimos.server.entity.IngestedBatch
 
getInput() - Method in class dev.dokimos.server.entity.ItemResult
 
getInputs() - Method in class dev.dokimos.server.entity.DatasetItem
 
getInputText() - Method in class dev.dokimos.server.entity.TraceSpan
 
getInstance() - Static method in class dev.dokimos.core.DatasetResolverRegistry
Returns the singleton registry instance.
getItemCount() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getItemCount() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getItemResult() - Method in class dev.dokimos.server.entity.Annotation
 
getItemResult() - Method in class dev.dokimos.server.entity.EvalResult
 
getItems() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getJobsForRun(UUID, TenantScope) - Method in class dev.dokimos.server.service.EvalJobService
Lists the judge jobs registered for a run, oldest first.
getKeyHash() - Method in class dev.dokimos.server.entity.ApiKey
 
getKind() - Method in class dev.dokimos.server.entity.TraceSpan
 
getLastError() - Method in class dev.dokimos.server.entity.EvalJob
 
getLastError() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getLastItemId() - Method in class dev.dokimos.server.entity.EvalJob
 
getLastUsedAt() - Method in class dev.dokimos.server.entity.ApiKey
 
getLatencyMs() - Method in class dev.dokimos.server.entity.ItemResult
 
getLatestVersion(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Returns the latest version of the dataset, visible under the scope.
getMatchKey() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getMatchType() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getMatchValue() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getMaxAttempts() - Method in class dev.dokimos.server.config.JudgeProperties
 
getMaxAttempts() - Method in class dev.dokimos.server.config.TraceProperties.Eval
 
getMaxScore() - Method in class dev.dokimos.server.entity.EvalJob
 
getMaxScore() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getMaxScore() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getMetadata() - Method in class dev.dokimos.server.entity.DatasetItem
 
getMetadata() - Method in class dev.dokimos.server.entity.EvalResult
 
getMetadata() - Method in class dev.dokimos.server.entity.ItemResult
 
getMinScore() - Method in class dev.dokimos.server.entity.EvalJob
 
getMinScore() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getMinScore() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getModel() - Method in class dev.dokimos.server.entity.LlmConnection
 
getName() - Method in class dev.dokimos.server.entity.ApiKey
 
getName() - Method in class dev.dokimos.server.entity.Dataset
 
getName() - Method in class dev.dokimos.server.entity.Experiment
 
getName() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getName() - Method in class dev.dokimos.server.entity.LlmConnection
 
getName() - Method in class dev.dokimos.server.entity.Project
 
getName() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getName() - Method in class dev.dokimos.server.entity.TraceSpan
 
getNote() - Method in class dev.dokimos.server.entity.Annotation
 
getOrCreateExperiment(Project, String, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
Resolves an experiment of the project by name within the scope, creating it stamped with the scope's tenant when absent.
getOrCreateProject(String, TenantScope) - Method in class dev.dokimos.server.service.ProjectService
Resolves the project by name within the scope, creating it stamped with the scope's tenant when it does not exist.
getOrdinal() - Method in class dev.dokimos.server.entity.DatasetItem
 
getOutputText() - Method in class dev.dokimos.server.entity.TraceSpan
 
getOverriddenExpectedOutput() - Method in class dev.dokimos.server.entity.Annotation
 
getPageSize() - Method in class dev.dokimos.server.config.JudgeProperties
 
getParentSpanId() - Method in class dev.dokimos.server.entity.TraceSpan
 
getPassedCount() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getPassRate() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getPollIntervalMs() - Method in class dev.dokimos.server.config.JudgeProperties
 
getPollIntervalMs() - Method in class dev.dokimos.server.config.TraceProperties.Eval
 
getProject() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getProject() - Method in class dev.dokimos.server.entity.Experiment
 
getProject(String, TenantScope) - Method in class dev.dokimos.server.service.ProjectService
 
getProjectId() - Method in class dev.dokimos.server.entity.Trace
 
getProjectId() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getProtocol() - Method in class dev.dokimos.server.entity.LlmConnection
 
getReason() - Method in class dev.dokimos.server.entity.EvalResult
 
getReason() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getRetentionDays() - Method in class dev.dokimos.server.config.TraceProperties
 
getRole() - Method in class dev.dokimos.server.entity.ApiKey
 
getRootSpanName() - Method in class dev.dokimos.server.entity.Trace
 
getRule() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getRun() - Method in class dev.dokimos.server.entity.EvalJob
 
getRun() - Method in class dev.dokimos.server.entity.ItemResult
 
getRunDetails(UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.service.RunService
 
getRunDetails(UUID, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
 
getRunId() - Method in class dev.dokimos.server.entity.IngestedBatch
 
getRunInExperiment(UUID, Experiment, String, ExperimentRunRepository, TenantScope) - Method in class dev.dokimos.server.service.ComparisonSupport
Loads a run by id and asserts it belongs to the given experiment.
getRuns() - Method in class dev.dokimos.server.entity.Experiment
 
getScore() - Method in class dev.dokimos.server.entity.EvalResult
 
getScore() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getSecret() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getSpan() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getSpanCount() - Method in class dev.dokimos.server.entity.Trace
 
getSpanId() - Method in class dev.dokimos.server.entity.TraceSpan
 
getSpans() - Method in class dev.dokimos.server.entity.Trace
 
getStartedAt() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getStartTimeUnixNano() - Method in class dev.dokimos.server.entity.Trace
 
getStartTimeUnixNano() - Method in class dev.dokimos.server.entity.TraceSpan
 
getStatus() - Method in class dev.dokimos.server.entity.EvalJob
 
getStatus() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getStatus() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getStatusCode() - Method in class dev.dokimos.server.entity.TraceSpan
 
getSuccess() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getSweepIntervalMs() - Method in class dev.dokimos.server.config.TraceProperties
 
getTenantId() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getTenantId() - Method in class dev.dokimos.server.entity.Annotation
 
getTenantId() - Method in class dev.dokimos.server.entity.ApiKey
 
getTenantId() - Method in class dev.dokimos.server.entity.Dataset
 
getTenantId() - Method in class dev.dokimos.server.entity.DatasetItem
 
getTenantId() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getTenantId() - Method in class dev.dokimos.server.entity.EvalResult
 
getTenantId() - Method in class dev.dokimos.server.entity.Experiment
 
getTenantId() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getTenantId() - Method in class dev.dokimos.server.entity.ItemResult
 
getTenantId() - Method in class dev.dokimos.server.entity.LlmConnection
 
getTenantId() - Method in class dev.dokimos.server.entity.Project
 
getTenantId() - Method in class dev.dokimos.server.entity.Trace
 
getTenantId() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getTenantId() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getTenantId() - Method in class dev.dokimos.server.entity.TraceSpan
 
getThreshold() - Method in class dev.dokimos.server.entity.EvalJob
 
getThreshold() - Method in class dev.dokimos.server.entity.EvalResult
 
getThreshold() - Method in class dev.dokimos.server.entity.TraceEvalJob
 
getThreshold() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getTokensIn() - Method in class dev.dokimos.server.entity.ItemResult
 
getTokensOut() - Method in class dev.dokimos.server.entity.ItemResult
 
getTotalCostUsd() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getTotalTokensIn() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getTotalTokensOut() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getTrace() - Method in class dev.dokimos.server.entity.TraceSpan
 
getTrace(UUID, TenantScope) - Method in class dev.dokimos.server.service.TraceQueryService
Returns the full detail of one trace: its metadata, spans, and the online eval jobs scoped to its spans.
getTrace(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceController
Returns a single trace with its spans and online eval jobs, or 404 if it does not exist or belongs to another tenant.
getTraceId() - Method in class dev.dokimos.server.entity.Trace
 
getTraceId() - Method in class dev.dokimos.server.entity.TraceSpan
 
getTrends(UUID, int, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
 
getTrends(UUID, int, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ExperimentController
 
getTriggeredBy() - Method in class dev.dokimos.server.entity.ExperimentRun
 
getType() - Method in class dev.dokimos.core.OutputType
The captured generic type.
getUpdatedAt() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getUpdatedAt() - Method in class dev.dokimos.server.entity.Annotation
 
getUpdatedAt() - Method in class dev.dokimos.server.entity.Dataset
 
getUpdatedAt() - Method in class dev.dokimos.server.entity.LlmConnection
 
getUpdatedAt() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
getUrl() - Method in class dev.dokimos.server.entity.AlertWebhook
 
getVerdict() - Method in class dev.dokimos.server.entity.Annotation
 
getVersion() - Method in class dev.dokimos.server.entity.DatasetVersion
 
getVersion(String, int, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Returns a specific version of the dataset, visible under the scope.
getVersion(String, String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Returns a specific version of the dataset.
gitBranch() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the gitBranch record component.
gitSha() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the gitSha record component.
GlobalExceptionHandler - Class in dev.dokimos.server.controller
 
GlobalExceptionHandler() - Constructor for class dev.dokimos.server.controller.GlobalExceptionHandler
 
goalCompletion() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating goal completion.

H

HallucinationEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that uses an LLM to detect hallucinations in the actual output.
HallucinationEvaluator.Builder - Class in dev.dokimos.core.evaluators
 
handleCompareRuns(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
Compares two runs via RunComparison: per-evaluator deltas, pass-rate test, per-item diffs.
handleConflict(IllegalStateException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
 
handleDataIntegrity(DataIntegrityViolationException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
Maps a database constraint violation to a 409 rather than a 500.
handleGeneral(Exception) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
 
handleGetFailingQueries(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
Returns failing queries from a run, filtered by score threshold.
handleListExperiments(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
Lists past evaluation runs with optional filtering.
handleMissingParam(MissingServletRequestParameterException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
Maps a missing required query parameter (for example baselineRunId on the diff endpoint) to a 400 rather than letting it fall through to the generic 500 handler.
handleNotFound(IllegalArgumentException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
 
handleResponseStatus(ResponseStatusException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
Honors the status carried by a ResponseStatusException (for example a 400 raised by a controller for an unrecognized query-parameter value) instead of letting the generic handler collapse it to a 500.
handleRunEvaluation(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
Runs an evaluation: loads a dataset, calls an LLM, evaluates results, and persists the run.
handleTestExecutionException(ExtensionContext, Throwable) - Method in class dev.dokimos.junit.DatasetRunExtension
 
handleUnreadableBody(HttpMessageNotReadableException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
Maps an unparseable or type-mismatched request body (for example a malformed UUID) to a 400 rather than letting it fall through to the generic 500 handler.
handleValidation(MethodArgumentNotValidException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
Maps bean-validation failures on @RequestBody payloads to a 400, surfacing the first field error message so the caller sees which constraint failed instead of an opaque 500.
hashCode() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.agents.ToolCall
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.agents.ToolDefinition
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.CallMetrics
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.conversation.Message
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.Dataset
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.EvalResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.EvalTestCase
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.Example
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.ExperimentResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.ItemResult
Returns a hash code value for this object.
hashCode() - Method in class dev.dokimos.core.OutputType
 
hashCode() - Method in record class dev.dokimos.core.RunHandle
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.RunResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.TaskResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.GateRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TrendData
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
Returns a hash code value for this object.
hashCode() - Method in class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
 
hashCode() - Method in record class dev.dokimos.server.filter.Principal
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.tenant.TenantScope
Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Returns a hash code value for this object.
hasInlineKey() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the hasInlineKey record component.
hasInlineKey() - Method in class dev.dokimos.server.entity.LlmConnection
Returns true when an inline encrypted key is stored rather than an external credential reference.
hasRegressions() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
True when the overall pass rate or any evaluator is significantly regressed.
hasSecret() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns the value of the hasSecret record component.
hasSecret() - Method in class dev.dokimos.server.entity.AlertWebhook
Returns true when a signing secret is configured.
hasToolCalls() - Method in record class dev.dokimos.core.conversation.Message
Checks whether this message carries any tool calls.
helpfulness() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating helpfulness.

I

id() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.filter.Principal
Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Returns the value of the id record component.
IGNORE - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
Do not compare arguments.
ignoreCase(boolean) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Sets whether to ignore case when matching.
impatientUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated impatient user who wants quick answers.
IMPROVED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
The candidate is meaningfully and significantly better than the baseline.
improvedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the improvedCount record component.
improvedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the improvedCount record component.
improvedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the improvedCount record component.
improvedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the improvedCount record component.
improvements() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Evaluator deltas flagged as significant improvements.
IN_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Expected is an ordered subsequence of actual; graded by LCS.
includePerCriterionScores(boolean) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets whether to include per-criterion scores in the result metadata.
includeReason(boolean) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Sets whether to include a detailed reason in the result.
includeReason(boolean) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Sets the flag whether to provide a reason or not.
includeReason(boolean) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Sets the flag whether to provide a reason or not.
includeToolCalls(boolean) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Includes each turn's tool calls in the judge prompt.
INCORRECT - Enum constant in enum class dev.dokimos.server.entity.AnnotationVerdict
 
index() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Returns the value of the index record component.
index() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns the value of the index record component.
index() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Returns the value of the index record component.
informationAccuracy() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating information accuracy.
ingest(OtlpExportTraceServiceRequest) - Method in class dev.dokimos.server.service.TraceIngestService
Parses, persists, and schedules online evals for an OTLP request.
IngestedBatch - Class in dev.dokimos.server.entity
Marks an item batch (identified by idempotency key) as committed for a run.
IngestedBatch(UUID, String, Instant) - Constructor for class dev.dokimos.server.entity.IngestedBatch
 
IngestedBatch.IngestedBatchId - Class in dev.dokimos.server.entity
Composite primary key.
IngestedBatchId() - Constructor for class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
 
IngestedBatchId(UUID, String) - Constructor for class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
 
IngestedBatchRepository - Interface in dev.dokimos.server.repository
 
ingestTraces(OtlpExportTraceServiceRequest) - Method in class dev.dokimos.server.controller.v1.TraceController
Ingests an OTLP/HTTP JSON trace export.
ingestTracesProtobuf(byte[]) - Method in class dev.dokimos.server.controller.v1.TraceController
Ingests an OTLP protobuf trace export.
initialMessage(String) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Sets the initial user message to start the conversation.
input() - Method in record class dev.dokimos.core.EvalTestCase
Gets the primary input value.
input() - Method in record class dev.dokimos.core.Example
Returns the primary input value.
input() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Returns the value of the input record component.
input() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns the value of the input record component.
input() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns the value of the input record component.
input() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the input record component.
input() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the input record component.
input() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Returns the value of the input record component.
input(String) - Method in class dev.dokimos.core.EvalTestCase.Builder
Sets the primary input value.
input(String) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
Sets the primary input value (the "input" key).
input(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds an input with the given key and value.
input(String, Object) - Method in class dev.dokimos.core.Example.Builder
Adds an input with the given key and value.
INPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
 
INPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport
Default key for reading input from dataset examples.
INPUT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport
Default key for reading input from dataset examples.
inputAs(OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the primary input ("input") converted to the given generic type.
inputAs(OutputType<T>) - Method in record class dev.dokimos.core.Example
Reads the primary input ("input") converted to the given generic type.
inputAs(Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the primary input ("input") converted to the given type.
inputAs(Class<T>) - Method in record class dev.dokimos.core.Example
Reads the primary input ("input") converted to the given type.
inputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the input under key converted to the given generic type.
inputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.Example
Reads the input under key converted to the given generic type.
inputAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the input under key converted to the given type.
inputAs(String, Class<T>) - Method in record class dev.dokimos.core.Example
Reads the input under key converted to the given type.
inputs() - Method in record class dev.dokimos.core.EvalTestCase
Returns the value of the inputs record component.
inputs() - Method in record class dev.dokimos.core.Example
Returns the value of the inputs record component.
inputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the inputs record component.
inputs() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Returns the value of the inputs record component.
inputs() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns the value of the inputs record component.
inputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds all entries from the given inputs map.
inputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder
Adds all entries from the given inputs map.
inputSchema() - Method in record class dev.dokimos.core.agents.ToolDefinition
Returns the value of the inputSchema record component.
inputSchema(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
Sets the input schema.
inputText() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the inputText record component.
inputText() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the inputText record component.
inputText() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Returns the value of the inputText record component.
INSTANCE - Static variable in class dev.dokimos.core.NoOpReporter
Singleton instance of the no-op reporter.
intValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns the value of the intValue record component.
isAssistant() - Method in record class dev.dokimos.core.conversation.Message
Checks if this message is from an assistant.
isAuthEnabled() - Method in class dev.dokimos.server.config.ApiKeyProperties
Returns true if API key authentication is enabled.
isCredentialSourceValid() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Cross-field rule enforcing that exactly one credential source is supplied.
isCredentialSourceValid() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
 
isDatasetItemKey(String) - Method in class dev.dokimos.server.service.ComparisonSupport
True when a comparison key is a dataset item id rather than a positional fallback.
isDatasetLinkageValid() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Cross-field rule enforcing that datasetName and datasetVersion are either both supplied or both absent.
isEmpty() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Checks if the conversation is empty.
isEnabled() - Method in class dev.dokimos.server.entity.AlertWebhook
 
isEnabled() - Method in class dev.dokimos.server.entity.ApiKey
 
isEnabled() - Method in class dev.dokimos.server.entity.TraceEvalRule
 
isEvaluationParamsValid() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
 
isMatchKeyValid() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
 
isRetryable() - Method in exception class dev.dokimos.server.judge.JudgeCallException
Returns true when the failure is worth retrying: a timeout, network error, or 5xx response.
isScoreRangeValid() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
 
isScoreRangeValid() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
 
isSuccess() - Method in class dev.dokimos.server.entity.EvalResult
 
isSystem() - Method in record class dev.dokimos.core.conversation.Message
Checks if this message is a system message.
isSystem() - Method in record class dev.dokimos.server.filter.Principal
Returns whether this is the system principal.
isUser() - Method in record class dev.dokimos.core.conversation.Message
Checks if this message is from a user.
ItemComparison - Record Class in dev.dokimos.core.comparison
Comparison of a single paired item across baseline and candidate.
ItemComparison(String, ComparisonStatus, Double, Double, boolean, List<EvaluatorDelta>) - Constructor for record class dev.dokimos.core.comparison.ItemComparison
Creates an instance of a ItemComparison record class.
itemCount() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
Returns the value of the itemCount record component.
itemCount() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Returns the value of the itemCount record component.
itemCount() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns the value of the itemCount record component.
itemCount() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the itemCount record component.
itemCount() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the itemCount record component.
ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Backwards-compatible 5-arg constructor: passes null metadata, datasetItemId, and call metrics.
ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Backwards-compatible 6-arg constructor: passes null datasetItemId and null call metrics.
ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean, UUID) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Backwards-compatible 7-arg constructor: passes null call metrics.
ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean, UUID, Integer, Integer, Double, Long) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Creates an instance of a ItemData record class.
ItemDeliveryFailure(String, int, List<ItemResult>) - Constructor for record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Creates an instance of a ItemDeliveryFailure record class.
ItemDetail(String, String, String, boolean, List<RunRecord.EvalDetail>) - Constructor for record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Creates an instance of a ItemDetail record class.
itemId() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the itemId record component.
itemId() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
Returns the value of the itemId record component.
itemKey(Function<ItemResult, String>) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
Function that derives an item-identity key from an item result.
ItemPayload(Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Creates an instance of a ItemPayload record class.
ItemResult - Class in dev.dokimos.server.entity
 
ItemResult - Record Class in dev.dokimos.core
The outcome of executing a single example: the example itself, the actual outputs the task produced, the evaluator results, and optional metrics describing the underlying LLM call.
ItemResult(Example, Map<String, Object>, List<EvalResult>) - Constructor for record class dev.dokimos.core.ItemResult
Creates a result without call metrics.
ItemResult(Example, Map<String, Object>, List<EvalResult>, CallMetrics) - Constructor for record class dev.dokimos.core.ItemResult
Creates an instance of a ItemResult record class.
ItemResult(ExperimentRun, Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.ItemResult
 
itemResultId() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
Returns the value of the itemResultId record component.
ItemResultRepository - Interface in dev.dokimos.server.repository
 
itemResults() - Method in record class dev.dokimos.core.ExperimentResult
Returns all item results across all runs.
itemResults() - Method in record class dev.dokimos.core.RunResult
Returns the value of the itemResults record component.
items() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the items record component.
items() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the items record component.
items() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the items record component.
items() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Returns the value of the items record component.
items() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
Returns the value of the items record component.
items() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
Returns the value of the items record component.
items() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
Returns the value of the items record component.
items() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the items record component.
ItemSnapshot(UUID, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Creates an instance of a ItemSnapshot record class.
ItemSummary(UUID, Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<RunDetails.EvalSummary>, Instant, UUID, AnnotationView, Integer, Integer, Double, Long) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Creates an instance of a ItemSummary record class.
iterator() - Method in record class dev.dokimos.core.Dataset
 

J

job() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Returns the value of the job record component.
json() - Element in annotation interface dev.dokimos.junit.DatasetSource
Inline JSON dataset.
Json - Class in dev.dokimos.core.internal
Shared, framework-internal JSON utilities backed by a single, immutable Jackson ObjectMapper.
jsonl() - Element in annotation interface dev.dokimos.junit.DatasetSource
Inline JSONL dataset.
JsonResultStore - Class in dev.dokimos.mcp.store
Stores run records as a JSON array in a local file.
JsonResultStore() - Constructor for class dev.dokimos.mcp.store.JsonResultStore
 
JsonResultStore(Path) - Constructor for class dev.dokimos.mcp.store.JsonResultStore
 
judge() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
Returns the value of the judge record component.
judge(JudgeLM) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Sets the JudgeLM to use for generating responses.
judge(JudgeLM) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets the JudgeLM to use for evaluation.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets the judge LLM for evaluating task completion.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Sets the judge LLM for evaluating argument grounding.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets an optional judge LLM for semantic checks.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Sets an optional judge LLM for semantic checks.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Sets the LLM judge to use for scoring context relevance.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Sets the model to use for the evaluation.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Sets the model to use for the evaluation.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Sets the model to use for the evaluation.
JudgeCallException - Exception Class in dev.dokimos.server.judge
Unchecked failure raised when a judge HTTP call cannot complete.
JudgeCallException(int, String) - Constructor for exception class dev.dokimos.server.judge.JudgeCallException
 
JudgeCallException(int, String, Throwable) - Constructor for exception class dev.dokimos.server.judge.JudgeCallException
 
JudgeInfo(String, Double) - Constructor for record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
Creates an instance of a JudgeInfo record class.
JudgeJobTransactions - Class in dev.dokimos.server.service
The transactional steps of the judge worker, each in its own committed transaction so the worker can make the LLM HTTP call between them without holding a database transaction open.
JudgeJobTransactions(EvalJobRepository, EvalResultRepository, ItemResultRepository, RunService) - Constructor for class dev.dokimos.server.service.JudgeJobTransactions
 
JudgeJobTransactions.ItemSnapshot - Record Class in dev.dokimos.server.service
A detached view of an item result carrying only the fields the judge prompt needs.
JudgeJobTransactions.ScoredResult - Record Class in dev.dokimos.server.service
Pairs an eval result with the id of the item result it belongs to, for batch persistence.
JudgeLM - Interface in dev.dokimos.core
A language model used for evaluation.
JudgeProperties - Class in dev.dokimos.server.config
Tuning knobs for the background judge worker, bound from the dokimos.judge prefix.
JudgeProperties() - Constructor for class dev.dokimos.server.config.JudgeProperties
 
Judges and tasks - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Section
JudgeScorer - Class in dev.dokimos.server.judge
Drives a single judge scoring: builds the prompt from a criteria and the selected parameters, calls the underlying JudgeLM, and parses the response.
JudgeScorer(JudgeLM, String, List<EvalTestCaseParam>, double, double, Double) - Constructor for class dev.dokimos.server.judge.JudgeScorer
 
JudgeScorer.ScoreOutcome - Record Class in dev.dokimos.server.judge
The result of scoring one item: a numeric score, the judge's reasoning, and the pass decision.
JudgeWorker - Class in dev.dokimos.server.service
Background worker that drains the judge job queue.
JudgeWorker(JudgeJobTransactions, LlmCredentialService, JudgeProperties) - Constructor for class dev.dokimos.server.service.JudgeWorker
 

K

key() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns the value of the key record component.
key() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Returns the value of the key record component.
key() - Element in annotation interface dev.dokimos.junit.MetadataEntry
The metadata key.
key() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
Returns the value of the key record component.
key() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
Returns the value of the key record component.
kind() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the kind record component.
kind() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the kind record component.
kind() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the kind record component.

L

LangChain4jSupport - Class in dev.dokimos.langchain4j
Utilities for integrating with LangChain4j.
last() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the last record component.
lastAssistantMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the last assistant message in the conversation, if any.
lastError() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the lastError record component.
lastError() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the lastError record component.
lastMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the last message in the conversation, if any.
lastUsedAt() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the lastUsedAt record component.
lastUserMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the last user message in the conversation, if any.
latencyMs() - Method in record class dev.dokimos.core.CallMetrics
Returns the value of the latencyMs record component.
latencyMs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the latencyMs record component.
latencyMs() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the latencyMs record component.
LATEST - Static variable in class dev.dokimos.server.client.ServerDatasetResolver
Version path alias that resolves to the newest version on the server.
latestItemCount() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the latestItemCount record component.
latestRun() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Returns the value of the latestRun record component.
LatestRunInfo(UUID, RunStatus, Double, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Creates an instance of a LatestRunInfo record class.
latestVersion() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the latestVersion record component.
LENIENT - Enum constant in enum class dev.dokimos.core.evaluators.StructuralMatchMode
Lenient comparison.
lenientMapper() - Static method in class dev.dokimos.core.LlmResponseUtils
An ObjectMapper configured to tolerate the common ways a language model deviates from strict JSON (trailing commas, single quotes, unquoted field names, comments, and unescaped control characters).
list() - Method in class dev.dokimos.server.service.ApiKeyService
Lists every key as metadata only; key material is never included.
list(TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
 
list(HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
Lists the connections visible to the caller.
list(String, int) - Method in class dev.dokimos.mcp.store.JsonResultStore
 
list(String, int) - Method in interface dev.dokimos.mcp.store.ResultStore
Lists runs, most recent first.
list(String, UUID, UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.service.ReviewQueueService
Returns a page of items awaiting review, oldest first.
list(String, UUID, UUID, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ReviewQueueController
Lists run items still awaiting a human verdict, oldest first.
list(UUID, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
Lists a project's webhooks in creation order.
list(UUID, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
Lists the rules of a project, oldest first, within the scope.
list(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.EvalJobController
Lists the judge jobs registered for a run, oldest first.
listAlertWebhooks(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
Lists the project's webhooks.
listApiKeys() - Method in class dev.dokimos.server.controller.v1.ApiKeyController
Lists every key as metadata only; the raw key is never returned.
listDatasets(TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Returns dataset summaries visible under the scope with the latest version number and item count for each.
listDatasets(HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Lists the datasets visible to the caller with their latest version number and item count.
listDiff(UUID, UUID, UUID, String, Pageable, TenantScope) - Method in class dev.dokimos.server.service.DiffService
Builds the per-case diff between a candidate run and an explicit baseline run, returning the whole-run summary together with the requested, filtered, sorted page of cases.
listExperiments(Project, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
 
listExperiments(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
 
listItems(DatasetVersion, Pageable) - Method in class dev.dokimos.server.service.DatasetService
Overload for callers that have already resolved a DatasetVersion; avoids the double-fetch path through DatasetService.getVersion(java.lang.String, int, dev.dokimos.server.tenant.TenantScope).
listItems(String, int, Pageable, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Returns items for the given version ordered by ordinal, paginated.
listItems(String, String, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Returns the items of a dataset version ordered by ordinal, paginated.
listProjects(TenantScope) - Method in class dev.dokimos.server.service.ProjectService
 
listProjects(HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
 
listRuns(Experiment, TenantScope) - Method in class dev.dokimos.server.service.RunService
 
listRuns(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ExperimentController
 
listTraceEvalRules(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
Lists the rules of a project, oldest first.
listTraces(UUID, int, int, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceController
Lists ingested traces newest first, optionally filtered to a project.
listTraces(UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.service.TraceQueryService
Lists traces newest first, optionally filtered to a project.
llmBased(JudgeLM) - Static method in interface dev.dokimos.core.MatchingStrategy
Creates an LLM-based matching strategy.
LlmConnection - Class in dev.dokimos.server.entity
A named, reusable pointer to an OpenAI-compatible endpoint used by the server-side judge.
LlmConnection(String, String, String) - Constructor for class dev.dokimos.server.entity.LlmConnection
 
LlmConnectionController - Class in dev.dokimos.server.controller.v1
 
LlmConnectionController(LlmConnectionService) - Constructor for class dev.dokimos.server.controller.v1.LlmConnectionController
 
LlmConnectionProtocol - Enum Class in dev.dokimos.server.entity
The API surface an LlmConnection's endpoint speaks.
LlmConnectionRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for LlmConnection.
LlmConnectionRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for LlmConnection.
LlmConnectionRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the LlmConnection finders.
LlmConnectionRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
 
LlmConnectionService - Class in dev.dokimos.server.service
Registers and reads LLM connections.
LlmConnectionService(LlmConnectionRepository, LlmCredentialService, EvalJobRepository) - Constructor for class dev.dokimos.server.service.LlmConnectionService
 
LlmConnectionView - Record Class in dev.dokimos.server.dto.v1
Public view of an LlmConnection.
LlmConnectionView(UUID, String, String, String, LlmConnectionProtocol, String, boolean, Instant) - Constructor for record class dev.dokimos.server.dto.v1.LlmConnectionView
Creates an instance of a LlmConnectionView record class.
LlmCredentialService - Class in dev.dokimos.server.service
Resolves and protects the API key for an LlmConnection.
LlmCredentialService(ApiKeyProperties) - Constructor for class dev.dokimos.server.service.LlmCredentialService
 
LLMJudgeEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that uses an LLM to evaluate outputs based on the specified criteria.
LLMJudgeEvaluator.Builder - Class in dev.dokimos.core.evaluators
 
LlmResponseUtils - Class in dev.dokimos.core
Utility methods for processing LLM responses.
LLMSimulatedUser - Class in dev.dokimos.core.conversation
An LLM-based simulated user for multi-turn conversation testing.
LLMSimulatedUser.Builder - Class in dev.dokimos.core.conversation
Builder for constructing LLM simulated users.
load(String) - Static method in record class dev.dokimos.core.Dataset
Loads a dataset from a URI or path through the resolver registry.
loadUnevaluatedPage(UUID, String, UUID, int) - Method in class dev.dokimos.server.service.JudgeJobTransactions
Reads a seek-keyed page of items that have no result yet for the job's evaluator.
log() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
 

M

main(String[]) - Static method in class dev.dokimos.mcp.DokimosMcpServer
 
main(String[]) - Static method in class dev.dokimos.server.DokimosServerApplication
 
markSucceeded(UUID, double, boolean, String) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
Marks a job SUCCEEDED and records its score.
markSucceeded(UUID, UUID) - Method in class dev.dokimos.server.service.JudgeJobTransactions
Marks the job SUCCEEDED and finalizes its run (re-materializes counts, moves the run to SUCCESS).
markUsed() - Method in class dev.dokimos.server.entity.ApiKey
Records that the key was just used to authenticate a request.
matches(TraceSpan) - Method in class dev.dokimos.server.entity.TraceEvalRule
Returns whether the given span matches this rule.
matches(Object, Object) - Method in interface dev.dokimos.core.MatchingStrategy
Determines if a retrieved item matches an expected item.
matches(Map<String, Object>, Map<String, Object>) - Method in interface dev.dokimos.core.evaluators.agents.ArgumentMatcher
Determines whether the actual arguments match the expected arguments.
matches(Map<String, Object>, Map<String, Object>) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher
 
matchingStrategy(MatchingStrategy) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Sets the strategy for matching retrieved items to expected items.
matchingStrategy(MatchingStrategy) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Sets the strategy for matching retrieved items to expected items.
MatchingStrategy - Interface in dev.dokimos.core
Strategy for determining if a retrieved item matches an expected item.
matchKey() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the matchKey record component.
matchKey() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the matchKey record component.
matchMode(ToolCorrectnessEvaluator.MatchMode) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets the match mode for comparing tool calls.
matchMode(ToolTrajectoryEvaluator.MatchMode) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets the trajectory match mode.
matchType() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the matchType record component.
matchType() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the matchType record component.
matchValue() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the matchValue record component.
matchValue() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the matchValue record component.
MAX - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
Returns the maximum score across all criteria.
maxInputArgs(int) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets the maximum number of total input parameters allowed per tool.
maxOptionalArgs(int) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets the maximum number of optional parameters allowed per tool.
maxScore() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the maxScore record component.
maxScore() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the maxScore record component.
maxScore() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the maxScore record component.
maxTurns(int) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Sets the maximum number of conversation turns.
MEAN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
Simple arithmetic mean of all scores.
measuredAsyncTask(Function<Example, SpringAiAlibabaSupport.AlibabaAgentResponse>, String, PriceTable) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Creates a measured AsyncTask that runs a Spring AI Alibaba agent and captures latency automatically and, when a PriceTable and model id are supplied, cost, lighting up the run's metrics cards.
measuredAsyncTask(Function<Example, SpringAiAlibabaSupport.AlibabaAgentResponse>, String, PriceTable, Executor) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Creates a measured AsyncTask that runs a Spring AI Alibaba agent on the supplied Executor so you control and isolate concurrency, with a non-null executor required.
measuredAsyncTask(ChatClient, String, PriceTable) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates a measured AsyncTask that calls a Spring AI ChatClient and captures token usage, latency, and (when a PriceTable is supplied) cost, lighting up the run's metrics cards.
measuredAsyncTask(ChatClient, String, PriceTable, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates a measured AsyncTask that dispatches each blocking call on the supplied Executor so you control and isolate concurrency.
measuredAsyncTask(ChatClient, String, String, String, PriceTable, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
Creates a measured AsyncTask with caller-chosen input and output keys, dispatching each blocking call on the supplied Executor (or the common ForkJoinPool when executor is null).
measuredRagTask(Function<String, Result<String>>, String, PriceTable) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a measured RAG MeasuredTask from a function returning Result, capturing the token usage, latency, and (when a PriceTable is supplied) cost alongside the output and retrieved context.
measuredRagTask(Function<String, Result<String>>, String, String, String, String, PriceTable) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a measured RAG MeasuredTask with custom key names.
measuredTask(MeasuredTask) - Method in class dev.dokimos.core.Experiment.Builder
Sets a measured task that carries CallMetrics through to each ItemResult.
measuredTask(ChatModel, String, PriceTable) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a measured Q&A MeasuredTask that captures token usage, latency, and (when a PriceTable is supplied) cost, lighting up the run's metrics cards.
measuredTask(ChatModel, String, PriceTable, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a measured Q&A MeasuredTask that writes the response under a caller-chosen key.
MeasuredTask - Interface in dev.dokimos.core
A task that produces outputs together with optional CallMetrics describing the underlying LLM call.
Measured tasks - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Section
message() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
Returns the value of the message record component.
message(Message) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds a message to the trajectory.
Message - Record Class in dev.dokimos.core.conversation
Represents a single message in a conversation.
Message(Message.Role, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.conversation.Message
Creates a message with no tool calls.
Message(Message.Role, String, Map<String, Object>, List<ToolCall>) - Constructor for record class dev.dokimos.core.conversation.Message
Compact constructor.
Message.Role - Enum Class in dev.dokimos.core.conversation
The role of a message sender in a conversation.
messages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the value of the messages record component.
messages(OverAllState) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Extracts the raw Spring AI Message list from a graph state.
messages(List<Message>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds all messages from a list.
MESSAGES_KEY - Static variable in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
The Spring AI Alibaba graph-state key under which the message list is stored.
metadata() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.agents.ToolCall
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.conversation.Message
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.EvalResult
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.EvalTestCase
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.Example
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.ExperimentResult
Returns the value of the metadata record component.
metadata() - Element in annotation interface dev.dokimos.junit.DatasetSource
Run metadata as alternating key-value pairs (for example {"model", "gpt-4", "temperature", "0"}).
metadata() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the metadata record component.
metadata(String, Object) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Adds a metadata entry.
metadata(String, Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Adds a metadata entry.
metadata(String, Object) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds metadata with the given key and value.
metadata(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds metadata with the given key and value.
metadata(String, Object) - Method in class dev.dokimos.core.Example.Builder
Adds metadata with the given key and value.
metadata(String, Object) - Method in class dev.dokimos.core.Experiment.Builder
Adds a metadata entry to the experiment.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Sets all metadata.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Sets all metadata.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds all entries from the given metadata map.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalResult.Builder
Sets the metadata.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
Adds all entries from the given metadata map.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder
Adds all entries from the given metadata map.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.Experiment.Builder
Adds multiple metadata entries to the experiment.
metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.agents.AgentTrace
Reads the metadata entry stored under key and converts it into a generic target captured by an OutputType token, for example new OutputType<List<String>>() {}.
metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.agents.ToolCall
Reads the metadata entry stored under key and converts it into a generic target captured by an OutputType token, for example new OutputType<List<String>>() {}.
metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the metadata value under key converted to the given generic type.
metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.Example
Reads the metadata value under key converted to the given generic type.
metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.agents.AgentTrace
Reads the metadata entry stored under key and converts it into an instance of type.
metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.agents.ToolCall
Reads the metadata entry stored under key and converts it into an instance of type.
metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
Reads the metadata value under key converted to the given type.
metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.Example
Reads the metadata value under key converted to the given type.
MetadataEntry - Annotation Interface in dev.dokimos.junit
A single typed run-metadata key-value pair for DatasetSource.entries().
method() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns the value of the method record component.
metrics() - Method in record class dev.dokimos.core.ItemResult
Returns the value of the metrics record component.
metrics() - Method in record class dev.dokimos.core.TaskResult
Returns the value of the metrics record component.
MIN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
Returns the minimum score across all criteria.
minScore() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the minScore record component.
minScore() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the minScore record component.
minScore() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the minScore record component.
mode(ArgMatchMode) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
Sets the key-set comparison mode.
mode(StructuralMatchMode) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Sets the comparison mode.
model() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
Returns the value of the model record component.
model() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns the value of the model record component.
model() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the model record component.
model() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns the value of the model record component.
modelConfig() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the modelConfig record component.

N

name() - Method in record class dev.dokimos.core.agents.ToolCall
Returns the value of the name record component.
name() - Method in record class dev.dokimos.core.agents.ToolDefinition
Returns the value of the name record component.
name() - Method in class dev.dokimos.core.BaseEvaluator
 
name() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Returns the value of the name record component.
name() - Method in record class dev.dokimos.core.Dataset
Returns the dataset's name.
name() - Method in record class dev.dokimos.core.EvalResult
Returns the value of the name record component.
name() - Method in interface dev.dokimos.core.Evaluator
Returns the evaluator name.
name() - Method in record class dev.dokimos.core.ExperimentResult
Returns the value of the name record component.
name() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
Returns the value of the name record component.
name() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the name record component.
name(String) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Sets the tool name.
name(String) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
Sets the tool name.
name(String) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.Dataset.Builder
Sets the dataset name.
name(String) - Method in class dev.dokimos.core.EvalResult.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.Experiment.Builder
Sets the experiment name.
NAMES_AND_ARGS - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
Compare tool names and their arguments.
NAMES_AND_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
Compare tool names and their invocation order.
NAMES_ONLY - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
Compare only the set of tool names used.
NETWORK_ERROR - Static variable in exception class dev.dokimos.server.judge.JudgeCallException
Status used when the failure is a network error or timeout rather than an HTTP response.
noBaseline(double) - Static method in record class dev.dokimos.core.gate.GateVerdict
The verdict when no baseline exists yet: nothing to regress against, so the gate passes.
NoOpReporter - Class in dev.dokimos.core
A no-op implementation of Reporter that does nothing.
note() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
Returns the value of the note record component.
note() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the note record component.
notSignificant(String) - Static method in record class dev.dokimos.core.comparison.SignificanceResult
Non-significant placeholder with pValue = 1.0 and no confidence interval.
noviceUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated novice user who is new to the domain.
number() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the number record component.
numberOfElements() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the numberOfElements record component.

O

observedToolNames() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Returns the distinct tool names observed during the run, in first-seen order.
of(Message.Role, String) - Static method in record class dev.dokimos.core.conversation.Message
Creates a message with just role and content.
of(ArgMatchMode) - Static method in interface dev.dokimos.core.evaluators.agents.ArgumentMatcher
Returns a tolerant matcher using the given key-set mode.
of(String) - Static method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Creates a response carrying output text only, with no token counts (latency-only metrics).
of(String, double, double, String) - Static method in record class dev.dokimos.core.EvalResult
Creates a result by comparing the score against a threshold.
of(String, ApiKey) - Static method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
 
of(String, String) - Static method in record class dev.dokimos.core.conversation.EvaluationCriterion
Creates a criterion with default weight of 1.0.
of(String, String) - Static method in record class dev.dokimos.core.EvalTestCase
Creates a test case with a single input and actual output.
of(String, String) - Static method in record class dev.dokimos.core.Example
Creates an example with a single input and expected output.
of(String, String, String) - Static method in record class dev.dokimos.core.EvalTestCase
Creates a test case with input, actual output, and expected output.
of(String, String, Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolDefinition
Creates a tool definition with a name, description, and input schema.
of(String, Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolCall
Creates a tool call with just a name and arguments.
of(Map<String, Object>) - Static method in record class dev.dokimos.core.TaskResult
Creates a result without call metrics.
of(Page<T>) - Static method in record class dev.dokimos.server.dto.v1.PageResponse
 
of(Pageable) - Static method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
 
of(Sort) - Static method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
 
offset() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns the value of the offset record component.
offTopicUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated off-topic user who frequently goes on tangents.
onItemDeliveryFailure(Consumer<DokimosServerReporter.ItemDeliveryFailure>) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
Callback invoked when a batch of items is permanently dropped after all delivery retries.
onProcessEvent(AgentProcessEvent) - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Receives every AgentProcessEvent for the run and dispatches by concrete type.
onRegressionAlert(RegressionAlertEvent) - Method in class dev.dokimos.server.service.AlertWebhookDispatcher
Resolves the project's enabled webhooks and POSTs the alert to each.
onRemovedEvaluator() - Method in class dev.dokimos.core.gate.GateConfig
 
onRemovedEvaluator(GateConfig.RemovedEvaluatorPolicy) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
OpenAiCompatibleJudge - Class in dev.dokimos.server.judge
A JudgeLM that calls an OpenAI-compatible chat completions endpoint over the JDK HTTP client, with no vendor SDK.
OpenAiCompatibleJudge(String, String, String) - Constructor for class dev.dokimos.server.judge.OpenAiCompatibleJudge
 
OpenAiSupport - Class in dev.dokimos.openai
Utilities for integrating with the OpenAI Java SDK.
OpenResponsesJudge - Class in dev.dokimos.server.judge
A JudgeLM that calls an Open Responses endpoint (POST {baseUrl}/responses) over the JDK HTTP client, with no vendor SDK.
OpenResponsesJudge(String, String, String) - Constructor for class dev.dokimos.server.judge.OpenResponsesJudge
 
ordinal() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns the value of the ordinal record component.
OtlpAnyValue - Record Class in dev.dokimos.server.dto.v1.otlp
The OTLP AnyValue union in its JSON encoding.
OtlpAnyValue(String, Boolean, String, Double) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Creates an instance of a OtlpAnyValue record class.
OtlpExportTraceServiceRequest - Record Class in dev.dokimos.server.dto.v1.otlp
The top level of the OTLP/HTTP JSON encoding of ExportTraceServiceRequest.
OtlpExportTraceServiceRequest(List<OtlpResourceSpans>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
Creates an instance of a OtlpExportTraceServiceRequest record class.
OtlpKeyValue - Record Class in dev.dokimos.server.dto.v1.otlp
A single OTLP attribute: a key and an OtlpAnyValue holding the typed value.
OtlpKeyValue(String, OtlpAnyValue) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
Creates an instance of a OtlpKeyValue record class.
OtlpProtobufConverter - Class in dev.dokimos.server.service
Translates the protobuf ExportTraceServiceRequest into the same DTO tree Jackson produces for the OTLP/HTTP JSON encoding, so both encodings share one parser and persistence path.
OtlpResource - Record Class in dev.dokimos.server.dto.v1.otlp
A resource and its attributes.
OtlpResource(List<OtlpKeyValue>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpResource
Creates an instance of a OtlpResource record class.
OtlpResourceSpans - Record Class in dev.dokimos.server.dto.v1.otlp
The spans emitted by one resource, with that resource's attributes (for example service.name).
OtlpResourceSpans(OtlpResource, List<OtlpScopeSpans>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
Creates an instance of a OtlpResourceSpans record class.
OtlpScopeSpans - Record Class in dev.dokimos.server.dto.v1.otlp
The spans emitted by one instrumentation scope.
OtlpScopeSpans(List<OtlpSpan>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
Creates an instance of a OtlpScopeSpans record class.
OtlpSpan - Record Class in dev.dokimos.server.dto.v1.otlp
One OTLP span in the JSON encoding.
OtlpSpan(String, String, String, String, String, String, String, OtlpStatus, List<OtlpKeyValue>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Creates an instance of a OtlpSpan record class.
OtlpStatus - Record Class in dev.dokimos.server.dto.v1.otlp
A span status.
OtlpStatus(String, String) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
Creates an instance of a OtlpStatus record class.
OtlpTraceParser - Class in dev.dokimos.server.service
Pure translation from the OTLP/HTTP JSON request DTOs into the server's own span model, with no persistence.
OtlpTraceParser() - Constructor for class dev.dokimos.server.service.OtlpTraceParser
 
OtlpTraceParser.ParsedSpan - Record Class in dev.dokimos.server.service
A span translated from OTLP, carrying the merged attributes and derived input/output text.
OtlpTraceParser.Result - Record Class in dev.dokimos.server.service
The outcome of parsing: the valid spans and the count of malformed spans that were skipped.
OUTPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport
Default key for the model output in evaluation results.
OUTPUT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport
Default key for the model output in evaluation results.
outputKey(String) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Sets the map key used to read the value from both the actual and expected output maps.
outputs() - Method in record class dev.dokimos.core.TaskResult
Returns the value of the outputs record component.
outputText() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the outputText record component.
outputText() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the outputText record component.
outputText() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Returns the value of the outputText record component.
OutputType<T> - Class in dev.dokimos.core
A super-type token that captures a full generic type T (including its type arguments) at compile time so it survives erasure at runtime.
overriddenExpectedOutput() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
Returns the value of the overriddenExpectedOutput record component.
overriddenExpectedOutput() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the overriddenExpectedOutput record component.
overriddenExpectedOutput() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
Returns the value of the overriddenExpectedOutput record component.

P

PAGE_SIZE - Static variable in class dev.dokimos.server.client.ServerDatasetResolver
Page size used when listing dataset items.
pageable() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the pageable record component.
PageablePage(long, PageResponse.PageSort, boolean, int, int, boolean) - Constructor for record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Creates an instance of a PageablePage record class.
paged() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns the value of the paged record component.
pageNumber() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns the value of the pageNumber record component.
PageResponse<T> - Record Class in dev.dokimos.server.dto.v1
Stable page envelope used by paginated endpoints.
PageResponse(List<T>, int, int, long, int, boolean, boolean, int, boolean, PageResponse.PageSort, PageResponse.PageablePage) - Constructor for record class dev.dokimos.server.dto.v1.PageResponse
Creates an instance of a PageResponse record class.
PageResponse.PageablePage - Record Class in dev.dokimos.server.dto.v1
Mirrors Spring's PageableObject JSON shape.
PageResponse.PageSort - Record Class in dev.dokimos.server.dto.v1
Mirrors Spring's SortObject JSON shape.
pageSize() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns the value of the pageSize record component.
PageSort(boolean, boolean, boolean) - Constructor for record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Creates an instance of a PageSort record class.
pairing() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the pairing record component.
pairing() - Method in class dev.dokimos.core.gate.GateConfig
 
pairing() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the pairing record component.
pairing() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the pairing record component.
pairing() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the pairing record component.
pairing() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Returns the value of the pairing record component.
pairing(GateConfig.Pairing) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
parallelism(int) - Method in class dev.dokimos.core.Experiment.Builder
Sets the level of parallelism for running the experiment.
parameterNames() - Method in record class dev.dokimos.core.agents.ToolDefinition
Extracts all parameter names from the input schema properties.
parameterSchema(String) - Method in record class dev.dokimos.core.agents.ToolDefinition
Gets the schema for a specific parameter.
parentSpanId() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the parentSpanId record component.
parentSpanId() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the parentSpanId record component.
parentSpanId() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the parentSpanId record component.
parse(OtlpExportTraceServiceRequest) - Method in class dev.dokimos.server.service.OtlpTraceParser
Flattens the request into parsed spans, skipping malformed ones.
parse(String, TypeReference<T>) - Static method in class dev.dokimos.core.LlmResponseUtils
Extracts the JSON payload from an LLM response (dropping any surrounding prose or code fence) and parses it leniently into the requested type.
parseCsv(String, String) - Static method in class dev.dokimos.core.DatasetParser
 
parseCsv(String, String, char) - Static method in class dev.dokimos.core.DatasetParser
 
ParsedSpan(String, String, String, String, String, String, Long, Long, Map<String, Object>, String, String, String) - Constructor for record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Creates an instance of a ParsedSpan record class.
parseJson(String) - Static method in class dev.dokimos.core.DatasetParser
 
parseJsonl(String, String) - Static method in class dev.dokimos.core.DatasetParser
Parses a dataset from a JSONL string.
parseJsonl(Path, String) - Static method in class dev.dokimos.core.DatasetParser
Parses a dataset from a JSONL file, streaming line-by-line from disk.
parseTree(String) - Static method in class dev.dokimos.core.LlmResponseUtils
Extracts the JSON payload from an LLM response (dropping any surrounding prose or code fence) and parses it leniently into a tree.
pass() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Returns the value of the pass record component.
passCount() - Method in record class dev.dokimos.core.ExperimentResult
Returns the average number of items that passed across all runs.
passCount() - Method in record class dev.dokimos.core.RunResult
Returns the number of items that passed all evaluations in this run.
passCount() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the passCount record component.
passed() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the passed record component.
passed() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the passed record component.
passedCount() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the passedCount record component.
passedItems() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the passedItems record component.
passedItems() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns the value of the passedItems record component.
passFlip() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns the value of the passFlip record component.
passFlip() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns the value of the passFlip record component.
passRate() - Method in record class dev.dokimos.core.ExperimentResult
Returns the average pass rate across all runs.
passRate() - Method in record class dev.dokimos.core.RunResult
Returns the proportion of items that passed in this run.
passRate() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns the value of the passRate record component.
passRateDelta() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the passRateDelta record component.
passRateDelta() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the passRateDelta record component.
passRateDelta() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the passRateDelta record component.
passRateDelta() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the passRateDelta record component.
passRateDelta() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the passRateDelta record component.
passRateImproved() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the passRateImproved record component.
passRateRegressed() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the passRateRegressed record component.
passRateSignificance() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the passRateSignificance record component.
pattern(String) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Sets the regular expression pattern.
payload() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
Returns the value of the payload record component.
PENDING - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
 
PENDING - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
 
permutationIterations() - Method in class dev.dokimos.core.gate.GateConfig
 
permutationIterations(int) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
Permutation iteration count.
permutationIterations(int) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
persistPage(UUID, List<JudgeJobTransactions.ScoredResult>, UUID) - Method in class dev.dokimos.server.service.JudgeJobTransactions
Persists a page of eval results and advances the job's seek cursor in one transaction.
persona(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Sets a short persona description.
Per-turn windowing - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Section
poll() - Method in class dev.dokimos.server.service.JudgeWorker
Polls for and processes one job per cycle.
poll() - Method in class dev.dokimos.server.service.TraceEvalWorker
Polls for and processes one job per cycle.
POSITIONAL - Enum constant in enum class dev.dokimos.core.gate.GateConfig.Pairing
Always pair by position ("item-<index>" keys).
PRECISION - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Matched divided by the number of actual calls.
PrecisionEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that measures retrieval precision.
PrecisionEvaluator.Builder - Class in dev.dokimos.core.evaluators
Builder for constructing PrecisionEvaluator instances.
prettyWriter() - Static method in class dev.dokimos.core.internal.Json
A thread-safe writer producing pretty-printed JSON.
pricedItemCount() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the pricedItemCount record component.
PriceTable - Interface in dev.dokimos.core
Turns a model id and token counts into a USD cost, returning null when the model is unknown or a count is missing (never throws, never fabricates a number).
principal(HttpServletRequest) - Static method in class dev.dokimos.server.tenant.TenantScopeResolver
Resolves the principal behind a request, falling back to the system principal when the auth filter did not set one.
Principal - Record Class in dev.dokimos.server.filter
Authenticated caller.
Principal(String, Role, String) - Constructor for record class dev.dokimos.server.filter.Principal
Creates an instance of a Principal record class.
PRINCIPAL_ATTRIBUTE - Static variable in class dev.dokimos.server.filter.ApiKeyAuthFilter
Request attribute holding the authenticated Principal.
principalId(HttpServletRequest) - Static method in class dev.dokimos.server.tenant.TenantScopeResolver
Resolves the principal id of the current request, or null when no principal is present.
problemResolution() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating problem resolution.
professionalTone() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating professional tone.
project(ExperimentResult, GateConfig) - Static method in class dev.dokimos.core.gate.BaselineStore
Projects an experiment result into the v1 baseline format (no I/O).
Project - Class in dev.dokimos.server.entity
A project groups experiments.
Project(String) - Constructor for class dev.dokimos.server.entity.Project
 
ProjectController - Class in dev.dokimos.server.controller.v1
 
ProjectController(ProjectService, ExperimentService, RunService) - Constructor for class dev.dokimos.server.controller.v1.ProjectController
 
projectId() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns the value of the projectId record component.
projectId() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the projectId record component.
projectId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the projectId record component.
projectId() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the projectId record component.
projectId() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
Returns the value of the projectId record component.
projectName() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the projectName record component.
projectName() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the projectName record component.
projectName() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the projectName record component.
projectName() - Method in record class dev.dokimos.server.dto.v1.TrendData
Returns the value of the projectName record component.
projectName() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the projectName record component.
projectName(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
Project name on the server.
ProjectRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for Project.
ProjectRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for Project, implemented over the tenant-scoped query helper.
ProjectRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the Project finders.
ProjectRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
 
ProjectService - Class in dev.dokimos.server.service
 
ProjectService(ProjectRepository) - Constructor for class dev.dokimos.server.service.ProjectService
 
ProjectSummary - Record Class in dev.dokimos.server.dto.v1
 
ProjectSummary(UUID, String, long, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ProjectSummary
Creates an instance of a ProjectSummary record class.
promote(PromoteRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
Promotes run item results into a new immutable version of an existing dataset.
promote(PromoteRequest, String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
Promotes run item results into a new version of an existing dataset.
PromoteItem(UUID, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
Creates an instance of a PromoteItem record class.
PromoteRequest - Record Class in dev.dokimos.server.dto.v1
Payload for promoting run item results into a new version of an existing dataset.
PromoteRequest(String, String, List<PromoteRequest.PromoteItem>) - Constructor for record class dev.dokimos.server.dto.v1.PromoteRequest
Creates an instance of a PromoteRequest record class.
PromoteRequest.PromoteItem - Record Class in dev.dokimos.server.dto.v1
A single run item result to promote.
protocol() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns the value of the protocol record component.
protocol() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns the value of the protocol record component.
protocol() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns the value of the protocol record component.
provenance() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the provenance record component.
Provenance(String, BaselineFile.JudgeInfo) - Constructor for record class dev.dokimos.core.gate.BaselineFile.Provenance
Creates an instance of a Provenance record class.
provideArguments(ExtensionContext) - Method in class dev.dokimos.junit.DatasetArgumentsProvider
 
pValue() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns the value of the pValue record component.
pValue() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns the value of the pValue record component.
pValue() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns the value of the pValue record component.

R

RAG Evaluation - Search tag in class dev.dokimos.langchain4j.LangChain4jSupport
Section
ragTask(Function<String, Result<String>>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a RAG evaluation Task from a function that returns Result.
ragTask(Function<String, Result<String>>, String, String, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a RAG evaluation Task with custom key names.
reactiveStringTask(Function<Example, Mono<String>>) - Static method in class dev.dokimos.springai.SpringAiSupport
Adapts a Reactor Mono of String output to an AsyncTask, wrapping the emitted string under the default output key.
reactiveTask(Function<Example, Mono<TaskResult>>) - Static method in class dev.dokimos.springai.SpringAiSupport
Adapts a Reactor Mono of TaskResult to an AsyncTask.
read(String, TypeReference<T>) - Static method in class dev.dokimos.core.internal.Json
Parses a JSON string into the generic target captured by a Jackson TypeReference, using the strict comparison reader so duplicate object keys are rejected alongside the NaN/Infinity and trailing-token tightening that applies to every reader.
read(String, JavaType) - Static method in class dev.dokimos.core.internal.Json
Parses a JSON string into an instance described by a Jackson JavaType, supporting generic targets such as List<Foo>.
read(String, Class<T>) - Static method in class dev.dokimos.core.internal.Json
Parses a JSON string into an instance of type.
read(Path) - Static method in class dev.dokimos.core.gate.BaselineStore
Reads and validates a baseline file.
reader() - Static method in class dev.dokimos.core.internal.Json
A thread-safe reader over the shared, immutable mapper.
reason() - Method in record class dev.dokimos.core.EvalResult
Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Returns the value of the reason record component.
reason(String) - Method in class dev.dokimos.core.EvalResult.Builder
Sets the reason or explanation.
reasoningSteps() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns the value of the reasoningSteps record component.
reasoningSteps(List<String>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Sets all reasoning steps.
RECALL - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Matched divided by the number of expected calls.
RecallEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that measures retrieval recall.
RecallEvaluator.Builder - Class in dev.dokimos.core.evaluators
Builder for constructing RecallEvaluator instances.
recordFailure(UUID, String, boolean, int) - Method in class dev.dokimos.server.service.JudgeJobTransactions
Records a failure.
recordFailure(UUID, String, boolean, int) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
Records a failure.
recoverStaleClaims(Instant) - Method in class dev.dokimos.server.service.JudgeJobTransactions
Returns jobs orphaned by a crashed worker (claimed before the cutoff and never finished) to PENDING so the next poll can reclaim them.
recoverStaleClaims(Instant) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
Returns jobs orphaned by a crashed worker (claimed before the cutoff and never finished) to PENDING so the next poll can reclaim them.
RegexEvaluator - Class in dev.dokimos.core.evaluators
Evaluator that checks if the actual output matches a regular expression pattern.
RegexEvaluator.Builder - Class in dev.dokimos.core.evaluators
 
register(DatasetResolver) - Method in class dev.dokimos.core.DatasetResolverRegistry
Registers a custom resolver with the highest priority.
REGRESSED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
The candidate is meaningfully and significantly worse than the baseline.
RegressedCase(String, String, List<GateVerdict.EvaluatorDrop>) - Constructor for record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Creates an instance of a RegressedCase record class.
RegressedCase(String, String, List<GateResult.EvaluatorDrop>) - Constructor for record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Creates an instance of a RegressedCase record class.
regressedCaseCount() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the regressedCaseCount record component.
regressedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the regressedCount record component.
regressedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the regressedCount record component.
regressedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the regressedCount record component.
regressedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the regressedCount record component.
RegressedEvaluator(String, Double, Double, double, double) - Constructor for record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Creates an instance of a RegressedEvaluator record class.
RegressedEvaluator(String, Double, Double, double, double) - Constructor for record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Creates an instance of a RegressedEvaluator record class.
regressedEvaluators() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the regressedEvaluators record component.
regressedEvaluators() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the regressedEvaluators record component.
RegressionAlertEvent - Record Class in dev.dokimos.server.service
Published inside the run-completion transaction when a run regresses, and consumed only after that transaction commits.
RegressionAlertEvent(UUID, RegressionAlertPayload) - Constructor for record class dev.dokimos.server.service.RegressionAlertEvent
Creates an instance of a RegressionAlertEvent record class.
RegressionAlertPayload - Record Class in dev.dokimos.server.dto.v1
JSON body POSTed to a project's alert webhooks when a completed run regresses against its baseline.
RegressionAlertPayload(String, UUID, String, UUID, UUID, double, double, double, int) - Constructor for record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Creates an instance of a RegressionAlertPayload record class.
RegressionAlertService - Class in dev.dokimos.server.service
Computes, inside the run-completion transaction, whether a just-completed run regressed against its baseline, and publishes a RegressionAlertEvent when it did.
RegressionAlertService(ExperimentRunRepository, ComparisonSupport, ApplicationEventPublisher) - Constructor for class dev.dokimos.server.service.RegressionAlertService
 
RegressionGate - Class in dev.dokimos.core.gate
Compares a candidate experiment result against a committed baseline and produces a GateVerdict.
RegressionGateRunner - Class in dev.dokimos.core.gate
The run lifecycle around RegressionGate: resolves whether to update, bootstrap, or compare a baseline, performs the file I/O, and turns a FAIL verdict into an AssertionError.
RegressionGateRunner.Environment - Interface in dev.dokimos.core.gate
Reads the outside world the lifecycle depends on.
regressions() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Evaluator deltas flagged as significant regressions.
rejected() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
Returns the value of the rejected record component.
rejectedSpans() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
Returns the value of the rejectedSpans record component.
REMOVED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
The item exists only in the baseline.
removedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the removedCount record component.
removedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the removedCount record component.
removedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the removedCount record component.
removedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the removedCount record component.
reporter(Reporter) - Method in class dev.dokimos.core.Experiment.Builder
Sets the reporter for this experiment.
Reporter - Interface in dev.dokimos.core
Interface for reporting experiment results to an external system.
reportItem(RunHandle, ItemResult) - Method in class dev.dokimos.core.NoOpReporter
 
reportItem(RunHandle, ItemResult) - Method in interface dev.dokimos.core.Reporter
Reports a single evaluated item.
reportItem(RunHandle, ItemResult) - Method in class dev.dokimos.server.client.DokimosServerReporter
 
requeueStaleClaims(Instant) - Method in interface dev.dokimos.server.repository.EvalJobRepository
Returns jobs claimed before the cutoff to PENDING so a job orphaned by a crashed worker is picked up again rather than stranded in CLAIMED forever.
requeueStaleClaims(Instant) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
Returns jobs claimed before the cutoff to PENDING so a job orphaned by a crashed worker is picked up again rather than stranded in CLAIMED forever.
requiredParameters() - Method in record class dev.dokimos.core.agents.ToolDefinition
Extracts required parameter names from the input schema.
requireTerminal(ExperimentRun, String) - Method in class dev.dokimos.server.service.ComparisonSupport
A run can be gated, diffed, or used as a baseline only once it has reached a terminal status.
reset() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Clears all captured state so this collector can observe a fresh run.
resolve(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver
 
resolve(String) - Method in interface dev.dokimos.core.DatasetResolver
Resolve the URI to a Dataset.
resolve(String) - Method in class dev.dokimos.core.DatasetResolverRegistry
Resolves a URI to a dataset using the first matching resolver.
resolve(String) - Method in class dev.dokimos.core.FileDatasetResolver
 
resolve(String) - Method in class dev.dokimos.server.client.ServerDatasetResolver
Fetches the dataset at the URI from the server, applying retries on 5xx responses and falling back to the offline cache when a pinned version is unreachable.
resolveKey(LlmConnection) - Method in class dev.dokimos.server.service.LlmCredentialService
Resolves the effective plaintext API key for a connection.
resolveParameter(ParameterContext, ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
 
resolveType(Type) - Static method in class dev.dokimos.core.internal.Json
Resolves a Jackson JavaType from a generic Type.
resource() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
Returns the value of the resource record component.
resourceSpans() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
Returns the value of the resourceSpans record component.
respond(ConversationTrajectory) - Method in interface dev.dokimos.core.conversation.ConversationalApplication
Generates a response to the current conversation state.
responseRelevance() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating response relevance.
RESPONSES - Enum constant in enum class dev.dokimos.server.entity.LlmConnectionProtocol
The Responses API (POST {baseUrl}/responses, input items, output_text results).
restricted() - Method in record class dev.dokimos.server.tenant.TenantScope
Returns the value of the restricted record component.
result() - Method in record class dev.dokimos.core.agents.ToolCall
Returns the value of the result record component.
result() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Returns the value of the result record component.
result(String) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Sets the tool execution result.
Result(List<OtlpTraceParser.ParsedSpan>, int) - Constructor for record class dev.dokimos.server.service.OtlpTraceParser.Result
Creates an instance of a Result record class.
resultAs(OutputType<T>) - Method in record class dev.dokimos.core.agents.ToolCall
Deserializes this tool call's result string into a generic target captured by an OutputType token, for example new OutputType<List<Order>>() {}.
resultAs(Class<T>) - Method in record class dev.dokimos.core.agents.ToolCall
Deserializes this tool call's result string into an instance of type.
resultJson(Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder
Sets the tool execution result from an arbitrary value by serializing it to compact (single-line) JSON and storing it in the same result string component used by ToolCall.Builder.result(String).
ResultStore - Interface in dev.dokimos.mcp.store
Persistence layer for evaluation run records.
retrievalContextKey(String) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Sets the key used to retrieve context chunks from actualOutputs.
retrievedKey(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Sets the key for retrieved items in actualOutputs.
retrievedKey(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Sets the key for retrieved items in actualOutputs.
ReviewQueueController - Class in dev.dokimos.server.controller.v1
 
ReviewQueueController(ReviewQueueService) - Constructor for class dev.dokimos.server.controller.v1.ReviewQueueController
 
ReviewQueueItem - Record Class in dev.dokimos.server.dto.v1
A run item surfaced in the review queue because it still needs a human verdict, carrying enough run, experiment, and project context for a reviewer to act on it without opening the run first.
ReviewQueueItem(UUID, UUID, UUID, String, String, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<RunDetails.EvalSummary>, AnnotationVerdict, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ReviewQueueItem
Creates an instance of a ReviewQueueItem record class.
ReviewQueueService - Class in dev.dokimos.server.service
Surfaces run items that still need a human verdict so a reviewer can work through a single queue instead of opening runs one at a time.
ReviewQueueService(ItemResultRepository, AnnotationRepository) - Constructor for class dev.dokimos.server.service.ReviewQueueService
 
role() - Method in record class dev.dokimos.core.conversation.Message
Returns the value of the role record component.
role() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the role record component.
role() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Returns the value of the role record component.
role() - Method in record class dev.dokimos.server.filter.Principal
Returns the value of the role record component.
Role - Enum Class in dev.dokimos.server.filter
Role granted to an authenticated Principal.
rootSpanName() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the rootSpanName record component.
rootSpanName() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the rootSpanName record component.
ruleId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the ruleId record component.
run() - Method in class dev.dokimos.core.Experiment
Runs the experiment and returns the aggregated results.
run(Example) - Method in interface dev.dokimos.core.AsyncTask
Runs the task on the given Example and returns a future of its result.
run(Example) - Method in interface dev.dokimos.core.MeasuredTask
Run the task on the given Example and produce a result with optional metrics.
run(Example) - Method in interface dev.dokimos.core.Task
Run the task on the given Example and produce outputs.
run(ExperimentResult, Path, GateConfig, RegressionGateRunner.Environment) - Static method in class dev.dokimos.core.gate.RegressionGateRunner
Runs the gate lifecycle for one candidate against one baseline path.
RunComparison - Class in dev.dokimos.core.comparison
Regression-comparison engine that compares a baseline set of runs against a candidate set.
RunComparison.Builder - Class in dev.dokimos.core.comparison
Builder for RunComparison.
RunComparisonResult - Record Class in dev.dokimos.core.comparison
Result of comparing a baseline set of runs against a candidate set.
RunComparisonResult(double, double, double, SignificanceResult, boolean, boolean, int, int, int, int, int, int, int, List<EvaluatorDelta>, List<ItemComparison>) - Constructor for record class dev.dokimos.core.comparison.RunComparisonResult
Creates an instance of a RunComparisonResult record class.
RunController - Class in dev.dokimos.server.controller.v1
 
RunController(RunService) - Constructor for class dev.dokimos.server.controller.v1.RunController
 
runCount() - Method in record class dev.dokimos.core.ExperimentResult
Returns the number of runs performed.
RunDetails - Record Class in dev.dokimos.server.dto.v1
Detail view of a single run.
RunDetails(UUID, UUID, String, String, RunStatus, Map<String, Object>, long, long, Double, Instant, Instant, UUID, Integer, Long, Long, Double, Double, Long, Long, Page<RunDetails.ItemSummary>) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails
Creates an instance of a RunDetails record class.
RunDetails.EvalSummary - Record Class in dev.dokimos.server.dto.v1
 
RunDetails.ItemSummary - Record Class in dev.dokimos.server.dto.v1
 
RunHandle - Record Class in dev.dokimos.core
A handle representing an active experiment run.
RunHandle(String) - Constructor for record class dev.dokimos.core.RunHandle
Creates a new run handle.
runId() - Method in record class dev.dokimos.core.RunHandle
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns the value of the runId record component.
runIndex() - Method in record class dev.dokimos.core.RunResult
Returns the value of the runIndex record component.
RUNNING - Enum constant in enum class dev.dokimos.server.entity.RunStatus
 
RunPoint(UUID, Instant, double, long, long) - Constructor for record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Creates an instance of a RunPoint record class.
RunRecord - Record Class in dev.dokimos.mcp.store
Persistent record of a single evaluation run.
RunRecord(String, Instant, String, String, String, Map<String, Object>, double, int, int, int, Map<String, Double>, List<RunRecord.ItemDetail>) - Constructor for record class dev.dokimos.mcp.store.RunRecord
Creates an instance of a RunRecord record class.
RunRecord.EvalDetail - Record Class in dev.dokimos.mcp.store
Single evaluator result for one example.
RunRecord.ItemDetail - Record Class in dev.dokimos.mcp.store
Detail for a single evaluated example.
RunResult - Record Class in dev.dokimos.core
Results from a single run of an experiment.
RunResult(int, List<ItemResult>) - Constructor for record class dev.dokimos.core.RunResult
Creates an instance of a RunResult record class.
runResults() - Method in record class dev.dokimos.core.ExperimentResult
Returns the value of the runResults record component.
runs() - Method in record class dev.dokimos.core.ExperimentResult
Returns the individual run results for detailed analysis.
runs() - Method in record class dev.dokimos.server.dto.v1.TrendData
Returns the value of the runs record component.
runs(int) - Method in class dev.dokimos.core.Experiment.Builder
Sets the number of times to run the experiment.
RunService - Class in dev.dokimos.server.service
 
RunService(ExperimentRunRepository, ItemResultRepository, IngestedBatchRepository, DatasetService, DatasetItemRepository, AnnotationRepository, RegressionAlertService) - Constructor for class dev.dokimos.server.service.RunService
 
runsPerItem() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns the value of the runsPerItem record component.
RunStatus - Enum Class in dev.dokimos.core
Status of an experiment run.
RunStatus - Enum Class in dev.dokimos.server.entity
 
RunSummary - Record Class in dev.dokimos.server.dto.v1
Summary view of a single run in a list.
RunSummary(UUID, RunStatus, Map<String, Object>, long, long, Double, Instant, Instant, UUID, Integer, Long, Long, Double, Double) - Constructor for record class dev.dokimos.server.dto.v1.RunSummary
Creates an instance of a RunSummary record class.

S

safety() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating safety and appropriateness.
satisfiedCustomer(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated satisfied customer who is cooperative and positive.
save(RunRecord) - Method in class dev.dokimos.mcp.store.JsonResultStore
 
save(RunRecord) - Method in interface dev.dokimos.mcp.store.ResultStore
Saves a run record.
save(S) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
 
save(S) - Method in interface dev.dokimos.server.tenant.ScopedRepository
Persists a new or updated entity.
saveAll(Iterable<S>) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
 
saveAll(Iterable<S>) - Method in interface dev.dokimos.server.tenant.ScopedRepository
Persists all the given entities.
scenario() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the value of the scenario record component.
scenario(String) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Sets the scenario description for the conversation.
scenario(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Sets the scenario description.
SCHEME - Static variable in class dev.dokimos.server.client.ServerDatasetResolver
URI scheme handled by this resolver.
scope(HttpServletRequest) - Static method in class dev.dokimos.server.tenant.TenantScopeResolver
Resolves the tenant scope the current request reads and writes under, using the principal's own scope and failing closed to a shared-only scope when no principal is present.
scoped(String) - Static method in record class dev.dokimos.server.tenant.TenantScope
Returns a scope restricted to the given tenant.
ScopedRepository<T> - Interface in dev.dokimos.server.tenant
Common tenant-scoped operations shared by every scoped repository.
scopeSpans() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
Returns the value of the scopeSpans record component.
score() - Method in record class dev.dokimos.core.EvalResult
Returns the value of the score record component.
score() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Returns the value of the score record component.
score() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Returns the value of the score record component.
score() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Returns the value of the score record component.
score() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns the value of the score record component.
score() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns the value of the score record component.
score() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the score record component.
score() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Returns the value of the score record component.
score(double) - Method in class dev.dokimos.core.EvalResult.Builder
Sets the numeric score.
score(String, String, String) - Method in class dev.dokimos.server.judge.JudgeScorer
Scores one item.
ScoredResult(UUID, EvalResult) - Constructor for record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
Creates an instance of a ScoredResult record class.
ScoreOutcome(double, String, boolean) - Constructor for record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Creates an instance of a ScoreOutcome record class.
scoreRange(double, double) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Sets the expected score range for the LLM response.
scoreStdDev(String) - Method in record class dev.dokimos.core.ExperimentResult
Returns the sample standard deviation of scores for the specified evaluator across runs.
secret() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Returns the value of the secret record component.
secret() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Returns the value of the secret record component.
seed() - Method in class dev.dokimos.core.gate.GateConfig
 
seed(long) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
Seed for permutation and bootstrap procedures.
seed(long) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
ServerDatasetResolver - Class in dev.dokimos.server.client
Resolves dataset URIs of the form dataset://<name>@<version> against a Dokimos server.
ServerDatasetResolver() - Constructor for class dev.dokimos.server.client.ServerDatasetResolver
Creates a resolver wired to DOKIMOS_SERVER_URL / DOKIMOS_API_KEY.
serverUrl(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
Dokimos server URL, e.g.
setApiKey(String) - Method in class dev.dokimos.server.config.ApiKeyProperties
 
setAttemptCount(int) - Method in class dev.dokimos.server.entity.EvalJob
 
setAttemptCount(int) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setAttributes(Map<String, Object>) - Method in class dev.dokimos.server.entity.TraceSpan
 
setAvgLatencyMs(Double) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setBaseUrl(String) - Method in class dev.dokimos.server.entity.LlmConnection
 
setClaimedAt(Instant) - Method in class dev.dokimos.server.entity.EvalJob
 
setClaimedAt(Instant) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setClaimTimeoutMs(long) - Method in class dev.dokimos.server.config.JudgeProperties
 
setClaimTimeoutMs(long) - Method in class dev.dokimos.server.config.TraceProperties.Eval
 
setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.EvalJob
 
setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setConnection(LlmConnection) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setCostUsd(Double) - Method in class dev.dokimos.server.entity.ItemResult
 
setCreatedBy(String) - Method in class dev.dokimos.server.entity.Annotation
 
setCredentialRef(String) - Method in class dev.dokimos.server.entity.LlmConnection
 
setCriteria(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setDatasetItem(DatasetItem) - Method in class dev.dokimos.server.entity.ItemResult
 
setDatasetVersion(DatasetVersion) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setDescription(String) - Method in class dev.dokimos.server.entity.Dataset
 
setEnabled(boolean) - Method in class dev.dokimos.server.entity.AlertWebhook
 
setEnabled(boolean) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setEncryptedApiKey(String) - Method in class dev.dokimos.server.entity.LlmConnection
 
setEncryptionKey(String) - Method in class dev.dokimos.server.config.ApiKeyProperties
 
setEndTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.Trace
 
setEndTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.TraceSpan
 
setEvaluationParams(String) - Method in class dev.dokimos.server.entity.EvalJob
 
setEvaluatorName(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setExpiresAt(Instant) - Method in class dev.dokimos.server.entity.Trace
 
setGitBranch(String) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setGitSha(String) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setInputText(String) - Method in class dev.dokimos.server.entity.TraceSpan
 
setItemCount(int) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setKind(String) - Method in class dev.dokimos.server.entity.TraceSpan
 
setLastError(String) - Method in class dev.dokimos.server.entity.EvalJob
 
setLastError(String) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setLastItemId(UUID) - Method in class dev.dokimos.server.entity.EvalJob
 
setLatencyMs(Long) - Method in class dev.dokimos.server.entity.ItemResult
 
setMatchKey(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setMatchType(TraceMatchType) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setMatchValue(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setMaxAttempts(int) - Method in class dev.dokimos.server.config.JudgeProperties
 
setMaxAttempts(int) - Method in class dev.dokimos.server.config.TraceProperties.Eval
 
setMaxScore(double) - Method in class dev.dokimos.server.entity.EvalJob
 
setMaxScore(double) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setMetadata(Map<String, Object>) - Method in class dev.dokimos.server.entity.EvalResult
 
setMinScore(double) - Method in class dev.dokimos.server.entity.EvalJob
 
setMinScore(double) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setModel(String) - Method in class dev.dokimos.server.entity.LlmConnection
 
setName(String) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setName(String) - Method in class dev.dokimos.server.entity.LlmConnection
 
setName(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setNote(String) - Method in class dev.dokimos.server.entity.Annotation
 
setOutputText(String) - Method in class dev.dokimos.server.entity.TraceSpan
 
setOverriddenExpectedOutput(Map<String, Object>) - Method in class dev.dokimos.server.entity.Annotation
 
setPageSize(int) - Method in class dev.dokimos.server.config.JudgeProperties
 
setParentSpanId(String) - Method in class dev.dokimos.server.entity.TraceSpan
 
setPassedCount(int) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setPassRate(Double) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setPollIntervalMs(long) - Method in class dev.dokimos.server.config.JudgeProperties
 
setPollIntervalMs(long) - Method in class dev.dokimos.server.config.TraceProperties.Eval
 
setProjectId(UUID) - Method in class dev.dokimos.server.entity.Trace
 
setProtocol(LlmConnectionProtocol) - Method in class dev.dokimos.server.entity.LlmConnection
 
setReason(String) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setRetentionDays(int) - Method in class dev.dokimos.server.config.TraceProperties
 
setRootSpanName(String) - Method in class dev.dokimos.server.entity.Trace
 
setScore(Double) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setSecret(String) - Method in class dev.dokimos.server.entity.AlertWebhook
 
setSpanCount(int) - Method in class dev.dokimos.server.entity.Trace
 
setStartTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.Trace
 
setStartTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.TraceSpan
 
setStatus(EvalJobStatus) - Method in class dev.dokimos.server.entity.EvalJob
 
setStatus(RunStatus) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setStatus(TraceEvalJobStatus) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setStatusCode(String) - Method in class dev.dokimos.server.entity.TraceSpan
 
setSuccess(Boolean) - Method in class dev.dokimos.server.entity.TraceEvalJob
 
setSweepIntervalMs(long) - Method in class dev.dokimos.server.config.TraceProperties
 
setTenantId(String) - Method in class dev.dokimos.server.entity.AlertWebhook
 
setTenantId(String) - Method in class dev.dokimos.server.entity.Annotation
 
setTenantId(String) - Method in class dev.dokimos.server.entity.Dataset
 
setTenantId(String) - Method in class dev.dokimos.server.entity.DatasetItem
 
setTenantId(String) - Method in class dev.dokimos.server.entity.DatasetVersion
 
setTenantId(String) - Method in class dev.dokimos.server.entity.EvalResult
 
setTenantId(String) - Method in class dev.dokimos.server.entity.Experiment
 
setTenantId(String) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setTenantId(String) - Method in class dev.dokimos.server.entity.ItemResult
 
setTenantId(String) - Method in class dev.dokimos.server.entity.LlmConnection
 
setTenantId(String) - Method in class dev.dokimos.server.entity.Project
 
setTenantId(String) - Method in class dev.dokimos.server.entity.Trace
 
setTenantId(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setTenantId(String) - Method in class dev.dokimos.server.entity.TraceSpan
 
setThreshold(Double) - Method in class dev.dokimos.server.entity.EvalJob
 
setThreshold(Double) - Method in class dev.dokimos.server.entity.TraceEvalRule
 
setTokensIn(Integer) - Method in class dev.dokimos.server.entity.ItemResult
 
setTokensOut(Integer) - Method in class dev.dokimos.server.entity.ItemResult
 
setTotalCostUsd(Double) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setTotalTokensIn(Long) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setTotalTokensOut(Long) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setTrace(Trace) - Method in class dev.dokimos.server.entity.TraceSpan
 
setTriggeredBy(String) - Method in class dev.dokimos.server.entity.ExperimentRun
 
setUrl(String) - Method in class dev.dokimos.server.entity.AlertWebhook
 
setVerdict(AnnotationVerdict) - Method in class dev.dokimos.server.entity.Annotation
 
severityMargin() - Method in class dev.dokimos.core.gate.GateConfig
 
severityMargin(double) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
sha256Hex(String) - Static method in class dev.dokimos.server.filter.ApiKeyHasher
Returns the lowercase SHA-256 hex digest of the given key.
significance() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns the value of the significance record component.
SignificanceResult - Record Class in dev.dokimos.core.comparison
Outcome of a statistical significance test on a paired comparison.
SignificanceResult(String, double, boolean, Double, Double) - Constructor for record class dev.dokimos.core.comparison.SignificanceResult
Creates an instance of a SignificanceResult record class.
significant() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns the value of the significant record component.
significant() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the significant record component.
significant() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns the value of the significant record component.
significant() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the significant record component.
significant() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the significant record component.
significantImprovedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the significantImprovedCount record component.
significantRegressedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the significantRegressedCount record component.
simpleTask(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a simple Task for Q&A evaluation.
simpleTask(ChatModel, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Creates a simple Task for Q&A evaluation that writes the response under a caller-chosen key.
simulate() - Method in class dev.dokimos.core.conversation.ConversationSimulator
Runs the conversation simulation.
simulateAsync() - Method in class dev.dokimos.core.conversation.ConversationSimulator
Runs the conversation simulation asynchronously using the common fork-join pool.
simulateAsync(ExecutorService) - Method in class dev.dokimos.core.conversation.ConversationSimulator
Runs the conversation simulation asynchronously using the provided executor.
simulatedUser(SimulatedUser) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Sets the simulated user for the conversation.
SimulatedUser - Interface in dev.dokimos.core.conversation
Functional interface for simulating user behavior in multi-turn conversations.
size() - Method in record class dev.dokimos.core.Dataset
Returns the number of examples in the dataset.
size() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the size record component.
sort() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns the value of the sort record component.
sort() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the sort record component.
sorted() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Returns the value of the sorted record component.
SPAN_NAME - Enum constant in enum class dev.dokimos.server.entity.TraceMatchType
 
spanCount() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the spanCount record component.
spanCount() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the spanCount record component.
spanId() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the spanId record component.
spanId() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the spanId record component.
spanId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the spanId record component.
spanId() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the spanId record component.
spans() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
Returns the value of the spans record component.
spans() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the spans record component.
spans() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
Returns the value of the spans record component.
SpanView - Record Class in dev.dokimos.server.dto.v1
Public view of a TraceSpan, including its derived input/output text and flattened attributes.
SpanView(UUID, String, String, String, String, String, Long, Long, String, String, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.SpanView
Creates an instance of a SpanView record class.
SpaResourceConfig - Class in dev.dokimos.server.config
Serves the single-page React app and forwards client side routes to index.html so a deep link or a page refresh on a route such as /traces or /api-keys is handled by the SPA router instead of returning 404.
SpaResourceConfig() - Constructor for class dev.dokimos.server.config.SpaResourceConfig
 
spoolDirectory(Path) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
Opt-in durable spool directory.
SpringAiAlibabaSupport - Class in dev.dokimos.springai.alibaba
Utilities for evaluating Spring AI Alibaba (graph/agent) runs with the Dokimos agent evaluators.
SpringAiAlibabaSupport.AlibabaAgentResponse - Record Class in dev.dokimos.springai.alibaba
A Spring AI Alibaba agent run's output text paired with optional token usage, consumed by SpringAiAlibabaSupport.measuredAsyncTask(Function, String, PriceTable).
SpringAiSupport - Class in dev.dokimos.springai
Utilities for integrating with Spring AI.
stampTenantId() - Method in record class dev.dokimos.server.tenant.TenantScope
Returns the tenant id to stamp on a newly written row, or null for a shared row (the unrestricted and shared-only scopes).
startedAt() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Returns the value of the startedAt record component.
startedAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the startedAt record component.
startedAt() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the startedAt record component.
startedAt() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns the value of the startedAt record component.
startRun(String, Map<String, Object>) - Method in class dev.dokimos.core.NoOpReporter
 
startRun(String, Map<String, Object>) - Method in interface dev.dokimos.core.Reporter
Starts a new experiment run.
startRun(String, Map<String, Object>) - Method in class dev.dokimos.server.client.DokimosServerReporter
 
startTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the startTimeUnixNano record component.
startTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the startTimeUnixNano record component.
startTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the startTimeUnixNano record component.
startTimeUnixNano() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the startTimeUnixNano record component.
status() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns the value of the status record component.
status() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns the value of the status record component.
status() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
Returns the value of the status record component.
statusCode() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns the value of the statusCode record component.
statusCode() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the statusCode record component.
stoppingCondition(Predicate<ConversationTrajectory>) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
Sets a stopping condition for early termination.
STRICT - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Same length, same order, each position matches.
STRICT - Enum constant in enum class dev.dokimos.core.evaluators.StructuralMatchMode
Strict comparison (the eval-safe default).
strictMode(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Enables strict mode which fails on any unexpected parameter.
strictMode(boolean) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Enables or disables strict mode.
stringValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns the value of the stringValue record component.
stripMarkdown(String) - Static method in class dev.dokimos.core.LlmResponseUtils
Strips markdown code block formatting from an LLM response.
StructuralMatchEvaluator - Class in dev.dokimos.core.evaluators
Compares the actual output against the expected output as JSON structures rather than as opaque strings.
StructuralMatchEvaluator.Builder - Class in dev.dokimos.core.evaluators
Builder for constructing structural match evaluators.
StructuralMatchMode - Enum Class in dev.dokimos.core.evaluators
Controls how StructuralMatchEvaluator compares an expected JSON structure against an actual one.
SUBSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
Expected entries are a subset of the actual arguments (extras allowed).
SUBSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Every actual call has a distinct match in expected.
SUCCEEDED - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
 
SUCCEEDED - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
 
success() - Method in record class dev.dokimos.core.EvalResult
Returns the value of the success record component.
success() - Method in record class dev.dokimos.core.ItemResult
 
success() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Returns the value of the success record component.
success() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Returns the value of the success record component.
success(String, double, String) - Static method in record class dev.dokimos.core.EvalResult
Creates a successful result.
SUCCESS - Enum constant in enum class dev.dokimos.core.RunStatus
The run completed successfully.
SUCCESS - Enum constant in enum class dev.dokimos.server.entity.RunStatus
 
sumCostByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Sums the call cost across a run's items.
summary() - Method in record class dev.dokimos.server.dto.v1.DiffView
Returns the value of the summary record component.
sumTokensInByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Sums the prompt tokens across a run's items.
sumTokensOutByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
Sums the completion tokens across a run's items.
SUPERSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
Actual entries are a subset of the expected arguments (omissions allowed).
SUPERSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Every expected call has a distinct match in actual.
supports(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver
 
supports(String) - Method in interface dev.dokimos.core.DatasetResolver
Check if this resolver supports the given URI.
supports(String) - Method in class dev.dokimos.core.FileDatasetResolver
 
supports(String) - Method in class dev.dokimos.server.client.ServerDatasetResolver
Indicates whether this resolver will attempt the given URI.
supportsParameter(ParameterContext, ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
Supports an optional DatasetRunExtension.DatasetItemRecorder test-method parameter.
sweep() - Method in class dev.dokimos.server.service.TraceRetentionSweeper
Deletes expired traces.
system() - Static method in record class dev.dokimos.server.filter.Principal
System principal used when no API key authentication is configured, or for reads in an open deployment.
system(String) - Static method in record class dev.dokimos.core.conversation.Message
Creates a system message.
SYSTEM - Enum constant in enum class dev.dokimos.core.conversation.Message.Role
A system message providing context or instructions.
systemEnvironment() - Static method in class dev.dokimos.core.gate.RegressionGateRunner
Returns the production environment: CI from CI/GITHUB_ACTIONS, the update flag from GateConfig.updateBaselineRequested(), the verdict directory at target/dokimos, and the log sink routed to this class's logger.
systemMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds a system message to the trajectory.
systemMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns only the system messages from the conversation.
systemPrompt(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Sets the complete system prompt directly.

T

task(Task) - Method in class dev.dokimos.core.Experiment.Builder
Sets the task.
Task - Interface in dev.dokimos.core
 
TaskCompletionEvaluator - Class in dev.dokimos.core.evaluators.agents
Evaluates whether an AI agent completed the user's requested tasks.
TaskCompletionEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
TaskResult - Record Class in dev.dokimos.core
The outcome of executing a MeasuredTask: the actual outputs and optional metrics describing the underlying LLM call.
TaskResult(Map<String, Object>, CallMetrics) - Constructor for record class dev.dokimos.core.TaskResult
Creates an instance of a TaskResult record class.
tasks(List<String>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
Sets the tasks the agent was asked to complete (the "tasks" key in metadata).
tasksKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets the metadata key for the task list.
technicalExpert(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
Creates a simulated technical expert who understands complex concepts.
temperature() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
Returns the value of the temperature record component.
tenantId() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns the value of the tenantId record component.
tenantId() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Returns the value of the tenantId record component.
tenantId() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the tenantId record component.
tenantId() - Method in record class dev.dokimos.server.filter.Principal
Returns the value of the tenantId record component.
tenantId() - Method in record class dev.dokimos.server.tenant.TenantScope
Returns the value of the tenantId record component.
TenantPredicate - Class in dev.dokimos.server.tenant
Builds the SQL/JPQL tenant predicate for a TenantScope against a tenant_id path.
tenantScope() - Method in record class dev.dokimos.server.filter.Principal
Resolves the TenantScope this principal reads and writes under.
TenantScope - Record Class in dev.dokimos.server.tenant
Immutable tenant visibility used by every scoped repository read and by service-side write stamping.
TenantScope(boolean, String) - Constructor for record class dev.dokimos.server.tenant.TenantScope
Creates an instance of a TenantScope record class.
TenantScopedFinder<T> - Class in dev.dokimos.server.tenant
Reusable tenant-scoped query helper shared by every scoped repository implementation.
TenantScopedFinder(EntityManager, Class<T>) - Constructor for class dev.dokimos.server.tenant.TenantScopedFinder
 
TenantScopeResolver - Class in dev.dokimos.server.tenant
Derives the TenantScope and principal id for the current request from the Principal the auth filter placed on the request attribute.
text() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Returns the value of the text record component.
threshold() - Method in class dev.dokimos.core.BaseEvaluator
 
threshold() - Method in record class dev.dokimos.core.EvalResult
Returns the value of the threshold record component.
threshold() - Method in interface dev.dokimos.core.Evaluator
Returns the minimum score threshold for success.
threshold() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Returns the value of the threshold record component.
threshold() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns the value of the threshold record component.
threshold() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns the value of the threshold record component.
threshold() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns the value of the threshold record component.
threshold() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns the value of the threshold record component.
threshold() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the threshold record component.
threshold(double) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.EvalResult.Builder
Sets the success threshold.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Sets the maximum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
Sets the minimum score threshold for success.
timestamp() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the timestamp record component.
toAgentOutputs() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Builds the actual-outputs map the agent evaluators read, identical in shape to AgentTrace.toOutputMap().
toAgentTrace() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Collapses the conversation into a single AgentTrace: the final response is the last assistant message's content (or empty), the tool calls are ConversationTrajectory.toolCalls(), reasoning is empty, and metadata carries the scenario and turn count.
toAgentTrace(ReactAgent, Map<String, Object>, RunnableConfig) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Runs a ReactAgent's compiled graph and folds the resulting state into a single AgentTrace.
toAgentTrace(OverAllState) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Folds the full multi-turn conversation of a graph run into a single AgentTrace.
toAgentTrace(ChatCompletionMessage) - Static method in class dev.dokimos.openai.OpenAiSupport
Builds an AgentTrace from an OpenAI ChatCompletionMessage.
toAgentTrace(ChatCompletionMessage, Function<String, String>) - Static method in class dev.dokimos.openai.OpenAiSupport
Builds an AgentTrace from an OpenAI ChatCompletionMessage, looking up each tool call's result by its id.
toAgentTrace(Result<?>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Builds an AgentTrace from a LangChain4j Result.
toAgentTrace(Optional<OverAllState>) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Folds the optional graph state returned by CompiledGraph.invoke(Map) into a single AgentTrace.
toAgentTrace(AssistantMessage) - Static method in class dev.dokimos.springai.SpringAiSupport
Builds an AgentTrace from a Spring AI AssistantMessage.
toAgentTrace(AssistantMessage, List<ToolResponseMessage>) - Static method in class dev.dokimos.springai.SpringAiSupport
Builds an AgentTrace from a Spring AI AssistantMessage and the tool responses produced for it.
toCsv() - Method in record class dev.dokimos.core.ExperimentResult
Returns the experiment result as a CSV string.
toCsv(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to a CSV string.
toDto(ExportTraceServiceRequest) - Static method in class dev.dokimos.server.service.OtlpProtobufConverter
Converts a decoded protobuf request into the common OTLP request DTO.
toEvaluationResponse(EvalResult) - Static method in class dev.dokimos.springai.SpringAiSupport
Converts a Dokimos EvalResult to a Spring AI EvaluationResponse.
toHtml() - Method in record class dev.dokimos.core.ExperimentResult
Returns the experiment result as an HTML string.
toHtml(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to an HTML string.
toJson() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Serializes the trajectory to JSON for debugging and logging.
toJson() - Method in record class dev.dokimos.core.ExperimentResult
Returns the experiment result as a JSON string.
toJson() - Method in record class dev.dokimos.core.gate.GateVerdict
Serializes to compact JSON, the shape the CI report action consumes.
toJson(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to a JSON string.
tokenizedItemCount() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the tokenizedItemCount record component.
tokensIn() - Method in record class dev.dokimos.core.CallMetrics
Returns the value of the tokensIn record component.
tokensIn() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the tokensIn record component.
tokensIn() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the tokensIn record component.
tokensIn() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Returns the value of the tokensIn record component.
tokensOut() - Method in record class dev.dokimos.core.CallMetrics
Returns the value of the tokensOut record component.
tokensOut() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns the value of the tokensOut record component.
tokensOut() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns the value of the tokensOut record component.
tokensOut() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Returns the value of the tokensOut record component.
tolerant() - Static method in interface dev.dokimos.core.evaluators.agents.ArgumentMatcher
Returns the default tolerant matcher using ArgMatchMode.EXACT.
TolerantArgumentMatcher - Class in dev.dokimos.core.evaluators.agents
Default ArgumentMatcher that compares arguments structurally with a few deliberate tolerances.
TolerantArgumentMatcher.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the matcher.
toMarkdown() - Method in record class dev.dokimos.core.ExperimentResult
Returns the experiment result as a Markdown string.
toMarkdown() - Method in record class dev.dokimos.core.gate.GateVerdict
Renders the verdict as CI-agnostic Markdown so any runner (GitLab, Jenkins, local) can post the same comment.
toMarkdown(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
Exports the experiment result to a Markdown string.
toNode(Object) - Static method in class dev.dokimos.core.internal.Json
Converts an arbitrary value to a JsonNode tree (the in-memory model the structural comparator works against).
ToolArgumentHallucinationEvaluator - Class in dev.dokimos.core.evaluators.agents
Uses a judge LLM to assess whether tool call argument values are factually grounded in the user's input and preceding tool call results.
ToolArgumentHallucinationEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolCall - Record Class in dev.dokimos.core.agents
Represents a single tool invocation made by an AI agent.
ToolCall(String, Map<String, Object>, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.ToolCall
Creates an instance of a ToolCall record class.
ToolCall.Builder - Class in dev.dokimos.core.agents
Builder for constructing tool calls.
toolCalls() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns the value of the toolCalls record component.
toolCalls() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Flattens every assistant turn's tool calls into one list, in chronological order.
toolCalls() - Method in record class dev.dokimos.core.conversation.Message
Returns the value of the toolCalls record component.
toolCalls() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Returns the tool calls captured so far, in execution order.
toolCalls(List<ToolCall>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
Sets all tool calls.
toolCalls(List<ToolCall>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
Sets the actual tool calls the agent made (the "toolCalls" key in actual outputs).
ToolCalls - Class in dev.dokimos.core.agents
Coercion helpers for turning a raw value into a typed List<ToolCall>.
toolCallsByTurn() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Groups tool calls per assistant turn, in order: one inner list per assistant message (each possibly empty).
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Sets the key used to retrieve tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Sets the key used to retrieve tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Sets the key used to retrieve actual tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
Sets the key used to retrieve tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Sets the key used to retrieve tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
Sets the key used to retrieve actual tool calls from actualOutputs.
ToolCallValidityEvaluator - Class in dev.dokimos.core.evaluators.agents
Validates that tool calls are syntactically correct per their JSON schema definitions.
ToolCallValidityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolCorrectnessEvaluator - Class in dev.dokimos.core.evaluators.agents
Checks whether the agent used the expected set of tools.
ToolCorrectnessEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolCorrectnessEvaluator.MatchMode - Enum Class in dev.dokimos.core.evaluators.agents
The comparison mode for evaluating tool correctness.
ToolDefinition - Record Class in dev.dokimos.core.agents
Describes an available tool's contract including its name, description, and JSON schema.
ToolDefinition(String, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.ToolDefinition
Creates an instance of a ToolDefinition record class.
ToolDefinition.Builder - Class in dev.dokimos.core.agents
Builder for constructing tool definitions.
ToolDescriptionReliabilityEvaluator - Class in dev.dokimos.core.evaluators.agents
Evaluates tool description quality using a mix of rule-based checks and optional LLM checks.
ToolDescriptionReliabilityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolEfficiencyEvaluator - Class in dev.dokimos.core.evaluators.agents
Measures how efficiently an agent used its tools by detecting redundant calls.
ToolEfficiencyEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolErrorEvaluator - Class in dev.dokimos.core.evaluators.agents
Detects tool execution failures by inspecting ToolCall.result().
ToolErrorEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolHandlers - Class in dev.dokimos.mcp
Implements the four MCP tool handlers for the dokimos evaluation framework.
ToolHandlers(ResultStore, ObjectMapper) - Constructor for class dev.dokimos.mcp.ToolHandlers
 
ToolNameReliabilityEvaluator - Class in dev.dokimos.core.evaluators.agents
Evaluates tool naming quality using a mix of rule-based checks and optional LLM checks.
ToolNameReliabilityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
toolNames() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns the set of tool names used in this trace.
tools(List<ToolDefinition>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
Sets the tools available to the agent (the "tools" key in metadata).
toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Sets the key used to retrieve tool definitions from metadata.
toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Sets the metadata key for tool definitions.
toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Sets the metadata key for tool definitions.
ToolTrajectoryEvaluator - Class in dev.dokimos.core.evaluators.agents
Evaluates an agent's tool-call trajectory against an expected trajectory using a selectable match mode.
ToolTrajectoryEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
Builder for constructing the evaluator.
ToolTrajectoryEvaluator.MatchMode - Enum Class in dev.dokimos.core.evaluators.agents
The comparison mode for evaluating a trajectory.
toOutputMap() - Method in record class dev.dokimos.core.agents.AgentTrace
Converts this agent trace to a map suitable for use as actualOutputs in an EvalTestCase.
toRunResult(ExperimentRun) - Method in class dev.dokimos.server.service.ComparisonSupport
Converts a server run plus its item and eval results into a single core RunResult at run index 0.
toRunResult(List<ItemResult>) - Method in class dev.dokimos.server.service.ComparisonSupport
Converts already-loaded item entities into a core RunResult at run index 0, preserving their order so positional pairing keys line up with the source list.
toRunResults(BaselineFile) - Static method in class dev.dokimos.core.gate.BaselineStore
Reconstructs comparison-ready runs from a baseline.
toString() - Method in record class dev.dokimos.core.agents.AgentTrace
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.agents.ToolCall
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.agents.ToolDefinition
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.CallMetrics
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.comparison.ItemComparison
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.comparison.SignificanceResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.conversation.Message
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.Dataset
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.EvalResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.EvalTestCase
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.Example
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.ExperimentResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.BaselineFile
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.ItemResult
Returns a string representation of this record class.
toString() - Method in class dev.dokimos.core.OutputType
 
toString() - Method in record class dev.dokimos.core.RunHandle
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.RunResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.TaskResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DiffCase
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.DiffView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.GateRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.SpanView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TrendData
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.filter.Principal
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.tenant.TenantScope
Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
Returns a string representation of this record class.
totalCostUsd() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the totalCostUsd record component.
totalCostUsd() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the totalCostUsd record component.
totalCount() - Method in record class dev.dokimos.core.ExperimentResult
Returns the total number of items evaluated per run.
totalCount() - Method in record class dev.dokimos.core.RunResult
Returns the total number of items evaluated in this run.
totalCount() - Method in record class dev.dokimos.mcp.store.RunRecord
Returns the value of the totalCount record component.
totalElements() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the totalElements record component.
totalItems() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the totalItems record component.
totalItems() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
Returns the value of the totalItems record component.
totalPages() - Method in record class dev.dokimos.server.dto.v1.PageResponse
Returns the value of the totalPages record component.
totalRegressedCases() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the totalRegressedCases record component.
totalTokensIn() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the totalTokensIn record component.
totalTokensIn() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the totalTokensIn record component.
totalTokensOut() - Method in record class dev.dokimos.server.dto.v1.RunDetails
Returns the value of the totalTokensOut record component.
totalTokensOut() - Method in record class dev.dokimos.server.dto.v1.RunSummary
Returns the value of the totalTokensOut record component.
toTestCase() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Builds a test case for the deterministic tool-call evaluators, using the last user message as input.
toTestCase() - Method in record class dev.dokimos.core.ItemResult
 
toTestCase(String) - Method in record class dev.dokimos.core.agents.AgentTrace
Builds an EvalTestCase from this trace for the given user input.
toTestCase(String) - Method in record class dev.dokimos.core.Example
Converts this example to a test case with a single actual output.
toTestCase(String, List<ToolDefinition>) - Method in record class dev.dokimos.core.agents.AgentTrace
Builds an EvalTestCase from this trace, also wiring the available tool definitions into metadata.
toTestCase(String, List<ToolDefinition>, List<String>) - Method in record class dev.dokimos.core.agents.AgentTrace
Builds an EvalTestCase from this trace with everything the agent evaluators need in one call.
toTestCase(List<ToolDefinition>) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Builds a test case for the deterministic tool-call and tool-definition evaluators, adding the tools the agent could call.
toTestCase(List<ToolDefinition>, List<String>) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Builds a test case for the judge-based evaluators (TaskCompletionEvaluator, ToolArgumentHallucinationEvaluator).
toTestCase(Map<String, Object>) - Method in record class dev.dokimos.core.Example
Converts this example to a test case with the given actual outputs.
toTestCase(EvaluationRequest) - Static method in class dev.dokimos.springai.SpringAiSupport
Converts a Spring AI EvaluationRequest to a Dokimos EvalTestCase.
toText() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Formats the conversation as a simple text transcript.
toToolCall(ChatCompletionMessageToolCall, String) - Static method in class dev.dokimos.openai.OpenAiSupport
Converts a single OpenAI function ChatCompletionMessageToolCall to a ToolCall.
toToolCall(ToolExecution) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Converts a single LangChain4j ToolExecution to a ToolCall.
toToolCalls(OverAllState) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Extracts every tool call across all turns of a graph run, correlating each call to its result with per-turn windowing.
toToolCalls(ChatCompletionMessage) - Static method in class dev.dokimos.openai.OpenAiSupport
Extracts function ToolCalls from an OpenAI ChatCompletionMessage in order.
toToolCalls(ChatCompletionMessage, Function<String, String>) - Static method in class dev.dokimos.openai.OpenAiSupport
Extracts function ToolCalls from an OpenAI ChatCompletionMessage, looking up each tool call's result by its id.
toToolCalls(Result<?>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Extracts ToolCalls from a LangChain4j Result in execution order.
toToolCalls(AssistantMessage) - Static method in class dev.dokimos.springai.SpringAiSupport
Extracts ToolCalls from a Spring AI AssistantMessage without results.
toToolCalls(AssistantMessage, List<ToolResponseMessage>) - Static method in class dev.dokimos.springai.SpringAiSupport
Extracts ToolCalls from a Spring AI AssistantMessage, attaching results from the supplied tool responses by tool-call id.
toToolDefinition(ChatCompletionTool) - Static method in class dev.dokimos.openai.OpenAiSupport
Converts a single OpenAI function ChatCompletionTool to a ToolDefinition.
toToolDefinition(ToolSpecification) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Converts a single ToolSpecification to a ToolDefinition.
toToolDefinitions(EmbabelTraceCollector) - Static method in class dev.dokimos.embabel.EmbabelSupport
Synthesizes ToolDefinitions from the tool names observed during a run.
toToolDefinitions(List<ChatCompletionTool>) - Static method in class dev.dokimos.openai.OpenAiSupport
Converts OpenAI ChatCompletionTools to ToolDefinitions so tool calls can be evaluated against the tools the agent was given.
toToolDefinitions(List<ToolSpecification>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
Converts LangChain4j ToolSpecifications to ToolDefinitions so tool calls can be evaluated against the tools the agent was given.
toToolDefinitions(List<ToolDefinition>) - Static method in class dev.dokimos.springai.SpringAiSupport
Converts Spring AI ToolDefinitions to Dokimos ToolDefinitions so tool calls can be evaluated against the tools the agent was given.
toToolDefinitions(List<ToolCallback>) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
Converts the ToolCallbacks an agent was built with into Dokimos ToolDefinitions, so tool calls can be evaluated against the tools the agent had available.
touchUpdatedAt() - Method in class dev.dokimos.server.entity.AlertWebhook
Stamps the webhook as just modified.
touchUpdatedAt() - Method in class dev.dokimos.server.entity.Annotation
 
touchUpdatedAt() - Method in class dev.dokimos.server.entity.Dataset
 
touchUpdatedAt() - Method in class dev.dokimos.server.entity.LlmConnection
Stamps the connection as just modified.
touchUpdatedAt() - Method in class dev.dokimos.server.entity.TraceEvalRule
Stamps the rule as just modified.
trace() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
Materializes the captured run into an AgentTrace.
Trace - Class in dev.dokimos.server.entity
A single distributed execution trace ingested over OTLP, holding one or more TraceSpan rows.
Trace(String, Instant, Instant) - Constructor for class dev.dokimos.server.entity.Trace
 
TraceController - Class in dev.dokimos.server.controller.v1
OTLP trace ingestion and read endpoints.
TraceController(TraceIngestService, TraceQueryService) - Constructor for class dev.dokimos.server.controller.v1.TraceController
 
TraceDetail - Record Class in dev.dokimos.server.dto.v1
Full view of one trace: its metadata, all of its spans, and the online eval jobs scoped to those spans.
TraceDetail(UUID, String, UUID, String, String, int, Long, Long, Instant, Instant, List<SpanView>, List<TraceEvalJobView>) - Constructor for record class dev.dokimos.server.dto.v1.TraceDetail
Creates an instance of a TraceDetail record class.
TraceEvalEnqueuer - Class in dev.dokimos.server.service
Decides which online eval jobs to create for a freshly ingested trace and persists them.
TraceEvalEnqueuer(TraceEvalRuleRepository, TraceEvalJobRepository) - Constructor for class dev.dokimos.server.service.TraceEvalEnqueuer
 
TraceEvalJob - Class in dev.dokimos.server.entity
A unit of online scoring work: score one ingested TraceSpan's derived output against one TraceEvalRule's judge configuration.
TraceEvalJob(TraceSpan, TraceEvalRule) - Constructor for class dev.dokimos.server.entity.TraceEvalJob
 
TraceEvalJobRepository - Interface in dev.dokimos.server.repository
 
TraceEvalJobStatus - Enum Class in dev.dokimos.server.entity
Lifecycle state of a TraceEvalJob.
TraceEvalJobTransactions - Class in dev.dokimos.server.service
The transactional steps of the trace eval worker, each in its own committed transaction so the worker can make the LLM HTTP call between them without holding a database transaction open.
TraceEvalJobTransactions(TraceEvalJobRepository) - Constructor for class dev.dokimos.server.service.TraceEvalJobTransactions
 
TraceEvalJobTransactions.ClaimedJob - Record Class in dev.dokimos.server.service
A claimed job paired with the span text snapshots the worker scores after the transaction closes.
TraceEvalJobView - Record Class in dev.dokimos.server.dto.v1
Public view of a TraceEvalJob, returned in the per-trace detail.
TraceEvalJobView(UUID, UUID, UUID, String, TraceEvalJobStatus, Double, Boolean, String, int, String, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.TraceEvalJobView
Creates an instance of a TraceEvalJobView record class.
TraceEvalRule - Class in dev.dokimos.server.entity
A per-project rule that enqueues an online judge evaluation when an ingested span matches.
TraceEvalRule(UUID, String, TraceMatchType, String, LlmConnection, String, String) - Constructor for class dev.dokimos.server.entity.TraceEvalRule
 
TraceEvalRuleController - Class in dev.dokimos.server.controller.v1
Manages per-project trace eval rules.
TraceEvalRuleController(TraceEvalRuleService) - Constructor for class dev.dokimos.server.controller.v1.TraceEvalRuleController
 
TraceEvalRuleRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for TraceEvalRule.
TraceEvalRuleRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for TraceEvalRule.
TraceEvalRuleRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the TraceEvalRule finders.
TraceEvalRuleRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
 
TraceEvalRuleService - Class in dev.dokimos.server.service
Manages per-project trace eval rules.
TraceEvalRuleService(TraceEvalRuleRepository, ProjectRepository, LlmConnectionRepository) - Constructor for class dev.dokimos.server.service.TraceEvalRuleService
 
TraceEvalRuleView - Record Class in dev.dokimos.server.dto.v1
Public view of a TraceEvalRule.
TraceEvalRuleView(UUID, UUID, String, boolean, TraceMatchType, String, String, UUID, String, String, double, double, Double, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Creates an instance of a TraceEvalRuleView record class.
TraceEvalWorker - Class in dev.dokimos.server.service
Background worker that drains the online trace eval queue.
TraceEvalWorker(TraceEvalJobTransactions, LlmCredentialService, TraceProperties) - Constructor for class dev.dokimos.server.service.TraceEvalWorker
 
traceId() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
Returns the value of the traceId record component.
traceId() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
Returns the value of the traceId record component.
traceId() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
Returns the value of the traceId record component.
traceId() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
Returns the value of the traceId record component.
TraceIngestResponse - Record Class in dev.dokimos.server.dto.v1
Result of an OTLP ingestion call.
TraceIngestResponse(int, int, int) - Constructor for record class dev.dokimos.server.dto.v1.TraceIngestResponse
Creates an instance of a TraceIngestResponse record class.
TraceIngestService - Class in dev.dokimos.server.service
Persists OTLP traces and enqueues online evaluations for matching spans.
TraceIngestService(OtlpTraceParser, TraceRepository, ProjectRepository, TraceEvalEnqueuer, TraceProperties) - Constructor for class dev.dokimos.server.service.TraceIngestService
 
TraceMatchType - Enum Class in dev.dokimos.server.entity
How a TraceEvalRule decides whether a span matches.
TraceProperties - Class in dev.dokimos.server.config
Tuning knobs for trace ingestion and online evaluation, bound from the dokimos.trace prefix.
TraceProperties() - Constructor for class dev.dokimos.server.config.TraceProperties
 
TraceProperties.Eval - Class in dev.dokimos.server.config
Online trace eval worker knobs, bound from dokimos.trace.eval.
TraceQueryService - Class in dev.dokimos.server.service
Read side for ingested traces: a paginated list and a per-trace detail with spans and eval jobs.
TraceQueryService(TraceRepository, TraceSpanRepository, TraceEvalJobRepository) - Constructor for class dev.dokimos.server.service.TraceQueryService
 
TraceRepository - Interface in dev.dokimos.server.repository
Tenant-scoped repository for Trace.
TraceRepositoryFragment - Interface in dev.dokimos.server.repository
Entity-specific scoped finders for Trace plus the unrestricted ingestion and sweeper paths.
TraceRepositoryFragmentImpl - Class in dev.dokimos.server.repository
Tenant-scoped implementation of the Trace finders plus the unrestricted ingestion paths.
TraceRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
 
TraceRetentionSweeper - Class in dev.dokimos.server.service
Periodically deletes traces whose retention window has closed.
TraceRetentionSweeper(TraceRepository) - Constructor for class dev.dokimos.server.service.TraceRetentionSweeper
 
traces() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
Returns the value of the traces record component.
TraceSpan - Class in dev.dokimos.server.entity
One span of an ingested Trace.
TraceSpan(String, String, String, Instant) - Constructor for class dev.dokimos.server.entity.TraceSpan
 
TraceSpanRepository - Interface in dev.dokimos.server.repository
 
TraceSummary - Record Class in dev.dokimos.server.dto.v1
Compact view of a Trace for the list endpoint, without its spans.
TraceSummary(UUID, String, UUID, String, int, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.TraceSummary
Creates an instance of a TraceSummary record class.
TrajectoryEvaluationCriteria - Class in dev.dokimos.core.conversation
Factory for creating pre-built evaluation criteria for trajectory evaluation.
TrajectoryEvaluator - Class in dev.dokimos.core.conversation
Evaluates complete conversation trajectories using LLM-as-judge patterns.
TrajectoryEvaluator.Builder - Class in dev.dokimos.core.conversation
Builder for constructing trajectory evaluators.
trajectoryKey(String) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Sets the key used to retrieve the trajectory from actualOutputs.
treatBlankAsError(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
Controls whether a null or blank result counts as an error.
TrendData - Record Class in dev.dokimos.server.dto.v1
 
TrendData(String, String, List<TrendData.RunPoint>) - Constructor for record class dev.dokimos.server.dto.v1.TrendData
Creates an instance of a TrendData record class.
TrendData.RunPoint - Record Class in dev.dokimos.server.dto.v1
 
triggeredBy() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
Returns the value of the triggeredBy record component.
trimStrings(boolean) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
Trims leading and trailing whitespace from strings before comparison.
turnCount() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns the number of conversation turns (user-assistant message pairs).
typed(Function<Example, T>) - Static method in interface dev.dokimos.core.Task
Creates a Task that produces a single typed value and stores it under the conventional "output" key, so callers can return a record, list, or other POJO from their task body instead of hand-building the output map.

U

UNCHANGED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
No meaningful or significant change.
unchangedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
Returns the value of the unchangedCount record component.
unchangedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the unchangedCount record component.
unchangedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
Returns the value of the unchangedCount record component.
unchangedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
Returns the value of the unchangedCount record component.
unpaged() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
Returns the value of the unpaged record component.
unrestricted() - Static method in record class dev.dokimos.server.tenant.TenantScope
Returns the scope that applies no tenant predicate.
unsorted() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
Returns the value of the unsorted record component.
UNSURE - Enum constant in enum class dev.dokimos.server.entity.AnnotationVerdict
 
unwrap() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
Returns the scalar Java value for this attribute, or null when no scalar variant is set.
update(UUID, UpdateLlmConnectionRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
Updates a connection.
update(UUID, UpdateLlmConnectionRequest, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
Replaces a connection's name, base URL, and model, and optionally its credential.
update(UUID, UUID, CreateTraceEvalRuleRequest, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
Replaces a rule's definition.
update(UUID, UUID, UpdateAlertWebhookRequest, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
Replaces a webhook's url and enabled flag, and optionally its secret.
updateAlertWebhook(UUID, UUID, UpdateAlertWebhookRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
Updates a webhook.
UpdateAlertWebhookRequest - Record Class in dev.dokimos.server.dto.v1
Payload for updating an alert webhook.
UpdateAlertWebhookRequest(String, String, Boolean) - Constructor for record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Creates an instance of a UpdateAlertWebhookRequest record class.
updateBaseline() - Method in class dev.dokimos.core.gate.GateConfig
 
updateBaseline(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
 
updateBaselineRequested() - Static method in class dev.dokimos.core.gate.GateConfig
Whether an explicit baseline update was requested via DOKIMOS_UPDATE_BASELINE (env, the primary control because -D does not reach the test JVM under default Gradle or the IntelliJ runner) or the dokimos.updateBaseline system property.
updatedAt() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the updatedAt record component.
updatedAt() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns the value of the updatedAt record component.
updatedAt() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
Returns the value of the updatedAt record component.
updatedAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
Returns the value of the updatedAt record component.
UpdateLlmConnectionRequest - Record Class in dev.dokimos.server.dto.v1
Payload for updating an LLM connection.
UpdateLlmConnectionRequest(String, String, String, LlmConnectionProtocol, String, String) - Constructor for record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
Creates an instance of a UpdateLlmConnectionRequest record class.
updateRequested() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
 
updateRun(UUID, UpdateRunRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
 
updateRun(UUID, UpdateRunRequest, TenantScope) - Method in class dev.dokimos.server.service.RunService
Updates a run's status.
UpdateRunRequest - Record Class in dev.dokimos.server.dto.v1
 
UpdateRunRequest(RunStatus) - Constructor for record class dev.dokimos.server.dto.v1.UpdateRunRequest
Creates an instance of a UpdateRunRequest record class.
updateTraceEvalRule(UUID, UUID, CreateTraceEvalRuleRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
Replaces a rule.
upsert(UUID, UUID, AnnotationRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AnnotationController
Creates or updates the annotation for the item result and returns it.
upsert(UUID, UUID, AnnotationRequest, String, TenantScope) - Method in class dev.dokimos.server.service.AnnotationService
Creates or updates the single annotation for the given item result.
url() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
Returns the value of the url record component.
url() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
Returns the value of the url record component.
url() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
Returns the value of the url record component.
user(String) - Static method in record class dev.dokimos.core.conversation.Message
Creates a user message.
USER - Enum constant in enum class dev.dokimos.core.conversation.Message.Role
A message from the user.
userMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Adds a user message to the trajectory.
userMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Returns only the user messages from the conversation.
UserPersonas - Class in dev.dokimos.core.conversation
Factory for creating pre-built simulated user personas.
userSatisfaction() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
Creates a criterion for evaluating user satisfaction.
Using Spring AI ChatClient as a Judge - Search tag in class dev.dokimos.springai.SpringAiSupport
Section

V

value() - Element in annotation interface dev.dokimos.junit.DatasetSource
URI of the dataset to load.
value() - Element in annotation interface dev.dokimos.junit.MetadataEntry
The metadata value.
value() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
Returns the value of the value record component.
valueOf(String) - Static method in enum class dev.dokimos.core.comparison.ComparisonStatus
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.conversation.AggregationStrategy
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.conversation.Message.Role
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.EvalTestCaseParam
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.StructuralMatchMode
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.gate.GateConfig.Pairing
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.RunStatus
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.AnnotationVerdict
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.EvalJobStatus
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.LlmConnectionProtocol
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.RunStatus
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.TraceEvalJobStatus
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.TraceMatchType
Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.filter.Role
Returns the enum constant of this class with the specified name.
values() - Static method in enum class dev.dokimos.core.comparison.ComparisonStatus
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.conversation.AggregationStrategy
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.conversation.Message.Role
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.EvalTestCaseParam
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.evaluators.StructuralMatchMode
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.gate.GateConfig.Pairing
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.RunStatus
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.AnnotationVerdict
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.EvalJobStatus
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.LlmConnectionProtocol
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.RunStatus
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.TraceEvalJobStatus
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.TraceMatchType
Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.filter.Role
Returns an array containing the constants of this enum class, in the order they are declared.
verdict() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
Returns the value of the verdict record component.
verdict() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
Returns the value of the verdict record component.
verdictDir() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
 
version() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Returns the value of the version record component.
version() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
Returns the value of the version record component.
versions() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
Returns the value of the versions record component.
VersionSummary(UUID, int, String, int, Instant, String) - Constructor for record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
Creates an instance of a VersionSummary record class.
VIEWER - Enum constant in enum class dev.dokimos.server.filter.Role
 

W

WARN - Enum constant in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
Warn only.
warnings() - Method in record class dev.dokimos.core.gate.GateVerdict
Returns the value of the warnings record component.
weight() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Returns the value of the weight record component.
WEIGHTED_MEAN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
Weighted mean based on criterion weights.
withMessage(Message) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
Creates a new trajectory with an additional message appended.
withWeight(double) - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
Creates a new criterion with a different weight.
write(Path, ExperimentResult, GateConfig) - Static method in class dev.dokimos.core.gate.BaselineStore
Writes a baseline atomically to the given source-tree path (creating parent directories).
writeCompact(Object) - Static method in class dev.dokimos.core.internal.Json
Serializes a value to compact (single-line) JSON.
writePretty(Object) - Static method in class dev.dokimos.core.internal.Json
Serializes a value to pretty-printed JSON.
A B C D E F G H I J K L M N O P R S T U V W 
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form