Index
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
A
- AbstractScopedRepository<T> - Class in dev.dokimos.server.tenant
-
Base implementation of
ScopedRepository. - accept(DatasetSource) - Method in class dev.dokimos.junit.DatasetArgumentsProvider
- acceptedSpans() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Returns the value of the
acceptedSpansrecord component. - ACTUAL_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
- actualOutput() - Method in record class dev.dokimos.core.EvalTestCase
-
Gets the primary actual output value.
- actualOutput() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns the value of the
actualOutputrecord component. - actualOutput() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
actualOutputrecord component. - actualOutput() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
actualOutputrecord component. - actualOutput() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Returns the value of the
actualOutputrecord component. - actualOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Sets the primary actual output value.
- actualOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds an actual output with the given key and value.
- actualOutput(String, Object) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
-
Records a single actual output under the given key.
- actualOutputAs(OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the primary actual output (
"output") converted to the given generic type. - actualOutputAs(Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the primary actual output (
"output") converted to the given type. - actualOutputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the actual output under
keyconverted to the given generic type. - actualOutputAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the actual output under
keyconverted to the given type. - actualOutputs() - Method in record class dev.dokimos.core.EvalTestCase
-
Returns the value of the
actualOutputsrecord component. - actualOutputs() - Method in record class dev.dokimos.core.ItemResult
-
Returns the value of the
actualOutputsrecord component. - actualOutputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
actualOutputsrecord component. - actualOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds all entries from the given actual outputs map.
- actualOutputs(Map<String, Object>) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
-
Records multiple actual outputs, merging them with any already recorded.
- ADDED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
-
The item exists only in the candidate.
- addedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
addedCountrecord component. - addedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
addedCountrecord component. - addedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
addedCountrecord component. - addedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
addedCountrecord component. - addEvalResult(EvalResult) - Method in class dev.dokimos.server.entity.ItemResult
- addExample(Example) - Method in class dev.dokimos.core.Dataset.Builder
-
Adds an example to the dataset.
- addExamples(List<Example>) - Method in class dev.dokimos.core.Dataset.Builder
-
Adds multiple examples to the dataset.
- addItems(UUID, AddItemsRequest, String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
- addItems(UUID, AddItemsRequest, String, TenantScope) - Method in class dev.dokimos.server.service.RunService
-
Adds item results to a run; only allowed while the run is RUNNING.
- AddItemsRequest - Record Class in dev.dokimos.server.dto.v1
- AddItemsRequest(List<AddItemsRequest.ItemData>) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest
-
Creates an instance of a
AddItemsRequestrecord class. - AddItemsRequest.EvalData - Record Class in dev.dokimos.server.dto.v1
- AddItemsRequest.ItemData - Record Class in dev.dokimos.server.dto.v1
- addReasoningStep(String) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Adds a reasoning step.
- addResourceHandlers(ResourceHandlerRegistry) - Method in class dev.dokimos.server.config.SpaResourceConfig
- addSpan(TraceSpan) - Method in class dev.dokimos.server.entity.Trace
-
Attaches a span to this trace and keeps both ends of the association consistent.
- addToolCall(ToolCall) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Adds a tool call to the trace.
- ADMIN - Enum constant in enum class dev.dokimos.server.filter.Role
- adversarialUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated adversarial user who tries to manipulate the system.
- afterEach(ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
- AgentEvalCase - Class in dev.dokimos.core.evaluators.agents
-
Typed entry point for building an
EvalTestCasefor the agent evaluators. - AgentEvalCase.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing an
EvalTestCasethat targets the agent evaluators. - Agent Evaluation - Search tag in class dev.dokimos.openai.OpenAiSupport
- Section
- AgentTrace - Record Class in dev.dokimos.core.agents
-
Wraps a complete agent execution trace for evaluation.
- AgentTrace(String, List<ToolCall>, List<String>, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.AgentTrace
-
Creates an instance of a
AgentTracerecord class. - AgentTrace.Builder - Class in dev.dokimos.core.agents
-
Builder for constructing agent traces.
- aggregate(List<Map.Entry<EvaluationCriterion, Double>>) - Method in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Aggregates the given criterion scores into a single score.
- aggregationStrategy(AggregationStrategy) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets the score aggregation strategy.
- AggregationStrategy - Enum Class in dev.dokimos.core.conversation
-
Strategies for aggregating scores from multiple evaluation criteria.
- aggressiveCustomer(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated aggressive customer who is frustrated and demanding.
- agreedCount() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns the value of the
agreedCountrecord component. - AlertWebhook - Class in dev.dokimos.server.entity
-
A configured HTTP endpoint that receives a JSON alert when a completed run of one of its project's experiments shows a significant pass-rate regression against its baseline.
- AlertWebhook(Project, String, String, boolean) - Constructor for class dev.dokimos.server.entity.AlertWebhook
- AlertWebhookController - Class in dev.dokimos.server.controller.v1
-
CRUD over a project's regression-alert webhooks.
- AlertWebhookController(AlertWebhookService) - Constructor for class dev.dokimos.server.controller.v1.AlertWebhookController
- AlertWebhookDispatcher - Class in dev.dokimos.server.service
-
Delivers regression alerts to a project's enabled webhooks.
- AlertWebhookDispatcher(AlertWebhookRepository, ObjectMapper) - Constructor for class dev.dokimos.server.service.AlertWebhookDispatcher
- AlertWebhookRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
AlertWebhook. - AlertWebhookRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
AlertWebhook. - AlertWebhookRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
AlertWebhookfinders. - AlertWebhookRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.AlertWebhookRepositoryFragmentImpl
- AlertWebhookService - Class in dev.dokimos.server.service
-
Manages a project's regression-alert webhooks.
- AlertWebhookService(AlertWebhookRepository, ProjectRepository) - Constructor for class dev.dokimos.server.service.AlertWebhookService
- AlertWebhookView - Record Class in dev.dokimos.server.dto.v1
-
Public view of an
AlertWebhook. - AlertWebhookView(UUID, UUID, String, boolean, boolean, Instant) - Constructor for record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Creates an instance of a
AlertWebhookViewrecord class. - AlibabaAgentResponse(String, Integer, Integer) - Constructor for record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Creates an instance of a
AlibabaAgentResponserecord class. - alignment(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlignmentController
-
Returns the judge-human alignment breakdown for a run.
- AlignmentController - Class in dev.dokimos.server.controller.v1
-
Exposes the per-evaluator judge-human alignment for a run: the agreement rate between automated evaluator verdicts and human annotations.
- AlignmentController(AlignmentService) - Constructor for class dev.dokimos.server.controller.v1.AlignmentController
- alignmentRate() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns the value of the
alignmentRaterecord component. - AlignmentService - Class in dev.dokimos.server.service
-
Computes per-run, per-evaluator agreement between automated evaluator verdicts and human annotations.
- AlignmentService(ExperimentRunRepository, ItemResultRepository, AnnotationRepository) - Constructor for class dev.dokimos.server.service.AlignmentService
- AlignmentView - Record Class in dev.dokimos.server.dto.v1
-
Per-run, per-evaluator agreement between automated evaluator verdicts and human annotations.
- AlignmentView(int, List<AlignmentView.EvaluatorAlignment>) - Constructor for record class dev.dokimos.server.dto.v1.AlignmentView
-
Creates an instance of a
AlignmentViewrecord class. - AlignmentView.EvaluatorAlignment - Record Class in dev.dokimos.server.dto.v1
-
Agreement breakdown for a single evaluator across a run's annotated items.
- allItemsLinked(RunResult) - Method in class dev.dokimos.server.service.ComparisonSupport
-
True when every item in the run carries a non-null dataset item id.
- allOf(MatchingStrategy...) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Creates a composite strategy that matches only if ALL strategies match.
- alpha() - Method in class dev.dokimos.core.gate.GateConfig
- alpha(double) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
-
Significance threshold; a change is significant when its p-value is below alpha.
- alpha(double) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- annotatedItems() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
-
Returns the value of the
annotatedItemsrecord component. - annotation() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
annotationrecord component. - Annotation - Class in dev.dokimos.server.entity
-
A human reviewer's verdict on a single
ItemResult. - Annotation(ItemResult, AnnotationVerdict) - Constructor for class dev.dokimos.server.entity.Annotation
- AnnotationController - Class in dev.dokimos.server.controller.v1
-
Endpoints for the single human review annotation on a run item result.
- AnnotationController(AnnotationService) - Constructor for class dev.dokimos.server.controller.v1.AnnotationController
- AnnotationRepository - Interface in dev.dokimos.server.repository
- AnnotationRequest - Record Class in dev.dokimos.server.dto.v1
-
Payload for creating or updating the annotation on a run item result.
- AnnotationRequest(AnnotationVerdict, Map<String, Object>, String) - Constructor for record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Creates an instance of a
AnnotationRequestrecord class. - AnnotationService - Class in dev.dokimos.server.service
-
Service for human review annotations on run item results.
- AnnotationService(AnnotationRepository, ItemResultRepository, ExperimentRunRepository) - Constructor for class dev.dokimos.server.service.AnnotationService
- AnnotationVerdict - Enum Class in dev.dokimos.server.entity
-
A human reviewer's verdict on a single run item result.
- AnnotationView - Record Class in dev.dokimos.server.dto.v1
-
Read model for an annotation on a run item result.
- AnnotationView(UUID, AnnotationVerdict, Map<String, Object>, String, String, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.AnnotationView
-
Creates an instance of a
AnnotationViewrecord class. - anonymous() - Static method in record class dev.dokimos.server.filter.Principal
-
Principal for an unauthenticated reader in an authenticated deployment.
- ANY_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Order-independent overlap; graded.
- anyOf(MatchingStrategy...) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Creates a composite strategy that matches if ANY of the strategies match.
- API_KEYS_PATH_PREFIX - Static variable in class dev.dokimos.server.filter.ApiKeyAuthFilter
-
Path prefix for the API key management endpoints, which require ADMIN.
- apiKey() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
-
Returns the value of the
apiKeyrecord component. - apiKey() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns the value of the
apiKeyrecord component. - apiKey() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns the value of the
apiKeyrecord component. - apiKey(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
-
Bearer API key for authentication.
- ApiKey - Class in dev.dokimos.server.entity
-
A scoped API key used to authenticate write requests against
/api/v1/**. - ApiKey(String, String, Role, String) - Constructor for class dev.dokimos.server.entity.ApiKey
-
Creates an enabled key.
- ApiKeyAuthenticator - Class in dev.dokimos.server.filter
-
Authenticatorbacked by two credential sources that coexist for backward compatibility: the single legacy key configured viaDOKIMOS_API_KEY(which maps toRole.ADMIN), and the scoped keys stored inapi_keys(each hashed, each carrying its own role and tenant). - ApiKeyAuthenticator(ApiKeyProperties, ApiKeyRepository) - Constructor for class dev.dokimos.server.filter.ApiKeyAuthenticator
- ApiKeyAuthFilter - Class in dev.dokimos.server.filter
-
Servlet filter that authenticates
/api/v1/**by delegating credential resolution to anAuthenticator, then enforces role-based authorization on the resolvedPrincipal. - ApiKeyAuthFilter(Authenticator, ObjectMapper) - Constructor for class dev.dokimos.server.filter.ApiKeyAuthFilter
- ApiKeyController - Class in dev.dokimos.server.controller.v1
-
Manages scoped API keys.
- ApiKeyController(ApiKeyService) - Constructor for class dev.dokimos.server.controller.v1.ApiKeyController
- ApiKeyHasher - Class in dev.dokimos.server.filter
-
Hashes raw API keys to the SHA-256 hex form stored in the database.
- ApiKeyProperties - Class in dev.dokimos.server.config
-
Configuration properties for API key authentication.
- ApiKeyProperties() - Constructor for class dev.dokimos.server.config.ApiKeyProperties
- ApiKeyRepository - Interface in dev.dokimos.server.repository
- ApiKeyService - Class in dev.dokimos.server.service
-
Mints and manages scoped API keys.
- ApiKeyService(ApiKeyRepository) - Constructor for class dev.dokimos.server.service.ApiKeyService
- ApiKeyView - Record Class in dev.dokimos.server.dto.v1
-
Metadata view of an
ApiKey. - ApiKeyView(UUID, String, Role, String, boolean, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ApiKeyView
-
Creates an instance of a
ApiKeyViewrecord class. - apiVersion(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
-
API version, e.g.
- application(ConversationalApplication) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Sets the application under test.
- ArgMatchMode - Enum Class in dev.dokimos.core.evaluators.agents
-
Controls how a tool call's arguments are compared against the expected arguments.
- argument(String, Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Adds an argument.
- argumentMatcher(ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets the argument matcher used by
ToolCorrectnessEvaluator.MatchMode.NAMES_AND_ARGS. - argumentMatcher(ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
-
Sets the argument matcher used to decide whether two calls are duplicates.
- argumentMatcher(ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets the default argument matcher applied to every tool unless overridden.
- argumentMatcher(String, ArgumentMatcher) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Overrides the argument matcher for a specific tool by name.
- ArgumentMatcher - Interface in dev.dokimos.core.evaluators.agents
-
Strategy for comparing a tool call's actual arguments against the expected arguments.
- arguments() - Method in record class dev.dokimos.core.agents.ToolCall
-
Returns the value of the
argumentsrecord component. - arguments(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Sets all arguments.
- argumentsAs(OutputType<T>) - Method in record class dev.dokimos.core.agents.ToolCall
-
Converts this tool call's
argumentsmap into a generic target captured by anOutputTypetoken, for examplenew OutputType<List<String>>() {}. - argumentsAs(Class<T>) - Method in record class dev.dokimos.core.agents.ToolCall
-
Converts this tool call's
argumentsmap into an instance oftype. - asJudge(OpenAIClient, ChatModel) - Static method in class dev.dokimos.openai.OpenAiSupport
- asJudge(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a
JudgeLMfrom a LangChain4jChatModel. - asJudge(ChatClient.Builder) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates a
JudgeLMfrom a Spring AIChatClient.Builder. - asJudge(ChatModel) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates a
JudgeLMfrom a Spring AIChatModel. - assertEval(EvalTestCase, Evaluator...) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the test case passes all evaluators.
- assertEval(EvalTestCase, List<Evaluator>) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the test case passes all evaluators.
- Assertions - Class in dev.dokimos.core
-
Assertion utilities for evaluation-based testing.
- assertNoRegression(ExperimentResult) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the candidate has not regressed against its committed baseline, resolving the baseline from the experiment name.
- assertNoRegression(ExperimentResult, String) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the candidate has not regressed against the baseline named
baselineName. - assertNoRegression(ExperimentResult, String, GateConfig) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the candidate has not regressed against the baseline named
baselineName, using the supplied configuration. - assertNoRegression(ExperimentResult, Path) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the candidate has not regressed against the baseline at the given path.
- assertNoRegression(ExperimentResult, Path, GateConfig) - Static method in class dev.dokimos.core.Assertions
-
Asserts that the candidate has not regressed against the baseline at the given path, using the supplied configuration.
- assistant(String) - Static method in record class dev.dokimos.core.conversation.Message
-
Creates an assistant message.
- assistant(String, List<ToolCall>) - Static method in record class dev.dokimos.core.conversation.Message
-
Creates an assistant message carrying the tool calls it made on this turn.
- ASSISTANT - Enum constant in enum class dev.dokimos.core.conversation.Message.Role
-
A message from the assistant.
- assistantMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds an assistant message to the trajectory.
- assistantMessage(String, List<ToolCall>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds an assistant message carrying the tool calls it made.
- assistantMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns only the assistant messages from the conversation.
- asyncRagTask(Function<String, Result<String>>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates an
AsyncTaskfor RAG evaluation from a function that returnsResult. - asyncRagTask(Function<String, Result<String>>, String, String, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates an
AsyncTaskfor RAG evaluation with custom key names. - asyncRagTask(Function<String, Result<String>>, String, String, String, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates an
AsyncTaskfor RAG evaluation that dispatches each blocking assistant call on the suppliedExecutor(or the commonForkJoinPoolwhenexecutorisnull). - asyncRagTask(Function<String, Result<String>>, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
- asyncTask(AsyncTask) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets an asynchronous task that produces a
TaskResultas aCompletableFuture. - asyncTask(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a simple
AsyncTaskfor Q&A evaluation from a LangChain4jChatModel. - asyncTask(ChatModel, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a simple
AsyncTaskfor Q&A evaluation that writes the response under a caller-chosen key. - asyncTask(ChatModel, String, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a simple
AsyncTaskfor Q&A evaluation that dispatches each blockingmodel.chat(...)call on the suppliedExecutor(or the commonForkJoinPoolwhenexecutorisnull). - asyncTask(ChatModel, Executor) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
- asyncTask(ChatClient) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates an
AsyncTaskthat calls a Spring AIChatClientoff the calling thread and writes the response under thedefault output key. - asyncTask(ChatClient, String, String) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates an
AsyncTaskthat calls a Spring AIChatClientoff the calling thread using caller-chosen input and output keys. - asyncTask(ChatClient, String, String, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates an
AsyncTaskthat calls a Spring AIChatClientusing caller-chosen input and output keys, dispatching each blocking call on the suppliedExecutor(or the commonForkJoinPoolwhenexecutorisnull). - asyncTask(ChatClient, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
- AsyncTask - Interface in dev.dokimos.core
-
A non-blocking task that produces a
TaskResultasynchronously. - atLeast(Role) - Method in enum class dev.dokimos.server.filter.Role
-
Returns true when this role is at least as privileged as the required role.
- attach(AgentInvocation.Builder) - Static method in class dev.dokimos.embabel.EmbabelSupport
-
Creates a fresh collector and registers it on a default
ProcessOptions. - attach(ProcessOptions, EmbabelTraceCollector) - Static method in class dev.dokimos.embabel.EmbabelSupport
-
Registers the given collector as a listener on a copy of the supplied
ProcessOptions. - attemptCount() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
attemptCountrecord component. - attemptCount() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
attemptCountrecord component. - ATTRIBUTE - Enum constant in enum class dev.dokimos.server.entity.TraceMatchType
- attributes() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
-
Returns the value of the
attributesrecord component. - attributes() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
attributesrecord component. - attributes() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
attributesrecord component. - attributes() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
attributesrecord component. - authenticate(String, String) - Method in class dev.dokimos.server.filter.ApiKeyAuthenticator
- authenticate(String, String) - Method in interface dev.dokimos.server.filter.Authenticator
-
Resolves the principal for a request based on its method and credential.
- Authenticator - Interface in dev.dokimos.server.filter
-
Strategy that resolves the
Principalbehind an incoming request from its credential. - AUTO - Enum constant in enum class dev.dokimos.core.gate.GateConfig.Pairing
-
Pair by
datasetItemIdwhen every item carries one, else positionally. - autoCloseReporter(boolean) - Method in class dev.dokimos.core.Experiment.Builder
-
Controls whether
Experiment.run()closes the reporter after the run completes. - averageScore(String) - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the average score for the specified evaluator across all runs.
- averageScore(String) - Method in record class dev.dokimos.core.RunResult
-
Returns the average score for the specified evaluator across all items in this run.
- averageScores() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
averageScoresrecord component. - avgLatencyByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Averages the call latency across a run's items.
- avgLatencyMs() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
avgLatencyMsrecord component. - avgLatencyMs() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
avgLatencyMsrecord component.
B
- BaseEvaluator - Class in dev.dokimos.core
-
Base class for implementing concrete evaluators.
- baselineBranch() - Method in record class dev.dokimos.server.dto.v1.GateRequest
-
Returns the value of the
baselineBranchrecord component. - BaselineFile - Record Class in dev.dokimos.core.gate
-
The committed regression-gate baseline (format v1).
- BaselineFile(int, String, BaselineFile.DatasetInfo, String, int, List<BaselineFile.BaselineItem>, BaselineFile.Provenance) - Constructor for record class dev.dokimos.core.gate.BaselineFile
-
Creates an instance of a
BaselineFilerecord class. - BaselineFile.BaselineItem - Record Class in dev.dokimos.core.gate
-
One item's projection.
- BaselineFile.DatasetInfo - Record Class in dev.dokimos.core.gate
-
Dataset summary metadata (advisory; never used for pairing).
- BaselineFile.EvaluatorEntry - Record Class in dev.dokimos.core.gate
-
One evaluator's recorded outcome for an item.
- BaselineFile.JudgeInfo - Record Class in dev.dokimos.core.gate
-
Judge provenance (advisory).
- BaselineFile.Provenance - Record Class in dev.dokimos.core.gate
-
Build/judge context, kept separate from the measured signal and excluded from the byte-stability guarantee.
- BaselineItem(String, String, List<BaselineFile.EvaluatorEntry>) - Constructor for record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Creates an instance of a
BaselineItemrecord class. - baselineItems() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Returns the value of the
baselineItemsrecord component. - baselineMean() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns the value of the
baselineMeanrecord component. - baselineMean() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Returns the value of the
baselineMeanrecord component. - baselineMean() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns the value of the
baselineMeanrecord component. - baselineMean() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns the value of the
baselineMeanrecord component. - baselineMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Returns the value of the
baselineMeanrecord component. - baselineMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns the value of the
baselineMeanrecord component. - baselinePassProbability() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns the value of the
baselinePassProbabilityrecord component. - baselinePassRate() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
baselinePassRaterecord component. - baselinePassRate() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
baselinePassRaterecord component. - baselinePassRate() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
baselinePassRaterecord component. - baselinePassRate() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
baselinePassRaterecord component. - baselinePassRate() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
baselinePassRaterecord component. - baselineRunId() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
baselineRunIdrecord component. - baselineRunId() - Method in record class dev.dokimos.server.dto.v1.GateRequest
-
Returns the value of the
baselineRunIdrecord component. - baselineRunId() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
baselineRunIdrecord component. - baselineRunId() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
baselineRunIdrecord component. - BaselineStore - Class in dev.dokimos.core.gate
-
Reads and writes the regression-gate baseline file, and reconstructs comparison-ready
RunResults from it. - baseUrl() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns the value of the
baseUrlrecord component. - baseUrl() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
baseUrlrecord component. - baseUrl() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns the value of the
baseUrlrecord component. - beforeEach(ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
- behaviorGuidelines(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Sets additional behavior guidelines for the simulated user.
- binary() - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Switches scoring to binary:
1.0when the structures match completely,0.0otherwise. - boolValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns the value of the
boolValuerecord component. - bootstrapIterations() - Method in class dev.dokimos.core.gate.GateConfig
- bootstrapIterations(int) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
-
Bootstrap iteration count.
- bootstrapIterations(int) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- bootstrapPasses() - Method in class dev.dokimos.core.gate.GateConfig
-
Whether a missing-baseline bootstrap writes the file and passes (the default), versus the strict approval-test stance that writes it but fails once so the run is red until the new baseline is reviewed and committed.
- bootstrapPasses(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- build() - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Builds the agent trace.
- build() - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Builds the tool call.
- build() - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
-
Builds the tool definition.
- build() - Method in class dev.dokimos.core.comparison.RunComparison.Builder
- build() - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Builds the conversation simulator.
- build() - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Builds the conversation trajectory.
- build() - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Builds the LLM simulated user.
- build() - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Builds the trajectory evaluator.
- build() - Method in class dev.dokimos.core.Dataset.Builder
-
Builds the dataset.
- build() - Method in class dev.dokimos.core.EvalResult.Builder
-
Builds the result.
- build() - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Builds the test case.
- build() - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
-
Builds the test case, writing only the slots that were set.
- build() - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
-
Builds the matcher.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Builds the ContextualRelevanceEvaluator.
- build() - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
- build() - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
- build() - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
- build() - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Builds the PrecisionEvaluator.
- build() - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Builds the RecallEvaluator.
- build() - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Builds the evaluator.
- build() - Method in class dev.dokimos.core.Example.Builder
- build() - Method in class dev.dokimos.core.Experiment.Builder
-
Builds the experiment.
- build() - Method in class dev.dokimos.core.gate.GateConfig.Builder
-
Builds the configuration.
- build() - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
- builder() - Static method in record class dev.dokimos.core.agents.AgentTrace
-
Creates a new builder for constructing agent traces.
- builder() - Static method in record class dev.dokimos.core.agents.ToolCall
-
Creates a new builder for constructing tool calls.
- builder() - Static method in record class dev.dokimos.core.agents.ToolDefinition
-
Creates a new builder for constructing tool definitions.
- builder() - Static method in class dev.dokimos.core.comparison.RunComparison
-
New builder with default configuration.
- builder() - Static method in class dev.dokimos.core.conversation.ConversationSimulator
-
Creates a new builder for constructing a conversation simulator.
- builder() - Static method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Creates a new builder for constructing trajectories.
- builder() - Static method in class dev.dokimos.core.conversation.LLMSimulatedUser
-
Creates a new builder for constructing an LLM simulated user.
- builder() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluator
-
Creates a new builder for constructing a trajectory evaluator.
- builder() - Static method in record class dev.dokimos.core.Dataset
-
Creates a new builder for constructing datasets.
- builder() - Static method in record class dev.dokimos.core.EvalResult
-
Creates a new builder for constructing results.
- builder() - Static method in record class dev.dokimos.core.EvalTestCase
-
Creates a new builder for constructing test cases.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.AgentEvalCase
-
Creates a new builder for constructing an agent
EvalTestCase. - builder() - Static method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher
-
Creates a new builder for constructing the matcher.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator
-
Creates a new builder for constructing the evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator
-
Creates a new builder for constructing the contextual relevance evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.ExactMatchEvaluator
-
Creates a new builder for constructing exact match evaluators.
- builder() - Static method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator
-
Creates a new builder for constructing the faithfulness evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.HallucinationEvaluator
-
Creates a new builder for constructing the hallucination evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator
- builder() - Static method in class dev.dokimos.core.evaluators.PrecisionEvaluator
-
Creates a new builder for constructing the precision evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.RecallEvaluator
-
Creates a new builder for constructing the recall evaluator.
- builder() - Static method in class dev.dokimos.core.evaluators.RegexEvaluator
- builder() - Static method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator
-
Creates a new builder for constructing structural match evaluators.
- builder() - Static method in record class dev.dokimos.core.Example
-
Creates a new builder for constructing examples.
- builder() - Static method in class dev.dokimos.core.Experiment
- builder() - Static method in class dev.dokimos.core.gate.GateConfig
-
Creates a new builder.
- builder() - Static method in class dev.dokimos.server.client.DokimosServerReporter
-
New builder for
DokimosServerReporter. - Builder() - Constructor for class dev.dokimos.core.agents.AgentTrace.Builder
- Builder() - Constructor for class dev.dokimos.core.agents.ToolCall.Builder
- Builder() - Constructor for class dev.dokimos.core.agents.ToolDefinition.Builder
- Builder() - Constructor for class dev.dokimos.core.comparison.RunComparison.Builder
- Builder() - Constructor for class dev.dokimos.core.conversation.ConversationSimulator.Builder
- Builder() - Constructor for class dev.dokimos.core.conversation.ConversationTrajectory.Builder
- Builder() - Constructor for class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
- Builder() - Constructor for class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.Dataset.Builder
- Builder() - Constructor for class dev.dokimos.core.EvalResult.Builder
- Builder() - Constructor for class dev.dokimos.core.EvalTestCase.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.RecallEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.RegexEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
- Builder() - Constructor for class dev.dokimos.core.Example.Builder
- Builder() - Constructor for class dev.dokimos.core.Experiment.Builder
- Builder() - Constructor for class dev.dokimos.core.gate.GateConfig.Builder
- byContainment(boolean) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches string items by checking if one contains the other.
- byEquality() - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches items using
Objects.equals(Object, Object). - byField(String) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches Map items by comparing a specific field.
- byFields(String...) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches Map items by comparing multiple fields.
- byIdentifier(Function<Object, Object>) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches items by extracting an identifier and comparing with equality.
C
- callMetrics() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Returns the
CallMetricscaptured from the completed run, with no price fallback. - callMetrics(String, PriceTable) - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Returns the
CallMetricscaptured from the completed run, lighting up the run's metrics cards. - CallMetrics - Record Class in dev.dokimos.core
-
Optional metrics describing the LLM call that produced an item result.
- CallMetrics(Integer, Integer, Double, Long) - Constructor for record class dev.dokimos.core.CallMetrics
-
Creates an instance of a
CallMetricsrecord class. - CANCELLED - Enum constant in enum class dev.dokimos.core.RunStatus
-
The run was cancelled before completion.
- CANCELLED - Enum constant in enum class dev.dokimos.server.entity.RunStatus
- candidateItems() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Returns the value of the
candidateItemsrecord component. - candidateMean() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns the value of the
candidateMeanrecord component. - candidateMean() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Returns the value of the
candidateMeanrecord component. - candidateMean() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns the value of the
candidateMeanrecord component. - candidateMean() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns the value of the
candidateMeanrecord component. - candidateMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Returns the value of the
candidateMeanrecord component. - candidateMean() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns the value of the
candidateMeanrecord component. - candidatePassProbability() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns the value of the
candidatePassProbabilityrecord component. - candidatePassRate() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
candidatePassRaterecord component. - candidatePassRate() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
candidatePassRaterecord component. - candidatePassRate() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
candidatePassRaterecord component. - candidatePassRate() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
candidatePassRaterecord component. - candidatePassRate() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
candidatePassRaterecord component. - candidateRunId() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
candidateRunIdrecord component. - candidateRunId() - Method in record class dev.dokimos.server.dto.v1.GateRequest
-
Returns the value of the
candidateRunIdrecord component. - candidateRunId() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
candidateRunIdrecord component. - caseInsensitive() - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches string items case-insensitively.
- caseInsensitive(boolean) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
-
Compares strings case-insensitively.
- cases() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
casesrecord component. - cases() - Method in record class dev.dokimos.server.dto.v1.DiffView
-
Returns the value of the
casesrecord component. - cases() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
casesrecord component. - casesTruncated() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
casesTruncatedrecord component. - casesTruncated() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
casesTruncatedrecord component. - CHAT_COMPLETIONS - Enum constant in enum class dev.dokimos.server.entity.LlmConnectionProtocol
-
The older Chat Completions API (
POST {baseUrl}/chat/completions,messages,choices). - ci() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
- ciHigh() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns the value of the
ciHighrecord component. - ciLow() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns the value of the
ciLowrecord component. - CLAIMED - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
- CLAIMED - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
- claimedAt() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
claimedAtrecord component. - ClaimedJob(TraceEvalJob, String, String) - Constructor for record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Creates an instance of a
ClaimedJobrecord class. - claimNext(int) - Method in interface dev.dokimos.server.repository.EvalJobRepository
-
Atomically claims the oldest pending job below the retry ceiling using
FOR UPDATE SKIP LOCKED, so multiple worker instances each pick a distinct job instead of blocking on, or double-processing, the same row. - claimNext(int) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
-
Atomically claims the oldest pending job below the retry ceiling using
FOR UPDATE SKIP LOCKED, so multiple worker instances each pick a distinct job instead of blocking on, or double-processing, the same row. - claimNextJob(int) - Method in class dev.dokimos.server.service.JudgeJobTransactions
-
Claims the oldest pending job below the retry ceiling: locks its row, marks it CLAIMED, stamps the claim time, and increments the attempt count.
- claimNextJob(int) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
-
Claims the oldest pending job below the retry ceiling: locks its row, marks it CLAIMED, stamps the claim time, and increments the attempt count.
- clarity() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating clarity of communication.
- ClasspathDatasetResolver - Class in dev.dokimos.core
- ClasspathDatasetResolver() - Constructor for class dev.dokimos.core.ClasspathDatasetResolver
- close() - Method in class dev.dokimos.core.NoOpReporter
- close() - Method in interface dev.dokimos.core.Reporter
-
Flushes pending items and releases resources.
- close() - Method in class dev.dokimos.server.client.DokimosServerReporter
- code() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
-
Returns the value of the
coderecord component. - coerce(Object) - Static method in class dev.dokimos.core.agents.ToolCalls
-
Coerces a value into a typed
List<ToolCall>. - compactWriter() - Static method in class dev.dokimos.core.internal.Json
-
A thread-safe writer producing compact (single-line) JSON.
- comparableCount() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns the value of the
comparableCountrecord component. - compare(ExperimentRun, ExperimentRun) - Method in class dev.dokimos.server.service.ComparisonSupport
-
Compares a baseline run against a candidate run with the core engine, deciding the pairing strategy from the runs' dataset versions and item links.
- compare(List<RunResult>, List<RunResult>) - Method in class dev.dokimos.core.comparison.RunComparison
-
Compares baseline runs against candidate runs.
- comparedPass() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
comparedPassrecord component. - ComparisonOutcome(RunComparisonResult, String, List<ItemResult>, List<ItemResult>) - Constructor for record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Creates an instance of a
ComparisonOutcomerecord class. - comparisonReader() - Static method in class dev.dokimos.core.internal.Json
-
A thread-safe reader configured for structural comparison: strict duplicate-key detection is enabled so
{"x":1,"x":2}fails rather than silently collapsing. - ComparisonStatus - Enum Class in dev.dokimos.core.comparison
-
Classification of how a metric or item changed between a baseline and a candidate.
- ComparisonSupport - Class in dev.dokimos.server.service
-
Shared entity-to-core conversion and run-comparison invocation for the regression gate and the per-case diff view.
- ComparisonSupport(ItemResultRepository) - Constructor for class dev.dokimos.server.service.ComparisonSupport
- ComparisonSupport.ComparisonOutcome - Record Class in dev.dokimos.server.service
-
Result of comparing two runs: the engine output, the pairing strategy, and the runs' loaded item entities so callers (the diff view) can derive per-case input text without re-querying.
- completedAt() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
completedAtrecord component. - completedAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
completedAtrecord component. - completedAt() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
completedAtrecord component. - completedAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
completedAtrecord component. - completeRun(RunHandle, RunStatus) - Method in class dev.dokimos.core.NoOpReporter
- completeRun(RunHandle, RunStatus) - Method in interface dev.dokimos.core.Reporter
-
Marks a run as complete.
- completeRun(RunHandle, RunStatus) - Method in class dev.dokimos.server.client.DokimosServerReporter
- config() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
configrecord component. - config() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
configrecord component. - confusedUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated confused user who struggles to understand.
- connectionId() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
connectionIdrecord component. - connectionId() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
connectionIdrecord component. - connectionId() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
connectionIdrecord component. - connectionId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
connectionIdrecord component. - consistency() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating consistency.
- constraintsKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets the metadata key for product constraints.
- content() - Method in record class dev.dokimos.core.conversation.Message
-
Returns the value of the
contentrecord component. - content() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
contentrecord component. - context() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Returns the value of the
contextrecord component. - CONTEXT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport
-
Default key for additional context in evaluation results.
- CONTEXT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport
-
Default key for additional context in evaluation results.
- contextKey(String) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
-
Sets the context key to use.
- contextKey(String) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
-
Sets the context key to use.
- ContextScore(String, double, String) - Constructor for record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Creates an instance of a
ContextScorerecord class. - ContextualRelevanceEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that measures how relevant retrieved context chunks are to a user's input query.
- ContextualRelevanceEvaluator.Builder - Class in dev.dokimos.core.evaluators
-
Builder for constructing ContextualRelevanceEvaluator instances.
- ContextualRelevanceEvaluator.ContextScore - Record Class in dev.dokimos.core.evaluators
-
Represents the relevance score for a single context chunk.
- ConversationalApplication - Interface in dev.dokimos.core.conversation
-
Functional interface representing an application that can engage in multi-turn conversations.
- conversationQuality() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating conversation quality.
- ConversationSimulator - Class in dev.dokimos.core.conversation
-
Orchestrates multi-turn conversations between a simulated user and an application.
- ConversationSimulator.Builder - Class in dev.dokimos.core.conversation
-
Builder for constructing conversation simulators.
- ConversationTrajectory - Record Class in dev.dokimos.core.conversation
-
Represents a complete conversation trajectory between a simulated user and an application.
- ConversationTrajectory(List<Message>, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.conversation.ConversationTrajectory
-
Compact constructor ensuring immutability.
- ConversationTrajectory.Builder - Class in dev.dokimos.core.conversation
-
Builder for constructing conversation trajectories.
- convert(Object, JavaType) - Static method in class dev.dokimos.core.internal.Json
-
Converts a value into an instance described by a Jackson
JavaType, supporting generic targets such asList<Foo>. - convert(Object, Class<T>) - Static method in class dev.dokimos.core.internal.Json
-
Converts a value into an instance of
typewithout an intermediate textual round-trip. - Converting Spring AI Evaluation Objects - Search tag in class dev.dokimos.springai.SpringAiSupport
- Section
- CORRECT - Enum constant in enum class dev.dokimos.server.entity.AnnotationVerdict
- costUsd() - Method in record class dev.dokimos.core.CallMetrics
-
Returns the value of the
costUsdrecord component. - costUsd() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
costUsdrecord component. - costUsd() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
costUsdrecord component. - costUsd(String, Integer, Integer) - Method in interface dev.dokimos.core.PriceTable
-
Computes the USD cost of a single call.
- count(TenantScope) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
- count(TenantScope) - Method in interface dev.dokimos.server.tenant.ScopedRepository
-
Counts the entities visible under the scope.
- count(TenantScope) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Counts the entities visible under the scope.
- countByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
- countCovered(Collection<?>, Collection<?>) - Method in interface dev.dokimos.core.MatchingStrategy
-
Counts how many distinct expected items are covered by any retrieved item.
- countItemsWithAllEvalsPassed(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
- countMatches(Collection<?>, Collection<?>) - Method in interface dev.dokimos.core.MatchingStrategy
-
Counts how many distinct retrieved items match any expected item.
- countPricedItemsByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Counts the run's items that carry a non-null cost, i.e. the items that contributed to
ItemResultRepository.sumCostByRun(ExperimentRun). - countTokenizedItemsByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Counts the run's items that carry a non-null prompt-token count, used as the denominator of the cost-coverage signal: an item with tokens but no cost is one a
PriceTablecould not price (unknown model or null token count), which is exactly the gap the signal reports. - create() - Static method in class dev.dokimos.core.comparison.RunComparison
-
Engine with default settings.
- create(CreateLlmConnectionRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
-
Registers an LLM connection.
- create(CreateApiKeyRequest) - Method in class dev.dokimos.server.service.ApiKeyService
-
Generates a key, stores its hash, and returns the raw key exactly once.
- create(CreateLlmConnectionRequest, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
-
Registers a connection.
- create(UUID, CreateAlertWebhookRequest, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
-
Registers a webhook for a project, stamped with the project's tenant.
- create(UUID, CreateTraceEvalRuleRequest, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
-
Creates a rule for a project, stamped with the project's tenant.
- createAlertWebhook(UUID, CreateAlertWebhookRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
-
Registers a webhook for the project.
- CreateAlertWebhookRequest - Record Class in dev.dokimos.server.dto.v1
-
Request to register an alert webhook for a project.
- CreateAlertWebhookRequest(String, String, Boolean) - Constructor for record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Creates an instance of a
CreateAlertWebhookRequestrecord class. - createApiKey(CreateApiKeyRequest) - Method in class dev.dokimos.server.controller.v1.ApiKeyController
-
Mints a key.
- CreateApiKeyRequest - Record Class in dev.dokimos.server.dto.v1
-
Request to mint a scoped API key.
- CreateApiKeyRequest(String, Role, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Creates an instance of a
CreateApiKeyRequestrecord class. - CreatedApiKeyView - Record Class in dev.dokimos.server.dto.v1
-
Response returned exactly once when a key is minted.
- CreatedApiKeyView(String, ApiKeyView) - Constructor for record class dev.dokimos.server.dto.v1.CreatedApiKeyView
-
Creates an instance of a
CreatedApiKeyViewrecord class. - createdAt() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
createdAtrecord component. - createdAt() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
createdAtrecord component. - createDataset(CreateDatasetRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Creates a dataset shell with no versions.
- createDataset(String, String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Creates a dataset whose name is unique within the scope, stamped with the scope's tenant.
- CreateDatasetRequest - Record Class in dev.dokimos.server.dto.v1
- CreateDatasetRequest(String, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateDatasetRequest
-
Creates an instance of a
CreateDatasetRequestrecord class. - createdBy() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
createdByrecord component. - createdBy() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns the value of the
createdByrecord component. - createdBy() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
createdByrecord component. - CreateLlmConnectionRequest - Record Class in dev.dokimos.server.dto.v1
-
Request to register an OpenAI-compatible LLM connection.
- CreateLlmConnectionRequest(String, String, String, LlmConnectionProtocol, String, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Creates an instance of a
CreateLlmConnectionRequestrecord class. - createRun(Experiment, CreateRunRequest, TenantScope) - Method in class dev.dokimos.server.service.RunService
-
Creates a run and persists its provenance fields (name, git SHA, branch, triggered_by) plus an optional link to the dataset version it executed against.
- createRun(Experiment, Map<String, Object>) - Method in class dev.dokimos.server.service.RunService
- createRun(String, CreateRunRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
- CreateRunRequest - Record Class in dev.dokimos.server.dto.v1
- CreateRunRequest(String, Map<String, Object>, String, String, String, String, String, Integer) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Creates an instance of a
CreateRunRequestrecord class. - CreateRunRequest(String, Map<String, Object>, String, String, String, String) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Backwards-compatible 6-arg constructor for callers that predate the dataset linkage.
- CreateRunResponse - Record Class in dev.dokimos.server.dto.v1
- CreateRunResponse(UUID) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunResponse
-
Creates an instance of a
CreateRunResponserecord class. - createTraceEvalRule(UUID, CreateTraceEvalRuleRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
-
Creates a rule.
- CreateTraceEvalRuleRequest - Record Class in dev.dokimos.server.dto.v1
-
Request to create or replace a trace eval rule.
- CreateTraceEvalRuleRequest(String, Boolean, TraceMatchType, String, String, UUID, String, String, double, double, Double) - Constructor for record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Creates an instance of a
CreateTraceEvalRuleRequestrecord class. - createVersion(String, CreateVersionRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Appends a new immutable version to the dataset with the supplied items.
- createVersion(String, String, List<CreateVersionRequest.ItemPayload>, String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Creates a new immutable version of the dataset visible under the scope and inserts all items in one transaction.
- CreateVersionRequest - Record Class in dev.dokimos.server.dto.v1
- CreateVersionRequest(String, List<CreateVersionRequest.ItemPayload>) - Constructor for record class dev.dokimos.server.dto.v1.CreateVersionRequest
-
Creates an instance of a
CreateVersionRequestrecord class. - CreateVersionRequest.ItemPayload - Record Class in dev.dokimos.server.dto.v1
- credentialRef() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns the value of the
credentialRefrecord component. - credentialRef() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
credentialRefrecord component. - credentialRef() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns the value of the
credentialRefrecord component. - criteria() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
criteriarecord component. - criteria() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
criteriarecord component. - criteria() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
criteriarecord component. - criteria(String) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Sets the evaluation criteria.
- criteria(List<EvaluationCriterion>) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets all evaluation criteria.
- criterion(EvaluationCriterion) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Adds an evaluation criterion.
- CURRENT_VERSION - Static variable in record class dev.dokimos.core.gate.BaselineFile
-
The current supported format version.
- currentVerdict() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
currentVerdictrecord component. - custom(JudgeLM, String, String) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a custom simulated user with the specified persona and guidelines.
- custom(String, String) - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a custom evaluation criterion.
- custom(String, String, double) - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a custom evaluation criterion with specified weight.
- custom(BiPredicate<Object, Object>) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Matches items using a custom predicate.
- customTask(Task) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a flexible
Taskthat allows full control over output mapping.
D
- dataset() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
datasetrecord component. - dataset(Dataset) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the dataset.
- Dataset - Class in dev.dokimos.server.entity
-
A named container that owns one or more immutable
DatasetVersions. - Dataset - Record Class in dev.dokimos.core
-
A collection of examples for evaluation.
- Dataset(String, String) - Constructor for class dev.dokimos.server.entity.Dataset
- Dataset(String, String, List<Example>) - Constructor for record class dev.dokimos.core.Dataset
-
Creates an instance of a
Datasetrecord class. - DATASET_ITEM_ID - Enum constant in enum class dev.dokimos.core.gate.GateConfig.Pairing
-
Always pair by
datasetItemId(fails if any item lacks one). - Dataset.Builder - Class in dev.dokimos.core
-
Builder for constructing datasets.
- DatasetArgumentsProvider - Class in dev.dokimos.junit
-
JUnit ArgumentsProvider that loads
Examples from aDataset. - DatasetArgumentsProvider() - Constructor for class dev.dokimos.junit.DatasetArgumentsProvider
- DatasetController - Class in dev.dokimos.server.controller.v1
- DatasetController(DatasetService) - Constructor for class dev.dokimos.server.controller.v1.DatasetController
- DatasetDetails - Record Class in dev.dokimos.server.dto.v1
- DatasetDetails(UUID, String, String, Instant, Instant, List<DatasetDetails.VersionSummary>) - Constructor for record class dev.dokimos.server.dto.v1.DatasetDetails
-
Creates an instance of a
DatasetDetailsrecord class. - DatasetDetails.VersionSummary - Record Class in dev.dokimos.server.dto.v1
- DatasetInfo(String, int) - Constructor for record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
-
Creates an instance of a
DatasetInforecord class. - DatasetItem - Class in dev.dokimos.server.entity
-
A single example within a
DatasetVersion. - DatasetItem(DatasetVersion, int, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.DatasetItem
- datasetItemId() - Method in record class dev.dokimos.core.Example
-
Returns the value of the
datasetItemIdrecord component. - datasetItemId() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Returns the value of the
datasetItemIdrecord component. - datasetItemId() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
datasetItemIdrecord component. - datasetItemId() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns the value of the
datasetItemIdrecord component. - datasetItemId() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Returns the value of the
datasetItemIdrecord component. - datasetItemId() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
datasetItemIdrecord component. - datasetItemId(String) - Method in class dev.dokimos.core.Example.Builder
-
Sets the stable dataset item id this example originates from.
- DatasetItemRecorder() - Constructor for class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
- DatasetItemRepository - Interface in dev.dokimos.server.repository
- DatasetItemView - Record Class in dev.dokimos.server.dto.v1
- DatasetItemView(UUID, int, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.DatasetItemView
-
Creates an instance of a
DatasetItemViewrecord class. - datasetName() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
datasetNamerecord component. - datasetName() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
datasetNamerecord component. - datasetName() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
datasetNamerecord component. - datasetName() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
-
Returns the value of the
datasetNamerecord component. - DatasetParser - Class in dev.dokimos.core
- datasetPath() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
datasetPathrecord component. - DatasetReporter - Annotation Interface in dev.dokimos.junit
-
Marks a static field that supplies the
ReporterforDatasetSourcetests. - DatasetRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
Dataset. - DatasetRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
Dataset. - DatasetRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
Datasetfinders. - DatasetRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
- DatasetResolutionException - Exception Class in dev.dokimos.core
-
Thrown when a dataset cannot be correctly resolved or loading fails.
- DatasetResolutionException(String) - Constructor for exception class dev.dokimos.core.DatasetResolutionException
- DatasetResolutionException(String, Throwable) - Constructor for exception class dev.dokimos.core.DatasetResolutionException
- DatasetResolver - Interface in dev.dokimos.core
-
Resolves a dataset URI to a
Dataset. - DatasetResolverRegistry - Class in dev.dokimos.core
-
Singleton registry for dataset resolvers.
- DatasetResolverRegistry() - Constructor for class dev.dokimos.core.DatasetResolverRegistry
-
Creates a fresh, independent registry.
- DatasetRunExtension - Class in dev.dokimos.junit
-
Opens and reports a
Reporterrun for eachDatasetSourcetest method. - DatasetRunExtension() - Constructor for class dev.dokimos.junit.DatasetRunExtension
- DatasetRunExtension.DatasetItemRecorder - Class in dev.dokimos.junit
-
Collects the actual outputs and evaluation results a
DatasetSourcetest body produced for one parameterized invocation. - DatasetService - Class in dev.dokimos.server.service
-
Service for server-owned versioned datasets.
- DatasetService(DatasetRepository, DatasetVersionRepository, DatasetItemRepository, ItemResultRepository) - Constructor for class dev.dokimos.server.service.DatasetService
- DatasetSource - Annotation Interface in dev.dokimos.junit
-
Provides
Examples from aDatasetas arguments to a parameterized test. - DatasetSummary - Record Class in dev.dokimos.server.dto.v1
- DatasetSummary(UUID, String, String, Integer, Integer, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.DatasetSummary
-
Creates an instance of a
DatasetSummaryrecord class. - datasetVersion() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
datasetVersionrecord component. - datasetVersion() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
datasetVersionrecord component. - datasetVersion() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
datasetVersionrecord component. - DatasetVersion - Class in dev.dokimos.server.entity
-
An immutable snapshot of a
Dataset. - DatasetVersion(Dataset, int, String, String, int) - Constructor for class dev.dokimos.server.entity.DatasetVersion
- DatasetVersionDetails - Record Class in dev.dokimos.server.dto.v1
- DatasetVersionDetails(UUID, String, int, String, int, Instant, String) - Constructor for record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Creates an instance of a
DatasetVersionDetailsrecord class. - datasetVersionId() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
datasetVersionIdrecord component. - datasetVersionId() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
datasetVersionIdrecord component. - datasetVersionId(ExperimentRun) - Method in class dev.dokimos.server.service.ComparisonSupport
-
The dataset version id of a run, or null for ad-hoc runs.
- DatasetVersionRepository - Interface in dev.dokimos.server.repository
- DEFAULT_API_VERSION - Static variable in class dev.dokimos.server.client.DokimosServerReporter
-
Default API version when none is specified.
- DEFAULT_MODEL - Static variable in class dev.dokimos.mcp.ToolHandlers
-
Default OpenAI model used when a run_evaluation call does not specify one.
- defaults() - Static method in class dev.dokimos.core.gate.GateConfig
-
Returns a configuration with all defaults.
- delete(UUID) - Method in class dev.dokimos.server.service.ApiKeyService
-
Permanently deletes a key.
- delete(UUID, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
-
Deletes a connection along with its judge job queue records.
- delete(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
-
Deletes a connection.
- delete(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
-
Deletes one of a project's webhooks.
- delete(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AnnotationService
-
Removes the annotation for the given run item result if one exists.
- delete(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
-
Deletes a rule.
- delete(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AnnotationController
-
Removes the annotation for the item result.
- delete(T) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
- delete(T) - Method in interface dev.dokimos.server.tenant.ScopedRepository
-
Removes an entity.
- deleteAlertWebhook(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
-
Deletes a webhook.
- deleteApiKey(UUID) - Method in class dev.dokimos.server.controller.v1.ApiKeyController
-
Permanently deletes a key.
- deleteByConnectionId(UUID) - Method in interface dev.dokimos.server.repository.EvalJobRepository
-
Removes the queue records for a connection.
- deleteByItemResultId(UUID) - Method in interface dev.dokimos.server.repository.AnnotationRepository
- deleteDataset(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Deletes a dataset visible under the scope.
- deleteDataset(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Deletes a dataset and its versions; runs that referenced any version become unlinked.
- deleteExperiment(UUID, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
-
Deletes an experiment visible under the scope; FKs cascade to its runs, items, and evals.
- deleteExperiment(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ExperimentController
- deleteExpired(Instant) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
-
Deletes traces whose retention window has closed, across all tenants; spans and trace eval jobs cascade.
- deleteExpired(Instant) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
- deleteProject(String, TenantScope) - Method in class dev.dokimos.server.service.ProjectService
-
Deletes a project visible under the scope; FKs cascade to its experiments, runs, items, and evals.
- deleteProject(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
- deleteRun(UUID, TenantScope) - Method in class dev.dokimos.server.service.RunService
-
Deletes a run visible under the scope; FKs cascade to its item and eval results.
- deleteRun(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
- deleteTraceEvalRule(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
-
Deletes a rule.
- delta() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns the value of the
deltarecord component. - delta() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Returns the value of the
deltarecord component. - delta() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns the value of the
deltarecord component. - delta() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns the value of the
deltarecord component. - delta() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Returns the value of the
deltarecord component. - delta() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns the value of the
deltarecord component. - description() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.core.Dataset
-
Returns the dataset's description.
- description() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
descriptionrecord component. - description() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
-
Returns the value of the
descriptionrecord component. - description(String) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
-
Sets the tool description.
- description(String) - Method in class dev.dokimos.core.Dataset.Builder
-
Sets the dataset description.
- description(String) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the description.
- detectJsonErrorField(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Controls whether a JSON object with a top-level
"error"field counts as an error. - dev.dokimos.core - package dev.dokimos.core
- dev.dokimos.core.agents - package dev.dokimos.core.agents
- dev.dokimos.core.comparison - package dev.dokimos.core.comparison
- dev.dokimos.core.conversation - package dev.dokimos.core.conversation
- dev.dokimos.core.evaluators - package dev.dokimos.core.evaluators
- dev.dokimos.core.evaluators.agents - package dev.dokimos.core.evaluators.agents
- dev.dokimos.core.exceptions - package dev.dokimos.core.exceptions
- dev.dokimos.core.export - package dev.dokimos.core.export
- dev.dokimos.core.gate - package dev.dokimos.core.gate
- dev.dokimos.core.internal - package dev.dokimos.core.internal
- dev.dokimos.embabel - package dev.dokimos.embabel
- dev.dokimos.junit - package dev.dokimos.junit
- dev.dokimos.langchain4j - package dev.dokimos.langchain4j
- dev.dokimos.mcp - package dev.dokimos.mcp
- dev.dokimos.mcp.store - package dev.dokimos.mcp.store
- dev.dokimos.openai - package dev.dokimos.openai
- dev.dokimos.server - package dev.dokimos.server
- dev.dokimos.server.client - package dev.dokimos.server.client
- dev.dokimos.server.config - package dev.dokimos.server.config
- dev.dokimos.server.controller - package dev.dokimos.server.controller
- dev.dokimos.server.controller.v1 - package dev.dokimos.server.controller.v1
- dev.dokimos.server.dto.v1 - package dev.dokimos.server.dto.v1
- dev.dokimos.server.dto.v1.otlp - package dev.dokimos.server.dto.v1.otlp
- dev.dokimos.server.entity - package dev.dokimos.server.entity
- dev.dokimos.server.filter - package dev.dokimos.server.filter
- dev.dokimos.server.judge - package dev.dokimos.server.judge
- dev.dokimos.server.repository - package dev.dokimos.server.repository
- dev.dokimos.server.service - package dev.dokimos.server.service
- dev.dokimos.server.tenant - package dev.dokimos.server.tenant
- dev.dokimos.springai - package dev.dokimos.springai
- dev.dokimos.springai.alibaba - package dev.dokimos.springai.alibaba
- dialogKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets the inputs key for the dialog.
- diff(UUID, UUID, UUID, String, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DiffController
-
Returns the per-case diff between a candidate run and an explicit baseline run.
- DiffCase - Record Class in dev.dokimos.server.dto.v1
-
One row of the per-case run-diff table: a single item compared across baseline and candidate, with its per-evaluator old-to-new deltas.
- DiffCase(String, String, String, boolean, String, List<DiffCase.EvaluatorDiff>) - Constructor for record class dev.dokimos.server.dto.v1.DiffCase
-
Creates an instance of a
DiffCaserecord class. - DiffCase.EvaluatorDiff - Record Class in dev.dokimos.server.dto.v1
-
A single evaluator's change on one item between baseline and candidate.
- DiffController - Class in dev.dokimos.server.controller.v1
-
Exposes the per-case run-diff view: the same comparison the CI gate runs, presented as a full, paginated table of every case with per-evaluator deltas.
- DiffController(DiffService) - Constructor for class dev.dokimos.server.controller.v1.DiffController
- DiffService - Class in dev.dokimos.server.service
-
Builds the per-case run-diff view for the UI.
- DiffService(ExperimentRepository, ExperimentRunRepository, ComparisonSupport) - Constructor for class dev.dokimos.server.service.DiffService
- DiffSummary - Record Class in dev.dokimos.server.dto.v1
-
Whole-run summary of a per-case run diff.
- DiffSummary(String, UUID, UUID, Double, Double, Double, boolean, int, int, int, int, int) - Constructor for record class dev.dokimos.server.dto.v1.DiffSummary
-
Creates an instance of a
DiffSummaryrecord class. - DiffView - Record Class in dev.dokimos.server.dto.v1
-
Combined per-case run-diff payload: the whole-run summary plus the first (or requested) page of cases.
- DiffView(DiffSummary, PageResponse<DiffCase>) - Constructor for record class dev.dokimos.server.dto.v1.DiffView
-
Creates an instance of a
DiffViewrecord class. - disable() - Method in class dev.dokimos.server.entity.ApiKey
-
Disables the key so future authentication attempts with it are rejected.
- disable(UUID) - Method in class dev.dokimos.server.service.ApiKeyService
-
Disables a key so future authentication attempts with it are rejected, keeping its record for audit.
- disableApiKey(UUID) - Method in class dev.dokimos.server.controller.v1.ApiKeyController
-
Disables a key so it can no longer authenticate.
- DokimosMcpServer - Class in dev.dokimos.mcp
-
MCP server that exposes dokimos evaluation tools over stdio transport.
- DokimosMcpServer() - Constructor for class dev.dokimos.mcp.DokimosMcpServer
- DokimosServerApplication - Class in dev.dokimos.server
- DokimosServerApplication() - Constructor for class dev.dokimos.server.DokimosServerApplication
- DokimosServerReporter - Class in dev.dokimos.server.client
-
Async HTTP
Reporterthat sends experiment results to a Dokimos server. - DokimosServerReporter.Builder - Class in dev.dokimos.server.client
-
Builder for
DokimosServerReporter. - DokimosServerReporter.ItemDeliveryFailure - Record Class in dev.dokimos.server.client
-
Describes a batch of items permanently dropped after all delivery retries were exhausted.
- DokimosTypeConversionException - Exception Class in dev.dokimos.core.exceptions
-
Thrown when a stored output value cannot be converted to the requested type by one of the typed read accessors (for example
EvalTestCase.actualOutputAs(Class)orExample.expectedOutputAs(dev.dokimos.core.OutputType)). - DokimosTypeConversionException(String) - Constructor for exception class dev.dokimos.core.exceptions.DokimosTypeConversionException
-
Creates an exception with the given detail message.
- DokimosTypeConversionException(String, Throwable) - Constructor for exception class dev.dokimos.core.exceptions.DokimosTypeConversionException
-
Creates an exception with the given detail message and underlying cause.
- dokimosVersion() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
-
Returns the value of the
dokimosVersionrecord component. - doubleValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns the value of the
doubleValuerecord component.
E
- EDITOR - Enum constant in enum class dev.dokimos.server.filter.Role
- EmbabelSupport - Class in dev.dokimos.embabel
-
Entry point for evaluating Embabel agent runs with Dokimos.
- EmbabelTraceCollector - Class in dev.dokimos.embabel
-
Accumulates an Embabel agent's tool calls into a Dokimos
AgentTrace. - EmbabelTraceCollector() - Constructor for class dev.dokimos.embabel.EmbabelTraceCollector
-
Creates a fresh collector with no captured events.
- empty() - Static method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Creates an empty trajectory with no messages.
- empty() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
emptyrecord component. - empty() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Returns the value of the
emptyrecord component. - enabled() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns the value of the
enabledrecord component. - enabled() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
enabledrecord component. - enabled() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Returns the value of the
enabledrecord component. - enabled() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
enabledrecord component. - enabled() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
enabledrecord component. - enabled() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Returns the value of the
enabledrecord component. - enabledOrDefault() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
- encryptInlineKey(LlmConnection, String) - Method in class dev.dokimos.server.service.LlmCredentialService
-
Returns a copy of the connection with its inline key encrypted.
- endTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
endTimeUnixNanorecord component. - endTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
endTimeUnixNanorecord component. - endTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
endTimeUnixNanorecord component. - endTimeUnixNano() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
endTimeUnixNanorecord component. - enqueue(UUID, EnqueueJudgeRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.EvalJobController
-
Enqueues server-side scoring for a run.
- enqueue(UUID, EnqueueJudgeRequest, TenantScope) - Method in class dev.dokimos.server.service.EvalJobService
-
Enqueues a judge job for a run and moves the run into the evaluating state.
- enqueueForTrace(Trace) - Method in class dev.dokimos.server.service.TraceEvalEnqueuer
-
Enqueues online eval jobs for a persisted trace.
- EnqueueJudgeRequest - Record Class in dev.dokimos.server.dto.v1
-
Request to enqueue a server-side judge job for a run.
- EnqueueJudgeRequest(UUID, String, String, List<String>, double, double, Double) - Constructor for record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Creates an instance of a
EnqueueJudgeRequestrecord class. - entries() - Element in annotation interface dev.dokimos.junit.DatasetSource
-
Run metadata as typed key-value entries (for example
{@MetadataEntry(key = "model", value = "gpt-4")}). - epsilon(double) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
-
Minimum absolute delta below which a change counts as UNCHANGED.
- equals(Object) - Method in record class dev.dokimos.core.agents.AgentTrace
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.agents.ToolCall
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.CallMetrics
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.conversation.Message
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.Dataset
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.EvalResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.EvalTestCase
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.Example
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.ExperimentResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.ItemResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in class dev.dokimos.core.OutputType
- equals(Object) - Method in record class dev.dokimos.core.RunHandle
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.RunResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.core.TaskResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.mcp.store.RunRecord
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AlignmentView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.DiffView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TrendData
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
- equals(Object) - Method in record class dev.dokimos.server.filter.Principal
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.RegressionAlertEvent
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.server.tenant.TenantScope
-
Indicates whether some other object is "equal to" this one.
- equals(Object) - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Indicates whether some other object is "equal to" this one.
- errorDetector(Predicate<String>) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Sets a custom predicate that flags a result string as an error.
- Eval() - Constructor for class dev.dokimos.server.config.TraceProperties.Eval
- EvalData(String, double, Double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Creates an instance of a
EvalDatarecord class. - EvalDetail(String, double, boolean, String) - Constructor for record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Creates an instance of a
EvalDetailrecord class. - EvalJob - Class in dev.dokimos.server.entity
-
A unit of server-side scoring work: score every not-yet-evaluated item of a run with a single evaluator configuration, using a registered
LlmConnection. - EvalJob(ExperimentRun, LlmConnection, String, String) - Constructor for class dev.dokimos.server.entity.EvalJob
- EvalJobController - Class in dev.dokimos.server.controller.v1
- EvalJobController(EvalJobService) - Constructor for class dev.dokimos.server.controller.v1.EvalJobController
- EvalJobRepository - Interface in dev.dokimos.server.repository
- evalJobs() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
evalJobsrecord component. - EvalJobService - Class in dev.dokimos.server.service
-
Enqueues server-side judge jobs and reads the jobs registered for a run.
- EvalJobService(EvalJobRepository, ExperimentRunRepository, LlmConnectionRepository) - Constructor for class dev.dokimos.server.service.EvalJobService
- EvalJobStatus - Enum Class in dev.dokimos.server.entity
-
Lifecycle state of an
EvalJob. - EvalJobView - Record Class in dev.dokimos.server.dto.v1
-
Public view of an
EvalJob, returned by the enqueue endpoint and the per-run job listing. - EvalJobView(UUID, UUID, UUID, String, EvalJobStatus, int, String, Instant, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.EvalJobView
-
Creates an instance of a
EvalJobViewrecord class. - evalResult() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
-
Returns the value of the
evalResultrecord component. - evalResult(EvalResult) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
-
Records a single evaluation result.
- EvalResult - Class in dev.dokimos.server.entity
- EvalResult - Record Class in dev.dokimos.core
-
The result of an evaluation.
- EvalResult(String, double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult
-
Creates an EvalResult without a threshold (for backwards compatibility).
- EvalResult(String, double, Double, boolean, String) - Constructor for class dev.dokimos.server.entity.EvalResult
- EvalResult(String, double, Double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult
-
Creates an instance of a
EvalResultrecord class. - EvalResult.Builder - Class in dev.dokimos.core
-
Builder for constructing evaluation results.
- EvalResultRepository - Interface in dev.dokimos.server.repository
- evalResults() - Method in record class dev.dokimos.core.ItemResult
-
Returns the value of the
evalResultsrecord component. - evalResults() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
evalResultsrecord component. - evalResults() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
evalResultsrecord component. - evalResults() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
evalResultsrecord component. - evalResults(List<EvalResult>) - Method in class dev.dokimos.junit.DatasetRunExtension.DatasetItemRecorder
-
Records multiple evaluation results.
- EvalSummary(UUID, String, double, Double, boolean, String) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Creates an instance of a
EvalSummaryrecord class. - EvalTestCase - Record Class in dev.dokimos.core
-
A test case for evaluation.
- EvalTestCase(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalTestCase
-
Creates an instance of a
EvalTestCaserecord class. - EvalTestCase.Builder - Class in dev.dokimos.core
-
Builder for constructing test cases with multiple inputs and outputs.
- EvalTestCaseParam - Enum Class in dev.dokimos.core
- evaluate(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator
- evaluate(EvalTestCase) - Method in interface dev.dokimos.core.Evaluator
-
Evaluates the test case and returns a scored result.
- evaluate(ExperimentResult, BaselineFile, GateConfig) - Static method in class dev.dokimos.core.gate.RegressionGate
-
Compares a candidate against a baseline and returns the gate verdict.
- evaluateAsync(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator
-
Evaluates the test case asynchronously using the common fork-join pool.
- evaluateAsync(EvalTestCase, ExecutorService) - Method in class dev.dokimos.core.BaseEvaluator
-
Evaluates the test case asynchronously using the provided executor.
- evaluateGate(UUID, GateRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.GateController
-
Evaluates the regression gate for a candidate run.
- evaluateGate(UUID, GateRequest, TenantScope) - Method in class dev.dokimos.server.service.GateService
-
Evaluates the regression gate for a candidate run within an experiment.
- evaluateOnCompletion(ExperimentRun) - Method in class dev.dokimos.server.service.RegressionAlertService
-
Evaluates a completed run for a significant pass-rate regression and, if found, publishes a regression alert event.
- EVALUATING - Enum constant in enum class dev.dokimos.server.entity.RunStatus
- EvaluationCriterion - Record Class in dev.dokimos.core.conversation
-
Defines a single evaluation dimension for trajectory evaluation.
- EvaluationCriterion(String, String, double) - Constructor for record class dev.dokimos.core.conversation.EvaluationCriterion
-
Compact constructor with validation.
- EvaluationException - Exception Class in dev.dokimos.core.evaluators
-
Thrown when an evaluation cannot be executed successfully.
- EvaluationException(String) - Constructor for exception class dev.dokimos.core.evaluators.EvaluationException
- EvaluationException(String, Throwable) - Constructor for exception class dev.dokimos.core.evaluators.EvaluationException
- evaluationParams() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
evaluationParamsrecord component. - evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Sets which test case parameters to validate before evaluation.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
-
Sets which test case parameters to use for the evaluation.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
-
Sets which test case parameters to use for the evaluation.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
-
Sets which test case parameters to use for the evaluation.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Sets which test case parameters to include in the prompt.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Sets which test case parameters to validate before evaluation.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Sets which test case parameters to validate before evaluation.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
-
Sets which test case parameters to evaluate.
- evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Sets which test case parameters to validate.
- evaluations() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns the value of the
evaluationsrecord component. - evaluator() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Returns the value of the
evaluatorrecord component. - evaluator() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns the value of the
evaluatorrecord component. - evaluator() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Returns the value of the
evaluatorrecord component. - evaluator() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Returns the value of the
evaluatorrecord component. - evaluator() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns the value of the
evaluatorrecord component. - evaluator(Evaluator) - Method in class dev.dokimos.core.Experiment.Builder
-
Adds a single evaluator to the experiment.
- Evaluator - Interface in dev.dokimos.core
-
Evaluates test cases and produces scored results.
- EvaluatorAlignment(String, int, int, int, Double) - Constructor for record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Creates an instance of a
EvaluatorAlignmentrecord class. - EvaluatorDelta - Record Class in dev.dokimos.core.comparison
-
Change in a single evaluator's mean score between baseline and candidate.
- EvaluatorDelta(String, Double, Double, double, ComparisonStatus, SignificanceResult) - Constructor for record class dev.dokimos.core.comparison.EvaluatorDelta
-
Creates an instance of a
EvaluatorDeltarecord class. - evaluatorDeltas() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns the value of the
evaluatorDeltasrecord component. - evaluatorDeltas() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
evaluatorDeltasrecord component. - EvaluatorDiff(String, Double, Double, double, String, boolean) - Constructor for record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Creates an instance of a
EvaluatorDiffrecord class. - EvaluatorDrop(String, Double, Double, double) - Constructor for record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Creates an instance of a
EvaluatorDroprecord class. - EvaluatorDrop(String, Double, Double, double) - Constructor for record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Creates an instance of a
EvaluatorDroprecord class. - evaluatorDrops() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Returns the value of the
evaluatorDropsrecord component. - evaluatorDrops() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Returns the value of the
evaluatorDropsrecord component. - EvaluatorEntry(String, double, Double, boolean) - Constructor for record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Creates an instance of a
EvaluatorEntryrecord class. - evaluatorName() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
evaluatorNamerecord component. - evaluatorName() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
evaluatorNamerecord component. - evaluatorNames() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the names of all evaluators used in this experiment.
- evaluators() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Returns the value of the
evaluatorsrecord component. - evaluators() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
-
Returns the value of the
evaluatorsrecord component. - evaluators() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns the value of the
evaluatorsrecord component. - evaluators(List<Evaluator>) - Method in class dev.dokimos.core.Experiment.Builder
-
Adds multiple evaluators to the experiment.
- EXACT - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
-
Same key set as expected, all values match.
- ExactMatchEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that checks for exact string match between actual and expected outputs.
- ExactMatchEvaluator.Builder - Class in dev.dokimos.core.evaluators
- example() - Method in record class dev.dokimos.core.ItemResult
-
Returns the value of the
examplerecord component. - Example - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
- Section
- Example - Record Class in dev.dokimos.core
-
A dataset example with inputs, expected outputs, and metadata.
- Example(Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.Example
-
Creates an example with no dataset item id.
- Example(Map<String, Object>, Map<String, Object>, Map<String, Object>, String) - Constructor for record class dev.dokimos.core.Example
-
Compact constructor that creates immutable copies of all maps.
- Example.Builder - Class in dev.dokimos.core
-
Builder for constructing examples with multiple inputs and outputs.
- examples() - Method in record class dev.dokimos.core.Dataset
-
Returns the examples in the dataset.
- excludedUnsure() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns the value of the
excludedUnsurerecord component. - existsByEnabledTrue() - Method in interface dev.dokimos.server.repository.ApiKeyRepository
-
Returns true when at least one enabled key exists, which puts the deployment in authenticated mode.
- existsByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
-
Returns whether a dataset with the name exists within the scope.
- existsByName(String, TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
- existsByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.LlmConnectionRepositoryFragment
-
Returns whether a connection with the name exists within the scope.
- existsByName(String, TenantScope) - Method in class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
- existsByProjectIdAndName(UUID, String, TenantScope) - Method in interface dev.dokimos.server.repository.TraceEvalRuleRepositoryFragment
-
Returns whether a rule of the name already exists in the project, within the scope.
- existsByProjectIdAndName(UUID, String, TenantScope) - Method in class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
- existsByRunAndEvaluatorName(ExperimentRun, String) - Method in interface dev.dokimos.server.repository.EvalJobRepository
- existsByRunIdAndIdempotencyKey(UUID, String) - Method in interface dev.dokimos.server.repository.IngestedBatchRepository
-
Checks whether a batch with the given idempotency key has already been committed for the run.
- EXPECTED_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
- expectedKey(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Sets the key for expected (relevant) items in expectedOutputs.
- expectedKey(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Sets the key for expected (relevant) items in expectedOutputs.
- expectedOutput() - Method in record class dev.dokimos.core.EvalTestCase
-
Gets the primary expected output value.
- expectedOutput() - Method in record class dev.dokimos.core.Example
-
Returns the primary expected output value.
- expectedOutput() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns the value of the
expectedOutputrecord component. - expectedOutput() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
expectedOutputrecord component. - expectedOutput() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
expectedOutputrecord component. - expectedOutput() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Returns the value of the
expectedOutputrecord component. - expectedOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Sets the primary expected output value.
- expectedOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds an expected output with the given key and value.
- expectedOutput(String, Object) - Method in class dev.dokimos.core.Example.Builder
-
Adds an expected output with the given key and value.
- expectedOutputAs(OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the primary expected output (
"output") converted to the given generic type. - expectedOutputAs(OutputType<T>) - Method in record class dev.dokimos.core.Example
-
Reads the primary expected output (
"output") converted to the given generic type. - expectedOutputAs(Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the primary expected output (
"output") converted to the given type. - expectedOutputAs(Class<T>) - Method in record class dev.dokimos.core.Example
-
Reads the primary expected output (
"output") converted to the given type. - expectedOutputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the expected output under
keyconverted to the given generic type. - expectedOutputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.Example
-
Reads the expected output under
keyconverted to the given generic type. - expectedOutputAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the expected output under
keyconverted to the given type. - expectedOutputAs(String, Class<T>) - Method in record class dev.dokimos.core.Example
-
Reads the expected output under
keyconverted to the given type. - expectedOutputs() - Method in record class dev.dokimos.core.EvalTestCase
-
Returns the value of the
expectedOutputsrecord component. - expectedOutputs() - Method in record class dev.dokimos.core.Example
-
Returns the value of the
expectedOutputsrecord component. - expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
expectedOutputsrecord component. - expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Returns the value of the
expectedOutputsrecord component. - expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns the value of the
expectedOutputsrecord component. - expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds all entries from the given expected outputs map.
- expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder
-
Adds all entries from the given expected outputs map.
- expectedToolCalls(List<ToolCall>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
-
Sets the expected tool calls (the
"toolCalls"key in expected outputs). - expectedToolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets the key used to retrieve expected tool calls from expectedOutputs.
- expectedToolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets the key used to retrieve expected tool calls from expectedOutputs.
- experiment() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
experimentrecord component. - Experiment - Class in dev.dokimos.core
-
An evaluation experiment that runs a task against a dataset and evaluates the results.
- Experiment - Class in dev.dokimos.server.entity
- Experiment(Project, String) - Constructor for class dev.dokimos.server.entity.Experiment
- Experiment.Builder - Class in dev.dokimos.core
- ExperimentController - Class in dev.dokimos.server.controller.v1
- ExperimentController(ExperimentService, RunService) - Constructor for class dev.dokimos.server.controller.v1.ExperimentController
- experimentCount() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Returns the value of the
experimentCountrecord component. - experimentId() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
experimentIdrecord component. - experimentId() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
experimentIdrecord component. - experimentId() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
experimentIdrecord component. - experimentName() - Element in annotation interface dev.dokimos.junit.DatasetSource
-
Name of the run opened when a
DatasetReporterfield is present. - experimentName() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
experimentNamerecord component. - experimentName() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
experimentNamerecord component. - experimentName() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
experimentNamerecord component. - experimentName() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
experimentNamerecord component. - experimentName() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
experimentNamerecord component. - experimentName() - Method in record class dev.dokimos.server.dto.v1.TrendData
-
Returns the value of the
experimentNamerecord component. - ExperimentRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
Experiment. - ExperimentRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
Experiment. - ExperimentRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
Experimentfinders. - ExperimentRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.ExperimentRepositoryFragmentImpl
- ExperimentResult - Record Class in dev.dokimos.core
-
Aggregated results from an experiment.
- ExperimentResult(String, String, Map<String, Object>, List<RunResult>) - Constructor for record class dev.dokimos.core.ExperimentResult
-
Creates an instance of a
ExperimentResultrecord class. - ExperimentResultExporter - Class in dev.dokimos.core.export
-
Utility class for exporting
ExperimentResultto various formats. - ExperimentRun - Class in dev.dokimos.server.entity
- ExperimentRun(Experiment, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.ExperimentRun
- ExperimentRunRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
ExperimentRun. - ExperimentRunRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
ExperimentRun. - ExperimentRunRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
ExperimentRunfinders. - ExperimentRunRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
- ExperimentService - Class in dev.dokimos.server.service
- ExperimentService(ExperimentRepository, ExperimentRunRepository) - Constructor for class dev.dokimos.server.service.ExperimentService
- ExperimentSummary - Record Class in dev.dokimos.server.dto.v1
- ExperimentSummary(UUID, String, Instant, ExperimentSummary.LatestRunInfo) - Constructor for record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Creates an instance of a
ExperimentSummaryrecord class. - ExperimentSummary.LatestRunInfo - Record Class in dev.dokimos.server.dto.v1
- expiresAt() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
expiresAtrecord component. - expiresAt() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
expiresAtrecord component. - exportCsv(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to a CSV file.
- exportCsv(Path) - Method in record class dev.dokimos.core.ExperimentResult
-
Exports the experiment result to a CSV file.
- exportHtml(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to an HTML file.
- exportHtml(Path) - Method in record class dev.dokimos.core.ExperimentResult
-
Exports the experiment result to an HTML file.
- exportJson(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to a JSON file.
- exportJson(Path) - Method in record class dev.dokimos.core.ExperimentResult
-
Exports the experiment result to a JSON file.
- exportMarkdown(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to a Markdown file.
- exportMarkdown(Path) - Method in record class dev.dokimos.core.ExperimentResult
-
Exports the experiment result to a Markdown file.
- extractJson(String) - Static method in class dev.dokimos.core.LlmResponseUtils
-
Extracts the JSON payload from an LLM response.
- extractTexts(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Extracts text content from a list of LangChain4j
Contentobjects. - extractTextsWithMetadata(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Extracts text content with metadata from a list of LangChain4j
Contentobjects.
F
- FAIL - Enum constant in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
-
Fail the gate: a dropped evaluator is indistinguishable from hiding a regression.
- failCount() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the average number of items that failed across all runs.
- failCount() - Method in record class dev.dokimos.core.RunResult
-
Returns the number of items that failed at least one evaluation in this run.
- failCount() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
failCountrecord component. - FAILED - Enum constant in enum class dev.dokimos.core.RunStatus
-
The run failed due to an error.
- FAILED - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
- FAILED - Enum constant in enum class dev.dokimos.server.entity.RunStatus
- FAILED - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
- failEvaluatedRun(UUID) - Method in class dev.dokimos.server.service.RunService
-
Moves an evaluating run to FAILED when its judge job has terminally failed, so the run does not stay stuck in EVALUATING.
- failOnRegression() - Method in class dev.dokimos.core.gate.GateConfig
- failOnRegression(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- failOnRemovedItems() - Method in class dev.dokimos.core.gate.GateConfig
- failOnRemovedItems(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- failure(String, double, String) - Static method in record class dev.dokimos.core.EvalResult
-
Creates a failed result.
- FaithfulnessEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that uses an LLM to check how much of the actual output is backed by the given context.
- FaithfulnessEvaluator.Builder - Class in dev.dokimos.core.evaluators
- FileDatasetResolver - Class in dev.dokimos.core
-
Resolves datasets from the filesystem.
- FileDatasetResolver() - Constructor for class dev.dokimos.core.FileDatasetResolver
- finalizeEvaluatedRun(UUID) - Method in class dev.dokimos.server.service.RunService
-
Finalizes a run whose judge job has finished scoring: re-computes the materialized pass-rate fields and moves the run to SUCCESS.
- finalResponse() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns the value of the
finalResponserecord component. - finalResponse(String) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Sets the agent's final text response.
- findAll(TenantScope) - Method in class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
- findAll(TenantScope) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
- findAll(TenantScope) - Method in interface dev.dokimos.server.tenant.ScopedRepository
-
Lists every entity visible under the scope.
- findAll(TenantScope, BiFunction<CriteriaBuilder, Root<T>, List<Order>>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Lists every entity visible under the scope, with an optional
order. - findAllOrdered(TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
-
Lists datasets visible under the scope, newest first.
- findAllOrdered(TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
- findAllOrdered(TenantScope) - Method in interface dev.dokimos.server.repository.LlmConnectionRepositoryFragment
-
Lists connections visible under the scope, newest first.
- findAllOrdered(TenantScope) - Method in class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
- findAllOrdered(Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
-
Lists traces newest first within the scope, paginated.
- findAllOrdered(Pageable, TenantScope) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
- findAllWithEvalsByIdIn(Collection<UUID>) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Loads the given items with their eval results fetch-joined, used to initialize the lazy
evalResultscollection on a page of items in one query rather than per row. - findAllWithExperimentCount(TenantScope) - Method in interface dev.dokimos.server.repository.ProjectRepositoryFragment
-
Returns each visible project paired with its experiment count, newest first, as
[Project, Long]rows. - findAllWithExperimentCount(TenantScope) - Method in class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
- findBaselineCandidates(Experiment, UUID, UUID, String, Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
-
SUCCESS baseline candidates for automatic gate resolution, within the scope, newest first.
- findBaselineCandidates(Experiment, UUID, UUID, String, Pageable, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
- findByDatasetAndVersion(Dataset, int) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
- findByDatasetOrderByVersionDesc(Dataset) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
- findByDatasetVersionOrderByOrdinalAsc(DatasetVersion, Pageable) - Method in interface dev.dokimos.server.repository.DatasetItemRepository
- findByExperiment(Experiment, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
-
Lists an experiment's runs newest first, within the scope.
- findByExperiment(Experiment, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
- findById(UUID, TenantScope) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
- findById(UUID, TenantScope) - Method in interface dev.dokimos.server.tenant.ScopedRepository
-
Loads an entity by id only if it is visible under the scope.
- findById(UUID, TenantScope) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Loads an entity by id under the scope; a row of another tenant returns empty, never leaking existence.
- findByIdForUpdate(UUID, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
-
Loads a run by id within the scope under a write lock, to serialize ingestion against completion.
- findByIdForUpdate(UUID, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
- findByIdForUpdate(UUID, TenantScope) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Loads an entity by id under the scope and a pessimistic write lock, to serialize concurrent writers.
- findByItemResultId(UUID) - Method in interface dev.dokimos.server.repository.AnnotationRepository
- findByItemResultIdIn(Collection<UUID>) - Method in interface dev.dokimos.server.repository.AnnotationRepository
- findByKeyHashAndEnabledTrue(String) - Method in interface dev.dokimos.server.repository.ApiKeyRepository
-
Looks up an enabled key by its SHA-256 hex hash.
- findByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
-
Finds a dataset by name within the scope.
- findByName(String, TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
- findByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.LlmConnectionRepositoryFragment
-
Finds a connection by name within the scope.
- findByName(String, TenantScope) - Method in class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
- findByName(String, TenantScope) - Method in interface dev.dokimos.server.repository.ProjectRepositoryFragment
-
Looks up a project by name within the scope.
- findByName(String, TenantScope) - Method in class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
- findByNameForUpdate(String, TenantScope) - Method in interface dev.dokimos.server.repository.DatasetRepositoryFragment
-
Finds a dataset by name within the scope under a pessimistic write lock, for version creation.
- findByNameForUpdate(String, TenantScope) - Method in class dev.dokimos.server.repository.DatasetRepositoryFragmentImpl
- findByProject(Project, TenantScope) - Method in interface dev.dokimos.server.repository.AlertWebhookRepositoryFragment
-
Lists a project's webhooks oldest first, within the scope.
- findByProject(Project, TenantScope) - Method in class dev.dokimos.server.repository.AlertWebhookRepositoryFragmentImpl
- findByProject(Project, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRepositoryFragment
-
Lists a project's experiments newest first, within the scope.
- findByProject(Project, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRepositoryFragmentImpl
- findByProjectAndName(Project, String, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRepositoryFragment
-
Finds an experiment of a project by name within the scope.
- findByProjectAndName(Project, String, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRepositoryFragmentImpl
- findByProjectId(UUID, TenantScope) - Method in interface dev.dokimos.server.repository.TraceEvalRuleRepositoryFragment
-
Lists a project's rules oldest first, within the scope.
- findByProjectId(UUID, TenantScope) - Method in class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
- findByProjectId(UUID, Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
-
Lists a project's traces newest first within the scope, paginated.
- findByProjectId(UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
- findByProjectIdAndEnabledTrue(UUID) - Method in interface dev.dokimos.server.repository.AlertWebhookRepositoryFragment
-
Enabled webhooks of a project regardless of tenant, the set dispatched to on a regressing run.
- findByProjectIdAndEnabledTrue(UUID) - Method in class dev.dokimos.server.repository.AlertWebhookRepositoryFragmentImpl
- findByProjectIdAndEnabledTrue(UUID) - Method in interface dev.dokimos.server.repository.TraceEvalRuleRepositoryFragment
-
Enabled rules for a project regardless of tenant, used by ingestion to decide which spans to enqueue.
- findByProjectIdAndEnabledTrue(UUID) - Method in class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
- findByRunIdWithEvals(UUID) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Loads all item results for a run with their eval results fetch-joined in one query.
- findByRunOrderByCreatedAtAsc(ExperimentRun) - Method in interface dev.dokimos.server.repository.EvalJobRepository
- findByRunOrderByCreatedAtAsc(ExperimentRun, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
- findByRunWithEvals(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Loads all item results for a run with their eval results and dataset-item link fetch-joined in one query, avoiding the N+1 the lazy
evalResultscollection would otherwise trigger when building a coreRunResultfor the gate comparison. - findByStatus(EvalJobStatus) - Method in interface dev.dokimos.server.repository.EvalJobRepository
- findByStatus(TraceEvalJobStatus) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
- findByTrace_IdOrderByStartTimeUnixNanoAsc(UUID) - Method in interface dev.dokimos.server.repository.TraceSpanRepository
-
Returns the spans of a trace ordered by start time, nulls last for spans missing a timestamp.
- findByTraceId(String) - Method in interface dev.dokimos.server.repository.TraceRepositoryFragment
-
Looks up a trace by its OTLP trace id regardless of tenant.
- findByTraceId(String) - Method in class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
- findByTracePk(UUID) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
-
Jobs for the spans of one trace, used by the per-trace detail view.
- findCompletedRunsByExperiment(Experiment, Pageable, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
-
Returns an experiment's terminal (SUCCESS or FAILED) runs newest first, within the scope.
- findCompletedRunsByExperiment(Experiment, Pageable, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
- findFirst(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>, BiFunction<CriteriaBuilder, Root<T>, List<Order>>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Returns the first entity matching
extraand visible under the scope, with an optionalorder. - findFirstByDatasetOrderByVersionDesc(Dataset) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
- findFirstByExperiment(Experiment, TenantScope) - Method in interface dev.dokimos.server.repository.ExperimentRunRepositoryFragment
-
Returns the most recent run of an experiment within the scope.
- findFirstByExperiment(Experiment, TenantScope) - Method in class dev.dokimos.server.repository.ExperimentRunRepositoryFragmentImpl
- findFirstForUpdate(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Returns the first entity matching
extraunder the scope and a pessimistic write lock. - findItemsNeedingReview(String, UUID, UUID, boolean, String, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Page of items still awaiting a human verdict, optionally scoped to a project, experiment, or run.
- findItemsNotYetEvaluated(UUID, String, UUID, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Seek-based page of run items that carry no eval result for the given evaluator yet.
- findLatestPerDataset(List<Dataset>) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
-
Returns the latest version row for every supplied dataset in a single query.
- findMaxVersion(Dataset) - Method in interface dev.dokimos.server.repository.DatasetVersionRepository
-
Returns the current maximum version number for the dataset, or
nullif no versions exist. - findPage(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>, BiFunction<CriteriaBuilder, Root<T>, List<Order>>, Pageable) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Returns a page of entities matching
extraand visible under the scope. - findWhere(TenantScope, BiFunction<CriteriaBuilder, Root<T>, Predicate>, BiFunction<CriteriaBuilder, Root<T>, List<Order>>) - Method in class dev.dokimos.server.tenant.TenantScopedFinder
-
Lists entities matching
extraand visible under the scope, with an optionalorder. - first() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
firstrecord component. - fixedResponse(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Adds a fixed response to use before generating dynamic responses.
- fixedResponses(List<String>) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Sets all fixed responses at once.
- flush() - Method in class dev.dokimos.core.NoOpReporter
- flush() - Method in interface dev.dokimos.core.Reporter
-
Blocks until all pending items are sent.
- flush() - Method in class dev.dokimos.server.client.DokimosServerReporter
- formatVersion() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
formatVersionrecord component. - forScope(CriteriaBuilder, Path<String>, TenantScope) - Static method in class dev.dokimos.server.tenant.TenantPredicate
-
Builds the criteria predicate for the scope over the given
tenant_idpath. - from(AlertWebhook) - Static method in record class dev.dokimos.server.dto.v1.AlertWebhookView
- from(Annotation) - Static method in record class dev.dokimos.server.dto.v1.AnnotationView
- from(ApiKey) - Static method in record class dev.dokimos.server.dto.v1.ApiKeyView
- from(EvalJob) - Static method in record class dev.dokimos.server.dto.v1.EvalJobView
- from(LlmConnection) - Static method in record class dev.dokimos.server.dto.v1.LlmConnectionView
- from(Trace) - Static method in record class dev.dokimos.server.dto.v1.TraceSummary
- from(TraceEvalJob) - Static method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
- from(TraceEvalRule) - Static method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
- from(TraceSpan) - Static method in record class dev.dokimos.server.dto.v1.SpanView
- fromCsv(String, String) - Static method in record class dev.dokimos.core.Dataset
-
Parses a dataset from a CSV string.
- fromCsv(Path) - Static method in record class dev.dokimos.core.Dataset
-
Loads a dataset from a CSV file.
- fromEnvironment() - Static method in class dev.dokimos.server.client.DokimosServerReporter
-
Creates a reporter from environment variables:
DOKIMOS_SERVER_URLandDOKIMOS_PROJECT_NAMEare required;DOKIMOS_API_KEYandDOKIMOS_API_VERSIONare optional. - fromJson(String) - Static method in record class dev.dokimos.core.Dataset
-
Parses a dataset from a JSON string.
- fromJson(Path) - Static method in record class dev.dokimos.core.Dataset
-
Loads a dataset from a JSON file.
- fromJsonl(String) - Static method in record class dev.dokimos.core.Dataset
-
Parses a dataset from a JSONL string with a default name.
- fromJsonl(String, String) - Static method in record class dev.dokimos.core.Dataset
-
Parses a dataset from a JSONL string.
- fromJsonl(Path) - Static method in record class dev.dokimos.core.Dataset
-
Loads a dataset from a JSONL file, streaming line-by-line from disk without loading the entire file into memory.
- fromMap(Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolCall
-
Creates a tool call from a map, typically when deserializing from a JSON dataset.
- fromMap(Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolDefinition
-
Creates a tool definition from a map, typically when deserializing from a JSON dataset.
G
- GateConfig - Class in dev.dokimos.core.gate
-
Configuration for the server-free regression gate.
- GateConfig.Builder - Class in dev.dokimos.core.gate
-
Builder for
GateConfig. - GateConfig.Pairing - Enum Class in dev.dokimos.core.gate
-
How baseline and candidate items are paired.
- GateConfig.RemovedEvaluatorPolicy - Enum Class in dev.dokimos.core.gate
-
What to do when an evaluator present in the baseline is missing from the candidate.
- GateController - Class in dev.dokimos.server.controller.v1
-
Exposes the CI regression gate.
- GateController(GateService) - Constructor for class dev.dokimos.server.controller.v1.GateController
- GateRequest - Record Class in dev.dokimos.server.dto.v1
-
Request to evaluate a CI regression gate for an already-ingested candidate run.
- GateRequest(UUID, UUID, String) - Constructor for record class dev.dokimos.server.dto.v1.GateRequest
-
Creates an instance of a
GateRequestrecord class. - GateResult - Record Class in dev.dokimos.server.dto.v1
-
Verdict of a CI regression gate.
- GateResult(String, boolean, UUID, UUID, String, Double, double, Double, boolean, int, int, int, int, int, List<GateResult.RegressedEvaluator>, List<GateResult.RegressedCase>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.GateResult
-
Creates an instance of a
GateResultrecord class. - GateResult.EvaluatorDrop - Record Class in dev.dokimos.server.dto.v1
-
A per-item evaluator score drop.
- GateResult.RegressedCase - Record Class in dev.dokimos.server.dto.v1
-
A single regressed item, identified by its dataset item id when paired by id or by its positional index otherwise.
- GateResult.RegressedEvaluator - Record Class in dev.dokimos.server.dto.v1
-
A single evaluator's regression between baseline and candidate.
- GateService - Class in dev.dokimos.server.service
-
Evaluates a CI regression gate by comparing an already-ingested candidate run against a resolved baseline run with the core
RunComparisonengine and returning a pass/fail verdict. - GateService(ExperimentRepository, ExperimentRunRepository, ComparisonSupport) - Constructor for class dev.dokimos.server.service.GateService
- GateVerdict - Record Class in dev.dokimos.core.gate
-
The result of a regression-gate comparison: the overall
status, the pass-rate move, the regressed evaluators and cases, and any coverage-loss or threshold-driftwarnings. - GateVerdict(String, boolean, String, Double, double, Double, boolean, int, int, int, int, int, int, List<GateVerdict.RegressedEvaluator>, List<GateVerdict.RegressedCase>, boolean, boolean, List<String>) - Constructor for record class dev.dokimos.core.gate.GateVerdict
-
Creates an instance of a
GateVerdictrecord class. - GateVerdict.EvaluatorDrop - Record Class in dev.dokimos.core.gate
-
A per-item evaluator score drop.
- GateVerdict.RegressedCase - Record Class in dev.dokimos.core.gate
-
A single regressed item, identified by its dataset item id when paired by id or by its positional index otherwise.
- GateVerdict.RegressedEvaluator - Record Class in dev.dokimos.core.gate
-
A single evaluator's significant regression between baseline and candidate.
- generate(String) - Method in interface dev.dokimos.core.JudgeLM
- generate(String) - Method in class dev.dokimos.server.judge.OpenAiCompatibleJudge
- generate(String) - Method in class dev.dokimos.server.judge.OpenResponsesJudge
- generateMessage(ConversationTrajectory) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser
- generateMessage(ConversationTrajectory) - Method in interface dev.dokimos.core.conversation.SimulatedUser
-
Generates the next user message based on the current conversation state.
- get(int) - Method in record class dev.dokimos.core.Dataset
-
Returns the example at the specified index.
- get(String) - Method in class dev.dokimos.mcp.store.JsonResultStore
- get(String) - Method in interface dev.dokimos.mcp.store.ResultStore
-
Returns a run by ID, or empty if not found.
- get(UUID, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
-
Returns a connection by id, visible under the scope.
- get(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
-
Returns a single connection by id, or 404 if it does not exist or belongs to another tenant.
- get(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
-
Returns one of a project's webhooks.
- get(UUID, UUID, TenantScope) - Method in class dev.dokimos.server.service.AnnotationService
-
Returns the annotation for the given run item result, scoped to the caller's tenant.
- get(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AnnotationController
-
Returns the annotation for the item result.
- getActualOutput() - Method in class dev.dokimos.server.entity.ItemResult
- getAlertWebhook(UUID, UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
-
Returns one webhook, or 404 if the project or webhook does not exist or belongs to another tenant.
- getAlignment(UUID, TenantScope) - Method in class dev.dokimos.server.service.AlignmentService
-
Computes the judge-human alignment breakdown for a run.
- getApiKey() - Method in class dev.dokimos.server.config.ApiKeyProperties
- getAttemptCount() - Method in class dev.dokimos.server.entity.EvalJob
- getAttemptCount() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getAttributes() - Method in class dev.dokimos.server.entity.TraceSpan
- getAvgLatencyMs() - Method in class dev.dokimos.server.entity.ExperimentRun
- getBaseUrl() - Method in class dev.dokimos.server.entity.LlmConnection
- getClaimedAt() - Method in class dev.dokimos.server.entity.EvalJob
- getClaimedAt() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getClaimTimeoutMs() - Method in class dev.dokimos.server.config.JudgeProperties
- getClaimTimeoutMs() - Method in class dev.dokimos.server.config.TraceProperties.Eval
- getCompletedAt() - Method in class dev.dokimos.server.entity.EvalJob
- getCompletedAt() - Method in class dev.dokimos.server.entity.ExperimentRun
- getCompletedAt() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getConfig() - Method in class dev.dokimos.server.entity.ExperimentRun
- getConnection() - Method in class dev.dokimos.server.entity.EvalJob
- getConnection() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getConnection() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getCostUsd() - Method in class dev.dokimos.server.entity.ItemResult
- getCreatedAt() - Method in class dev.dokimos.server.entity.AlertWebhook
- getCreatedAt() - Method in class dev.dokimos.server.entity.Annotation
- getCreatedAt() - Method in class dev.dokimos.server.entity.ApiKey
- getCreatedAt() - Method in class dev.dokimos.server.entity.Dataset
- getCreatedAt() - Method in class dev.dokimos.server.entity.DatasetVersion
- getCreatedAt() - Method in class dev.dokimos.server.entity.EvalJob
- getCreatedAt() - Method in class dev.dokimos.server.entity.Experiment
- getCreatedAt() - Method in class dev.dokimos.server.entity.IngestedBatch
- getCreatedAt() - Method in class dev.dokimos.server.entity.ItemResult
- getCreatedAt() - Method in class dev.dokimos.server.entity.LlmConnection
- getCreatedAt() - Method in class dev.dokimos.server.entity.Project
- getCreatedAt() - Method in class dev.dokimos.server.entity.Trace
- getCreatedAt() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getCreatedAt() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getCreatedAt() - Method in class dev.dokimos.server.entity.TraceSpan
- getCreatedBy() - Method in class dev.dokimos.server.entity.Annotation
- getCreatedBy() - Method in class dev.dokimos.server.entity.DatasetVersion
- getCredentialRef() - Method in class dev.dokimos.server.entity.LlmConnection
- getCriteria() - Method in class dev.dokimos.server.entity.EvalJob
- getCriteria() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getCriteria() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getDataset() - Method in class dev.dokimos.server.entity.DatasetVersion
- getDataset(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Returns the dataset with the given name, visible under the scope.
- getDataset(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Returns the dataset and every one of its versions, newest first.
- getDatasetDetails(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Returns full dataset details including the version list, newest first.
- getDatasetItem() - Method in class dev.dokimos.server.entity.ItemResult
- getDatasetVersion() - Method in class dev.dokimos.server.entity.DatasetItem
- getDatasetVersion() - Method in class dev.dokimos.server.entity.ExperimentRun
- getDescription() - Method in class dev.dokimos.server.entity.Dataset
- getDescription() - Method in class dev.dokimos.server.entity.DatasetVersion
- getEncryptedApiKey() - Method in class dev.dokimos.server.entity.LlmConnection
- getEncryptionKey() - Method in class dev.dokimos.server.config.ApiKeyProperties
-
Returns the master key used to encrypt inline connection API keys at rest, or null when unset.
- getEndTimeUnixNano() - Method in class dev.dokimos.server.entity.Trace
- getEndTimeUnixNano() - Method in class dev.dokimos.server.entity.TraceSpan
- getEval() - Method in class dev.dokimos.server.config.TraceProperties
- getEvalResults() - Method in class dev.dokimos.server.entity.ItemResult
- getEvaluationParams() - Method in class dev.dokimos.server.entity.EvalJob
- getEvaluatorName() - Method in class dev.dokimos.server.entity.EvalJob
- getEvaluatorName() - Method in class dev.dokimos.server.entity.EvalResult
- getEvaluatorName() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getEvaluatorName() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getExpectedOutput() - Method in class dev.dokimos.server.entity.ItemResult
- getExpectedOutputs() - Method in class dev.dokimos.server.entity.DatasetItem
- getExperiment() - Method in class dev.dokimos.server.entity.ExperimentRun
- getExperiment(UUID, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
- getExperiments() - Method in class dev.dokimos.server.entity.Project
- getExpiresAt() - Method in class dev.dokimos.server.entity.Trace
- getFailedItemCount() - Method in class dev.dokimos.server.client.DokimosServerReporter
-
Number of items permanently dropped after exhausting all delivery retries.
- getGitBranch() - Method in class dev.dokimos.server.entity.ExperimentRun
- getGitSha() - Method in class dev.dokimos.server.entity.ExperimentRun
- getHttpStatus() - Method in exception class dev.dokimos.server.judge.JudgeCallException
- getId() - Method in class dev.dokimos.server.entity.AlertWebhook
- getId() - Method in class dev.dokimos.server.entity.Annotation
- getId() - Method in class dev.dokimos.server.entity.ApiKey
- getId() - Method in class dev.dokimos.server.entity.Dataset
- getId() - Method in class dev.dokimos.server.entity.DatasetItem
- getId() - Method in class dev.dokimos.server.entity.DatasetVersion
- getId() - Method in class dev.dokimos.server.entity.EvalJob
- getId() - Method in class dev.dokimos.server.entity.EvalResult
- getId() - Method in class dev.dokimos.server.entity.Experiment
- getId() - Method in class dev.dokimos.server.entity.ExperimentRun
- getId() - Method in class dev.dokimos.server.entity.ItemResult
- getId() - Method in class dev.dokimos.server.entity.LlmConnection
- getId() - Method in class dev.dokimos.server.entity.Project
- getId() - Method in class dev.dokimos.server.entity.Trace
- getId() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getId() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getId() - Method in class dev.dokimos.server.entity.TraceSpan
- getIdempotencyKey() - Method in class dev.dokimos.server.entity.IngestedBatch
- getInput() - Method in class dev.dokimos.server.entity.ItemResult
- getInputs() - Method in class dev.dokimos.server.entity.DatasetItem
- getInputText() - Method in class dev.dokimos.server.entity.TraceSpan
- getInstance() - Static method in class dev.dokimos.core.DatasetResolverRegistry
-
Returns the singleton registry instance.
- getItemCount() - Method in class dev.dokimos.server.entity.DatasetVersion
- getItemCount() - Method in class dev.dokimos.server.entity.ExperimentRun
- getItemResult() - Method in class dev.dokimos.server.entity.Annotation
- getItemResult() - Method in class dev.dokimos.server.entity.EvalResult
- getItems() - Method in class dev.dokimos.server.entity.ExperimentRun
- getJobsForRun(UUID, TenantScope) - Method in class dev.dokimos.server.service.EvalJobService
-
Lists the judge jobs registered for a run, oldest first.
- getKeyHash() - Method in class dev.dokimos.server.entity.ApiKey
- getKind() - Method in class dev.dokimos.server.entity.TraceSpan
- getLastError() - Method in class dev.dokimos.server.entity.EvalJob
- getLastError() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getLastItemId() - Method in class dev.dokimos.server.entity.EvalJob
- getLastUsedAt() - Method in class dev.dokimos.server.entity.ApiKey
- getLatencyMs() - Method in class dev.dokimos.server.entity.ItemResult
- getLatestVersion(String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Returns the latest version of the dataset, visible under the scope.
- getMatchKey() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getMatchType() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getMatchValue() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getMaxAttempts() - Method in class dev.dokimos.server.config.JudgeProperties
- getMaxAttempts() - Method in class dev.dokimos.server.config.TraceProperties.Eval
- getMaxScore() - Method in class dev.dokimos.server.entity.EvalJob
- getMaxScore() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getMaxScore() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getMetadata() - Method in class dev.dokimos.server.entity.DatasetItem
- getMetadata() - Method in class dev.dokimos.server.entity.EvalResult
- getMetadata() - Method in class dev.dokimos.server.entity.ItemResult
- getMinScore() - Method in class dev.dokimos.server.entity.EvalJob
- getMinScore() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getMinScore() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getModel() - Method in class dev.dokimos.server.entity.LlmConnection
- getName() - Method in class dev.dokimos.server.entity.ApiKey
- getName() - Method in class dev.dokimos.server.entity.Dataset
- getName() - Method in class dev.dokimos.server.entity.Experiment
- getName() - Method in class dev.dokimos.server.entity.ExperimentRun
- getName() - Method in class dev.dokimos.server.entity.LlmConnection
- getName() - Method in class dev.dokimos.server.entity.Project
- getName() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getName() - Method in class dev.dokimos.server.entity.TraceSpan
- getNote() - Method in class dev.dokimos.server.entity.Annotation
- getOrCreateExperiment(Project, String, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
-
Resolves an experiment of the project by name within the scope, creating it stamped with the scope's tenant when absent.
- getOrCreateProject(String, TenantScope) - Method in class dev.dokimos.server.service.ProjectService
-
Resolves the project by name within the scope, creating it stamped with the scope's tenant when it does not exist.
- getOrdinal() - Method in class dev.dokimos.server.entity.DatasetItem
- getOutputText() - Method in class dev.dokimos.server.entity.TraceSpan
- getOverriddenExpectedOutput() - Method in class dev.dokimos.server.entity.Annotation
- getPageSize() - Method in class dev.dokimos.server.config.JudgeProperties
- getParentSpanId() - Method in class dev.dokimos.server.entity.TraceSpan
- getPassedCount() - Method in class dev.dokimos.server.entity.ExperimentRun
- getPassRate() - Method in class dev.dokimos.server.entity.ExperimentRun
- getPollIntervalMs() - Method in class dev.dokimos.server.config.JudgeProperties
- getPollIntervalMs() - Method in class dev.dokimos.server.config.TraceProperties.Eval
- getProject() - Method in class dev.dokimos.server.entity.AlertWebhook
- getProject() - Method in class dev.dokimos.server.entity.Experiment
- getProject(String, TenantScope) - Method in class dev.dokimos.server.service.ProjectService
- getProjectId() - Method in class dev.dokimos.server.entity.Trace
- getProjectId() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getProtocol() - Method in class dev.dokimos.server.entity.LlmConnection
- getReason() - Method in class dev.dokimos.server.entity.EvalResult
- getReason() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getRetentionDays() - Method in class dev.dokimos.server.config.TraceProperties
- getRole() - Method in class dev.dokimos.server.entity.ApiKey
- getRootSpanName() - Method in class dev.dokimos.server.entity.Trace
- getRule() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getRun() - Method in class dev.dokimos.server.entity.EvalJob
- getRun() - Method in class dev.dokimos.server.entity.ItemResult
- getRunDetails(UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.service.RunService
- getRunDetails(UUID, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
- getRunId() - Method in class dev.dokimos.server.entity.IngestedBatch
- getRunInExperiment(UUID, Experiment, String, ExperimentRunRepository, TenantScope) - Method in class dev.dokimos.server.service.ComparisonSupport
-
Loads a run by id and asserts it belongs to the given experiment.
- getRuns() - Method in class dev.dokimos.server.entity.Experiment
- getScore() - Method in class dev.dokimos.server.entity.EvalResult
- getScore() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getSecret() - Method in class dev.dokimos.server.entity.AlertWebhook
- getSpan() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getSpanCount() - Method in class dev.dokimos.server.entity.Trace
- getSpanId() - Method in class dev.dokimos.server.entity.TraceSpan
- getSpans() - Method in class dev.dokimos.server.entity.Trace
- getStartedAt() - Method in class dev.dokimos.server.entity.ExperimentRun
- getStartTimeUnixNano() - Method in class dev.dokimos.server.entity.Trace
- getStartTimeUnixNano() - Method in class dev.dokimos.server.entity.TraceSpan
- getStatus() - Method in class dev.dokimos.server.entity.EvalJob
- getStatus() - Method in class dev.dokimos.server.entity.ExperimentRun
- getStatus() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getStatusCode() - Method in class dev.dokimos.server.entity.TraceSpan
- getSuccess() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getSweepIntervalMs() - Method in class dev.dokimos.server.config.TraceProperties
- getTenantId() - Method in class dev.dokimos.server.entity.AlertWebhook
- getTenantId() - Method in class dev.dokimos.server.entity.Annotation
- getTenantId() - Method in class dev.dokimos.server.entity.ApiKey
- getTenantId() - Method in class dev.dokimos.server.entity.Dataset
- getTenantId() - Method in class dev.dokimos.server.entity.DatasetItem
- getTenantId() - Method in class dev.dokimos.server.entity.DatasetVersion
- getTenantId() - Method in class dev.dokimos.server.entity.EvalResult
- getTenantId() - Method in class dev.dokimos.server.entity.Experiment
- getTenantId() - Method in class dev.dokimos.server.entity.ExperimentRun
- getTenantId() - Method in class dev.dokimos.server.entity.ItemResult
- getTenantId() - Method in class dev.dokimos.server.entity.LlmConnection
- getTenantId() - Method in class dev.dokimos.server.entity.Project
- getTenantId() - Method in class dev.dokimos.server.entity.Trace
- getTenantId() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getTenantId() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getTenantId() - Method in class dev.dokimos.server.entity.TraceSpan
- getThreshold() - Method in class dev.dokimos.server.entity.EvalJob
- getThreshold() - Method in class dev.dokimos.server.entity.EvalResult
- getThreshold() - Method in class dev.dokimos.server.entity.TraceEvalJob
- getThreshold() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getTokensIn() - Method in class dev.dokimos.server.entity.ItemResult
- getTokensOut() - Method in class dev.dokimos.server.entity.ItemResult
- getTotalCostUsd() - Method in class dev.dokimos.server.entity.ExperimentRun
- getTotalTokensIn() - Method in class dev.dokimos.server.entity.ExperimentRun
- getTotalTokensOut() - Method in class dev.dokimos.server.entity.ExperimentRun
- getTrace() - Method in class dev.dokimos.server.entity.TraceSpan
- getTrace(UUID, TenantScope) - Method in class dev.dokimos.server.service.TraceQueryService
-
Returns the full detail of one trace: its metadata, spans, and the online eval jobs scoped to its spans.
- getTrace(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceController
-
Returns a single trace with its spans and online eval jobs, or 404 if it does not exist or belongs to another tenant.
- getTraceId() - Method in class dev.dokimos.server.entity.Trace
- getTraceId() - Method in class dev.dokimos.server.entity.TraceSpan
- getTrends(UUID, int, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
- getTrends(UUID, int, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ExperimentController
- getTriggeredBy() - Method in class dev.dokimos.server.entity.ExperimentRun
- getType() - Method in class dev.dokimos.core.OutputType
-
The captured generic type.
- getUpdatedAt() - Method in class dev.dokimos.server.entity.AlertWebhook
- getUpdatedAt() - Method in class dev.dokimos.server.entity.Annotation
- getUpdatedAt() - Method in class dev.dokimos.server.entity.Dataset
- getUpdatedAt() - Method in class dev.dokimos.server.entity.LlmConnection
- getUpdatedAt() - Method in class dev.dokimos.server.entity.TraceEvalRule
- getUrl() - Method in class dev.dokimos.server.entity.AlertWebhook
- getVerdict() - Method in class dev.dokimos.server.entity.Annotation
- getVersion() - Method in class dev.dokimos.server.entity.DatasetVersion
- getVersion(String, int, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Returns a specific version of the dataset, visible under the scope.
- getVersion(String, String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Returns a specific version of the dataset.
- gitBranch() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
gitBranchrecord component. - gitSha() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
gitSharecord component. - GlobalExceptionHandler - Class in dev.dokimos.server.controller
- GlobalExceptionHandler() - Constructor for class dev.dokimos.server.controller.GlobalExceptionHandler
- goalCompletion() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating goal completion.
H
- HallucinationEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that uses an LLM to detect hallucinations in the actual output.
- HallucinationEvaluator.Builder - Class in dev.dokimos.core.evaluators
- handleCompareRuns(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
-
Compares two runs via
RunComparison: per-evaluator deltas, pass-rate test, per-item diffs. - handleConflict(IllegalStateException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
- handleDataIntegrity(DataIntegrityViolationException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
-
Maps a database constraint violation to a 409 rather than a 500.
- handleGeneral(Exception) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
- handleGetFailingQueries(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
-
Returns failing queries from a run, filtered by score threshold.
- handleListExperiments(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
-
Lists past evaluation runs with optional filtering.
- handleMissingParam(MissingServletRequestParameterException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
-
Maps a missing required query parameter (for example
baselineRunIdon the diff endpoint) to a 400 rather than letting it fall through to the generic 500 handler. - handleNotFound(IllegalArgumentException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
- handleResponseStatus(ResponseStatusException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
-
Honors the status carried by a
ResponseStatusException(for example a 400 raised by a controller for an unrecognized query-parameter value) instead of letting the generic handler collapse it to a 500. - handleRunEvaluation(Map<String, Object>) - Method in class dev.dokimos.mcp.ToolHandlers
-
Runs an evaluation: loads a dataset, calls an LLM, evaluates results, and persists the run.
- handleTestExecutionException(ExtensionContext, Throwable) - Method in class dev.dokimos.junit.DatasetRunExtension
- handleUnreadableBody(HttpMessageNotReadableException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
-
Maps an unparseable or type-mismatched request body (for example a malformed UUID) to a 400 rather than letting it fall through to the generic 500 handler.
- handleValidation(MethodArgumentNotValidException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
-
Maps bean-validation failures on
@RequestBodypayloads to a 400, surfacing the first field error message so the caller sees which constraint failed instead of an opaque 500. - hashCode() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.agents.ToolCall
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.CallMetrics
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.conversation.Message
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.Dataset
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.EvalResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.EvalTestCase
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.Example
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.ItemResult
-
Returns a hash code value for this object.
- hashCode() - Method in class dev.dokimos.core.OutputType
- hashCode() - Method in record class dev.dokimos.core.RunHandle
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.RunResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.core.TaskResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.DiffView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.GateRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TrendData
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
-
Returns a hash code value for this object.
- hashCode() - Method in class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
- hashCode() - Method in record class dev.dokimos.server.filter.Principal
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.server.tenant.TenantScope
-
Returns a hash code value for this object.
- hashCode() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Returns a hash code value for this object.
- hasInlineKey() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
hasInlineKeyrecord component. - hasInlineKey() - Method in class dev.dokimos.server.entity.LlmConnection
-
Returns true when an inline encrypted key is stored rather than an external credential reference.
- hasRegressions() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
True when the overall pass rate or any evaluator is significantly regressed.
- hasSecret() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns the value of the
hasSecretrecord component. - hasSecret() - Method in class dev.dokimos.server.entity.AlertWebhook
-
Returns true when a signing secret is configured.
- hasToolCalls() - Method in record class dev.dokimos.core.conversation.Message
-
Checks whether this message carries any tool calls.
- helpfulness() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating helpfulness.
I
- id() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.filter.Principal
-
Returns the value of the
idrecord component. - id() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Returns the value of the
idrecord component. - IGNORE - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
-
Do not compare arguments.
- ignoreCase(boolean) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
-
Sets whether to ignore case when matching.
- impatientUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated impatient user who wants quick answers.
- IMPROVED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
-
The candidate is meaningfully and significantly better than the baseline.
- improvedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
improvedCountrecord component. - improvedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
improvedCountrecord component. - improvedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
improvedCountrecord component. - improvedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
improvedCountrecord component. - improvements() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Evaluator deltas flagged as significant improvements.
- IN_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Expected is an ordered subsequence of actual; graded by LCS.
- includePerCriterionScores(boolean) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets whether to include per-criterion scores in the result metadata.
- includeReason(boolean) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Sets whether to include a detailed reason in the result.
- includeReason(boolean) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
-
Sets the flag whether to provide a reason or not.
- includeReason(boolean) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
-
Sets the flag whether to provide a reason or not.
- includeToolCalls(boolean) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Includes each turn's tool calls in the judge prompt.
- INCORRECT - Enum constant in enum class dev.dokimos.server.entity.AnnotationVerdict
- index() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Returns the value of the
indexrecord component. - index() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns the value of the
indexrecord component. - index() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Returns the value of the
indexrecord component. - informationAccuracy() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating information accuracy.
- ingest(OtlpExportTraceServiceRequest) - Method in class dev.dokimos.server.service.TraceIngestService
-
Parses, persists, and schedules online evals for an OTLP request.
- IngestedBatch - Class in dev.dokimos.server.entity
-
Marks an item batch (identified by idempotency key) as committed for a run.
- IngestedBatch(UUID, String, Instant) - Constructor for class dev.dokimos.server.entity.IngestedBatch
- IngestedBatch.IngestedBatchId - Class in dev.dokimos.server.entity
-
Composite primary key.
- IngestedBatchId() - Constructor for class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
- IngestedBatchId(UUID, String) - Constructor for class dev.dokimos.server.entity.IngestedBatch.IngestedBatchId
- IngestedBatchRepository - Interface in dev.dokimos.server.repository
- ingestTraces(OtlpExportTraceServiceRequest) - Method in class dev.dokimos.server.controller.v1.TraceController
-
Ingests an OTLP/HTTP JSON trace export.
- ingestTracesProtobuf(byte[]) - Method in class dev.dokimos.server.controller.v1.TraceController
-
Ingests an OTLP protobuf trace export.
- initialMessage(String) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Sets the initial user message to start the conversation.
- input() - Method in record class dev.dokimos.core.EvalTestCase
-
Gets the primary input value.
- input() - Method in record class dev.dokimos.core.Example
-
Returns the primary input value.
- input() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Returns the value of the
inputrecord component. - input() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns the value of the
inputrecord component. - input() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns the value of the
inputrecord component. - input() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
inputrecord component. - input() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
inputrecord component. - input() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Returns the value of the
inputrecord component. - input(String) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Sets the primary input value.
- input(String) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
-
Sets the primary input value (the
"input"key). - input(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds an input with the given key and value.
- input(String, Object) - Method in class dev.dokimos.core.Example.Builder
-
Adds an input with the given key and value.
- INPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
- INPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport
-
Default key for reading input from dataset examples.
- INPUT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport
-
Default key for reading input from dataset examples.
- inputAs(OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the primary input (
"input") converted to the given generic type. - inputAs(OutputType<T>) - Method in record class dev.dokimos.core.Example
-
Reads the primary input (
"input") converted to the given generic type. - inputAs(Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the primary input (
"input") converted to the given type. - inputAs(Class<T>) - Method in record class dev.dokimos.core.Example
-
Reads the primary input (
"input") converted to the given type. - inputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the input under
keyconverted to the given generic type. - inputAs(String, OutputType<T>) - Method in record class dev.dokimos.core.Example
-
Reads the input under
keyconverted to the given generic type. - inputAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the input under
keyconverted to the given type. - inputAs(String, Class<T>) - Method in record class dev.dokimos.core.Example
-
Reads the input under
keyconverted to the given type. - inputs() - Method in record class dev.dokimos.core.EvalTestCase
-
Returns the value of the
inputsrecord component. - inputs() - Method in record class dev.dokimos.core.Example
-
Returns the value of the
inputsrecord component. - inputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
inputsrecord component. - inputs() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Returns the value of the
inputsrecord component. - inputs() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns the value of the
inputsrecord component. - inputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds all entries from the given inputs map.
- inputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder
-
Adds all entries from the given inputs map.
- inputSchema() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Returns the value of the
inputSchemarecord component. - inputSchema(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
-
Sets the input schema.
- inputText() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
inputTextrecord component. - inputText() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
inputTextrecord component. - inputText() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Returns the value of the
inputTextrecord component. - INSTANCE - Static variable in class dev.dokimos.core.NoOpReporter
-
Singleton instance of the no-op reporter.
- intValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns the value of the
intValuerecord component. - isAssistant() - Method in record class dev.dokimos.core.conversation.Message
-
Checks if this message is from an assistant.
- isAuthEnabled() - Method in class dev.dokimos.server.config.ApiKeyProperties
-
Returns true if API key authentication is enabled.
- isCredentialSourceValid() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Cross-field rule enforcing that exactly one credential source is supplied.
- isCredentialSourceValid() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
- isDatasetItemKey(String) - Method in class dev.dokimos.server.service.ComparisonSupport
-
True when a comparison key is a dataset item id rather than a positional fallback.
- isDatasetLinkageValid() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Cross-field rule enforcing that
datasetNameanddatasetVersionare either both supplied or both absent. - isEmpty() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Checks if the conversation is empty.
- isEnabled() - Method in class dev.dokimos.server.entity.AlertWebhook
- isEnabled() - Method in class dev.dokimos.server.entity.ApiKey
- isEnabled() - Method in class dev.dokimos.server.entity.TraceEvalRule
- isEvaluationParamsValid() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
- isMatchKeyValid() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
- isRetryable() - Method in exception class dev.dokimos.server.judge.JudgeCallException
-
Returns true when the failure is worth retrying: a timeout, network error, or 5xx response.
- isScoreRangeValid() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
- isScoreRangeValid() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
- isSuccess() - Method in class dev.dokimos.server.entity.EvalResult
- isSystem() - Method in record class dev.dokimos.core.conversation.Message
-
Checks if this message is a system message.
- isSystem() - Method in record class dev.dokimos.server.filter.Principal
-
Returns whether this is the system principal.
- isUser() - Method in record class dev.dokimos.core.conversation.Message
-
Checks if this message is from a user.
- ItemComparison - Record Class in dev.dokimos.core.comparison
-
Comparison of a single paired item across baseline and candidate.
- ItemComparison(String, ComparisonStatus, Double, Double, boolean, List<EvaluatorDelta>) - Constructor for record class dev.dokimos.core.comparison.ItemComparison
-
Creates an instance of a
ItemComparisonrecord class. - itemCount() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
-
Returns the value of the
itemCountrecord component. - itemCount() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Returns the value of the
itemCountrecord component. - itemCount() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns the value of the
itemCountrecord component. - itemCount() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
itemCountrecord component. - itemCount() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
itemCountrecord component. - ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Backwards-compatible 5-arg constructor: passes null metadata, datasetItemId, and call metrics.
- ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Backwards-compatible 6-arg constructor: passes null datasetItemId and null call metrics.
- ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean, UUID) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Backwards-compatible 7-arg constructor: passes null call metrics.
- ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean, UUID, Integer, Integer, Double, Long) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Creates an instance of a
ItemDatarecord class. - ItemDeliveryFailure(String, int, List<ItemResult>) - Constructor for record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Creates an instance of a
ItemDeliveryFailurerecord class. - ItemDetail(String, String, String, boolean, List<RunRecord.EvalDetail>) - Constructor for record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Creates an instance of a
ItemDetailrecord class. - itemId() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
itemIdrecord component. - itemId() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
-
Returns the value of the
itemIdrecord component. - itemKey(Function<ItemResult, String>) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
-
Function that derives an item-identity key from an item result.
- ItemPayload(Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Creates an instance of a
ItemPayloadrecord class. - ItemResult - Class in dev.dokimos.server.entity
- ItemResult - Record Class in dev.dokimos.core
-
The outcome of executing a single example: the example itself, the actual outputs the task produced, the evaluator results, and optional metrics describing the underlying LLM call.
- ItemResult(Example, Map<String, Object>, List<EvalResult>) - Constructor for record class dev.dokimos.core.ItemResult
-
Creates a result without call metrics.
- ItemResult(Example, Map<String, Object>, List<EvalResult>, CallMetrics) - Constructor for record class dev.dokimos.core.ItemResult
-
Creates an instance of a
ItemResultrecord class. - ItemResult(ExperimentRun, Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.ItemResult
- itemResultId() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
-
Returns the value of the
itemResultIdrecord component. - ItemResultRepository - Interface in dev.dokimos.server.repository
- itemResults() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns all item results across all runs.
- itemResults() - Method in record class dev.dokimos.core.RunResult
-
Returns the value of the
itemResultsrecord component. - items() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
-
Returns the value of the
itemsrecord component. - items() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
itemsrecord component. - ItemSnapshot(UUID, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Creates an instance of a
ItemSnapshotrecord class. - ItemSummary(UUID, Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<RunDetails.EvalSummary>, Instant, UUID, AnnotationView, Integer, Integer, Double, Long) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Creates an instance of a
ItemSummaryrecord class. - iterator() - Method in record class dev.dokimos.core.Dataset
J
- job() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Returns the value of the
jobrecord component. - json() - Element in annotation interface dev.dokimos.junit.DatasetSource
-
Inline JSON dataset.
- Json - Class in dev.dokimos.core.internal
-
Shared, framework-internal JSON utilities backed by a single, immutable Jackson
ObjectMapper. - jsonl() - Element in annotation interface dev.dokimos.junit.DatasetSource
-
Inline JSONL dataset.
- JsonResultStore - Class in dev.dokimos.mcp.store
-
Stores run records as a JSON array in a local file.
- JsonResultStore() - Constructor for class dev.dokimos.mcp.store.JsonResultStore
- JsonResultStore(Path) - Constructor for class dev.dokimos.mcp.store.JsonResultStore
- judge() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
-
Returns the value of the
judgerecord component. - judge(JudgeLM) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Sets the JudgeLM to use for generating responses.
- judge(JudgeLM) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets the JudgeLM to use for evaluation.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets the judge LLM for evaluating task completion.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
-
Sets the judge LLM for evaluating argument grounding.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets an optional judge LLM for semantic checks.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
-
Sets an optional judge LLM for semantic checks.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Sets the LLM judge to use for scoring context relevance.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
-
Sets the model to use for the evaluation.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
-
Sets the model to use for the evaluation.
- judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Sets the model to use for the evaluation.
- JudgeCallException - Exception Class in dev.dokimos.server.judge
-
Unchecked failure raised when a judge HTTP call cannot complete.
- JudgeCallException(int, String) - Constructor for exception class dev.dokimos.server.judge.JudgeCallException
- JudgeCallException(int, String, Throwable) - Constructor for exception class dev.dokimos.server.judge.JudgeCallException
- JudgeInfo(String, Double) - Constructor for record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
-
Creates an instance of a
JudgeInforecord class. - JudgeJobTransactions - Class in dev.dokimos.server.service
-
The transactional steps of the judge worker, each in its own committed transaction so the worker can make the LLM HTTP call between them without holding a database transaction open.
- JudgeJobTransactions(EvalJobRepository, EvalResultRepository, ItemResultRepository, RunService) - Constructor for class dev.dokimos.server.service.JudgeJobTransactions
- JudgeJobTransactions.ItemSnapshot - Record Class in dev.dokimos.server.service
-
A detached view of an item result carrying only the fields the judge prompt needs.
- JudgeJobTransactions.ScoredResult - Record Class in dev.dokimos.server.service
-
Pairs an eval result with the id of the item result it belongs to, for batch persistence.
- JudgeLM - Interface in dev.dokimos.core
-
A language model used for evaluation.
- JudgeProperties - Class in dev.dokimos.server.config
-
Tuning knobs for the background judge worker, bound from the
dokimos.judgeprefix. - JudgeProperties() - Constructor for class dev.dokimos.server.config.JudgeProperties
- Judges and tasks - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
- Section
- JudgeScorer - Class in dev.dokimos.server.judge
-
Drives a single judge scoring: builds the prompt from a criteria and the selected parameters, calls the underlying
JudgeLM, and parses the response. - JudgeScorer(JudgeLM, String, List<EvalTestCaseParam>, double, double, Double) - Constructor for class dev.dokimos.server.judge.JudgeScorer
- JudgeScorer.ScoreOutcome - Record Class in dev.dokimos.server.judge
-
The result of scoring one item: a numeric score, the judge's reasoning, and the pass decision.
- JudgeWorker - Class in dev.dokimos.server.service
-
Background worker that drains the judge job queue.
- JudgeWorker(JudgeJobTransactions, LlmCredentialService, JudgeProperties) - Constructor for class dev.dokimos.server.service.JudgeWorker
K
- key() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns the value of the
keyrecord component. - key() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Returns the value of the
keyrecord component. - key() - Element in annotation interface dev.dokimos.junit.MetadataEntry
-
The metadata key.
- key() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
-
Returns the value of the
keyrecord component. - key() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
-
Returns the value of the
keyrecord component. - kind() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
kindrecord component. - kind() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
kindrecord component. - kind() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
kindrecord component.
L
- LangChain4jSupport - Class in dev.dokimos.langchain4j
-
Utilities for integrating with LangChain4j.
- last() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
lastrecord component. - lastAssistantMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the last assistant message in the conversation, if any.
- lastError() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
lastErrorrecord component. - lastError() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
lastErrorrecord component. - lastMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the last message in the conversation, if any.
- lastUsedAt() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
lastUsedAtrecord component. - lastUserMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the last user message in the conversation, if any.
- latencyMs() - Method in record class dev.dokimos.core.CallMetrics
-
Returns the value of the
latencyMsrecord component. - latencyMs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
latencyMsrecord component. - latencyMs() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
latencyMsrecord component. - LATEST - Static variable in class dev.dokimos.server.client.ServerDatasetResolver
-
Version path alias that resolves to the newest version on the server.
- latestItemCount() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
latestItemCountrecord component. - latestRun() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Returns the value of the
latestRunrecord component. - LatestRunInfo(UUID, RunStatus, Double, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Creates an instance of a
LatestRunInforecord class. - latestVersion() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
latestVersionrecord component. - LENIENT - Enum constant in enum class dev.dokimos.core.evaluators.StructuralMatchMode
-
Lenient comparison.
- lenientMapper() - Static method in class dev.dokimos.core.LlmResponseUtils
-
An
ObjectMapperconfigured to tolerate the common ways a language model deviates from strict JSON (trailing commas, single quotes, unquoted field names, comments, and unescaped control characters). - list() - Method in class dev.dokimos.server.service.ApiKeyService
-
Lists every key as metadata only; key material is never included.
- list(TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
- list(HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
-
Lists the connections visible to the caller.
- list(String, int) - Method in class dev.dokimos.mcp.store.JsonResultStore
- list(String, int) - Method in interface dev.dokimos.mcp.store.ResultStore
-
Lists runs, most recent first.
- list(String, UUID, UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.service.ReviewQueueService
-
Returns a page of items awaiting review, oldest first.
- list(String, UUID, UUID, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ReviewQueueController
-
Lists run items still awaiting a human verdict, oldest first.
- list(UUID, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
-
Lists a project's webhooks in creation order.
- list(UUID, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
-
Lists the rules of a project, oldest first, within the scope.
- list(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.EvalJobController
-
Lists the judge jobs registered for a run, oldest first.
- listAlertWebhooks(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
-
Lists the project's webhooks.
- listApiKeys() - Method in class dev.dokimos.server.controller.v1.ApiKeyController
-
Lists every key as metadata only; the raw key is never returned.
- listDatasets(TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Returns dataset summaries visible under the scope with the latest version number and item count for each.
- listDatasets(HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Lists the datasets visible to the caller with their latest version number and item count.
- listDiff(UUID, UUID, UUID, String, Pageable, TenantScope) - Method in class dev.dokimos.server.service.DiffService
-
Builds the per-case diff between a candidate run and an explicit baseline run, returning the whole-run summary together with the requested, filtered, sorted page of cases.
- listExperiments(Project, TenantScope) - Method in class dev.dokimos.server.service.ExperimentService
- listExperiments(String, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
- listItems(DatasetVersion, Pageable) - Method in class dev.dokimos.server.service.DatasetService
-
Overload for callers that have already resolved a
DatasetVersion; avoids the double-fetch path throughDatasetService.getVersion(java.lang.String, int, dev.dokimos.server.tenant.TenantScope). - listItems(String, int, Pageable, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Returns items for the given version ordered by ordinal, paginated.
- listItems(String, String, Pageable, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Returns the items of a dataset version ordered by ordinal, paginated.
- listProjects(TenantScope) - Method in class dev.dokimos.server.service.ProjectService
- listProjects(HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
- listRuns(Experiment, TenantScope) - Method in class dev.dokimos.server.service.RunService
- listRuns(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.ExperimentController
- listTraceEvalRules(UUID, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
-
Lists the rules of a project, oldest first.
- listTraces(UUID, int, int, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceController
-
Lists ingested traces newest first, optionally filtered to a project.
- listTraces(UUID, Pageable, TenantScope) - Method in class dev.dokimos.server.service.TraceQueryService
-
Lists traces newest first, optionally filtered to a project.
- llmBased(JudgeLM) - Static method in interface dev.dokimos.core.MatchingStrategy
-
Creates an LLM-based matching strategy.
- LlmConnection - Class in dev.dokimos.server.entity
-
A named, reusable pointer to an OpenAI-compatible endpoint used by the server-side judge.
- LlmConnection(String, String, String) - Constructor for class dev.dokimos.server.entity.LlmConnection
- LlmConnectionController - Class in dev.dokimos.server.controller.v1
- LlmConnectionController(LlmConnectionService) - Constructor for class dev.dokimos.server.controller.v1.LlmConnectionController
- LlmConnectionProtocol - Enum Class in dev.dokimos.server.entity
-
The API surface an
LlmConnection's endpoint speaks. - LlmConnectionRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
LlmConnection. - LlmConnectionRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
LlmConnection. - LlmConnectionRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
LlmConnectionfinders. - LlmConnectionRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.LlmConnectionRepositoryFragmentImpl
- LlmConnectionService - Class in dev.dokimos.server.service
-
Registers and reads LLM connections.
- LlmConnectionService(LlmConnectionRepository, LlmCredentialService, EvalJobRepository) - Constructor for class dev.dokimos.server.service.LlmConnectionService
- LlmConnectionView - Record Class in dev.dokimos.server.dto.v1
-
Public view of an
LlmConnection. - LlmConnectionView(UUID, String, String, String, LlmConnectionProtocol, String, boolean, Instant) - Constructor for record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Creates an instance of a
LlmConnectionViewrecord class. - LlmCredentialService - Class in dev.dokimos.server.service
-
Resolves and protects the API key for an
LlmConnection. - LlmCredentialService(ApiKeyProperties) - Constructor for class dev.dokimos.server.service.LlmCredentialService
- LLMJudgeEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that uses an LLM to evaluate outputs based on the specified criteria.
- LLMJudgeEvaluator.Builder - Class in dev.dokimos.core.evaluators
- LlmResponseUtils - Class in dev.dokimos.core
-
Utility methods for processing LLM responses.
- LLMSimulatedUser - Class in dev.dokimos.core.conversation
-
An LLM-based simulated user for multi-turn conversation testing.
- LLMSimulatedUser.Builder - Class in dev.dokimos.core.conversation
-
Builder for constructing LLM simulated users.
- load(String) - Static method in record class dev.dokimos.core.Dataset
-
Loads a dataset from a URI or path through the resolver registry.
- loadUnevaluatedPage(UUID, String, UUID, int) - Method in class dev.dokimos.server.service.JudgeJobTransactions
-
Reads a seek-keyed page of items that have no result yet for the job's evaluator.
- log() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
M
- main(String[]) - Static method in class dev.dokimos.mcp.DokimosMcpServer
- main(String[]) - Static method in class dev.dokimos.server.DokimosServerApplication
- markSucceeded(UUID, double, boolean, String) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
-
Marks a job SUCCEEDED and records its score.
- markSucceeded(UUID, UUID) - Method in class dev.dokimos.server.service.JudgeJobTransactions
-
Marks the job SUCCEEDED and finalizes its run (re-materializes counts, moves the run to SUCCESS).
- markUsed() - Method in class dev.dokimos.server.entity.ApiKey
-
Records that the key was just used to authenticate a request.
- matches(TraceSpan) - Method in class dev.dokimos.server.entity.TraceEvalRule
-
Returns whether the given span matches this rule.
- matches(Object, Object) - Method in interface dev.dokimos.core.MatchingStrategy
-
Determines if a retrieved item matches an expected item.
- matches(Map<String, Object>, Map<String, Object>) - Method in interface dev.dokimos.core.evaluators.agents.ArgumentMatcher
-
Determines whether the actual arguments match the expected arguments.
- matches(Map<String, Object>, Map<String, Object>) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher
- matchingStrategy(MatchingStrategy) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Sets the strategy for matching retrieved items to expected items.
- matchingStrategy(MatchingStrategy) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Sets the strategy for matching retrieved items to expected items.
- MatchingStrategy - Interface in dev.dokimos.core
-
Strategy for determining if a retrieved item matches an expected item.
- matchKey() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
matchKeyrecord component. - matchKey() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
matchKeyrecord component. - matchMode(ToolCorrectnessEvaluator.MatchMode) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets the match mode for comparing tool calls.
- matchMode(ToolTrajectoryEvaluator.MatchMode) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets the trajectory match mode.
- matchType() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
matchTyperecord component. - matchType() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
matchTyperecord component. - matchValue() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
matchValuerecord component. - matchValue() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
matchValuerecord component. - MAX - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Returns the maximum score across all criteria.
- maxInputArgs(int) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets the maximum number of total input parameters allowed per tool.
- maxOptionalArgs(int) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets the maximum number of optional parameters allowed per tool.
- maxScore() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
maxScorerecord component. - maxScore() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
maxScorerecord component. - maxScore() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
maxScorerecord component. - maxTurns(int) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Sets the maximum number of conversation turns.
- MEAN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Simple arithmetic mean of all scores.
- measuredAsyncTask(Function<Example, SpringAiAlibabaSupport.AlibabaAgentResponse>, String, PriceTable) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Creates a measured
AsyncTaskthat runs a Spring AI Alibaba agent and captures latency automatically and, when aPriceTableand model id are supplied, cost, lighting up the run's metrics cards. - measuredAsyncTask(Function<Example, SpringAiAlibabaSupport.AlibabaAgentResponse>, String, PriceTable, Executor) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
- measuredAsyncTask(ChatClient, String, PriceTable) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates a measured
AsyncTaskthat calls a Spring AIChatClientand captures token usage, latency, and (when aPriceTableis supplied) cost, lighting up the run's metrics cards. - measuredAsyncTask(ChatClient, String, PriceTable, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
- measuredAsyncTask(ChatClient, String, String, String, PriceTable, Executor) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Creates a measured
AsyncTaskwith caller-chosen input and output keys, dispatching each blocking call on the suppliedExecutor(or the commonForkJoinPoolwhenexecutorisnull). - measuredRagTask(Function<String, Result<String>>, String, PriceTable) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a measured RAG
MeasuredTaskfrom a function returningResult, capturing thetoken usage, latency, and (when aPriceTableis supplied) cost alongside the output and retrieved context. - measuredRagTask(Function<String, Result<String>>, String, String, String, String, PriceTable) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a measured RAG
MeasuredTaskwith custom key names. - measuredTask(MeasuredTask) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets a measured task that carries
CallMetricsthrough to eachItemResult. - measuredTask(ChatModel, String, PriceTable) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a measured Q&A
MeasuredTaskthat captures token usage, latency, and (when aPriceTableis supplied) cost, lighting up the run's metrics cards. - measuredTask(ChatModel, String, PriceTable, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a measured Q&A
MeasuredTaskthat writes the response under a caller-chosen key. - MeasuredTask - Interface in dev.dokimos.core
-
A task that produces outputs together with optional
CallMetricsdescribing the underlying LLM call. - Measured tasks - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
- Section
- message() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
-
Returns the value of the
messagerecord component. - message(Message) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds a message to the trajectory.
- Message - Record Class in dev.dokimos.core.conversation
-
Represents a single message in a conversation.
- Message(Message.Role, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.conversation.Message
-
Creates a message with no tool calls.
- Message(Message.Role, String, Map<String, Object>, List<ToolCall>) - Constructor for record class dev.dokimos.core.conversation.Message
-
Compact constructor.
- Message.Role - Enum Class in dev.dokimos.core.conversation
-
The role of a message sender in a conversation.
- messages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the value of the
messagesrecord component. - messages(OverAllState) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Extracts the raw Spring AI
Messagelist from a graph state. - messages(List<Message>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds all messages from a list.
- MESSAGES_KEY - Static variable in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
The Spring AI Alibaba graph-state key under which the message list is stored.
- metadata() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.agents.ToolCall
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.conversation.Message
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.EvalResult
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.EvalTestCase
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.Example
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the value of the
metadatarecord component. - metadata() - Element in annotation interface dev.dokimos.junit.DatasetSource
-
Run metadata as alternating key-value pairs (for example
{"model", "gpt-4", "temperature", "0"}). - metadata() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns the value of the
metadatarecord component. - metadata() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
metadatarecord component. - metadata(String, Object) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Adds a metadata entry.
- metadata(String, Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Adds a metadata entry.
- metadata(String, Object) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds metadata with the given key and value.
- metadata(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds metadata with the given key and value.
- metadata(String, Object) - Method in class dev.dokimos.core.Example.Builder
-
Adds metadata with the given key and value.
- metadata(String, Object) - Method in class dev.dokimos.core.Experiment.Builder
-
Adds a metadata entry to the experiment.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Sets all metadata.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Sets all metadata.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds all entries from the given metadata map.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalResult.Builder
-
Sets the metadata.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder
-
Adds all entries from the given metadata map.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder
-
Adds all entries from the given metadata map.
- metadata(Map<String, Object>) - Method in class dev.dokimos.core.Experiment.Builder
-
Adds multiple metadata entries to the experiment.
- metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.agents.AgentTrace
-
Reads the metadata entry stored under
keyand converts it into a generic target captured by anOutputTypetoken, for examplenew OutputType<List<String>>() {}. - metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.agents.ToolCall
-
Reads the metadata entry stored under
keyand converts it into a generic target captured by anOutputTypetoken, for examplenew OutputType<List<String>>() {}. - metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the metadata value under
keyconverted to the given generic type. - metadataAs(String, OutputType<T>) - Method in record class dev.dokimos.core.Example
-
Reads the metadata value under
keyconverted to the given generic type. - metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.agents.AgentTrace
-
Reads the metadata entry stored under
keyand converts it into an instance oftype. - metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.agents.ToolCall
-
Reads the metadata entry stored under
keyand converts it into an instance oftype. - metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.EvalTestCase
-
Reads the metadata value under
keyconverted to the given type. - metadataAs(String, Class<T>) - Method in record class dev.dokimos.core.Example
-
Reads the metadata value under
keyconverted to the given type. - MetadataEntry - Annotation Interface in dev.dokimos.junit
-
A single typed run-metadata key-value pair for
DatasetSource.entries(). - method() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns the value of the
methodrecord component. - metrics() - Method in record class dev.dokimos.core.ItemResult
-
Returns the value of the
metricsrecord component. - metrics() - Method in record class dev.dokimos.core.TaskResult
-
Returns the value of the
metricsrecord component. - MIN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Returns the minimum score across all criteria.
- minScore() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
minScorerecord component. - minScore() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
minScorerecord component. - minScore() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
minScorerecord component. - mode(ArgMatchMode) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
-
Sets the key-set comparison mode.
- mode(StructuralMatchMode) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Sets the comparison mode.
- model() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
-
Returns the value of the
modelrecord component. - model() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns the value of the
modelrecord component. - model() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
modelrecord component. - model() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns the value of the
modelrecord component. - modelConfig() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
modelConfigrecord component.
N
- name() - Method in record class dev.dokimos.core.agents.ToolCall
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Returns the value of the
namerecord component. - name() - Method in class dev.dokimos.core.BaseEvaluator
- name() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.core.Dataset
-
Returns the dataset's name.
- name() - Method in record class dev.dokimos.core.EvalResult
-
Returns the value of the
namerecord component. - name() - Method in interface dev.dokimos.core.Evaluator
-
Returns the evaluator name.
- name() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns the value of the
namerecord component. - name() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
namerecord component. - name(String) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Sets the tool name.
- name(String) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder
-
Sets the tool name.
- name(String) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.Dataset.Builder
-
Sets the dataset name.
- name(String) - Method in class dev.dokimos.core.EvalResult.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Sets the evaluator name.
- name(String) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the experiment name.
- NAMES_AND_ARGS - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
-
Compare tool names and their arguments.
- NAMES_AND_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
-
Compare tool names and their invocation order.
- NAMES_ONLY - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
-
Compare only the set of tool names used.
- NETWORK_ERROR - Static variable in exception class dev.dokimos.server.judge.JudgeCallException
-
Status used when the failure is a network error or timeout rather than an HTTP response.
- noBaseline(double) - Static method in record class dev.dokimos.core.gate.GateVerdict
-
The verdict when no baseline exists yet: nothing to regress against, so the gate passes.
- NoOpReporter - Class in dev.dokimos.core
-
A no-op implementation of
Reporterthat does nothing. - note() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Returns the value of the
noterecord component. - note() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
noterecord component. - notSignificant(String) - Static method in record class dev.dokimos.core.comparison.SignificanceResult
-
Non-significant placeholder with
pValue = 1.0and no confidence interval. - noviceUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated novice user who is new to the domain.
- number() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
numberrecord component. - numberOfElements() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
numberOfElementsrecord component.
O
- observedToolNames() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Returns the distinct tool names observed during the run, in first-seen order.
- of(Message.Role, String) - Static method in record class dev.dokimos.core.conversation.Message
-
Creates a message with just role and content.
- of(ArgMatchMode) - Static method in interface dev.dokimos.core.evaluators.agents.ArgumentMatcher
-
Returns a tolerant matcher using the given key-set mode.
- of(String) - Static method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Creates a response carrying output text only, with no token counts (latency-only metrics).
- of(String, double, double, String) - Static method in record class dev.dokimos.core.EvalResult
-
Creates a result by comparing the score against a threshold.
- of(String, ApiKey) - Static method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
- of(String, String) - Static method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Creates a criterion with default weight of 1.0.
- of(String, String) - Static method in record class dev.dokimos.core.EvalTestCase
-
Creates a test case with a single input and actual output.
- of(String, String) - Static method in record class dev.dokimos.core.Example
-
Creates an example with a single input and expected output.
- of(String, String, String) - Static method in record class dev.dokimos.core.EvalTestCase
-
Creates a test case with input, actual output, and expected output.
- of(String, String, Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolDefinition
-
Creates a tool definition with a name, description, and input schema.
- of(String, Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolCall
-
Creates a tool call with just a name and arguments.
- of(Map<String, Object>) - Static method in record class dev.dokimos.core.TaskResult
-
Creates a result without call metrics.
- of(Page<T>) - Static method in record class dev.dokimos.server.dto.v1.PageResponse
- of(Pageable) - Static method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
- of(Sort) - Static method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
- offset() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns the value of the
offsetrecord component. - offTopicUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated off-topic user who frequently goes on tangents.
- onItemDeliveryFailure(Consumer<DokimosServerReporter.ItemDeliveryFailure>) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
-
Callback invoked when a batch of items is permanently dropped after all delivery retries.
- onProcessEvent(AgentProcessEvent) - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Receives every
AgentProcessEventfor the run and dispatches by concrete type. - onRegressionAlert(RegressionAlertEvent) - Method in class dev.dokimos.server.service.AlertWebhookDispatcher
-
Resolves the project's enabled webhooks and POSTs the alert to each.
- onRemovedEvaluator() - Method in class dev.dokimos.core.gate.GateConfig
- onRemovedEvaluator(GateConfig.RemovedEvaluatorPolicy) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- OpenAiCompatibleJudge - Class in dev.dokimos.server.judge
-
A
JudgeLMthat calls an OpenAI-compatible chat completions endpoint over the JDK HTTP client, with no vendor SDK. - OpenAiCompatibleJudge(String, String, String) - Constructor for class dev.dokimos.server.judge.OpenAiCompatibleJudge
- OpenAiSupport - Class in dev.dokimos.openai
-
Utilities for integrating with the OpenAI Java SDK.
- OpenResponsesJudge - Class in dev.dokimos.server.judge
-
A
JudgeLMthat calls an Open Responses endpoint (POST {baseUrl}/responses) over the JDK HTTP client, with no vendor SDK. - OpenResponsesJudge(String, String, String) - Constructor for class dev.dokimos.server.judge.OpenResponsesJudge
- ordinal() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns the value of the
ordinalrecord component. - OtlpAnyValue - Record Class in dev.dokimos.server.dto.v1.otlp
-
The OTLP
AnyValueunion in its JSON encoding. - OtlpAnyValue(String, Boolean, String, Double) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Creates an instance of a
OtlpAnyValuerecord class. - OtlpExportTraceServiceRequest - Record Class in dev.dokimos.server.dto.v1.otlp
-
The top level of the OTLP/HTTP JSON encoding of
ExportTraceServiceRequest. - OtlpExportTraceServiceRequest(List<OtlpResourceSpans>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
-
Creates an instance of a
OtlpExportTraceServiceRequestrecord class. - OtlpKeyValue - Record Class in dev.dokimos.server.dto.v1.otlp
-
A single OTLP attribute: a key and an
OtlpAnyValueholding the typed value. - OtlpKeyValue(String, OtlpAnyValue) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
-
Creates an instance of a
OtlpKeyValuerecord class. - OtlpProtobufConverter - Class in dev.dokimos.server.service
-
Translates the protobuf
ExportTraceServiceRequestinto the same DTO tree Jackson produces for the OTLP/HTTP JSON encoding, so both encodings share one parser and persistence path. - OtlpResource - Record Class in dev.dokimos.server.dto.v1.otlp
-
A resource and its attributes.
- OtlpResource(List<OtlpKeyValue>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpResource
-
Creates an instance of a
OtlpResourcerecord class. - OtlpResourceSpans - Record Class in dev.dokimos.server.dto.v1.otlp
-
The spans emitted by one resource, with that resource's attributes (for example
service.name). - OtlpResourceSpans(OtlpResource, List<OtlpScopeSpans>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
-
Creates an instance of a
OtlpResourceSpansrecord class. - OtlpScopeSpans - Record Class in dev.dokimos.server.dto.v1.otlp
-
The spans emitted by one instrumentation scope.
- OtlpScopeSpans(List<OtlpSpan>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
-
Creates an instance of a
OtlpScopeSpansrecord class. - OtlpSpan - Record Class in dev.dokimos.server.dto.v1.otlp
-
One OTLP span in the JSON encoding.
- OtlpSpan(String, String, String, String, String, String, String, OtlpStatus, List<OtlpKeyValue>) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Creates an instance of a
OtlpSpanrecord class. - OtlpStatus - Record Class in dev.dokimos.server.dto.v1.otlp
-
A span status.
- OtlpStatus(String, String) - Constructor for record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
-
Creates an instance of a
OtlpStatusrecord class. - OtlpTraceParser - Class in dev.dokimos.server.service
-
Pure translation from the OTLP/HTTP JSON request DTOs into the server's own span model, with no persistence.
- OtlpTraceParser() - Constructor for class dev.dokimos.server.service.OtlpTraceParser
- OtlpTraceParser.ParsedSpan - Record Class in dev.dokimos.server.service
-
A span translated from OTLP, carrying the merged attributes and derived input/output text.
- OtlpTraceParser.Result - Record Class in dev.dokimos.server.service
-
The outcome of parsing: the valid spans and the count of malformed spans that were skipped.
- OUTPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport
-
Default key for the model output in evaluation results.
- OUTPUT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport
-
Default key for the model output in evaluation results.
- outputKey(String) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Sets the map key used to read the value from both the actual and expected output maps.
- outputs() - Method in record class dev.dokimos.core.TaskResult
-
Returns the value of the
outputsrecord component. - outputText() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
outputTextrecord component. - outputText() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
outputTextrecord component. - outputText() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Returns the value of the
outputTextrecord component. - OutputType<T> - Class in dev.dokimos.core
-
A super-type token that captures a full generic type
T(including its type arguments) at compile time so it survives erasure at runtime. - overriddenExpectedOutput() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Returns the value of the
overriddenExpectedOutputrecord component. - overriddenExpectedOutput() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
overriddenExpectedOutputrecord component. - overriddenExpectedOutput() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
-
Returns the value of the
overriddenExpectedOutputrecord component.
P
- PAGE_SIZE - Static variable in class dev.dokimos.server.client.ServerDatasetResolver
-
Page size used when listing dataset items.
- pageable() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
pageablerecord component. - PageablePage(long, PageResponse.PageSort, boolean, int, int, boolean) - Constructor for record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Creates an instance of a
PageablePagerecord class. - paged() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns the value of the
pagedrecord component. - pageNumber() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns the value of the
pageNumberrecord component. - PageResponse<T> - Record Class in dev.dokimos.server.dto.v1
-
Stable page envelope used by paginated endpoints.
- PageResponse(List<T>, int, int, long, int, boolean, boolean, int, boolean, PageResponse.PageSort, PageResponse.PageablePage) - Constructor for record class dev.dokimos.server.dto.v1.PageResponse
-
Creates an instance of a
PageResponserecord class. - PageResponse.PageablePage - Record Class in dev.dokimos.server.dto.v1
-
Mirrors Spring's
PageableObjectJSON shape. - PageResponse.PageSort - Record Class in dev.dokimos.server.dto.v1
-
Mirrors Spring's
SortObjectJSON shape. - pageSize() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns the value of the
pageSizerecord component. - PageSort(boolean, boolean, boolean) - Constructor for record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Creates an instance of a
PageSortrecord class. - pairing() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
pairingrecord component. - pairing() - Method in class dev.dokimos.core.gate.GateConfig
- pairing() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
pairingrecord component. - pairing() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
pairingrecord component. - pairing() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
pairingrecord component. - pairing() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Returns the value of the
pairingrecord component. - pairing(GateConfig.Pairing) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- parallelism(int) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the level of parallelism for running the experiment.
- parameterNames() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Extracts all parameter names from the input schema properties.
- parameterSchema(String) - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Gets the schema for a specific parameter.
- parentSpanId() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
parentSpanIdrecord component. - parentSpanId() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
parentSpanIdrecord component. - parentSpanId() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
parentSpanIdrecord component. - parse(OtlpExportTraceServiceRequest) - Method in class dev.dokimos.server.service.OtlpTraceParser
-
Flattens the request into parsed spans, skipping malformed ones.
- parse(String, TypeReference<T>) - Static method in class dev.dokimos.core.LlmResponseUtils
-
Extracts the JSON payload from an LLM response (dropping any surrounding prose or code fence) and parses it leniently into the requested type.
- parseCsv(String, String) - Static method in class dev.dokimos.core.DatasetParser
- parseCsv(String, String, char) - Static method in class dev.dokimos.core.DatasetParser
- ParsedSpan(String, String, String, String, String, String, Long, Long, Map<String, Object>, String, String, String) - Constructor for record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Creates an instance of a
ParsedSpanrecord class. - parseJson(String) - Static method in class dev.dokimos.core.DatasetParser
- parseJsonl(String, String) - Static method in class dev.dokimos.core.DatasetParser
-
Parses a dataset from a JSONL string.
- parseJsonl(Path, String) - Static method in class dev.dokimos.core.DatasetParser
-
Parses a dataset from a JSONL file, streaming line-by-line from disk.
- parseTree(String) - Static method in class dev.dokimos.core.LlmResponseUtils
-
Extracts the JSON payload from an LLM response (dropping any surrounding prose or code fence) and parses it leniently into a tree.
- pass() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Returns the value of the
passrecord component. - passCount() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the average number of items that passed across all runs.
- passCount() - Method in record class dev.dokimos.core.RunResult
-
Returns the number of items that passed all evaluations in this run.
- passCount() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
passCountrecord component. - passed() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
passedrecord component. - passed() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
passedrecord component. - passedCount() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
passedCountrecord component. - passedItems() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
passedItemsrecord component. - passedItems() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns the value of the
passedItemsrecord component. - passFlip() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns the value of the
passFliprecord component. - passFlip() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns the value of the
passFliprecord component. - passRate() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the average pass rate across all runs.
- passRate() - Method in record class dev.dokimos.core.RunResult
-
Returns the proportion of items that passed in this run.
- passRate() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
passRaterecord component. - passRate() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Returns the value of the
passRaterecord component. - passRate() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
passRaterecord component. - passRate() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
passRaterecord component. - passRate() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns the value of the
passRaterecord component. - passRateDelta() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
passRateDeltarecord component. - passRateDelta() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
passRateDeltarecord component. - passRateDelta() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
passRateDeltarecord component. - passRateDelta() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
passRateDeltarecord component. - passRateDelta() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
passRateDeltarecord component. - passRateImproved() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
passRateImprovedrecord component. - passRateRegressed() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
passRateRegressedrecord component. - passRateSignificance() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
passRateSignificancerecord component. - pattern(String) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
-
Sets the regular expression pattern.
- payload() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
-
Returns the value of the
payloadrecord component. - PENDING - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
- PENDING - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
- permutationIterations() - Method in class dev.dokimos.core.gate.GateConfig
- permutationIterations(int) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
-
Permutation iteration count.
- permutationIterations(int) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- persistPage(UUID, List<JudgeJobTransactions.ScoredResult>, UUID) - Method in class dev.dokimos.server.service.JudgeJobTransactions
-
Persists a page of eval results and advances the job's seek cursor in one transaction.
- persona(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Sets a short persona description.
- Per-turn windowing - Search tag in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
- Section
- poll() - Method in class dev.dokimos.server.service.JudgeWorker
-
Polls for and processes one job per cycle.
- poll() - Method in class dev.dokimos.server.service.TraceEvalWorker
-
Polls for and processes one job per cycle.
- POSITIONAL - Enum constant in enum class dev.dokimos.core.gate.GateConfig.Pairing
-
Always pair by position (
"item-<index>"keys). - PRECISION - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Matched divided by the number of actual calls.
- PrecisionEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that measures retrieval precision.
- PrecisionEvaluator.Builder - Class in dev.dokimos.core.evaluators
-
Builder for constructing PrecisionEvaluator instances.
- prettyWriter() - Static method in class dev.dokimos.core.internal.Json
-
A thread-safe writer producing pretty-printed JSON.
- pricedItemCount() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
pricedItemCountrecord component. - PriceTable - Interface in dev.dokimos.core
-
Turns a model id and token counts into a USD cost, returning null when the model is unknown or a count is missing (never throws, never fabricates a number).
- principal(HttpServletRequest) - Static method in class dev.dokimos.server.tenant.TenantScopeResolver
-
Resolves the principal behind a request, falling back to the system principal when the auth filter did not set one.
- Principal - Record Class in dev.dokimos.server.filter
-
Authenticated caller.
- Principal(String, Role, String) - Constructor for record class dev.dokimos.server.filter.Principal
-
Creates an instance of a
Principalrecord class. - PRINCIPAL_ATTRIBUTE - Static variable in class dev.dokimos.server.filter.ApiKeyAuthFilter
-
Request attribute holding the authenticated
Principal. - principalId(HttpServletRequest) - Static method in class dev.dokimos.server.tenant.TenantScopeResolver
-
Resolves the principal id of the current request, or
nullwhen no principal is present. - problemResolution() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating problem resolution.
- professionalTone() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating professional tone.
- project(ExperimentResult, GateConfig) - Static method in class dev.dokimos.core.gate.BaselineStore
-
Projects an experiment result into the v1 baseline format (no I/O).
- Project - Class in dev.dokimos.server.entity
-
A project groups experiments.
- Project(String) - Constructor for class dev.dokimos.server.entity.Project
- ProjectController - Class in dev.dokimos.server.controller.v1
- ProjectController(ProjectService, ExperimentService, RunService) - Constructor for class dev.dokimos.server.controller.v1.ProjectController
- projectId() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns the value of the
projectIdrecord component. - projectId() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
projectIdrecord component. - projectId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
projectIdrecord component. - projectId() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
projectIdrecord component. - projectId() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
-
Returns the value of the
projectIdrecord component. - projectName() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
projectNamerecord component. - projectName() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
projectNamerecord component. - projectName() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
projectNamerecord component. - projectName() - Method in record class dev.dokimos.server.dto.v1.TrendData
-
Returns the value of the
projectNamerecord component. - projectName() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
projectNamerecord component. - projectName(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
-
Project name on the server.
- ProjectRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
Project. - ProjectRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
Project, implemented over the tenant-scoped query helper. - ProjectRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
Projectfinders. - ProjectRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.ProjectRepositoryFragmentImpl
- ProjectService - Class in dev.dokimos.server.service
- ProjectService(ProjectRepository) - Constructor for class dev.dokimos.server.service.ProjectService
- ProjectSummary - Record Class in dev.dokimos.server.dto.v1
- ProjectSummary(UUID, String, long, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ProjectSummary
-
Creates an instance of a
ProjectSummaryrecord class. - promote(PromoteRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.DatasetController
-
Promotes run item results into a new immutable version of an existing dataset.
- promote(PromoteRequest, String, TenantScope) - Method in class dev.dokimos.server.service.DatasetService
-
Promotes run item results into a new version of an existing dataset.
- PromoteItem(UUID, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
-
Creates an instance of a
PromoteItemrecord class. - PromoteRequest - Record Class in dev.dokimos.server.dto.v1
-
Payload for promoting run item results into a new version of an existing dataset.
- PromoteRequest(String, String, List<PromoteRequest.PromoteItem>) - Constructor for record class dev.dokimos.server.dto.v1.PromoteRequest
-
Creates an instance of a
PromoteRequestrecord class. - PromoteRequest.PromoteItem - Record Class in dev.dokimos.server.dto.v1
-
A single run item result to promote.
- protocol() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns the value of the
protocolrecord component. - protocol() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns the value of the
protocolrecord component. - protocol() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns the value of the
protocolrecord component. - provenance() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
provenancerecord component. - Provenance(String, BaselineFile.JudgeInfo) - Constructor for record class dev.dokimos.core.gate.BaselineFile.Provenance
-
Creates an instance of a
Provenancerecord class. - provideArguments(ExtensionContext) - Method in class dev.dokimos.junit.DatasetArgumentsProvider
- pValue() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns the value of the
pValuerecord component. - pValue() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns the value of the
pValuerecord component. - pValue() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns the value of the
pValuerecord component.
R
- RAG Evaluation - Search tag in class dev.dokimos.langchain4j.LangChain4jSupport
- Section
- ragTask(Function<String, Result<String>>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a RAG evaluation
Taskfrom a function that returnsResult. - ragTask(Function<String, Result<String>>, String, String, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a RAG evaluation
Taskwith custom key names. - reactiveStringTask(Function<Example, Mono<String>>) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Adapts a Reactor
MonoofStringoutput to anAsyncTask, wrapping the emitted string under thedefault output key. - reactiveTask(Function<Example, Mono<TaskResult>>) - Static method in class dev.dokimos.springai.SpringAiSupport
- read(String, TypeReference<T>) - Static method in class dev.dokimos.core.internal.Json
-
Parses a JSON string into the generic target captured by a Jackson
TypeReference, using the strict comparison reader so duplicate object keys are rejected alongside the NaN/Infinity and trailing-token tightening that applies to every reader. - read(String, JavaType) - Static method in class dev.dokimos.core.internal.Json
-
Parses a JSON string into an instance described by a Jackson
JavaType, supporting generic targets such asList<Foo>. - read(String, Class<T>) - Static method in class dev.dokimos.core.internal.Json
-
Parses a JSON string into an instance of
type. - read(Path) - Static method in class dev.dokimos.core.gate.BaselineStore
-
Reads and validates a baseline file.
- reader() - Static method in class dev.dokimos.core.internal.Json
-
A thread-safe reader over the shared, immutable mapper.
- reason() - Method in record class dev.dokimos.core.EvalResult
-
Returns the value of the
reasonrecord component. - reason() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Returns the value of the
reasonrecord component. - reason() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Returns the value of the
reasonrecord component. - reason() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns the value of the
reasonrecord component. - reason() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns the value of the
reasonrecord component. - reason() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
reasonrecord component. - reason() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Returns the value of the
reasonrecord component. - reason(String) - Method in class dev.dokimos.core.EvalResult.Builder
-
Sets the reason or explanation.
- reasoningSteps() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns the value of the
reasoningStepsrecord component. - reasoningSteps(List<String>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Sets all reasoning steps.
- RECALL - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Matched divided by the number of expected calls.
- RecallEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that measures retrieval recall.
- RecallEvaluator.Builder - Class in dev.dokimos.core.evaluators
-
Builder for constructing RecallEvaluator instances.
- recordFailure(UUID, String, boolean, int) - Method in class dev.dokimos.server.service.JudgeJobTransactions
-
Records a failure.
- recordFailure(UUID, String, boolean, int) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
-
Records a failure.
- recoverStaleClaims(Instant) - Method in class dev.dokimos.server.service.JudgeJobTransactions
-
Returns jobs orphaned by a crashed worker (claimed before the cutoff and never finished) to PENDING so the next poll can reclaim them.
- recoverStaleClaims(Instant) - Method in class dev.dokimos.server.service.TraceEvalJobTransactions
-
Returns jobs orphaned by a crashed worker (claimed before the cutoff and never finished) to PENDING so the next poll can reclaim them.
- RegexEvaluator - Class in dev.dokimos.core.evaluators
-
Evaluator that checks if the actual output matches a regular expression pattern.
- RegexEvaluator.Builder - Class in dev.dokimos.core.evaluators
- register(DatasetResolver) - Method in class dev.dokimos.core.DatasetResolverRegistry
-
Registers a custom resolver with the highest priority.
- REGRESSED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
-
The candidate is meaningfully and significantly worse than the baseline.
- RegressedCase(String, String, List<GateVerdict.EvaluatorDrop>) - Constructor for record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Creates an instance of a
RegressedCaserecord class. - RegressedCase(String, String, List<GateResult.EvaluatorDrop>) - Constructor for record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Creates an instance of a
RegressedCaserecord class. - regressedCaseCount() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
regressedCaseCountrecord component. - regressedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
regressedCountrecord component. - regressedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
regressedCountrecord component. - regressedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
regressedCountrecord component. - regressedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
regressedCountrecord component. - RegressedEvaluator(String, Double, Double, double, double) - Constructor for record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Creates an instance of a
RegressedEvaluatorrecord class. - RegressedEvaluator(String, Double, Double, double, double) - Constructor for record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Creates an instance of a
RegressedEvaluatorrecord class. - regressedEvaluators() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
regressedEvaluatorsrecord component. - regressedEvaluators() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
regressedEvaluatorsrecord component. - RegressionAlertEvent - Record Class in dev.dokimos.server.service
-
Published inside the run-completion transaction when a run regresses, and consumed only after that transaction commits.
- RegressionAlertEvent(UUID, RegressionAlertPayload) - Constructor for record class dev.dokimos.server.service.RegressionAlertEvent
-
Creates an instance of a
RegressionAlertEventrecord class. - RegressionAlertPayload - Record Class in dev.dokimos.server.dto.v1
-
JSON body POSTed to a project's alert webhooks when a completed run regresses against its baseline.
- RegressionAlertPayload(String, UUID, String, UUID, UUID, double, double, double, int) - Constructor for record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Creates an instance of a
RegressionAlertPayloadrecord class. - RegressionAlertService - Class in dev.dokimos.server.service
-
Computes, inside the run-completion transaction, whether a just-completed run regressed against its baseline, and publishes a
RegressionAlertEventwhen it did. - RegressionAlertService(ExperimentRunRepository, ComparisonSupport, ApplicationEventPublisher) - Constructor for class dev.dokimos.server.service.RegressionAlertService
- RegressionGate - Class in dev.dokimos.core.gate
-
Compares a candidate experiment result against a committed baseline and produces a
GateVerdict. - RegressionGateRunner - Class in dev.dokimos.core.gate
-
The run lifecycle around
RegressionGate: resolves whether to update, bootstrap, or compare a baseline, performs the file I/O, and turns a FAIL verdict into anAssertionError. - RegressionGateRunner.Environment - Interface in dev.dokimos.core.gate
-
Reads the outside world the lifecycle depends on.
- regressions() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Evaluator deltas flagged as significant regressions.
- rejected() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
-
Returns the value of the
rejectedrecord component. - rejectedSpans() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Returns the value of the
rejectedSpansrecord component. - REMOVED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
-
The item exists only in the baseline.
- removedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
removedCountrecord component. - removedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
removedCountrecord component. - removedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
removedCountrecord component. - removedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
removedCountrecord component. - reporter(Reporter) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the reporter for this experiment.
- Reporter - Interface in dev.dokimos.core
-
Interface for reporting experiment results to an external system.
- reportItem(RunHandle, ItemResult) - Method in class dev.dokimos.core.NoOpReporter
- reportItem(RunHandle, ItemResult) - Method in interface dev.dokimos.core.Reporter
-
Reports a single evaluated item.
- reportItem(RunHandle, ItemResult) - Method in class dev.dokimos.server.client.DokimosServerReporter
- requeueStaleClaims(Instant) - Method in interface dev.dokimos.server.repository.EvalJobRepository
-
Returns jobs claimed before the cutoff to PENDING so a job orphaned by a crashed worker is picked up again rather than stranded in CLAIMED forever.
- requeueStaleClaims(Instant) - Method in interface dev.dokimos.server.repository.TraceEvalJobRepository
-
Returns jobs claimed before the cutoff to PENDING so a job orphaned by a crashed worker is picked up again rather than stranded in CLAIMED forever.
- requiredParameters() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Extracts required parameter names from the input schema.
- requireTerminal(ExperimentRun, String) - Method in class dev.dokimos.server.service.ComparisonSupport
-
A run can be gated, diffed, or used as a baseline only once it has reached a terminal status.
- reset() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Clears all captured state so this collector can observe a fresh run.
- resolve(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver
- resolve(String) - Method in interface dev.dokimos.core.DatasetResolver
-
Resolve the URI to a
Dataset. - resolve(String) - Method in class dev.dokimos.core.DatasetResolverRegistry
-
Resolves a URI to a dataset using the first matching resolver.
- resolve(String) - Method in class dev.dokimos.core.FileDatasetResolver
- resolve(String) - Method in class dev.dokimos.server.client.ServerDatasetResolver
-
Fetches the dataset at the URI from the server, applying retries on 5xx responses and falling back to the offline cache when a pinned version is unreachable.
- resolveKey(LlmConnection) - Method in class dev.dokimos.server.service.LlmCredentialService
-
Resolves the effective plaintext API key for a connection.
- resolveParameter(ParameterContext, ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
- resolveType(Type) - Static method in class dev.dokimos.core.internal.Json
-
Resolves a Jackson
JavaTypefrom a genericType. - resource() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
-
Returns the value of the
resourcerecord component. - resourceSpans() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
-
Returns the value of the
resourceSpansrecord component. - respond(ConversationTrajectory) - Method in interface dev.dokimos.core.conversation.ConversationalApplication
-
Generates a response to the current conversation state.
- responseRelevance() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating response relevance.
- RESPONSES - Enum constant in enum class dev.dokimos.server.entity.LlmConnectionProtocol
-
The Responses API (
POST {baseUrl}/responses,inputitems,output_textresults). - restricted() - Method in record class dev.dokimos.server.tenant.TenantScope
-
Returns the value of the
restrictedrecord component. - result() - Method in record class dev.dokimos.core.agents.ToolCall
-
Returns the value of the
resultrecord component. - result() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Returns the value of the
resultrecord component. - result(String) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Sets the tool execution result.
- Result(List<OtlpTraceParser.ParsedSpan>, int) - Constructor for record class dev.dokimos.server.service.OtlpTraceParser.Result
-
Creates an instance of a
Resultrecord class. - resultAs(OutputType<T>) - Method in record class dev.dokimos.core.agents.ToolCall
-
Deserializes this tool call's
resultstring into a generic target captured by anOutputTypetoken, for examplenew OutputType<List<Order>>() {}. - resultAs(Class<T>) - Method in record class dev.dokimos.core.agents.ToolCall
-
Deserializes this tool call's
resultstring into an instance oftype. - resultJson(Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder
-
Sets the tool execution result from an arbitrary value by serializing it to compact (single-line) JSON and storing it in the same
resultstring component used byToolCall.Builder.result(String). - ResultStore - Interface in dev.dokimos.mcp.store
-
Persistence layer for evaluation run records.
- retrievalContextKey(String) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Sets the key used to retrieve context chunks from actualOutputs.
- retrievedKey(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Sets the key for retrieved items in actualOutputs.
- retrievedKey(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Sets the key for retrieved items in actualOutputs.
- ReviewQueueController - Class in dev.dokimos.server.controller.v1
- ReviewQueueController(ReviewQueueService) - Constructor for class dev.dokimos.server.controller.v1.ReviewQueueController
- ReviewQueueItem - Record Class in dev.dokimos.server.dto.v1
-
A run item surfaced in the review queue because it still needs a human verdict, carrying enough run, experiment, and project context for a reviewer to act on it without opening the run first.
- ReviewQueueItem(UUID, UUID, UUID, String, String, Map<String, Object>, Map<String, Object>, Map<String, Object>, List<RunDetails.EvalSummary>, AnnotationVerdict, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Creates an instance of a
ReviewQueueItemrecord class. - ReviewQueueService - Class in dev.dokimos.server.service
-
Surfaces run items that still need a human verdict so a reviewer can work through a single queue instead of opening runs one at a time.
- ReviewQueueService(ItemResultRepository, AnnotationRepository) - Constructor for class dev.dokimos.server.service.ReviewQueueService
- role() - Method in record class dev.dokimos.core.conversation.Message
-
Returns the value of the
rolerecord component. - role() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
rolerecord component. - role() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Returns the value of the
rolerecord component. - role() - Method in record class dev.dokimos.server.filter.Principal
-
Returns the value of the
rolerecord component. - Role - Enum Class in dev.dokimos.server.filter
-
Role granted to an authenticated
Principal. - rootSpanName() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
rootSpanNamerecord component. - rootSpanName() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
rootSpanNamerecord component. - ruleId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
ruleIdrecord component. - run() - Method in class dev.dokimos.core.Experiment
-
Runs the experiment and returns the aggregated results.
- run(Example) - Method in interface dev.dokimos.core.AsyncTask
-
Runs the task on the given
Exampleand returns a future of its result. - run(Example) - Method in interface dev.dokimos.core.MeasuredTask
-
Run the task on the given
Exampleand produce a result with optional metrics. - run(Example) - Method in interface dev.dokimos.core.Task
-
Run the task on the given
Exampleand produce outputs. - run(ExperimentResult, Path, GateConfig, RegressionGateRunner.Environment) - Static method in class dev.dokimos.core.gate.RegressionGateRunner
-
Runs the gate lifecycle for one candidate against one baseline path.
- RunComparison - Class in dev.dokimos.core.comparison
-
Regression-comparison engine that compares a baseline set of runs against a candidate set.
- RunComparison.Builder - Class in dev.dokimos.core.comparison
-
Builder for
RunComparison. - RunComparisonResult - Record Class in dev.dokimos.core.comparison
-
Result of comparing a baseline set of runs against a candidate set.
- RunComparisonResult(double, double, double, SignificanceResult, boolean, boolean, int, int, int, int, int, int, int, List<EvaluatorDelta>, List<ItemComparison>) - Constructor for record class dev.dokimos.core.comparison.RunComparisonResult
-
Creates an instance of a
RunComparisonResultrecord class. - RunController - Class in dev.dokimos.server.controller.v1
- RunController(RunService) - Constructor for class dev.dokimos.server.controller.v1.RunController
- runCount() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the number of runs performed.
- RunDetails - Record Class in dev.dokimos.server.dto.v1
-
Detail view of a single run.
- RunDetails(UUID, UUID, String, String, RunStatus, Map<String, Object>, long, long, Double, Instant, Instant, UUID, Integer, Long, Long, Double, Double, Long, Long, Page<RunDetails.ItemSummary>) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails
-
Creates an instance of a
RunDetailsrecord class. - RunDetails.EvalSummary - Record Class in dev.dokimos.server.dto.v1
- RunDetails.ItemSummary - Record Class in dev.dokimos.server.dto.v1
- RunHandle - Record Class in dev.dokimos.core
-
A handle representing an active experiment run.
- RunHandle(String) - Constructor for record class dev.dokimos.core.RunHandle
-
Creates a new run handle.
- runId() - Method in record class dev.dokimos.core.RunHandle
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns the value of the
runIdrecord component. - runId() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns the value of the
runIdrecord component. - runIndex() - Method in record class dev.dokimos.core.RunResult
-
Returns the value of the
runIndexrecord component. - RUNNING - Enum constant in enum class dev.dokimos.server.entity.RunStatus
- RunPoint(UUID, Instant, double, long, long) - Constructor for record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Creates an instance of a
RunPointrecord class. - RunRecord - Record Class in dev.dokimos.mcp.store
-
Persistent record of a single evaluation run.
- RunRecord(String, Instant, String, String, String, Map<String, Object>, double, int, int, int, Map<String, Double>, List<RunRecord.ItemDetail>) - Constructor for record class dev.dokimos.mcp.store.RunRecord
-
Creates an instance of a
RunRecordrecord class. - RunRecord.EvalDetail - Record Class in dev.dokimos.mcp.store
-
Single evaluator result for one example.
- RunRecord.ItemDetail - Record Class in dev.dokimos.mcp.store
-
Detail for a single evaluated example.
- RunResult - Record Class in dev.dokimos.core
-
Results from a single run of an experiment.
- RunResult(int, List<ItemResult>) - Constructor for record class dev.dokimos.core.RunResult
-
Creates an instance of a
RunResultrecord class. - runResults() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the value of the
runResultsrecord component. - runs() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the individual run results for detailed analysis.
- runs() - Method in record class dev.dokimos.server.dto.v1.TrendData
-
Returns the value of the
runsrecord component. - runs(int) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the number of times to run the experiment.
- RunService - Class in dev.dokimos.server.service
- RunService(ExperimentRunRepository, ItemResultRepository, IngestedBatchRepository, DatasetService, DatasetItemRepository, AnnotationRepository, RegressionAlertService) - Constructor for class dev.dokimos.server.service.RunService
- runsPerItem() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns the value of the
runsPerItemrecord component. - RunStatus - Enum Class in dev.dokimos.core
-
Status of an experiment run.
- RunStatus - Enum Class in dev.dokimos.server.entity
- RunSummary - Record Class in dev.dokimos.server.dto.v1
-
Summary view of a single run in a list.
- RunSummary(UUID, RunStatus, Map<String, Object>, long, long, Double, Instant, Instant, UUID, Integer, Long, Long, Double, Double) - Constructor for record class dev.dokimos.server.dto.v1.RunSummary
-
Creates an instance of a
RunSummaryrecord class.
S
- safety() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating safety and appropriateness.
- satisfiedCustomer(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated satisfied customer who is cooperative and positive.
- save(RunRecord) - Method in class dev.dokimos.mcp.store.JsonResultStore
- save(RunRecord) - Method in interface dev.dokimos.mcp.store.ResultStore
-
Saves a run record.
- save(S) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
- save(S) - Method in interface dev.dokimos.server.tenant.ScopedRepository
-
Persists a new or updated entity.
- saveAll(Iterable<S>) - Method in class dev.dokimos.server.tenant.AbstractScopedRepository
- saveAll(Iterable<S>) - Method in interface dev.dokimos.server.tenant.ScopedRepository
-
Persists all the given entities.
- scenario() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the value of the
scenariorecord component. - scenario(String) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Sets the scenario description for the conversation.
- scenario(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Sets the scenario description.
- SCHEME - Static variable in class dev.dokimos.server.client.ServerDatasetResolver
-
URI scheme handled by this resolver.
- scope(HttpServletRequest) - Static method in class dev.dokimos.server.tenant.TenantScopeResolver
-
Resolves the tenant scope the current request reads and writes under, using the principal's own scope and failing closed to a shared-only scope when no principal is present.
- scoped(String) - Static method in record class dev.dokimos.server.tenant.TenantScope
-
Returns a scope restricted to the given tenant.
- ScopedRepository<T> - Interface in dev.dokimos.server.tenant
-
Common tenant-scoped operations shared by every scoped repository.
- scopeSpans() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
-
Returns the value of the
scopeSpansrecord component. - score() - Method in record class dev.dokimos.core.EvalResult
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
scorerecord component. - score() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Returns the value of the
scorerecord component. - score(double) - Method in class dev.dokimos.core.EvalResult.Builder
-
Sets the numeric score.
- score(String, String, String) - Method in class dev.dokimos.server.judge.JudgeScorer
-
Scores one item.
- ScoredResult(UUID, EvalResult) - Constructor for record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
-
Creates an instance of a
ScoredResultrecord class. - ScoreOutcome(double, String, boolean) - Constructor for record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Creates an instance of a
ScoreOutcomerecord class. - scoreRange(double, double) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Sets the expected score range for the LLM response.
- scoreStdDev(String) - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the sample standard deviation of scores for the specified evaluator across runs.
- secret() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Returns the value of the
secretrecord component. - secret() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Returns the value of the
secretrecord component. - seed() - Method in class dev.dokimos.core.gate.GateConfig
- seed(long) - Method in class dev.dokimos.core.comparison.RunComparison.Builder
-
Seed for permutation and bootstrap procedures.
- seed(long) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- ServerDatasetResolver - Class in dev.dokimos.server.client
-
Resolves dataset URIs of the form
dataset://<name>@<version>against a Dokimos server. - ServerDatasetResolver() - Constructor for class dev.dokimos.server.client.ServerDatasetResolver
-
Creates a resolver wired to
DOKIMOS_SERVER_URL/DOKIMOS_API_KEY. - serverUrl(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
-
Dokimos server URL, e.g.
- setApiKey(String) - Method in class dev.dokimos.server.config.ApiKeyProperties
- setAttemptCount(int) - Method in class dev.dokimos.server.entity.EvalJob
- setAttemptCount(int) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setAttributes(Map<String, Object>) - Method in class dev.dokimos.server.entity.TraceSpan
- setAvgLatencyMs(Double) - Method in class dev.dokimos.server.entity.ExperimentRun
- setBaseUrl(String) - Method in class dev.dokimos.server.entity.LlmConnection
- setClaimedAt(Instant) - Method in class dev.dokimos.server.entity.EvalJob
- setClaimedAt(Instant) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setClaimTimeoutMs(long) - Method in class dev.dokimos.server.config.JudgeProperties
- setClaimTimeoutMs(long) - Method in class dev.dokimos.server.config.TraceProperties.Eval
- setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.EvalJob
- setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.ExperimentRun
- setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setConnection(LlmConnection) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setCostUsd(Double) - Method in class dev.dokimos.server.entity.ItemResult
- setCreatedBy(String) - Method in class dev.dokimos.server.entity.Annotation
- setCredentialRef(String) - Method in class dev.dokimos.server.entity.LlmConnection
- setCriteria(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setDatasetItem(DatasetItem) - Method in class dev.dokimos.server.entity.ItemResult
- setDatasetVersion(DatasetVersion) - Method in class dev.dokimos.server.entity.ExperimentRun
- setDescription(String) - Method in class dev.dokimos.server.entity.Dataset
- setEnabled(boolean) - Method in class dev.dokimos.server.entity.AlertWebhook
- setEnabled(boolean) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setEncryptedApiKey(String) - Method in class dev.dokimos.server.entity.LlmConnection
- setEncryptionKey(String) - Method in class dev.dokimos.server.config.ApiKeyProperties
- setEndTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.Trace
- setEndTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.TraceSpan
- setEvaluationParams(String) - Method in class dev.dokimos.server.entity.EvalJob
- setEvaluatorName(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setExpiresAt(Instant) - Method in class dev.dokimos.server.entity.Trace
- setGitBranch(String) - Method in class dev.dokimos.server.entity.ExperimentRun
- setGitSha(String) - Method in class dev.dokimos.server.entity.ExperimentRun
- setInputText(String) - Method in class dev.dokimos.server.entity.TraceSpan
- setItemCount(int) - Method in class dev.dokimos.server.entity.ExperimentRun
- setKind(String) - Method in class dev.dokimos.server.entity.TraceSpan
- setLastError(String) - Method in class dev.dokimos.server.entity.EvalJob
- setLastError(String) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setLastItemId(UUID) - Method in class dev.dokimos.server.entity.EvalJob
- setLatencyMs(Long) - Method in class dev.dokimos.server.entity.ItemResult
- setMatchKey(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setMatchType(TraceMatchType) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setMatchValue(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setMaxAttempts(int) - Method in class dev.dokimos.server.config.JudgeProperties
- setMaxAttempts(int) - Method in class dev.dokimos.server.config.TraceProperties.Eval
- setMaxScore(double) - Method in class dev.dokimos.server.entity.EvalJob
- setMaxScore(double) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setMetadata(Map<String, Object>) - Method in class dev.dokimos.server.entity.EvalResult
- setMinScore(double) - Method in class dev.dokimos.server.entity.EvalJob
- setMinScore(double) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setModel(String) - Method in class dev.dokimos.server.entity.LlmConnection
- setName(String) - Method in class dev.dokimos.server.entity.ExperimentRun
- setName(String) - Method in class dev.dokimos.server.entity.LlmConnection
- setName(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setNote(String) - Method in class dev.dokimos.server.entity.Annotation
- setOutputText(String) - Method in class dev.dokimos.server.entity.TraceSpan
- setOverriddenExpectedOutput(Map<String, Object>) - Method in class dev.dokimos.server.entity.Annotation
- setPageSize(int) - Method in class dev.dokimos.server.config.JudgeProperties
- setParentSpanId(String) - Method in class dev.dokimos.server.entity.TraceSpan
- setPassedCount(int) - Method in class dev.dokimos.server.entity.ExperimentRun
- setPassRate(Double) - Method in class dev.dokimos.server.entity.ExperimentRun
- setPollIntervalMs(long) - Method in class dev.dokimos.server.config.JudgeProperties
- setPollIntervalMs(long) - Method in class dev.dokimos.server.config.TraceProperties.Eval
- setProjectId(UUID) - Method in class dev.dokimos.server.entity.Trace
- setProtocol(LlmConnectionProtocol) - Method in class dev.dokimos.server.entity.LlmConnection
- setReason(String) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setRetentionDays(int) - Method in class dev.dokimos.server.config.TraceProperties
- setRootSpanName(String) - Method in class dev.dokimos.server.entity.Trace
- setScore(Double) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setSecret(String) - Method in class dev.dokimos.server.entity.AlertWebhook
- setSpanCount(int) - Method in class dev.dokimos.server.entity.Trace
- setStartTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.Trace
- setStartTimeUnixNano(Long) - Method in class dev.dokimos.server.entity.TraceSpan
- setStatus(EvalJobStatus) - Method in class dev.dokimos.server.entity.EvalJob
- setStatus(RunStatus) - Method in class dev.dokimos.server.entity.ExperimentRun
- setStatus(TraceEvalJobStatus) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setStatusCode(String) - Method in class dev.dokimos.server.entity.TraceSpan
- setSuccess(Boolean) - Method in class dev.dokimos.server.entity.TraceEvalJob
- setSweepIntervalMs(long) - Method in class dev.dokimos.server.config.TraceProperties
- setTenantId(String) - Method in class dev.dokimos.server.entity.AlertWebhook
- setTenantId(String) - Method in class dev.dokimos.server.entity.Annotation
- setTenantId(String) - Method in class dev.dokimos.server.entity.Dataset
- setTenantId(String) - Method in class dev.dokimos.server.entity.DatasetItem
- setTenantId(String) - Method in class dev.dokimos.server.entity.DatasetVersion
- setTenantId(String) - Method in class dev.dokimos.server.entity.EvalResult
- setTenantId(String) - Method in class dev.dokimos.server.entity.Experiment
- setTenantId(String) - Method in class dev.dokimos.server.entity.ExperimentRun
- setTenantId(String) - Method in class dev.dokimos.server.entity.ItemResult
- setTenantId(String) - Method in class dev.dokimos.server.entity.LlmConnection
- setTenantId(String) - Method in class dev.dokimos.server.entity.Project
- setTenantId(String) - Method in class dev.dokimos.server.entity.Trace
- setTenantId(String) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setTenantId(String) - Method in class dev.dokimos.server.entity.TraceSpan
- setThreshold(Double) - Method in class dev.dokimos.server.entity.EvalJob
- setThreshold(Double) - Method in class dev.dokimos.server.entity.TraceEvalRule
- setTokensIn(Integer) - Method in class dev.dokimos.server.entity.ItemResult
- setTokensOut(Integer) - Method in class dev.dokimos.server.entity.ItemResult
- setTotalCostUsd(Double) - Method in class dev.dokimos.server.entity.ExperimentRun
- setTotalTokensIn(Long) - Method in class dev.dokimos.server.entity.ExperimentRun
- setTotalTokensOut(Long) - Method in class dev.dokimos.server.entity.ExperimentRun
- setTrace(Trace) - Method in class dev.dokimos.server.entity.TraceSpan
- setTriggeredBy(String) - Method in class dev.dokimos.server.entity.ExperimentRun
- setUrl(String) - Method in class dev.dokimos.server.entity.AlertWebhook
- setVerdict(AnnotationVerdict) - Method in class dev.dokimos.server.entity.Annotation
- severityMargin() - Method in class dev.dokimos.core.gate.GateConfig
- severityMargin(double) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- sha256Hex(String) - Static method in class dev.dokimos.server.filter.ApiKeyHasher
-
Returns the lowercase SHA-256 hex digest of the given key.
- significance() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns the value of the
significancerecord component. - SignificanceResult - Record Class in dev.dokimos.core.comparison
-
Outcome of a statistical significance test on a paired comparison.
- SignificanceResult(String, double, boolean, Double, Double) - Constructor for record class dev.dokimos.core.comparison.SignificanceResult
-
Creates an instance of a
SignificanceResultrecord class. - significant() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns the value of the
significantrecord component. - significant() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
significantrecord component. - significant() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns the value of the
significantrecord component. - significant() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
significantrecord component. - significant() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
significantrecord component. - significantImprovedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
significantImprovedCountrecord component. - significantRegressedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
significantRegressedCountrecord component. - simpleTask(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a simple
Taskfor Q&A evaluation. - simpleTask(ChatModel, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Creates a simple
Taskfor Q&A evaluation that writes the response under a caller-chosen key. - simulate() - Method in class dev.dokimos.core.conversation.ConversationSimulator
-
Runs the conversation simulation.
- simulateAsync() - Method in class dev.dokimos.core.conversation.ConversationSimulator
-
Runs the conversation simulation asynchronously using the common fork-join pool.
- simulateAsync(ExecutorService) - Method in class dev.dokimos.core.conversation.ConversationSimulator
-
Runs the conversation simulation asynchronously using the provided executor.
- simulatedUser(SimulatedUser) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Sets the simulated user for the conversation.
- SimulatedUser - Interface in dev.dokimos.core.conversation
-
Functional interface for simulating user behavior in multi-turn conversations.
- size() - Method in record class dev.dokimos.core.Dataset
-
Returns the number of examples in the dataset.
- size() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
sizerecord component. - sort() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns the value of the
sortrecord component. - sort() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
sortrecord component. - sorted() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Returns the value of the
sortedrecord component. - SPAN_NAME - Enum constant in enum class dev.dokimos.server.entity.TraceMatchType
- spanCount() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
spanCountrecord component. - spanCount() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
spanCountrecord component. - spanId() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
spanIdrecord component. - spanId() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
spanIdrecord component. - spanId() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
spanIdrecord component. - spanId() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
spanIdrecord component. - spans() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
-
Returns the value of the
spansrecord component. - spans() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
spansrecord component. - spans() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
-
Returns the value of the
spansrecord component. - SpanView - Record Class in dev.dokimos.server.dto.v1
-
Public view of a
TraceSpan, including its derived input/output text and flattened attributes. - SpanView(UUID, String, String, String, String, String, Long, Long, String, String, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.SpanView
-
Creates an instance of a
SpanViewrecord class. - SpaResourceConfig - Class in dev.dokimos.server.config
-
Serves the single-page React app and forwards client side routes to
index.htmlso a deep link or a page refresh on a route such as/tracesor/api-keysis handled by the SPA router instead of returning 404. - SpaResourceConfig() - Constructor for class dev.dokimos.server.config.SpaResourceConfig
- spoolDirectory(Path) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder
-
Opt-in durable spool directory.
- SpringAiAlibabaSupport - Class in dev.dokimos.springai.alibaba
-
Utilities for evaluating Spring AI Alibaba (graph/agent) runs with the Dokimos agent evaluators.
- SpringAiAlibabaSupport.AlibabaAgentResponse - Record Class in dev.dokimos.springai.alibaba
-
A Spring AI Alibaba agent run's output text paired with optional token usage, consumed by
SpringAiAlibabaSupport.measuredAsyncTask(Function, String, PriceTable). - SpringAiSupport - Class in dev.dokimos.springai
-
Utilities for integrating with Spring AI.
- stampTenantId() - Method in record class dev.dokimos.server.tenant.TenantScope
-
Returns the tenant id to stamp on a newly written row, or
nullfor a shared row (the unrestricted and shared-only scopes). - startedAt() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Returns the value of the
startedAtrecord component. - startedAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
startedAtrecord component. - startedAt() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
startedAtrecord component. - startedAt() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns the value of the
startedAtrecord component. - startRun(String, Map<String, Object>) - Method in class dev.dokimos.core.NoOpReporter
- startRun(String, Map<String, Object>) - Method in interface dev.dokimos.core.Reporter
-
Starts a new experiment run.
- startRun(String, Map<String, Object>) - Method in class dev.dokimos.server.client.DokimosServerReporter
- startTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
startTimeUnixNanorecord component. - startTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
startTimeUnixNanorecord component. - startTimeUnixNano() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
startTimeUnixNanorecord component. - startTimeUnixNano() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
startTimeUnixNanorecord component. - status() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
statusrecord component. - status() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
-
Returns the value of the
statusrecord component. - statusCode() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns the value of the
statusCoderecord component. - statusCode() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
statusCoderecord component. - stoppingCondition(Predicate<ConversationTrajectory>) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder
-
Sets a stopping condition for early termination.
- STRICT - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Same length, same order, each position matches.
- STRICT - Enum constant in enum class dev.dokimos.core.evaluators.StructuralMatchMode
-
Strict comparison (the eval-safe default).
- strictMode(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Enables strict mode which fails on any unexpected parameter.
- strictMode(boolean) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Enables or disables strict mode.
- stringValue() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns the value of the
stringValuerecord component. - stripMarkdown(String) - Static method in class dev.dokimos.core.LlmResponseUtils
-
Strips markdown code block formatting from an LLM response.
- StructuralMatchEvaluator - Class in dev.dokimos.core.evaluators
-
Compares the actual output against the expected output as JSON structures rather than as opaque strings.
- StructuralMatchEvaluator.Builder - Class in dev.dokimos.core.evaluators
-
Builder for constructing structural match evaluators.
- StructuralMatchMode - Enum Class in dev.dokimos.core.evaluators
-
Controls how
StructuralMatchEvaluatorcompares an expected JSON structure against an actual one. - SUBSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
-
Expected entries are a subset of the actual arguments (extras allowed).
- SUBSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Every actual call has a distinct match in expected.
- SUCCEEDED - Enum constant in enum class dev.dokimos.server.entity.EvalJobStatus
- SUCCEEDED - Enum constant in enum class dev.dokimos.server.entity.TraceEvalJobStatus
- success() - Method in record class dev.dokimos.core.EvalResult
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.core.ItemResult
- success() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns the value of the
successrecord component. - success() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Returns the value of the
successrecord component. - success(String, double, String) - Static method in record class dev.dokimos.core.EvalResult
-
Creates a successful result.
- SUCCESS - Enum constant in enum class dev.dokimos.core.RunStatus
-
The run completed successfully.
- SUCCESS - Enum constant in enum class dev.dokimos.server.entity.RunStatus
- sumCostByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Sums the call cost across a run's items.
- summary() - Method in record class dev.dokimos.server.dto.v1.DiffView
-
Returns the value of the
summaryrecord component. - sumTokensInByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Sums the prompt tokens across a run's items.
- sumTokensOutByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
-
Sums the completion tokens across a run's items.
- SUPERSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
-
Actual entries are a subset of the expected arguments (omissions allowed).
- SUPERSET - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Every expected call has a distinct match in actual.
- supports(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver
- supports(String) - Method in interface dev.dokimos.core.DatasetResolver
-
Check if this resolver supports the given URI.
- supports(String) - Method in class dev.dokimos.core.FileDatasetResolver
- supports(String) - Method in class dev.dokimos.server.client.ServerDatasetResolver
-
Indicates whether this resolver will attempt the given URI.
- supportsParameter(ParameterContext, ExtensionContext) - Method in class dev.dokimos.junit.DatasetRunExtension
-
Supports an optional
DatasetRunExtension.DatasetItemRecordertest-method parameter. - sweep() - Method in class dev.dokimos.server.service.TraceRetentionSweeper
-
Deletes expired traces.
- system() - Static method in record class dev.dokimos.server.filter.Principal
-
System principal used when no API key authentication is configured, or for reads in an open deployment.
- system(String) - Static method in record class dev.dokimos.core.conversation.Message
-
Creates a system message.
- SYSTEM - Enum constant in enum class dev.dokimos.core.conversation.Message.Role
-
A system message providing context or instructions.
- systemEnvironment() - Static method in class dev.dokimos.core.gate.RegressionGateRunner
-
Returns the production environment: CI from
CI/GITHUB_ACTIONS, the update flag fromGateConfig.updateBaselineRequested(), the verdict directory attarget/dokimos, and the log sink routed to this class's logger. - systemMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds a system message to the trajectory.
- systemMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns only the system messages from the conversation.
- systemPrompt(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
-
Sets the complete system prompt directly.
T
- task(Task) - Method in class dev.dokimos.core.Experiment.Builder
-
Sets the task.
- Task - Interface in dev.dokimos.core
- TaskCompletionEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Evaluates whether an AI agent completed the user's requested tasks.
- TaskCompletionEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- TaskResult - Record Class in dev.dokimos.core
-
The outcome of executing a
MeasuredTask: the actual outputs and optional metrics describing the underlying LLM call. - TaskResult(Map<String, Object>, CallMetrics) - Constructor for record class dev.dokimos.core.TaskResult
-
Creates an instance of a
TaskResultrecord class. - tasks(List<String>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
-
Sets the tasks the agent was asked to complete (the
"tasks"key in metadata). - tasksKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets the metadata key for the task list.
- technicalExpert(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas
-
Creates a simulated technical expert who understands complex concepts.
- temperature() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
-
Returns the value of the
temperaturerecord component. - tenantId() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns the value of the
tenantIdrecord component. - tenantId() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Returns the value of the
tenantIdrecord component. - tenantId() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
tenantIdrecord component. - tenantId() - Method in record class dev.dokimos.server.filter.Principal
-
Returns the value of the
tenantIdrecord component. - tenantId() - Method in record class dev.dokimos.server.tenant.TenantScope
-
Returns the value of the
tenantIdrecord component. - TenantPredicate - Class in dev.dokimos.server.tenant
-
Builds the SQL/JPQL tenant predicate for a
TenantScopeagainst atenant_idpath. - tenantScope() - Method in record class dev.dokimos.server.filter.Principal
-
Resolves the
TenantScopethis principal reads and writes under. - TenantScope - Record Class in dev.dokimos.server.tenant
-
Immutable tenant visibility used by every scoped repository read and by service-side write stamping.
- TenantScope(boolean, String) - Constructor for record class dev.dokimos.server.tenant.TenantScope
-
Creates an instance of a
TenantScoperecord class. - TenantScopedFinder<T> - Class in dev.dokimos.server.tenant
-
Reusable tenant-scoped query helper shared by every scoped repository implementation.
- TenantScopedFinder(EntityManager, Class<T>) - Constructor for class dev.dokimos.server.tenant.TenantScopedFinder
- TenantScopeResolver - Class in dev.dokimos.server.tenant
-
Derives the
TenantScopeand principal id for the current request from thePrincipalthe auth filter placed on the request attribute. - text() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Returns the value of the
textrecord component. - threshold() - Method in class dev.dokimos.core.BaseEvaluator
- threshold() - Method in record class dev.dokimos.core.EvalResult
-
Returns the value of the
thresholdrecord component. - threshold() - Method in interface dev.dokimos.core.Evaluator
-
Returns the minimum score threshold for success.
- threshold() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Returns the value of the
thresholdrecord component. - threshold() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns the value of the
thresholdrecord component. - threshold() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns the value of the
thresholdrecord component. - threshold() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns the value of the
thresholdrecord component. - threshold() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns the value of the
thresholdrecord component. - threshold() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
thresholdrecord component. - threshold(double) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.EvalResult.Builder
-
Sets the success threshold.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
-
Sets the maximum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder
-
Sets the minimum score threshold for success.
- threshold(double) - Method in class dev.dokimos.core.evaluators.StructuralMatchEvaluator.Builder
-
Sets the minimum score threshold for success.
- timestamp() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
timestamprecord component. - toAgentOutputs() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Builds the actual-outputs map the agent evaluators read, identical in shape to
AgentTrace.toOutputMap(). - toAgentTrace() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Collapses the conversation into a single
AgentTrace: the final response is the last assistant message's content (or empty), the tool calls areConversationTrajectory.toolCalls(), reasoning is empty, and metadata carries the scenario and turn count. - toAgentTrace(ReactAgent, Map<String, Object>, RunnableConfig) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Runs a
ReactAgent's compiled graph and folds the resulting state into a singleAgentTrace. - toAgentTrace(OverAllState) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Folds the full multi-turn conversation of a graph run into a single
AgentTrace. - toAgentTrace(ChatCompletionMessage) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Builds an
AgentTracefrom an OpenAIChatCompletionMessage. - toAgentTrace(ChatCompletionMessage, Function<String, String>) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Builds an
AgentTracefrom an OpenAIChatCompletionMessage, looking up each tool call's result by its id. - toAgentTrace(Result<?>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Builds an
AgentTracefrom a LangChain4jResult. - toAgentTrace(Optional<OverAllState>) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Folds the optional graph state returned by
CompiledGraph.invoke(Map)into a singleAgentTrace. - toAgentTrace(AssistantMessage) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Builds an
AgentTracefrom a Spring AIAssistantMessage. - toAgentTrace(AssistantMessage, List<ToolResponseMessage>) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Builds an
AgentTracefrom a Spring AIAssistantMessageand the tool responses produced for it. - toCsv() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the experiment result as a CSV string.
- toCsv(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to a CSV string.
- toDto(ExportTraceServiceRequest) - Static method in class dev.dokimos.server.service.OtlpProtobufConverter
-
Converts a decoded protobuf request into the common OTLP request DTO.
- toEvaluationResponse(EvalResult) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Converts a Dokimos
EvalResultto a Spring AIEvaluationResponse. - toHtml() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the experiment result as an HTML string.
- toHtml(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to an HTML string.
- toJson() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Serializes the trajectory to JSON for debugging and logging.
- toJson() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the experiment result as a JSON string.
- toJson() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Serializes to compact JSON, the shape the CI report action consumes.
- toJson(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to a JSON string.
- tokenizedItemCount() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
tokenizedItemCountrecord component. - tokensIn() - Method in record class dev.dokimos.core.CallMetrics
-
Returns the value of the
tokensInrecord component. - tokensIn() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
tokensInrecord component. - tokensIn() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
tokensInrecord component. - tokensIn() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Returns the value of the
tokensInrecord component. - tokensOut() - Method in record class dev.dokimos.core.CallMetrics
-
Returns the value of the
tokensOutrecord component. - tokensOut() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns the value of the
tokensOutrecord component. - tokensOut() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns the value of the
tokensOutrecord component. - tokensOut() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Returns the value of the
tokensOutrecord component. - tolerant() - Static method in interface dev.dokimos.core.evaluators.agents.ArgumentMatcher
-
Returns the default tolerant matcher using
ArgMatchMode.EXACT. - TolerantArgumentMatcher - Class in dev.dokimos.core.evaluators.agents
-
Default
ArgumentMatcherthat compares arguments structurally with a few deliberate tolerances. - TolerantArgumentMatcher.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the matcher.
- toMarkdown() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the experiment result as a Markdown string.
- toMarkdown() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Renders the verdict as CI-agnostic Markdown so any runner (GitLab, Jenkins, local) can post the same comment.
- toMarkdown(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter
-
Exports the experiment result to a Markdown string.
- toNode(Object) - Static method in class dev.dokimos.core.internal.Json
-
Converts an arbitrary value to a
JsonNodetree (the in-memory model the structural comparator works against). - ToolArgumentHallucinationEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Uses a judge LLM to assess whether tool call argument values are factually grounded in the user's input and preceding tool call results.
- ToolArgumentHallucinationEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolCall - Record Class in dev.dokimos.core.agents
-
Represents a single tool invocation made by an AI agent.
- ToolCall(String, Map<String, Object>, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.ToolCall
-
Creates an instance of a
ToolCallrecord class. - ToolCall.Builder - Class in dev.dokimos.core.agents
-
Builder for constructing tool calls.
- toolCalls() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns the value of the
toolCallsrecord component. - toolCalls() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Flattens every assistant turn's tool calls into one list, in chronological order.
- toolCalls() - Method in record class dev.dokimos.core.conversation.Message
-
Returns the value of the
toolCallsrecord component. - toolCalls() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Returns the tool calls captured so far, in execution order.
- toolCalls(List<ToolCall>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder
-
Sets all tool calls.
- toolCalls(List<ToolCall>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
-
Sets the actual tool calls the agent made (the
"toolCalls"key in actual outputs). - ToolCalls - Class in dev.dokimos.core.agents
-
Coercion helpers for turning a raw value into a typed
List<ToolCall>. - toolCallsByTurn() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Groups tool calls per assistant turn, in order: one inner list per assistant message (each possibly empty).
- toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
-
Sets the key used to retrieve tool calls from actualOutputs.
- toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Sets the key used to retrieve tool calls from actualOutputs.
- toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
-
Sets the key used to retrieve actual tool calls from actualOutputs.
- toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolEfficiencyEvaluator.Builder
-
Sets the key used to retrieve tool calls from actualOutputs.
- toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Sets the key used to retrieve tool calls from actualOutputs.
- toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.Builder
-
Sets the key used to retrieve actual tool calls from actualOutputs.
- ToolCallValidityEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Validates that tool calls are syntactically correct per their JSON schema definitions.
- ToolCallValidityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolCorrectnessEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Checks whether the agent used the expected set of tools.
- ToolCorrectnessEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolCorrectnessEvaluator.MatchMode - Enum Class in dev.dokimos.core.evaluators.agents
-
The comparison mode for evaluating tool correctness.
- ToolDefinition - Record Class in dev.dokimos.core.agents
-
Describes an available tool's contract including its name, description, and JSON schema.
- ToolDefinition(String, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.ToolDefinition
-
Creates an instance of a
ToolDefinitionrecord class. - ToolDefinition.Builder - Class in dev.dokimos.core.agents
-
Builder for constructing tool definitions.
- ToolDescriptionReliabilityEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Evaluates tool description quality using a mix of rule-based checks and optional LLM checks.
- ToolDescriptionReliabilityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolEfficiencyEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Measures how efficiently an agent used its tools by detecting redundant calls.
- ToolEfficiencyEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolErrorEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Detects tool execution failures by inspecting
ToolCall.result(). - ToolErrorEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolHandlers - Class in dev.dokimos.mcp
-
Implements the four MCP tool handlers for the dokimos evaluation framework.
- ToolHandlers(ResultStore, ObjectMapper) - Constructor for class dev.dokimos.mcp.ToolHandlers
- ToolNameReliabilityEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Evaluates tool naming quality using a mix of rule-based checks and optional LLM checks.
- ToolNameReliabilityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- toolNames() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns the set of tool names used in this trace.
- tools(List<ToolDefinition>) - Method in class dev.dokimos.core.evaluators.agents.AgentEvalCase.Builder
-
Sets the tools available to the agent (the
"tools"key in metadata). - toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
-
Sets the key used to retrieve tool definitions from metadata.
- toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
-
Sets the metadata key for tool definitions.
- toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
-
Sets the metadata key for tool definitions.
- ToolTrajectoryEvaluator - Class in dev.dokimos.core.evaluators.agents
-
Evaluates an agent's tool-call trajectory against an expected trajectory using a selectable match mode.
- ToolTrajectoryEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents
-
Builder for constructing the evaluator.
- ToolTrajectoryEvaluator.MatchMode - Enum Class in dev.dokimos.core.evaluators.agents
-
The comparison mode for evaluating a trajectory.
- toOutputMap() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Converts this agent trace to a map suitable for use as
actualOutputsin anEvalTestCase. - toRunResult(ExperimentRun) - Method in class dev.dokimos.server.service.ComparisonSupport
-
Converts a server run plus its item and eval results into a single core
RunResultat run index 0. - toRunResult(List<ItemResult>) - Method in class dev.dokimos.server.service.ComparisonSupport
-
Converts already-loaded item entities into a core
RunResultat run index 0, preserving their order so positional pairing keys line up with the source list. - toRunResults(BaselineFile) - Static method in class dev.dokimos.core.gate.BaselineStore
-
Reconstructs comparison-ready runs from a baseline.
- toString() - Method in record class dev.dokimos.core.agents.AgentTrace
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.agents.ToolCall
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.agents.ToolDefinition
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.CallMetrics
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.comparison.EvaluatorDelta
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.comparison.ItemComparison
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.comparison.SignificanceResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.conversation.Message
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.Dataset
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.EvalResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.EvalTestCase
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.Example
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.BaselineFile.BaselineItem
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.BaselineFile.DatasetInfo
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.BaselineFile.EvaluatorEntry
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.BaselineFile.JudgeInfo
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.BaselineFile.Provenance
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.BaselineFile
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.GateVerdict.EvaluatorDrop
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedCase
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.GateVerdict.RegressedEvaluator
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.ItemResult
-
Returns a string representation of this record class.
- toString() - Method in class dev.dokimos.core.OutputType
- toString() - Method in record class dev.dokimos.core.RunHandle
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.RunResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.core.TaskResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.mcp.store.RunRecord.EvalDetail
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.mcp.store.RunRecord.ItemDetail
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.client.DokimosServerReporter.ItemDeliveryFailure
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AlignmentView.EvaluatorAlignment
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AlignmentView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.ApiKeyView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateApiKeyRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreatedApiKeyView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateDatasetRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateLlmConnectionRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateTraceEvalRuleRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest.ItemPayload
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.CreateVersionRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DatasetItemView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DiffCase.EvaluatorDiff
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DiffCase
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.DiffView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.EnqueueJudgeRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.EvalJobView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.GateRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.GateResult.EvaluatorDrop
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedCase
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.GateResult.RegressedEvaluator
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.LlmConnectionView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpExportTraceServiceRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResource
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpResourceSpans
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpScopeSpans
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpStatus
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest.PromoteItem
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.PromoteRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.RegressionAlertPayload
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.ReviewQueueItem
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.SpanView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.TrendData
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.filter.Principal
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.judge.JudgeScorer.ScoreOutcome
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.ComparisonSupport.ComparisonOutcome
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ItemSnapshot
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.JudgeJobTransactions.ScoredResult
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.OtlpTraceParser.Result
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.RegressionAlertEvent
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.service.TraceEvalJobTransactions.ClaimedJob
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.server.tenant.TenantScope
-
Returns a string representation of this record class.
- toString() - Method in record class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport.AlibabaAgentResponse
-
Returns a string representation of this record class.
- totalCostUsd() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
totalCostUsdrecord component. - totalCostUsd() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
totalCostUsdrecord component. - totalCount() - Method in record class dev.dokimos.core.ExperimentResult
-
Returns the total number of items evaluated per run.
- totalCount() - Method in record class dev.dokimos.core.RunResult
-
Returns the total number of items evaluated in this run.
- totalCount() - Method in record class dev.dokimos.mcp.store.RunRecord
-
Returns the value of the
totalCountrecord component. - totalElements() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
totalElementsrecord component. - totalItems() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
totalItemsrecord component. - totalItems() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint
-
Returns the value of the
totalItemsrecord component. - totalPages() - Method in record class dev.dokimos.server.dto.v1.PageResponse
-
Returns the value of the
totalPagesrecord component. - totalRegressedCases() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
totalRegressedCasesrecord component. - totalTokensIn() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
totalTokensInrecord component. - totalTokensIn() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
totalTokensInrecord component. - totalTokensOut() - Method in record class dev.dokimos.server.dto.v1.RunDetails
-
Returns the value of the
totalTokensOutrecord component. - totalTokensOut() - Method in record class dev.dokimos.server.dto.v1.RunSummary
-
Returns the value of the
totalTokensOutrecord component. - toTestCase() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Builds a test case for the deterministic tool-call evaluators, using the last user message as input.
- toTestCase() - Method in record class dev.dokimos.core.ItemResult
- toTestCase(String) - Method in record class dev.dokimos.core.agents.AgentTrace
-
Builds an
EvalTestCasefrom this trace for the given user input. - toTestCase(String) - Method in record class dev.dokimos.core.Example
-
Converts this example to a test case with a single actual output.
- toTestCase(String, List<ToolDefinition>) - Method in record class dev.dokimos.core.agents.AgentTrace
-
Builds an
EvalTestCasefrom this trace, also wiring the available tool definitions into metadata. - toTestCase(String, List<ToolDefinition>, List<String>) - Method in record class dev.dokimos.core.agents.AgentTrace
-
Builds an
EvalTestCasefrom this trace with everything the agent evaluators need in one call. - toTestCase(List<ToolDefinition>) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Builds a test case for the deterministic tool-call and tool-definition evaluators, adding the tools the agent could call.
- toTestCase(List<ToolDefinition>, List<String>) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Builds a test case for the judge-based evaluators (
TaskCompletionEvaluator,ToolArgumentHallucinationEvaluator). - toTestCase(Map<String, Object>) - Method in record class dev.dokimos.core.Example
-
Converts this example to a test case with the given actual outputs.
- toTestCase(EvaluationRequest) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Converts a Spring AI
EvaluationRequestto a DokimosEvalTestCase. - toText() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Formats the conversation as a simple text transcript.
- toToolCall(ChatCompletionMessageToolCall, String) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Converts a single OpenAI function
ChatCompletionMessageToolCallto aToolCall. - toToolCall(ToolExecution) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Converts a single LangChain4j
ToolExecutionto aToolCall. - toToolCalls(OverAllState) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Extracts every tool call across all turns of a graph run, correlating each call to its result with per-turn windowing.
- toToolCalls(ChatCompletionMessage) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Extracts function
ToolCalls from an OpenAIChatCompletionMessagein order. - toToolCalls(ChatCompletionMessage, Function<String, String>) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Extracts function
ToolCalls from an OpenAIChatCompletionMessage, looking up each tool call's result by its id. - toToolCalls(Result<?>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Extracts
ToolCalls from a LangChain4jResultin execution order. - toToolCalls(AssistantMessage) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Extracts
ToolCalls from a Spring AIAssistantMessagewithout results. - toToolCalls(AssistantMessage, List<ToolResponseMessage>) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Extracts
ToolCalls from a Spring AIAssistantMessage, attaching results from the supplied tool responses by tool-call id. - toToolDefinition(ChatCompletionTool) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Converts a single OpenAI function
ChatCompletionToolto aToolDefinition. - toToolDefinition(ToolSpecification) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Converts a single
ToolSpecificationto aToolDefinition. - toToolDefinitions(EmbabelTraceCollector) - Static method in class dev.dokimos.embabel.EmbabelSupport
-
Synthesizes
ToolDefinitions from the tool names observed during a run. - toToolDefinitions(List<ChatCompletionTool>) - Static method in class dev.dokimos.openai.OpenAiSupport
-
Converts OpenAI
ChatCompletionTools toToolDefinitions so tool calls can be evaluated against the tools the agent was given. - toToolDefinitions(List<ToolSpecification>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport
-
Converts LangChain4j
ToolSpecifications toToolDefinitions so tool calls can be evaluated against the tools the agent was given. - toToolDefinitions(List<ToolDefinition>) - Static method in class dev.dokimos.springai.SpringAiSupport
-
Converts Spring AI
ToolDefinitions to DokimosToolDefinitions so tool calls can be evaluated against the tools the agent was given. - toToolDefinitions(List<ToolCallback>) - Static method in class dev.dokimos.springai.alibaba.SpringAiAlibabaSupport
-
Converts the
ToolCallbacks an agent was built with into DokimosToolDefinitions, so tool calls can be evaluated against the tools the agent had available. - touchUpdatedAt() - Method in class dev.dokimos.server.entity.AlertWebhook
-
Stamps the webhook as just modified.
- touchUpdatedAt() - Method in class dev.dokimos.server.entity.Annotation
- touchUpdatedAt() - Method in class dev.dokimos.server.entity.Dataset
- touchUpdatedAt() - Method in class dev.dokimos.server.entity.LlmConnection
-
Stamps the connection as just modified.
- touchUpdatedAt() - Method in class dev.dokimos.server.entity.TraceEvalRule
-
Stamps the rule as just modified.
- trace() - Method in class dev.dokimos.embabel.EmbabelTraceCollector
-
Materializes the captured run into an
AgentTrace. - Trace - Class in dev.dokimos.server.entity
-
A single distributed execution trace ingested over OTLP, holding one or more
TraceSpanrows. - Trace(String, Instant, Instant) - Constructor for class dev.dokimos.server.entity.Trace
- TraceController - Class in dev.dokimos.server.controller.v1
-
OTLP trace ingestion and read endpoints.
- TraceController(TraceIngestService, TraceQueryService) - Constructor for class dev.dokimos.server.controller.v1.TraceController
- TraceDetail - Record Class in dev.dokimos.server.dto.v1
-
Full view of one trace: its metadata, all of its spans, and the online eval jobs scoped to those spans.
- TraceDetail(UUID, String, UUID, String, String, int, Long, Long, Instant, Instant, List<SpanView>, List<TraceEvalJobView>) - Constructor for record class dev.dokimos.server.dto.v1.TraceDetail
-
Creates an instance of a
TraceDetailrecord class. - TraceEvalEnqueuer - Class in dev.dokimos.server.service
-
Decides which online eval jobs to create for a freshly ingested trace and persists them.
- TraceEvalEnqueuer(TraceEvalRuleRepository, TraceEvalJobRepository) - Constructor for class dev.dokimos.server.service.TraceEvalEnqueuer
- TraceEvalJob - Class in dev.dokimos.server.entity
-
A unit of online scoring work: score one ingested
TraceSpan's derived output against oneTraceEvalRule's judge configuration. - TraceEvalJob(TraceSpan, TraceEvalRule) - Constructor for class dev.dokimos.server.entity.TraceEvalJob
- TraceEvalJobRepository - Interface in dev.dokimos.server.repository
- TraceEvalJobStatus - Enum Class in dev.dokimos.server.entity
-
Lifecycle state of a
TraceEvalJob. - TraceEvalJobTransactions - Class in dev.dokimos.server.service
-
The transactional steps of the trace eval worker, each in its own committed transaction so the worker can make the LLM HTTP call between them without holding a database transaction open.
- TraceEvalJobTransactions(TraceEvalJobRepository) - Constructor for class dev.dokimos.server.service.TraceEvalJobTransactions
- TraceEvalJobTransactions.ClaimedJob - Record Class in dev.dokimos.server.service
-
A claimed job paired with the span text snapshots the worker scores after the transaction closes.
- TraceEvalJobView - Record Class in dev.dokimos.server.dto.v1
-
Public view of a
TraceEvalJob, returned in the per-trace detail. - TraceEvalJobView(UUID, UUID, UUID, String, TraceEvalJobStatus, Double, Boolean, String, int, String, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.TraceEvalJobView
-
Creates an instance of a
TraceEvalJobViewrecord class. - TraceEvalRule - Class in dev.dokimos.server.entity
-
A per-project rule that enqueues an online judge evaluation when an ingested span matches.
- TraceEvalRule(UUID, String, TraceMatchType, String, LlmConnection, String, String) - Constructor for class dev.dokimos.server.entity.TraceEvalRule
- TraceEvalRuleController - Class in dev.dokimos.server.controller.v1
-
Manages per-project trace eval rules.
- TraceEvalRuleController(TraceEvalRuleService) - Constructor for class dev.dokimos.server.controller.v1.TraceEvalRuleController
- TraceEvalRuleRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
TraceEvalRule. - TraceEvalRuleRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
TraceEvalRule. - TraceEvalRuleRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
TraceEvalRulefinders. - TraceEvalRuleRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.TraceEvalRuleRepositoryFragmentImpl
- TraceEvalRuleService - Class in dev.dokimos.server.service
-
Manages per-project trace eval rules.
- TraceEvalRuleService(TraceEvalRuleRepository, ProjectRepository, LlmConnectionRepository) - Constructor for class dev.dokimos.server.service.TraceEvalRuleService
- TraceEvalRuleView - Record Class in dev.dokimos.server.dto.v1
-
Public view of a
TraceEvalRule. - TraceEvalRuleView(UUID, UUID, String, boolean, TraceMatchType, String, String, UUID, String, String, double, double, Double, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Creates an instance of a
TraceEvalRuleViewrecord class. - TraceEvalWorker - Class in dev.dokimos.server.service
-
Background worker that drains the online trace eval queue.
- TraceEvalWorker(TraceEvalJobTransactions, LlmCredentialService, TraceProperties) - Constructor for class dev.dokimos.server.service.TraceEvalWorker
- traceId() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpSpan
-
Returns the value of the
traceIdrecord component. - traceId() - Method in record class dev.dokimos.server.dto.v1.TraceDetail
-
Returns the value of the
traceIdrecord component. - traceId() - Method in record class dev.dokimos.server.dto.v1.TraceSummary
-
Returns the value of the
traceIdrecord component. - traceId() - Method in record class dev.dokimos.server.service.OtlpTraceParser.ParsedSpan
-
Returns the value of the
traceIdrecord component. - TraceIngestResponse - Record Class in dev.dokimos.server.dto.v1
-
Result of an OTLP ingestion call.
- TraceIngestResponse(int, int, int) - Constructor for record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Creates an instance of a
TraceIngestResponserecord class. - TraceIngestService - Class in dev.dokimos.server.service
-
Persists OTLP traces and enqueues online evaluations for matching spans.
- TraceIngestService(OtlpTraceParser, TraceRepository, ProjectRepository, TraceEvalEnqueuer, TraceProperties) - Constructor for class dev.dokimos.server.service.TraceIngestService
- TraceMatchType - Enum Class in dev.dokimos.server.entity
-
How a
TraceEvalRuledecides whether a span matches. - TraceProperties - Class in dev.dokimos.server.config
-
Tuning knobs for trace ingestion and online evaluation, bound from the
dokimos.traceprefix. - TraceProperties() - Constructor for class dev.dokimos.server.config.TraceProperties
- TraceProperties.Eval - Class in dev.dokimos.server.config
-
Online trace eval worker knobs, bound from
dokimos.trace.eval. - TraceQueryService - Class in dev.dokimos.server.service
-
Read side for ingested traces: a paginated list and a per-trace detail with spans and eval jobs.
- TraceQueryService(TraceRepository, TraceSpanRepository, TraceEvalJobRepository) - Constructor for class dev.dokimos.server.service.TraceQueryService
- TraceRepository - Interface in dev.dokimos.server.repository
-
Tenant-scoped repository for
Trace. - TraceRepositoryFragment - Interface in dev.dokimos.server.repository
-
Entity-specific scoped finders for
Traceplus the unrestricted ingestion and sweeper paths. - TraceRepositoryFragmentImpl - Class in dev.dokimos.server.repository
-
Tenant-scoped implementation of the
Tracefinders plus the unrestricted ingestion paths. - TraceRepositoryFragmentImpl() - Constructor for class dev.dokimos.server.repository.TraceRepositoryFragmentImpl
- TraceRetentionSweeper - Class in dev.dokimos.server.service
-
Periodically deletes traces whose retention window has closed.
- TraceRetentionSweeper(TraceRepository) - Constructor for class dev.dokimos.server.service.TraceRetentionSweeper
- traces() - Method in record class dev.dokimos.server.dto.v1.TraceIngestResponse
-
Returns the value of the
tracesrecord component. - TraceSpan - Class in dev.dokimos.server.entity
-
One span of an ingested
Trace. - TraceSpan(String, String, String, Instant) - Constructor for class dev.dokimos.server.entity.TraceSpan
- TraceSpanRepository - Interface in dev.dokimos.server.repository
- TraceSummary - Record Class in dev.dokimos.server.dto.v1
-
Compact view of a
Tracefor the list endpoint, without its spans. - TraceSummary(UUID, String, UUID, String, int, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.TraceSummary
-
Creates an instance of a
TraceSummaryrecord class. - TrajectoryEvaluationCriteria - Class in dev.dokimos.core.conversation
-
Factory for creating pre-built evaluation criteria for trajectory evaluation.
- TrajectoryEvaluator - Class in dev.dokimos.core.conversation
-
Evaluates complete conversation trajectories using LLM-as-judge patterns.
- TrajectoryEvaluator.Builder - Class in dev.dokimos.core.conversation
-
Builder for constructing trajectory evaluators.
- trajectoryKey(String) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
-
Sets the key used to retrieve the trajectory from actualOutputs.
- treatBlankAsError(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolErrorEvaluator.Builder
-
Controls whether a null or blank result counts as an error.
- TrendData - Record Class in dev.dokimos.server.dto.v1
- TrendData(String, String, List<TrendData.RunPoint>) - Constructor for record class dev.dokimos.server.dto.v1.TrendData
-
Creates an instance of a
TrendDatarecord class. - TrendData.RunPoint - Record Class in dev.dokimos.server.dto.v1
- triggeredBy() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest
-
Returns the value of the
triggeredByrecord component. - trimStrings(boolean) - Method in class dev.dokimos.core.evaluators.agents.TolerantArgumentMatcher.Builder
-
Trims leading and trailing whitespace from strings before comparison.
- turnCount() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns the number of conversation turns (user-assistant message pairs).
- typed(Function<Example, T>) - Static method in interface dev.dokimos.core.Task
-
Creates a
Taskthat produces a single typed value and stores it under the conventional"output"key, so callers can return a record, list, or other POJO from their task body instead of hand-building the output map.
U
- UNCHANGED - Enum constant in enum class dev.dokimos.core.comparison.ComparisonStatus
-
No meaningful or significant change.
- unchangedCount() - Method in record class dev.dokimos.core.comparison.RunComparisonResult
-
Returns the value of the
unchangedCountrecord component. - unchangedCount() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
unchangedCountrecord component. - unchangedCount() - Method in record class dev.dokimos.server.dto.v1.DiffSummary
-
Returns the value of the
unchangedCountrecord component. - unchangedCount() - Method in record class dev.dokimos.server.dto.v1.GateResult
-
Returns the value of the
unchangedCountrecord component. - unpaged() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageablePage
-
Returns the value of the
unpagedrecord component. - unrestricted() - Static method in record class dev.dokimos.server.tenant.TenantScope
-
Returns the scope that applies no tenant predicate.
- unsorted() - Method in record class dev.dokimos.server.dto.v1.PageResponse.PageSort
-
Returns the value of the
unsortedrecord component. - UNSURE - Enum constant in enum class dev.dokimos.server.entity.AnnotationVerdict
- unwrap() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpAnyValue
-
Returns the scalar Java value for this attribute, or null when no scalar variant is set.
- update(UUID, UpdateLlmConnectionRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.LlmConnectionController
-
Updates a connection.
- update(UUID, UpdateLlmConnectionRequest, TenantScope) - Method in class dev.dokimos.server.service.LlmConnectionService
-
Replaces a connection's name, base URL, and model, and optionally its credential.
- update(UUID, UUID, CreateTraceEvalRuleRequest, TenantScope) - Method in class dev.dokimos.server.service.TraceEvalRuleService
-
Replaces a rule's definition.
- update(UUID, UUID, UpdateAlertWebhookRequest, TenantScope) - Method in class dev.dokimos.server.service.AlertWebhookService
-
Replaces a webhook's url and enabled flag, and optionally its secret.
- updateAlertWebhook(UUID, UUID, UpdateAlertWebhookRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AlertWebhookController
-
Updates a webhook.
- UpdateAlertWebhookRequest - Record Class in dev.dokimos.server.dto.v1
-
Payload for updating an alert webhook.
- UpdateAlertWebhookRequest(String, String, Boolean) - Constructor for record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Creates an instance of a
UpdateAlertWebhookRequestrecord class. - updateBaseline() - Method in class dev.dokimos.core.gate.GateConfig
- updateBaseline(boolean) - Method in class dev.dokimos.core.gate.GateConfig.Builder
- updateBaselineRequested() - Static method in class dev.dokimos.core.gate.GateConfig
-
Whether an explicit baseline update was requested via
DOKIMOS_UPDATE_BASELINE(env, the primary control because-Ddoes not reach the test JVM under default Gradle or the IntelliJ runner) or thedokimos.updateBaselinesystem property. - updatedAt() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
updatedAtrecord component. - updatedAt() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns the value of the
updatedAtrecord component. - updatedAt() - Method in record class dev.dokimos.server.dto.v1.DatasetSummary
-
Returns the value of the
updatedAtrecord component. - updatedAt() - Method in record class dev.dokimos.server.dto.v1.TraceEvalRuleView
-
Returns the value of the
updatedAtrecord component. - UpdateLlmConnectionRequest - Record Class in dev.dokimos.server.dto.v1
-
Payload for updating an LLM connection.
- UpdateLlmConnectionRequest(String, String, String, LlmConnectionProtocol, String, String) - Constructor for record class dev.dokimos.server.dto.v1.UpdateLlmConnectionRequest
-
Creates an instance of a
UpdateLlmConnectionRequestrecord class. - updateRequested() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
- updateRun(UUID, UpdateRunRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.RunController
- updateRun(UUID, UpdateRunRequest, TenantScope) - Method in class dev.dokimos.server.service.RunService
-
Updates a run's status.
- UpdateRunRequest - Record Class in dev.dokimos.server.dto.v1
- UpdateRunRequest(RunStatus) - Constructor for record class dev.dokimos.server.dto.v1.UpdateRunRequest
-
Creates an instance of a
UpdateRunRequestrecord class. - updateTraceEvalRule(UUID, UUID, CreateTraceEvalRuleRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.TraceEvalRuleController
-
Replaces a rule.
- upsert(UUID, UUID, AnnotationRequest, HttpServletRequest) - Method in class dev.dokimos.server.controller.v1.AnnotationController
-
Creates or updates the annotation for the item result and returns it.
- upsert(UUID, UUID, AnnotationRequest, String, TenantScope) - Method in class dev.dokimos.server.service.AnnotationService
-
Creates or updates the single annotation for the given item result.
- url() - Method in record class dev.dokimos.server.dto.v1.AlertWebhookView
-
Returns the value of the
urlrecord component. - url() - Method in record class dev.dokimos.server.dto.v1.CreateAlertWebhookRequest
-
Returns the value of the
urlrecord component. - url() - Method in record class dev.dokimos.server.dto.v1.UpdateAlertWebhookRequest
-
Returns the value of the
urlrecord component. - user(String) - Static method in record class dev.dokimos.core.conversation.Message
-
Creates a user message.
- USER - Enum constant in enum class dev.dokimos.core.conversation.Message.Role
-
A message from the user.
- userMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder
-
Adds a user message to the trajectory.
- userMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Returns only the user messages from the conversation.
- UserPersonas - Class in dev.dokimos.core.conversation
-
Factory for creating pre-built simulated user personas.
- userSatisfaction() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria
-
Creates a criterion for evaluating user satisfaction.
- Using Spring AI ChatClient as a Judge - Search tag in class dev.dokimos.springai.SpringAiSupport
- Section
V
- value() - Element in annotation interface dev.dokimos.junit.DatasetSource
-
URI of the dataset to load.
- value() - Element in annotation interface dev.dokimos.junit.MetadataEntry
-
The metadata value.
- value() - Method in record class dev.dokimos.server.dto.v1.otlp.OtlpKeyValue
-
Returns the value of the
valuerecord component. - valueOf(String) - Static method in enum class dev.dokimos.core.comparison.ComparisonStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.conversation.Message.Role
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.EvalTestCaseParam
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.StructuralMatchMode
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.gate.GateConfig.Pairing
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.core.RunStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.entity.AnnotationVerdict
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.entity.EvalJobStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.entity.LlmConnectionProtocol
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.entity.RunStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.entity.TraceEvalJobStatus
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.entity.TraceMatchType
-
Returns the enum constant of this class with the specified name.
- valueOf(String) - Static method in enum class dev.dokimos.server.filter.Role
-
Returns the enum constant of this class with the specified name.
- values() - Static method in enum class dev.dokimos.core.comparison.ComparisonStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.conversation.Message.Role
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.EvalTestCaseParam
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.evaluators.agents.ArgMatchMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.evaluators.agents.ToolTrajectoryEvaluator.MatchMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.evaluators.StructuralMatchMode
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.gate.GateConfig.Pairing
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.core.RunStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.entity.AnnotationVerdict
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.entity.EvalJobStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.entity.LlmConnectionProtocol
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.entity.RunStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.entity.TraceEvalJobStatus
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.entity.TraceMatchType
-
Returns an array containing the constants of this enum class, in the order they are declared.
- values() - Static method in enum class dev.dokimos.server.filter.Role
-
Returns an array containing the constants of this enum class, in the order they are declared.
- verdict() - Method in record class dev.dokimos.server.dto.v1.AnnotationRequest
-
Returns the value of the
verdictrecord component. - verdict() - Method in record class dev.dokimos.server.dto.v1.AnnotationView
-
Returns the value of the
verdictrecord component. - verdictDir() - Method in interface dev.dokimos.core.gate.RegressionGateRunner.Environment
- version() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Returns the value of the
versionrecord component. - version() - Method in record class dev.dokimos.server.dto.v1.DatasetVersionDetails
-
Returns the value of the
versionrecord component. - versions() - Method in record class dev.dokimos.server.dto.v1.DatasetDetails
-
Returns the value of the
versionsrecord component. - VersionSummary(UUID, int, String, int, Instant, String) - Constructor for record class dev.dokimos.server.dto.v1.DatasetDetails.VersionSummary
-
Creates an instance of a
VersionSummaryrecord class. - VIEWER - Enum constant in enum class dev.dokimos.server.filter.Role
W
- WARN - Enum constant in enum class dev.dokimos.core.gate.GateConfig.RemovedEvaluatorPolicy
-
Warn only.
- warnings() - Method in record class dev.dokimos.core.gate.GateVerdict
-
Returns the value of the
warningsrecord component. - weight() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Returns the value of the
weightrecord component. - WEIGHTED_MEAN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy
-
Weighted mean based on criterion weights.
- withMessage(Message) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory
-
Creates a new trajectory with an additional message appended.
- withWeight(double) - Method in record class dev.dokimos.core.conversation.EvaluationCriterion
-
Creates a new criterion with a different weight.
- write(Path, ExperimentResult, GateConfig) - Static method in class dev.dokimos.core.gate.BaselineStore
-
Writes a baseline atomically to the given source-tree path (creating parent directories).
- writeCompact(Object) - Static method in class dev.dokimos.core.internal.Json
-
Serializes a value to compact (single-line) JSON.
- writePretty(Object) - Static method in class dev.dokimos.core.internal.Json
-
Serializes a value to pretty-printed JSON.
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form