Index (Dokimos :: Parent POM 0.15.0-SNAPSHOT API)

A B C D E F G H I J L M N O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

accept(DatasetSource) - Method in class dev.dokimos.junit.DatasetArgumentsProvider
ACTUAL_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
actualOutput() - Method in record class dev.dokimos.core.EvalTestCase: Gets the primary actual output value.
actualOutput() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the actualOutput record component.
actualOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder: Sets the primary actual output value.
actualOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds an actual output with the given key and value.
actualOutputs() - Method in record class dev.dokimos.core.EvalTestCase: Returns the value of the actualOutputs record component.
actualOutputs() - Method in record class dev.dokimos.core.ItemResult: Returns the value of the actualOutputs record component.
actualOutputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns the value of the actualOutputs record component.
actualOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds all entries from the given actual outputs map.
addEvalResult(EvalResult) - Method in class dev.dokimos.server.entity.ItemResult
addExample(Example) - Method in class dev.dokimos.core.Dataset.Builder: Adds an example to the dataset.
addExamples(List<Example>) - Method in class dev.dokimos.core.Dataset.Builder: Adds multiple examples to the dataset.
addItems(UUID, AddItemsRequest) - Method in class dev.dokimos.server.controller.v1.RunController
addItems(UUID, AddItemsRequest) - Method in class dev.dokimos.server.service.RunService
AddItemsRequest - Record Class in dev.dokimos.server.dto.v1
AddItemsRequest(List<AddItemsRequest.ItemData>) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest: Creates an instance of a AddItemsRequest record class.
AddItemsRequest.EvalData - Record Class in dev.dokimos.server.dto.v1
AddItemsRequest.ItemData - Record Class in dev.dokimos.server.dto.v1
addReasoningStep(String) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Adds a reasoning step.
addToolCall(ToolCall) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Adds a tool call to the trace.
adversarialUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated adversarial user who tries to manipulate the system.
AgentTrace - Record Class in dev.dokimos.core.agents: Wraps a complete agent execution trace for evaluation.
AgentTrace(String, List<ToolCall>, List<String>, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.AgentTrace: Creates an instance of a AgentTrace record class.
AgentTrace.Builder - Class in dev.dokimos.core.agents: Builder for constructing agent traces.
aggregate(List<Map.Entry<EvaluationCriterion, Double>>) - Method in enum class dev.dokimos.core.conversation.AggregationStrategy: Aggregates the given criterion scores into a single score.
aggregationStrategy(AggregationStrategy) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets the score aggregation strategy.
AggregationStrategy - Enum Class in dev.dokimos.core.conversation: Strategies for aggregating scores from multiple evaluation criteria.
aggressiveCustomer(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated aggressive customer who is frustrated and demanding.
allOf(MatchingStrategy...) - Static method in interface dev.dokimos.core.MatchingStrategy: Creates a composite strategy that matches only if ALL strategies match.
anyOf(MatchingStrategy...) - Static method in interface dev.dokimos.core.MatchingStrategy: Creates a composite strategy that matches if ANY of the strategies match.
apiKey(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder: Sets the API key for authentication.
ApiKeyAuthFilter - Class in dev.dokimos.server.filter: Filter that enforces API key authentication for write operations on /api/v1/** endpoints.
ApiKeyAuthFilter(ApiKeyProperties, ObjectMapper) - Constructor for class dev.dokimos.server.filter.ApiKeyAuthFilter
ApiKeyProperties - Class in dev.dokimos.server.config: Configuration properties for API key authentication.
ApiKeyProperties() - Constructor for class dev.dokimos.server.config.ApiKeyProperties
apiVersion(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder: Sets the API version to use.
application(ConversationalApplication) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Sets the application under test.
argument(String, Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder: Adds an argument.
arguments() - Method in record class dev.dokimos.core.agents.ToolCall: Returns the value of the arguments record component.
arguments(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolCall.Builder: Sets all arguments.
asJudge(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Creates a JudgeLM from a LangChain4j ChatModel.
asJudge(ChatClient.Builder) - Static method in class dev.dokimos.springai.SpringAiSupport: Creates a JudgeLM from a Spring AI ChatClient.Builder.
asJudge(ChatModel) - Static method in class dev.dokimos.springai.SpringAiSupport: Creates a JudgeLM from a Spring AI ChatModel.
assertEval(EvalTestCase, Evaluator...) - Static method in class dev.dokimos.core.Assertions: Asserts that the test case passes all evaluators.
assertEval(EvalTestCase, List<Evaluator>) - Static method in class dev.dokimos.core.Assertions: Asserts that the test case passes all evaluators.
Assertions - Class in dev.dokimos.core: Assertion utilities for evaluation-based testing.
assistant(String) - Static method in record class dev.dokimos.core.conversation.Message: Creates an assistant message.
ASSISTANT - Enum constant in enum class dev.dokimos.core.conversation.Message.Role: A message from the assistant.
assistantMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds an assistant message to the trajectory.
assistantMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns only the assistant messages from the conversation.
averageScore(String) - Method in record class dev.dokimos.core.ExperimentResult: Returns the average score for the specified evaluator across all runs.
averageScore(String) - Method in record class dev.dokimos.core.RunResult: Returns the average score for the specified evaluator across all items in this run.

B

BaseEvaluator - Class in dev.dokimos.core: Base class for implementing concrete evaluators.
behaviorGuidelines(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Sets additional behavior guidelines for the simulated user.
build() - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Builds the agent trace.
build() - Method in class dev.dokimos.core.agents.ToolCall.Builder: Builds the tool call.
build() - Method in class dev.dokimos.core.agents.ToolDefinition.Builder: Builds the tool definition.
build() - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Builds the conversation simulator.
build() - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Builds the conversation trajectory.
build() - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Builds the LLM simulated user.
build() - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Builds the trajectory evaluator.
build() - Method in class dev.dokimos.core.Dataset.Builder: Builds the dataset.
build() - Method in class dev.dokimos.core.EvalResult.Builder: Builds the result.
build() - Method in class dev.dokimos.core.EvalTestCase.Builder: Builds the test case.
build() - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Builds the ContextualRelevanceEvaluator.
build() - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
build() - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
build() - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
build() - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Builds the PrecisionEvaluator.
build() - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Builds the RecallEvaluator.
build() - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder: Builds the evaluator.
build() - Method in class dev.dokimos.core.Example.Builder
build() - Method in class dev.dokimos.core.Experiment.Builder: Builds the experiment.
build() - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder: Builds the reporter.
builder() - Static method in record class dev.dokimos.core.agents.AgentTrace: Creates a new builder for constructing agent traces.
builder() - Static method in record class dev.dokimos.core.agents.ToolCall: Creates a new builder for constructing tool calls.
builder() - Static method in record class dev.dokimos.core.agents.ToolDefinition: Creates a new builder for constructing tool definitions.
builder() - Static method in class dev.dokimos.core.conversation.ConversationSimulator: Creates a new builder for constructing a conversation simulator.
builder() - Static method in record class dev.dokimos.core.conversation.ConversationTrajectory: Creates a new builder for constructing trajectories.
builder() - Static method in class dev.dokimos.core.conversation.LLMSimulatedUser: Creates a new builder for constructing an LLM simulated user.
builder() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluator: Creates a new builder for constructing a trajectory evaluator.
builder() - Static method in record class dev.dokimos.core.Dataset: Creates a new builder for constructing datasets.
builder() - Static method in record class dev.dokimos.core.EvalResult: Creates a new builder for constructing results.
builder() - Static method in record class dev.dokimos.core.EvalTestCase: Creates a new builder for constructing test cases.
builder() - Static method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator: Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator: Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator: Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator: Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator: Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator: Creates a new builder for constructing the evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator: Creates a new builder for constructing the contextual relevance evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.ExactMatchEvaluator: Creates a new builder for constructing exact match evaluators.
builder() - Static method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator: Creates a new builder for constructing the faithfulness evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.HallucinationEvaluator: Creates a new builder for constructing the hallucination evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator
builder() - Static method in class dev.dokimos.core.evaluators.PrecisionEvaluator: Creates a new builder for constructing the precision evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.RecallEvaluator: Creates a new builder for constructing the recall evaluator.
builder() - Static method in class dev.dokimos.core.evaluators.RegexEvaluator
builder() - Static method in record class dev.dokimos.core.Example: Creates a new builder for constructing examples.
builder() - Static method in class dev.dokimos.core.Experiment
builder() - Static method in class dev.dokimos.server.client.DokimosServerReporter: Creates a new builder for DokimosServerReporter.
Builder() - Constructor for class dev.dokimos.core.agents.AgentTrace.Builder
Builder() - Constructor for class dev.dokimos.core.agents.ToolCall.Builder
Builder() - Constructor for class dev.dokimos.core.agents.ToolDefinition.Builder
Builder() - Constructor for class dev.dokimos.core.conversation.ConversationSimulator.Builder
Builder() - Constructor for class dev.dokimos.core.conversation.ConversationTrajectory.Builder
Builder() - Constructor for class dev.dokimos.core.conversation.LLMSimulatedUser.Builder
Builder() - Constructor for class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.Dataset.Builder
Builder() - Constructor for class dev.dokimos.core.EvalResult.Builder
Builder() - Constructor for class dev.dokimos.core.EvalTestCase.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.RecallEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.evaluators.RegexEvaluator.Builder
Builder() - Constructor for class dev.dokimos.core.Example.Builder
Builder() - Constructor for class dev.dokimos.core.Experiment.Builder
byContainment(boolean) - Static method in interface dev.dokimos.core.MatchingStrategy: Matches string items by checking if one contains the other.
byEquality() - Static method in interface dev.dokimos.core.MatchingStrategy: Matches items using Objects.equals(Object, Object).
byField(String) - Static method in interface dev.dokimos.core.MatchingStrategy: Matches Map items by comparing a specific field.
byFields(String...) - Static method in interface dev.dokimos.core.MatchingStrategy: Matches Map items by comparing multiple fields.
byIdentifier(Function<Object, Object>) - Static method in interface dev.dokimos.core.MatchingStrategy: Matches items by extracting an identifier and comparing with equality.

C

CANCELLED - Enum constant in enum class dev.dokimos.core.RunStatus: The run was cancelled before completion.
CANCELLED - Enum constant in enum class dev.dokimos.server.entity.RunStatus
caseInsensitive() - Static method in interface dev.dokimos.core.MatchingStrategy: Matches string items case-insensitively.
clarity() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating clarity of communication.
ClasspathDatasetResolver - Class in dev.dokimos.core
ClasspathDatasetResolver() - Constructor for class dev.dokimos.core.ClasspathDatasetResolver
close() - Method in class dev.dokimos.core.NoOpReporter
close() - Method in interface dev.dokimos.core.Reporter: Flushes pending items and releases resources.
close() - Method in class dev.dokimos.server.client.DokimosServerReporter
completedAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the completedAt record component.
completedAt() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the completedAt record component.
completeRun(RunHandle, RunStatus) - Method in class dev.dokimos.core.NoOpReporter
completeRun(RunHandle, RunStatus) - Method in interface dev.dokimos.core.Reporter: Marks a run as complete.
completeRun(RunHandle, RunStatus) - Method in class dev.dokimos.server.client.DokimosServerReporter
config() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the config record component.
config() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the config record component.
confusedUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated confused user who struggles to understand.
consistency() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating consistency.
constraintsKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets the metadata key for product constraints.
content() - Method in record class dev.dokimos.core.conversation.Message: Returns the value of the content record component.
context() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Returns the value of the context record component.
CONTEXT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport: Default key for additional context in evaluation results.
CONTEXT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport: Default key for additional context in evaluation results.
contextKey(String) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder: Sets the context key to use.
contextKey(String) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder: Sets the context key to use.
ContextScore(String, double, String) - Constructor for record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Creates an instance of a ContextScore record class.
ContextualRelevanceEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that measures how relevant retrieved context chunks are to a user's input query.
ContextualRelevanceEvaluator.Builder - Class in dev.dokimos.core.evaluators: Builder for constructing ContextualRelevanceEvaluator instances.
ContextualRelevanceEvaluator.ContextScore - Record Class in dev.dokimos.core.evaluators: Represents the relevance score for a single context chunk.
ConversationalApplication - Interface in dev.dokimos.core.conversation: Functional interface representing an application that can engage in multi-turn conversations.
conversationQuality() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating conversation quality.
ConversationSimulator - Class in dev.dokimos.core.conversation: Orchestrates multi-turn conversations between a simulated user and an application.
ConversationSimulator.Builder - Class in dev.dokimos.core.conversation: Builder for constructing conversation simulators.
ConversationTrajectory - Record Class in dev.dokimos.core.conversation: Represents a complete conversation trajectory between a simulated user and an application.
ConversationTrajectory(List<Message>, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.conversation.ConversationTrajectory: Compact constructor ensuring immutability.
ConversationTrajectory.Builder - Class in dev.dokimos.core.conversation: Builder for constructing conversation trajectories.
Converting Spring AI Evaluation Objects - Search tag in class dev.dokimos.springai.SpringAiSupport: Section
countByRun(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
countItemsWithAllEvalsPassed(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
countMatches(Collection<?>, Collection<?>) - Method in interface dev.dokimos.core.MatchingStrategy: Counts how many retrieved items match any expected item.
countPassedItems(ExperimentRun) - Method in interface dev.dokimos.server.repository.ItemResultRepository
createdAt() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Returns the value of the createdAt record component.
createdAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the createdAt record component.
createRun(Experiment, Map<String, Object>) - Method in class dev.dokimos.server.service.RunService
createRun(String, CreateRunRequest) - Method in class dev.dokimos.server.controller.v1.ProjectController
CreateRunRequest - Record Class in dev.dokimos.server.dto.v1
CreateRunRequest(String, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunRequest: Creates an instance of a CreateRunRequest record class.
CreateRunResponse - Record Class in dev.dokimos.server.dto.v1
CreateRunResponse(UUID) - Constructor for record class dev.dokimos.server.dto.v1.CreateRunResponse: Creates an instance of a CreateRunResponse record class.
criteria(String) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Sets the evaluation criteria.
criteria(List<EvaluationCriterion>) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets all evaluation criteria.
criterion(EvaluationCriterion) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Adds an evaluation criterion.
custom(JudgeLM, String, String) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a custom simulated user with the specified persona and guidelines.
custom(String, String) - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a custom evaluation criterion.
custom(String, String, double) - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a custom evaluation criterion with specified weight.
custom(BiPredicate<Object, Object>) - Static method in interface dev.dokimos.core.MatchingStrategy: Matches items using a custom predicate.
customTask(Task) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Creates a flexible Task that allows full control over output mapping.

D

dataset(Dataset) - Method in class dev.dokimos.core.Experiment.Builder: Sets the dataset.
Dataset - Record Class in dev.dokimos.core: A collection of examples for evaluation.
Dataset(String, String, List<Example>) - Constructor for record class dev.dokimos.core.Dataset: Creates an instance of a Dataset record class.
Dataset.Builder - Class in dev.dokimos.core: Builder for constructing datasets.
DatasetArgumentsProvider - Class in dev.dokimos.junit: JUnit ArgumentsProvider that loads Examples from a Dataset.
DatasetArgumentsProvider() - Constructor for class dev.dokimos.junit.DatasetArgumentsProvider
DatasetParser - Class in dev.dokimos.core
DatasetResolutionException - Exception Class in dev.dokimos.core: Thrown when a dataset cannot be correctly resolved or loading fails.
DatasetResolutionException(String) - Constructor for exception class dev.dokimos.core.DatasetResolutionException
DatasetResolutionException(String, Throwable) - Constructor for exception class dev.dokimos.core.DatasetResolutionException
DatasetResolver - Interface in dev.dokimos.core: Resolves a dataset URI to a Dataset.
DatasetResolverRegistry - Class in dev.dokimos.core: Singleton registry for dataset resolvers.
DatasetSource - Annotation Interface in dev.dokimos.junit: Provides Examples from a Dataset as arguments to a parameterized test.
DEFAULT_API_VERSION - Static variable in class dev.dokimos.server.client.DokimosServerReporter: The default API version used when not explicitly specified.
description() - Method in record class dev.dokimos.core.agents.ToolDefinition: Returns the value of the description record component.
description() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Returns the value of the description record component.
description() - Method in record class dev.dokimos.core.Dataset: Returns the dataset's description.
description() - Method in record class dev.dokimos.core.ExperimentResult: Returns the value of the description record component.
description(String) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder: Sets the tool description.
description(String) - Method in class dev.dokimos.core.Dataset.Builder: Sets the dataset description.
description(String) - Method in class dev.dokimos.core.Experiment.Builder: Sets the description.
dev.dokimos.core - package dev.dokimos.core
dev.dokimos.core.agents - package dev.dokimos.core.agents
dev.dokimos.core.conversation - package dev.dokimos.core.conversation
dev.dokimos.core.evaluators - package dev.dokimos.core.evaluators
dev.dokimos.core.evaluators.agents - package dev.dokimos.core.evaluators.agents
dev.dokimos.core.export - package dev.dokimos.core.export
dev.dokimos.junit - package dev.dokimos.junit
dev.dokimos.langchain4j - package dev.dokimos.langchain4j
dev.dokimos.server - package dev.dokimos.server
dev.dokimos.server.client - package dev.dokimos.server.client
dev.dokimos.server.config - package dev.dokimos.server.config
dev.dokimos.server.controller - package dev.dokimos.server.controller
dev.dokimos.server.controller.v1 - package dev.dokimos.server.controller.v1
dev.dokimos.server.dto.v1 - package dev.dokimos.server.dto.v1
dev.dokimos.server.entity - package dev.dokimos.server.entity
dev.dokimos.server.filter - package dev.dokimos.server.filter
dev.dokimos.server.repository - package dev.dokimos.server.repository
dev.dokimos.server.service - package dev.dokimos.server.service
dev.dokimos.springai - package dev.dokimos.springai
dialogKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets the inputs key for the dialog.
DokimosServerApplication - Class in dev.dokimos.server
DokimosServerApplication() - Constructor for class dev.dokimos.server.DokimosServerApplication
DokimosServerReporter - Class in dev.dokimos.server.client: An async HTTP implementation of Reporter that sends experiment results to a Dokimos server.
DokimosServerReporter.Builder - Class in dev.dokimos.server.client: Builder for DokimosServerReporter.

E

empty() - Static method in record class dev.dokimos.core.conversation.ConversationTrajectory: Creates an empty trajectory with no messages.
equals(Object) - Method in record class dev.dokimos.core.agents.AgentTrace: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.agents.ToolCall: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.agents.ToolDefinition: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.conversation.Message: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.Dataset: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.EvalResult: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.EvalTestCase: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.Example: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.ExperimentResult: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.ItemResult: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.RunHandle: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.core.RunResult: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.RunSummary: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TrendData: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Indicates whether some other object is "equal to" this one.
equals(Object) - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest: Indicates whether some other object is "equal to" this one.
EvalData(String, double, Double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Creates an instance of a EvalData record class.
EvalResult - Class in dev.dokimos.server.entity
EvalResult - Record Class in dev.dokimos.core: The result of an evaluation.
EvalResult(String, double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult: Creates an EvalResult without a threshold (for backwards compatibility).
EvalResult(String, double, Double, boolean, String) - Constructor for class dev.dokimos.server.entity.EvalResult
EvalResult(String, double, Double, boolean, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalResult: Creates an instance of a EvalResult record class.
EvalResult.Builder - Class in dev.dokimos.core: Builder for constructing evaluation results.
EvalResultRepository - Interface in dev.dokimos.server.repository
evalResults() - Method in record class dev.dokimos.core.ItemResult: Returns the value of the evalResults record component.
evalResults() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns the value of the evalResults record component.
evalResults() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the evalResults record component.
EvalSummary(UUID, String, double, Double, boolean, String) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Creates an instance of a EvalSummary record class.
EvalTestCase - Record Class in dev.dokimos.core: A test case for evaluation.
EvalTestCase(Map<String, Object>, Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.EvalTestCase: Creates an instance of a EvalTestCase record class.
EvalTestCase.Builder - Class in dev.dokimos.core: Builder for constructing test cases with multiple inputs and outputs.
EvalTestCaseParam - Enum Class in dev.dokimos.core
evaluate(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator
evaluate(EvalTestCase) - Method in interface dev.dokimos.core.Evaluator: Evaluates the test case and returns a scored result.
evaluateAsync(EvalTestCase) - Method in class dev.dokimos.core.BaseEvaluator: Evaluates the test case asynchronously using the common fork-join pool.
evaluateAsync(EvalTestCase, ExecutorService) - Method in class dev.dokimos.core.BaseEvaluator: Evaluates the test case asynchronously using the provided executor.
EvaluationCriterion - Record Class in dev.dokimos.core.conversation: Defines a single evaluation dimension for trajectory evaluation.
EvaluationCriterion(String, String, double) - Constructor for record class dev.dokimos.core.conversation.EvaluationCriterion: Compact constructor with validation.
EvaluationException - Exception Class in dev.dokimos.core.evaluators: Thrown when an evaluation cannot be executed successfully.
EvaluationException(String) - Constructor for exception class dev.dokimos.core.evaluators.EvaluationException
EvaluationException(String, Throwable) - Constructor for exception class dev.dokimos.core.evaluators.EvaluationException
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder: Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder: Sets which test case parameters to validate.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Sets which test case parameters to validate before evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder: Sets which test case parameters to use for the evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder: Sets which test case parameters to use for the evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder: Sets which test case parameters to use for the evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Sets which test case parameters to include in the prompt.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Sets which test case parameters to validate before evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Sets which test case parameters to validate before evaluation.
evaluationParams(List<EvalTestCaseParam>) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder: Sets which test case parameters to evaluate.
evaluator(Evaluator) - Method in class dev.dokimos.core.Experiment.Builder: Adds a single evaluator to the experiment.
Evaluator - Interface in dev.dokimos.core: Evaluates test cases and produces scored results.
evaluatorName() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns the value of the evaluatorName record component.
evaluatorNames() - Method in record class dev.dokimos.core.ExperimentResult: Returns the names of all evaluators used in this experiment.
evaluators(List<Evaluator>) - Method in class dev.dokimos.core.Experiment.Builder: Adds multiple evaluators to the experiment.
ExactMatchEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that checks for exact string match between actual and expected outputs.
ExactMatchEvaluator.Builder - Class in dev.dokimos.core.evaluators
example() - Method in record class dev.dokimos.core.ItemResult: Returns the value of the example record component.
Example - Record Class in dev.dokimos.core: A dataset example with inputs, expected outputs, and metadata.
Example(Map<String, Object>, Map<String, Object>, Map<String, Object>) - Constructor for record class dev.dokimos.core.Example: Compact constructor that creates immutable copies of all maps.
Example.Builder - Class in dev.dokimos.core: Builder for constructing examples with multiple inputs and outputs.
examples() - Method in record class dev.dokimos.core.Dataset: Returns the examples in the dataset.
EXPECTED_OUTPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
expectedKey(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Sets the key for expected (relevant) items in expectedOutputs.
expectedKey(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Sets the key for expected (relevant) items in expectedOutputs.
expectedOutput() - Method in record class dev.dokimos.core.EvalTestCase: Gets the primary expected output value.
expectedOutput() - Method in record class dev.dokimos.core.Example: Returns the primary expected output value.
expectedOutput() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the expectedOutput record component.
expectedOutput(String) - Method in class dev.dokimos.core.EvalTestCase.Builder: Sets the primary expected output value.
expectedOutput(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds an expected output with the given key and value.
expectedOutput(String, Object) - Method in class dev.dokimos.core.Example.Builder: Adds an expected output with the given key and value.
expectedOutputs() - Method in record class dev.dokimos.core.EvalTestCase: Returns the value of the expectedOutputs record component.
expectedOutputs() - Method in record class dev.dokimos.core.Example: Returns the value of the expectedOutputs record component.
expectedOutputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns the value of the expectedOutputs record component.
expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds all entries from the given expected outputs map.
expectedOutputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder: Adds all entries from the given expected outputs map.
expectedToolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Sets the key used to retrieve expected tool calls from expectedOutputs.
Experiment - Class in dev.dokimos.core: An evaluation experiment that runs a task against a dataset and evaluates the results.
Experiment - Class in dev.dokimos.server.entity
Experiment(Project, String) - Constructor for class dev.dokimos.server.entity.Experiment
Experiment.Builder - Class in dev.dokimos.core
ExperimentController - Class in dev.dokimos.server.controller.v1
ExperimentController(ExperimentService, RunService) - Constructor for class dev.dokimos.server.controller.v1.ExperimentController
experimentCount() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Returns the value of the experimentCount record component.
experimentId() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the experimentId record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest: Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the experimentName record component.
experimentName() - Method in record class dev.dokimos.server.dto.v1.TrendData: Returns the value of the experimentName record component.
ExperimentRepository - Interface in dev.dokimos.server.repository
ExperimentResult - Record Class in dev.dokimos.core: Aggregated results from an experiment.
ExperimentResult(String, String, Map<String, Object>, List<RunResult>) - Constructor for record class dev.dokimos.core.ExperimentResult: Creates an instance of a ExperimentResult record class.
ExperimentResultExporter - Class in dev.dokimos.core.export: Utility class for exporting ExperimentResult to various formats.
ExperimentRun - Class in dev.dokimos.server.entity
ExperimentRun(Experiment, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.ExperimentRun
ExperimentRunRepository - Interface in dev.dokimos.server.repository
ExperimentService - Class in dev.dokimos.server.service
ExperimentService(ExperimentRepository, ExperimentRunRepository, ItemResultRepository) - Constructor for class dev.dokimos.server.service.ExperimentService
ExperimentSummary - Record Class in dev.dokimos.server.dto.v1
ExperimentSummary(UUID, String, Instant, ExperimentSummary.LatestRunInfo) - Constructor for record class dev.dokimos.server.dto.v1.ExperimentSummary: Creates an instance of a ExperimentSummary record class.
ExperimentSummary.LatestRunInfo - Record Class in dev.dokimos.server.dto.v1
exportCsv(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to a CSV file.
exportCsv(Path) - Method in record class dev.dokimos.core.ExperimentResult: Exports the experiment result to a CSV file.
exportHtml(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to an HTML file.
exportHtml(Path) - Method in record class dev.dokimos.core.ExperimentResult: Exports the experiment result to an HTML file.
exportJson(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to a JSON file.
exportJson(Path) - Method in record class dev.dokimos.core.ExperimentResult: Exports the experiment result to a JSON file.
exportMarkdown(ExperimentResult, Path) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to a Markdown file.
exportMarkdown(Path) - Method in record class dev.dokimos.core.ExperimentResult: Exports the experiment result to a Markdown file.
extractTexts(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Extracts text content from a list of LangChain4j Content objects.
extractTextsWithMetadata(List<Content>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Extracts text content with metadata from a list of LangChain4j Content objects.

F

failCount() - Method in record class dev.dokimos.core.ExperimentResult: Returns the average number of items that failed across all runs.
failCount() - Method in record class dev.dokimos.core.RunResult: Returns the number of items that failed at least one evaluation in this run.
FAILED - Enum constant in enum class dev.dokimos.core.RunStatus: The run failed due to an error.
FAILED - Enum constant in enum class dev.dokimos.server.entity.RunStatus
failure(String, double, String) - Static method in record class dev.dokimos.core.EvalResult: Creates a failed result.
FaithfulnessEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that uses an LLM to check how much of the actual output is backed by the given context.
FaithfulnessEvaluator.Builder - Class in dev.dokimos.core.evaluators
FileDatasetResolver - Class in dev.dokimos.core: Resolves datasets from the filesystem.
FileDatasetResolver() - Constructor for class dev.dokimos.core.FileDatasetResolver
finalResponse() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns the value of the finalResponse record component.
finalResponse(String) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Sets the agent's final text response.
findAllWithExperimentCount() - Method in interface dev.dokimos.server.repository.ProjectRepository
findByExperimentOrderByStartedAtDesc(Experiment) - Method in interface dev.dokimos.server.repository.ExperimentRunRepository
findByExperimentOrderByStartedAtDesc(Experiment, Pageable) - Method in interface dev.dokimos.server.repository.ExperimentRunRepository
findByName(String) - Method in interface dev.dokimos.server.repository.ProjectRepository
findByProjectAndName(Project, String) - Method in interface dev.dokimos.server.repository.ExperimentRepository
findByProjectOrderByCreatedAtDesc(Project) - Method in interface dev.dokimos.server.repository.ExperimentRepository
findByRunOrderByCreatedAtAsc(ExperimentRun, Pageable) - Method in interface dev.dokimos.server.repository.ItemResultRepository
findCompletedRunsByExperiment(Experiment, Pageable) - Method in interface dev.dokimos.server.repository.ExperimentRunRepository
findFirstByExperimentOrderByStartedAtDesc(Experiment) - Method in interface dev.dokimos.server.repository.ExperimentRunRepository
fixedResponse(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Adds a fixed response to use before generating dynamic responses.
fixedResponses(List<String>) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Sets all fixed responses at once.
flush() - Method in class dev.dokimos.core.NoOpReporter
flush() - Method in interface dev.dokimos.core.Reporter: Blocks until all pending items are sent.
flush() - Method in class dev.dokimos.server.client.DokimosServerReporter
fromCsv(String, String) - Static method in record class dev.dokimos.core.Dataset: Parses a dataset from a CSV string.
fromCsv(Path) - Static method in record class dev.dokimos.core.Dataset: Loads a dataset from a CSV file.
fromEnvironment() - Static method in class dev.dokimos.server.client.DokimosServerReporter: Creates a reporter from environment variables.
fromJson(String) - Static method in record class dev.dokimos.core.Dataset: Parses a dataset from a JSON string.
fromJson(Path) - Static method in record class dev.dokimos.core.Dataset: Loads a dataset from a JSON file.
fromJsonl(String) - Static method in record class dev.dokimos.core.Dataset: Parses a dataset from a JSONL string with a default name.
fromJsonl(String, String) - Static method in record class dev.dokimos.core.Dataset: Parses a dataset from a JSONL string.
fromJsonl(Path) - Static method in record class dev.dokimos.core.Dataset: Loads a dataset from a JSONL file, streaming line-by-line from disk without loading the entire file into memory.
fromMap(Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolCall: Creates a tool call from a map, typically when deserializing from a JSON dataset.
fromMap(Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolDefinition: Creates a tool definition from a map, typically when deserializing from a JSON dataset.

G

generate(String) - Method in interface dev.dokimos.core.JudgeLM
generateMessage(ConversationTrajectory) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser
generateMessage(ConversationTrajectory) - Method in interface dev.dokimos.core.conversation.SimulatedUser: Generates the next user message based on the current conversation state.
get(int) - Method in record class dev.dokimos.core.Dataset: Returns the example at the specified index.
getActualOutput() - Method in class dev.dokimos.server.entity.ItemResult
getApiKey() - Method in class dev.dokimos.server.config.ApiKeyProperties
getCompletedAt() - Method in class dev.dokimos.server.entity.ExperimentRun
getConfig() - Method in class dev.dokimos.server.entity.ExperimentRun
getCreatedAt() - Method in class dev.dokimos.server.entity.Experiment
getCreatedAt() - Method in class dev.dokimos.server.entity.ItemResult
getCreatedAt() - Method in class dev.dokimos.server.entity.Project
getEvalResults() - Method in class dev.dokimos.server.entity.ItemResult
getEvaluatorName() - Method in class dev.dokimos.server.entity.EvalResult
getExpectedOutput() - Method in class dev.dokimos.server.entity.ItemResult
getExperiment() - Method in class dev.dokimos.server.entity.ExperimentRun
getExperiment(UUID) - Method in class dev.dokimos.server.service.ExperimentService
getExperiments() - Method in class dev.dokimos.server.entity.Project
getId() - Method in class dev.dokimos.server.entity.EvalResult
getId() - Method in class dev.dokimos.server.entity.Experiment
getId() - Method in class dev.dokimos.server.entity.ExperimentRun
getId() - Method in class dev.dokimos.server.entity.ItemResult
getId() - Method in class dev.dokimos.server.entity.Project
getInput() - Method in class dev.dokimos.server.entity.ItemResult
getInstance() - Static method in class dev.dokimos.core.DatasetResolverRegistry: Returns the singleton registry instance.
getItemResult() - Method in class dev.dokimos.server.entity.EvalResult
getItems() - Method in class dev.dokimos.server.entity.ExperimentRun
getMetadata() - Method in class dev.dokimos.server.entity.ItemResult
getName() - Method in class dev.dokimos.server.entity.Experiment
getName() - Method in class dev.dokimos.server.entity.Project
getOrCreateExperiment(Project, String) - Method in class dev.dokimos.server.service.ExperimentService
getOrCreateProject(String) - Method in class dev.dokimos.server.service.ProjectService
getProject() - Method in class dev.dokimos.server.entity.Experiment
getProject(String) - Method in class dev.dokimos.server.service.ProjectService
getReason() - Method in class dev.dokimos.server.entity.EvalResult
getRun() - Method in class dev.dokimos.server.entity.ItemResult
getRunDetails(UUID, Pageable) - Method in class dev.dokimos.server.controller.v1.RunController
getRunDetails(UUID, Pageable) - Method in class dev.dokimos.server.service.RunService
getRuns() - Method in class dev.dokimos.server.entity.Experiment
getScore() - Method in class dev.dokimos.server.entity.EvalResult
getStartedAt() - Method in class dev.dokimos.server.entity.ExperimentRun
getStatus() - Method in class dev.dokimos.server.entity.ExperimentRun
getThreshold() - Method in class dev.dokimos.server.entity.EvalResult
getTrends(UUID, int) - Method in class dev.dokimos.server.controller.v1.ExperimentController
getTrends(UUID, int) - Method in class dev.dokimos.server.service.ExperimentService
GlobalExceptionHandler - Class in dev.dokimos.server.controller
GlobalExceptionHandler() - Constructor for class dev.dokimos.server.controller.GlobalExceptionHandler
goalCompletion() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating goal completion.

H

HallucinationEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that uses an LLM to detect hallucinations in the actual output.
HallucinationEvaluator.Builder - Class in dev.dokimos.core.evaluators
handleGeneral(Exception) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
handleNotFound(IllegalArgumentException) - Method in class dev.dokimos.server.controller.GlobalExceptionHandler
hashCode() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.agents.ToolCall: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.agents.ToolDefinition: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.conversation.Message: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.Dataset: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.EvalResult: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.EvalTestCase: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.Example: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.ExperimentResult: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.ItemResult: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.RunHandle: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.core.RunResult: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TrendData: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns a hash code value for this object.
hashCode() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest: Returns a hash code value for this object.
helpfulness() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating helpfulness.

I

id() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the id record component.
id() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the id record component.
ignoreCase(boolean) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder: Sets whether to ignore case when matching.
impatientUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated impatient user who wants quick answers.
includePerCriterionScores(boolean) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets whether to include per-criterion scores in the result metadata.
includeReason(boolean) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Sets whether to include a detailed reason in the result.
includeReason(boolean) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder: Sets the flag whether to provide a reason or not.
includeReason(boolean) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder: Sets the flag whether to provide a reason or not.
informationAccuracy() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating information accuracy.
initialMessage(String) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Sets the initial user message to start the conversation.
input() - Method in record class dev.dokimos.core.EvalTestCase: Gets the primary input value.
input() - Method in record class dev.dokimos.core.Example: Returns the primary input value.
input() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the input record component.
input(String) - Method in class dev.dokimos.core.EvalTestCase.Builder: Sets the primary input value.
input(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds an input with the given key and value.
input(String, Object) - Method in class dev.dokimos.core.Example.Builder: Adds an input with the given key and value.
INPUT - Enum constant in enum class dev.dokimos.core.EvalTestCaseParam
INPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport: Default key for reading input from dataset examples.
INPUT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport: Default key for reading input from dataset examples.
inputs() - Method in record class dev.dokimos.core.EvalTestCase: Returns the value of the inputs record component.
inputs() - Method in record class dev.dokimos.core.Example: Returns the value of the inputs record component.
inputs() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns the value of the inputs record component.
inputs(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds all entries from the given inputs map.
inputs(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder: Adds all entries from the given inputs map.
inputSchema() - Method in record class dev.dokimos.core.agents.ToolDefinition: Returns the value of the inputSchema record component.
inputSchema(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder: Sets the input schema.
INSTANCE - Static variable in class dev.dokimos.core.NoOpReporter: Singleton instance of the no-op reporter.
isAssistant() - Method in record class dev.dokimos.core.conversation.Message: Checks if this message is from an assistant.
isAuthEnabled() - Method in class dev.dokimos.server.config.ApiKeyProperties: Returns true if API key authentication is enabled.
isEmpty() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Checks if the conversation is empty.
isSuccess() - Method in class dev.dokimos.server.entity.EvalResult
isSystem() - Method in record class dev.dokimos.core.conversation.Message: Checks if this message is a system message.
isUser() - Method in record class dev.dokimos.core.conversation.Message: Checks if this message is from a user.
itemCount() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the itemCount record component.
ItemData(Map<String, Object>, Map<String, Object>, Map<String, Object>, List<AddItemsRequest.EvalData>, boolean) - Constructor for record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Creates an instance of a ItemData record class.
ItemResult - Class in dev.dokimos.server.entity
ItemResult - Record Class in dev.dokimos.core
ItemResult(Example, Map<String, Object>, List<EvalResult>) - Constructor for record class dev.dokimos.core.ItemResult: Creates an instance of a ItemResult record class.
ItemResult(ExperimentRun, String, String, String, Map<String, Object>) - Constructor for class dev.dokimos.server.entity.ItemResult
ItemResultRepository - Interface in dev.dokimos.server.repository
itemResults() - Method in record class dev.dokimos.core.ExperimentResult: Returns all item results across all runs.
itemResults() - Method in record class dev.dokimos.core.RunResult: Returns the value of the itemResults record component.
items() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest: Returns the value of the items record component.
items() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the items record component.
ItemSummary(UUID, String, String, String, Map<String, Object>, List<RunDetails.EvalSummary>, Instant) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Creates an instance of a ItemSummary record class.
iterator() - Method in record class dev.dokimos.core.Dataset

J

json() - Element in annotation interface dev.dokimos.junit.DatasetSource: Inline JSON dataset.
jsonl() - Element in annotation interface dev.dokimos.junit.DatasetSource: Inline JSONL dataset.
judge(JudgeLM) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Sets the JudgeLM to use for generating responses.
judge(JudgeLM) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets the JudgeLM to use for evaluation.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets the judge LLM for evaluating task completion.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder: Sets the judge LLM for evaluating argument grounding.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets an optional judge LLM for semantic checks.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder: Sets an optional judge LLM for semantic checks.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Sets the LLM judge to use for scoring context relevance.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder: Sets the model to use for the evaluation.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder: Sets the model to use for the evaluation.
judge(JudgeLM) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Sets the model to use for the evaluation.
JudgeLM - Interface in dev.dokimos.core: A language model used for evaluation.

L

LangChain4jSupport - Class in dev.dokimos.langchain4j: Utilities for integrating with LangChain4j.
lastAssistantMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the last assistant message in the conversation, if any.
lastMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the last message in the conversation, if any.
lastUserMessage() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the last user message in the conversation, if any.
latestRun() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Returns the value of the latestRun record component.
LatestRunInfo(UUID, RunStatus, Double, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Creates an instance of a LatestRunInfo record class.
listExperiments(Project) - Method in class dev.dokimos.server.service.ExperimentService
listExperiments(String) - Method in class dev.dokimos.server.controller.v1.ProjectController
listProjects() - Method in class dev.dokimos.server.controller.v1.ProjectController
listProjects() - Method in class dev.dokimos.server.service.ProjectService
listRuns(Experiment) - Method in class dev.dokimos.server.service.RunService
listRuns(UUID) - Method in class dev.dokimos.server.controller.v1.ExperimentController
llmBased(JudgeLM) - Static method in interface dev.dokimos.core.MatchingStrategy: Creates an LLM-based matching strategy.
LLMJudgeEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that uses an LLM to evaluate outputs based on the specified criteria.
LLMJudgeEvaluator.Builder - Class in dev.dokimos.core.evaluators
LlmResponseUtils - Class in dev.dokimos.core: Utility methods for processing LLM responses.
LLMSimulatedUser - Class in dev.dokimos.core.conversation: An LLM-based simulated user for multi-turn conversation testing.
LLMSimulatedUser.Builder - Class in dev.dokimos.core.conversation: Builder for constructing LLM simulated users.

M

main(String[]) - Static method in class dev.dokimos.server.DokimosServerApplication
matches(Object, Object) - Method in interface dev.dokimos.core.MatchingStrategy: Determines if a retrieved item matches an expected item.
matchingStrategy(MatchingStrategy) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Sets the strategy for matching retrieved items to expected items.
matchingStrategy(MatchingStrategy) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Sets the strategy for matching retrieved items to expected items.
MatchingStrategy - Interface in dev.dokimos.core: Strategy for determining if a retrieved item matches an expected item.
matchMode(ToolCorrectnessEvaluator.MatchMode) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Sets the match mode for comparing tool calls.
MAX - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy: Returns the maximum score across all criteria.
maxInputArgs(int) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets the maximum number of total input parameters allowed per tool.
maxOptionalArgs(int) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets the maximum number of optional parameters allowed per tool.
maxTurns(int) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Sets the maximum number of conversation turns.
MEAN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy: Simple arithmetic mean of all scores.
message(Message) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds a message to the trajectory.
Message - Record Class in dev.dokimos.core.conversation: Represents a single message in a conversation.
Message(Message.Role, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.conversation.Message: Compact constructor.
Message.Role - Enum Class in dev.dokimos.core.conversation: The role of a message sender in a conversation.
messages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the value of the messages record component.
messages(List<Message>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds all messages from a list.
metadata() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.agents.ToolCall: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.conversation.Message: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.EvalResult: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.EvalTestCase: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.Example: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.core.ExperimentResult: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest: Returns the value of the metadata record component.
metadata() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns the value of the metadata record component.
metadata(String, Object) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Adds a metadata entry.
metadata(String, Object) - Method in class dev.dokimos.core.agents.ToolCall.Builder: Adds a metadata entry.
metadata(String, Object) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds metadata with the given key and value.
metadata(String, Object) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds metadata with the given key and value.
metadata(String, Object) - Method in class dev.dokimos.core.Example.Builder: Adds metadata with the given key and value.
metadata(String, Object) - Method in class dev.dokimos.core.Experiment.Builder: Adds a metadata entry to the experiment.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Sets all metadata.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.agents.ToolCall.Builder: Sets all metadata.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds all entries from the given metadata map.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalResult.Builder: Sets the metadata.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.EvalTestCase.Builder: Adds all entries from the given metadata map.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.Example.Builder: Adds all entries from the given metadata map.
metadata(Map<String, Object>) - Method in class dev.dokimos.core.Experiment.Builder: Adds multiple metadata entries to the experiment.
MIN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy: Returns the minimum score across all criteria.

N

name() - Method in record class dev.dokimos.core.agents.ToolCall: Returns the value of the name record component.
name() - Method in record class dev.dokimos.core.agents.ToolDefinition: Returns the value of the name record component.
name() - Method in class dev.dokimos.core.BaseEvaluator
name() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Returns the value of the name record component.
name() - Method in record class dev.dokimos.core.Dataset: Returns the dataset's name.
name() - Method in record class dev.dokimos.core.EvalResult: Returns the value of the name record component.
name() - Method in interface dev.dokimos.core.Evaluator: Returns the evaluator name.
name() - Method in record class dev.dokimos.core.ExperimentResult: Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Returns the value of the name record component.
name() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Returns the value of the name record component.
name(String) - Method in class dev.dokimos.core.agents.ToolCall.Builder: Sets the tool name.
name(String) - Method in class dev.dokimos.core.agents.ToolDefinition.Builder: Sets the tool name.
name(String) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.Dataset.Builder: Sets the dataset name.
name(String) - Method in class dev.dokimos.core.EvalResult.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder: Sets the evaluator name.
name(String) - Method in class dev.dokimos.core.Experiment.Builder: Sets the experiment name.
NAMES_AND_ARGS - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode: Compare tool names and their arguments.
NAMES_AND_ORDER - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode: Compare tool names and their invocation order.
NAMES_ONLY - Enum constant in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode: Compare only the set of tool names used.
NoOpReporter - Class in dev.dokimos.core: A no-op implementation of Reporter that does nothing.
noviceUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated novice user who is new to the domain.

O

of(Message.Role, String) - Static method in record class dev.dokimos.core.conversation.Message: Creates a message with just role and content.
of(String, double, double, String) - Static method in record class dev.dokimos.core.EvalResult: Creates a result by comparing the score against a threshold.
of(String, String) - Static method in record class dev.dokimos.core.conversation.EvaluationCriterion: Creates a criterion with default weight of 1.0.
of(String, String) - Static method in record class dev.dokimos.core.EvalTestCase: Creates a test case with a single input and actual output.
of(String, String) - Static method in record class dev.dokimos.core.Example: Creates an example with a single input and expected output.
of(String, String, String) - Static method in record class dev.dokimos.core.EvalTestCase: Creates a test case with input, actual output, and expected output.
of(String, String, Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolDefinition: Creates a tool definition with a name, description, and input schema.
of(String, Map<String, Object>) - Static method in record class dev.dokimos.core.agents.ToolCall: Creates a tool call with just a name and arguments.
offTopicUser(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated off-topic user who frequently goes on tangents.
OUTPUT_KEY - Static variable in class dev.dokimos.langchain4j.LangChain4jSupport: Default key for the model output in evaluation results.
OUTPUT_KEY - Static variable in class dev.dokimos.springai.SpringAiSupport: Default key for the model output in evaluation results.

P

parallelism(int) - Method in class dev.dokimos.core.Experiment.Builder: Sets the level of parallelism for running the experiment.
parameterNames() - Method in record class dev.dokimos.core.agents.ToolDefinition: Extracts all parameter names from the input schema properties.
parameterSchema(String) - Method in record class dev.dokimos.core.agents.ToolDefinition: Gets the schema for a specific parameter.
parseCsv(String, String) - Static method in class dev.dokimos.core.DatasetParser
parseCsv(String, String, char) - Static method in class dev.dokimos.core.DatasetParser
parseJson(String) - Static method in class dev.dokimos.core.DatasetParser
parseJsonl(String, String) - Static method in class dev.dokimos.core.DatasetParser: Parses a dataset from a JSONL string.
parseJsonl(Path, String) - Static method in class dev.dokimos.core.DatasetParser: Parses a dataset from a JSONL file, streaming line-by-line from disk.
passCount() - Method in record class dev.dokimos.core.ExperimentResult: Returns the average number of items that passed across all runs.
passCount() - Method in record class dev.dokimos.core.RunResult: Returns the number of items that passed all evaluations in this run.
passedCount() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the passedCount record component.
passedItems() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the passedItems record component.
passedItems() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns the value of the passedItems record component.
passRate() - Method in record class dev.dokimos.core.ExperimentResult: Returns the average pass rate across all runs.
passRate() - Method in record class dev.dokimos.core.RunResult: Returns the proportion of items that passed in this run.
passRate() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the passRate record component.
passRate() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns the value of the passRate record component.
pattern(String) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder: Sets the regular expression pattern.
persona(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Sets a short persona description.
PrecisionEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that measures retrieval precision.
PrecisionEvaluator.Builder - Class in dev.dokimos.core.evaluators: Builder for constructing PrecisionEvaluator instances.
problemResolution() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating problem resolution.
professionalTone() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating professional tone.
Project - Class in dev.dokimos.server.entity
Project(String) - Constructor for class dev.dokimos.server.entity.Project
ProjectController - Class in dev.dokimos.server.controller.v1
ProjectController(ProjectService, ExperimentService, RunService) - Constructor for class dev.dokimos.server.controller.v1.ProjectController
projectName() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the projectName record component.
projectName() - Method in record class dev.dokimos.server.dto.v1.TrendData: Returns the value of the projectName record component.
projectName(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder: Sets the project name.
ProjectRepository - Interface in dev.dokimos.server.repository
ProjectService - Class in dev.dokimos.server.service
ProjectService(ProjectRepository) - Constructor for class dev.dokimos.server.service.ProjectService
ProjectSummary - Record Class in dev.dokimos.server.dto.v1
ProjectSummary(UUID, String, long, Instant) - Constructor for record class dev.dokimos.server.dto.v1.ProjectSummary: Creates an instance of a ProjectSummary record class.
provideArguments(ExtensionContext) - Method in class dev.dokimos.junit.DatasetArgumentsProvider

R

RAG Evaluation - Search tag in class dev.dokimos.langchain4j.LangChain4jSupport: Section
ragTask(Function<String, Result<String>>) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Creates a RAG evaluation Task from a function that returns Result.
ragTask(Function<String, Result<String>>, String, String, String) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Creates a RAG evaluation Task with custom key names.
reason() - Method in record class dev.dokimos.core.EvalResult: Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns the value of the reason record component.
reason() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns the value of the reason record component.
reason(String) - Method in class dev.dokimos.core.EvalResult.Builder: Sets the reason or explanation.
reasoningSteps() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns the value of the reasoningSteps record component.
reasoningSteps(List<String>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Sets all reasoning steps.
RecallEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that measures retrieval recall.
RecallEvaluator.Builder - Class in dev.dokimos.core.evaluators: Builder for constructing RecallEvaluator instances.
RegexEvaluator - Class in dev.dokimos.core.evaluators: Evaluator that checks if the actual output matches a regular expression pattern.
RegexEvaluator.Builder - Class in dev.dokimos.core.evaluators
register(DatasetResolver) - Method in class dev.dokimos.core.DatasetResolverRegistry: Registers a custom resolver with the highest priority.
reporter(Reporter) - Method in class dev.dokimos.core.Experiment.Builder: Sets the reporter for this experiment.
Reporter - Interface in dev.dokimos.core: Interface for reporting experiment results to an external system.
reportItem(RunHandle, ItemResult) - Method in class dev.dokimos.core.NoOpReporter
reportItem(RunHandle, ItemResult) - Method in interface dev.dokimos.core.Reporter: Reports a single evaluated item.
reportItem(RunHandle, ItemResult) - Method in class dev.dokimos.server.client.DokimosServerReporter
requiredParameters() - Method in record class dev.dokimos.core.agents.ToolDefinition: Extracts required parameter names from the input schema.
resolve(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver
resolve(String) - Method in interface dev.dokimos.core.DatasetResolver: Resolve the URI to a Dataset.
resolve(String) - Method in class dev.dokimos.core.DatasetResolverRegistry: Resolves a URI to a dataset using the first matching resolver.
resolve(String) - Method in class dev.dokimos.core.FileDatasetResolver
respond(ConversationTrajectory) - Method in interface dev.dokimos.core.conversation.ConversationalApplication: Generates a response to the current conversation state.
responseRelevance() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating response relevance.
result() - Method in record class dev.dokimos.core.agents.ToolCall: Returns the value of the result record component.
result(String) - Method in class dev.dokimos.core.agents.ToolCall.Builder: Sets the tool execution result.
retrievalContextKey(String) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Sets the key used to retrieve context chunks from actualOutputs.
retrievedKey(String) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Sets the key for retrieved items in actualOutputs.
retrievedKey(String) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Sets the key for retrieved items in actualOutputs.
role() - Method in record class dev.dokimos.core.conversation.Message: Returns the value of the role record component.
run() - Method in class dev.dokimos.core.Experiment: Runs the experiment and returns the aggregated results.
run(Example) - Method in interface dev.dokimos.core.Task: Run the task on the given Example and produce outputs.
RunController - Class in dev.dokimos.server.controller.v1
RunController(RunService) - Constructor for class dev.dokimos.server.controller.v1.RunController
runCount() - Method in record class dev.dokimos.core.ExperimentResult: Returns the number of runs performed.
RunDetails - Record Class in dev.dokimos.server.dto.v1
RunDetails(UUID, UUID, String, String, RunStatus, Map<String, Object>, long, long, Double, Instant, Instant, Page<RunDetails.ItemSummary>) - Constructor for record class dev.dokimos.server.dto.v1.RunDetails: Creates an instance of a RunDetails record class.
RunDetails.EvalSummary - Record Class in dev.dokimos.server.dto.v1
RunDetails.ItemSummary - Record Class in dev.dokimos.server.dto.v1
RunHandle - Record Class in dev.dokimos.core: A handle representing an active experiment run.
RunHandle(String) - Constructor for record class dev.dokimos.core.RunHandle: Creates a new run handle.
runId() - Method in record class dev.dokimos.core.RunHandle: Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse: Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Returns the value of the runId record component.
runId() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns the value of the runId record component.
runIndex() - Method in record class dev.dokimos.core.RunResult: Returns the value of the runIndex record component.
RUNNING - Enum constant in enum class dev.dokimos.server.entity.RunStatus
RunPoint(UUID, Instant, double, long, long) - Constructor for record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Creates an instance of a RunPoint record class.
RunResult - Record Class in dev.dokimos.core: Results from a single run of an experiment.
RunResult(int, List<ItemResult>) - Constructor for record class dev.dokimos.core.RunResult: Creates an instance of a RunResult record class.
runResults() - Method in record class dev.dokimos.core.ExperimentResult: Returns the value of the runResults record component.
runs() - Method in record class dev.dokimos.core.ExperimentResult: Returns the individual run results for detailed analysis.
runs() - Method in record class dev.dokimos.server.dto.v1.TrendData: Returns the value of the runs record component.
runs(int) - Method in class dev.dokimos.core.Experiment.Builder: Sets the number of times to run the experiment.
RunService - Class in dev.dokimos.server.service
RunService(ExperimentRunRepository, ItemResultRepository, ObjectMapper) - Constructor for class dev.dokimos.server.service.RunService
RunStatus - Enum Class in dev.dokimos.core: Status of an experiment run.
RunStatus - Enum Class in dev.dokimos.server.entity
RunSummary - Record Class in dev.dokimos.server.dto.v1
RunSummary(UUID, RunStatus, Map<String, Object>, long, long, Double, Instant, Instant) - Constructor for record class dev.dokimos.server.dto.v1.RunSummary: Creates an instance of a RunSummary record class.

S

safety() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating safety and appropriateness.
satisfiedCustomer(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated satisfied customer who is cooperative and positive.
scenario() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the value of the scenario record component.
scenario(String) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Sets the scenario description for the conversation.
scenario(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Sets the scenario description.
score() - Method in record class dev.dokimos.core.EvalResult: Returns the value of the score record component.
score() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Returns the value of the score record component.
score() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns the value of the score record component.
score() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns the value of the score record component.
score(double) - Method in class dev.dokimos.core.EvalResult.Builder: Sets the numeric score.
scoreRange(double, double) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Sets the expected score range for the LLM response.
scoreStdDev(String) - Method in record class dev.dokimos.core.ExperimentResult: Returns the sample standard deviation of scores for the specified evaluator across runs.
serverUrl(String) - Method in class dev.dokimos.server.client.DokimosServerReporter.Builder: Sets the Dokimos server URL.
setApiKey(String) - Method in class dev.dokimos.server.config.ApiKeyProperties
setCompletedAt(Instant) - Method in class dev.dokimos.server.entity.ExperimentRun
setStatus(RunStatus) - Method in class dev.dokimos.server.entity.ExperimentRun
simpleTask(ChatModel) - Static method in class dev.dokimos.langchain4j.LangChain4jSupport: Creates a simple Task for Q&A evaluation.
simulate() - Method in class dev.dokimos.core.conversation.ConversationSimulator: Runs the conversation simulation.
simulateAsync() - Method in class dev.dokimos.core.conversation.ConversationSimulator: Runs the conversation simulation asynchronously using the common fork-join pool.
simulateAsync(ExecutorService) - Method in class dev.dokimos.core.conversation.ConversationSimulator: Runs the conversation simulation asynchronously using the provided executor.
simulatedUser(SimulatedUser) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Sets the simulated user for the conversation.
SimulatedUser - Interface in dev.dokimos.core.conversation: Functional interface for simulating user behavior in multi-turn conversations.
size() - Method in record class dev.dokimos.core.Dataset: Returns the number of examples in the dataset.
SpringAiSupport - Class in dev.dokimos.springai: Utilities for integrating with Spring AI.
startedAt() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Returns the value of the startedAt record component.
startedAt() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the startedAt record component.
startedAt() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the startedAt record component.
startedAt() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns the value of the startedAt record component.
startRun(String, Map<String, Object>) - Method in class dev.dokimos.core.NoOpReporter
startRun(String, Map<String, Object>) - Method in interface dev.dokimos.core.Reporter: Starts a new experiment run.
startRun(String, Map<String, Object>) - Method in class dev.dokimos.server.client.DokimosServerReporter
status() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns the value of the status record component.
status() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest: Returns the value of the status record component.
stoppingCondition(Predicate<ConversationTrajectory>) - Method in class dev.dokimos.core.conversation.ConversationSimulator.Builder: Sets a stopping condition for early termination.
strictMode(boolean) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Enables strict mode which fails on any unexpected parameter.
strictMode(boolean) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Enables or disables strict mode.
stripMarkdown(String) - Static method in class dev.dokimos.core.LlmResponseUtils: Strips markdown code block formatting from an LLM response.
success() - Method in record class dev.dokimos.core.EvalResult: Returns the value of the success record component.
success() - Method in record class dev.dokimos.core.ItemResult
success() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns the value of the success record component.
success() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns the value of the success record component.
success(String, double, String) - Static method in record class dev.dokimos.core.EvalResult: Creates a successful result.
SUCCESS - Enum constant in enum class dev.dokimos.core.RunStatus: The run completed successfully.
SUCCESS - Enum constant in enum class dev.dokimos.server.entity.RunStatus
supports(String) - Method in class dev.dokimos.core.ClasspathDatasetResolver
supports(String) - Method in interface dev.dokimos.core.DatasetResolver: Check if this resolver supports the given URI.
supports(String) - Method in class dev.dokimos.core.FileDatasetResolver
system(String) - Static method in record class dev.dokimos.core.conversation.Message: Creates a system message.
SYSTEM - Enum constant in enum class dev.dokimos.core.conversation.Message.Role: A system message providing context or instructions.
systemMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds a system message to the trajectory.
systemMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns only the system messages from the conversation.
systemPrompt(String) - Method in class dev.dokimos.core.conversation.LLMSimulatedUser.Builder: Sets the complete system prompt directly.

T

task(Task) - Method in class dev.dokimos.core.Experiment.Builder: Sets the task.
Task - Interface in dev.dokimos.core
TaskCompletionEvaluator - Class in dev.dokimos.core.evaluators.agents: Evaluates whether an AI agent completed the user's requested tasks.
TaskCompletionEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents: Builder for constructing the evaluator.
tasksKey(String) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets the metadata key for the task list.
technicalExpert(JudgeLM) - Static method in class dev.dokimos.core.conversation.UserPersonas: Creates a simulated technical expert who understands complex concepts.
threshold() - Method in class dev.dokimos.core.BaseEvaluator
threshold() - Method in record class dev.dokimos.core.EvalResult: Returns the value of the threshold record component.
threshold() - Method in interface dev.dokimos.core.Evaluator: Returns the minimum score threshold for success.
threshold() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns the value of the threshold record component.
threshold() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns the value of the threshold record component.
threshold(double) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.EvalResult.Builder: Sets the success threshold.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.TaskCompletionEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.ExactMatchEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.FaithfulnessEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.HallucinationEvaluator.Builder: Sets the maximum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.LLMJudgeEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.PrecisionEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.RecallEvaluator.Builder: Sets the minimum score threshold for success.
threshold(double) - Method in class dev.dokimos.core.evaluators.RegexEvaluator.Builder: Sets the minimum score threshold for success.
toCsv() - Method in record class dev.dokimos.core.ExperimentResult: Returns the experiment result as a CSV string.
toCsv(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to a CSV string.
toEvaluationResponse(EvalResult) - Static method in class dev.dokimos.springai.SpringAiSupport: Converts a Dokimos EvalResult to a Spring AI EvaluationResponse.
toHtml() - Method in record class dev.dokimos.core.ExperimentResult: Returns the experiment result as an HTML string.
toHtml(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to an HTML string.
toJson() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Serializes the trajectory to JSON for debugging and logging.
toJson() - Method in record class dev.dokimos.core.ExperimentResult: Returns the experiment result as a JSON string.
toJson(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to a JSON string.
toMarkdown() - Method in record class dev.dokimos.core.ExperimentResult: Returns the experiment result as a Markdown string.
toMarkdown(ExperimentResult) - Static method in class dev.dokimos.core.export.ExperimentResultExporter: Exports the experiment result to a Markdown string.
ToolArgumentHallucinationEvaluator - Class in dev.dokimos.core.evaluators.agents: Uses a judge LLM to assess whether tool call argument values are factually grounded in the user's input and preceding tool call results.
ToolArgumentHallucinationEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents: Builder for constructing the evaluator.
ToolCall - Record Class in dev.dokimos.core.agents: Represents a single tool invocation made by an AI agent.
ToolCall(String, Map<String, Object>, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.ToolCall: Creates an instance of a ToolCall record class.
ToolCall.Builder - Class in dev.dokimos.core.agents: Builder for constructing tool calls.
toolCalls() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns the value of the toolCalls record component.
toolCalls(List<ToolCall>) - Method in class dev.dokimos.core.agents.AgentTrace.Builder: Sets all tool calls.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolArgumentHallucinationEvaluator.Builder: Sets the key used to retrieve tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Sets the key used to retrieve tool calls from actualOutputs.
toolCallsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.Builder: Sets the key used to retrieve actual tool calls from actualOutputs.
ToolCallValidityEvaluator - Class in dev.dokimos.core.evaluators.agents: Validates that tool calls are syntactically correct per their JSON schema definitions.
ToolCallValidityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents: Builder for constructing the evaluator.
ToolCorrectnessEvaluator - Class in dev.dokimos.core.evaluators.agents: Checks whether the agent used the expected set of tools.
ToolCorrectnessEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents: Builder for constructing the evaluator.
ToolCorrectnessEvaluator.MatchMode - Enum Class in dev.dokimos.core.evaluators.agents: The comparison mode for evaluating tool correctness.
ToolDefinition - Record Class in dev.dokimos.core.agents: Describes an available tool's contract including its name, description, and JSON schema.
ToolDefinition(String, String, Map<String, Object>) - Constructor for record class dev.dokimos.core.agents.ToolDefinition: Creates an instance of a ToolDefinition record class.
ToolDefinition.Builder - Class in dev.dokimos.core.agents: Builder for constructing tool definitions.
ToolDescriptionReliabilityEvaluator - Class in dev.dokimos.core.evaluators.agents: Evaluates tool description quality using a mix of rule-based checks and optional LLM checks.
ToolDescriptionReliabilityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents: Builder for constructing the evaluator.
ToolNameReliabilityEvaluator - Class in dev.dokimos.core.evaluators.agents: Evaluates tool naming quality using a mix of rule-based checks and optional LLM checks.
ToolNameReliabilityEvaluator.Builder - Class in dev.dokimos.core.evaluators.agents: Builder for constructing the evaluator.
toolNames() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns the set of tool names used in this trace.
toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolCallValidityEvaluator.Builder: Sets the key used to retrieve tool definitions from metadata.
toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolDescriptionReliabilityEvaluator.Builder: Sets the metadata key for tool definitions.
toolsKey(String) - Method in class dev.dokimos.core.evaluators.agents.ToolNameReliabilityEvaluator.Builder: Sets the metadata key for tool definitions.
toOutputMap() - Method in record class dev.dokimos.core.agents.AgentTrace: Converts this agent trace to a map suitable for use as actualOutputs in an EvalTestCase.
toString() - Method in record class dev.dokimos.core.agents.AgentTrace: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.agents.ToolCall: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.agents.ToolDefinition: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.conversation.Message: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.Dataset: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.EvalResult: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.EvalTestCase: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.evaluators.ContextualRelevanceEvaluator.ContextScore: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.Example: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.ExperimentResult: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.ItemResult: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.RunHandle: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.core.RunResult: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.EvalData: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest.ItemData: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.AddItemsRequest: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateRunRequest: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.CreateRunResponse: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary.LatestRunInfo: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ExperimentSummary: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.ProjectSummary: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails.EvalSummary: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails.ItemSummary: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.RunSummary: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.TrendData: Returns a string representation of this record class.
toString() - Method in record class dev.dokimos.server.dto.v1.UpdateRunRequest: Returns a string representation of this record class.
totalCount() - Method in record class dev.dokimos.core.ExperimentResult: Returns the total number of items evaluated per run.
totalCount() - Method in record class dev.dokimos.core.RunResult: Returns the total number of items evaluated in this run.
totalItems() - Method in record class dev.dokimos.server.dto.v1.RunDetails: Returns the value of the totalItems record component.
totalItems() - Method in record class dev.dokimos.server.dto.v1.TrendData.RunPoint: Returns the value of the totalItems record component.
toTestCase() - Method in record class dev.dokimos.core.ItemResult
toTestCase(String) - Method in record class dev.dokimos.core.Example: Converts this example to a test case with a single actual output.
toTestCase(Map<String, Object>) - Method in record class dev.dokimos.core.Example: Converts this example to a test case with the given actual outputs.
toTestCase(EvaluationRequest) - Static method in class dev.dokimos.springai.SpringAiSupport: Converts a Spring AI EvaluationRequest to a Dokimos EvalTestCase.
toText() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Formats the conversation as a simple text transcript.
TrajectoryEvaluationCriteria - Class in dev.dokimos.core.conversation: Factory for creating pre-built evaluation criteria for trajectory evaluation.
TrajectoryEvaluator - Class in dev.dokimos.core.conversation: Evaluates complete conversation trajectories using LLM-as-judge patterns.
TrajectoryEvaluator.Builder - Class in dev.dokimos.core.conversation: Builder for constructing trajectory evaluators.
trajectoryKey(String) - Method in class dev.dokimos.core.conversation.TrajectoryEvaluator.Builder: Sets the key used to retrieve the trajectory from actualOutputs.
TrendData - Record Class in dev.dokimos.server.dto.v1
TrendData(String, String, List<TrendData.RunPoint>) - Constructor for record class dev.dokimos.server.dto.v1.TrendData: Creates an instance of a TrendData record class.
TrendData.RunPoint - Record Class in dev.dokimos.server.dto.v1
turnCount() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns the number of conversation turns (user-assistant message pairs).

U

updateRun(UUID, UpdateRunRequest) - Method in class dev.dokimos.server.controller.v1.RunController
updateRun(UUID, UpdateRunRequest) - Method in class dev.dokimos.server.service.RunService
UpdateRunRequest - Record Class in dev.dokimos.server.dto.v1
UpdateRunRequest(RunStatus) - Constructor for record class dev.dokimos.server.dto.v1.UpdateRunRequest: Creates an instance of a UpdateRunRequest record class.
user(String) - Static method in record class dev.dokimos.core.conversation.Message: Creates a user message.
USER - Enum constant in enum class dev.dokimos.core.conversation.Message.Role: A message from the user.
userMessage(String) - Method in class dev.dokimos.core.conversation.ConversationTrajectory.Builder: Adds a user message to the trajectory.
userMessages() - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Returns only the user messages from the conversation.
UserPersonas - Class in dev.dokimos.core.conversation: Factory for creating pre-built simulated user personas.
userSatisfaction() - Static method in class dev.dokimos.core.conversation.TrajectoryEvaluationCriteria: Creates a criterion for evaluating user satisfaction.
Using Spring AI ChatClient as a Judge - Search tag in class dev.dokimos.springai.SpringAiSupport: Section

V

value() - Element in annotation interface dev.dokimos.junit.DatasetSource: URI of the dataset to load.
valueOf(String) - Static method in enum class dev.dokimos.core.conversation.AggregationStrategy: Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.conversation.Message.Role: Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.EvalTestCaseParam: Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode: Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.core.RunStatus: Returns the enum constant of this class with the specified name.
valueOf(String) - Static method in enum class dev.dokimos.server.entity.RunStatus: Returns the enum constant of this class with the specified name.
values() - Static method in enum class dev.dokimos.core.conversation.AggregationStrategy: Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.conversation.Message.Role: Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.EvalTestCaseParam: Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.evaluators.agents.ToolCorrectnessEvaluator.MatchMode: Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.core.RunStatus: Returns an array containing the constants of this enum class, in the order they are declared.
values() - Static method in enum class dev.dokimos.server.entity.RunStatus: Returns an array containing the constants of this enum class, in the order they are declared.

W

weight() - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Returns the value of the weight record component.
WEIGHTED_MEAN - Enum constant in enum class dev.dokimos.core.conversation.AggregationStrategy: Weighted mean based on criterion weights.
withMessage(Message) - Method in record class dev.dokimos.core.conversation.ConversationTrajectory: Creates a new trajectory with an additional message appended.
withWeight(double) - Method in record class dev.dokimos.core.conversation.EvaluationCriterion: Creates a new criterion with a different weight.

A B C D E F G H I J L M N O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form