Package dev.dokimos.core.evaluators.agents

Class PlanQualityEvaluator.Builder

java.lang.Object
dev.dokimos.core.evaluators.agents.PlanQualityEvaluator.Builder
Enclosing class:
PlanQualityEvaluator
public static class PlanQualityEvaluator.Builder extends Object
Builder for constructing the evaluator.

  • Constructor Details

    • Builder

      public Builder()

  • Method Details

    • name

      public PlanQualityEvaluator.Builder name(String name)
      Sets the evaluator name.
      Parameters:
      name - the evaluator name
      Returns:
      this builder

    • threshold

      public PlanQualityEvaluator.Builder threshold(double threshold)
      Sets the minimum score threshold for success.
      Parameters:
      threshold - the threshold value
      Returns:
      this builder

    • evaluationParams

      public PlanQualityEvaluator.Builder evaluationParams(List<EvalTestCaseParam> params)
      Sets which test case parameters to validate.
      Parameters:
      params - the parameters
      Returns:
      this builder

    • reasoningStepsKey

      public PlanQualityEvaluator.Builder reasoningStepsKey(String reasoningStepsKey)
      Sets the actualOutputs key for the plan (reasoning steps).
      Parameters:
      reasoningStepsKey - the key
      Returns:
      this builder

    • judge

      public PlanQualityEvaluator.Builder judge(JudgeLM judge)
      Sets an optional judge LLM for the coherence check. Without a judge, only the rule-based non_empty_reasoning check runs.
      Parameters:
      judge - the judge LLM
      Returns:
      this builder

    • build

      public PlanQualityEvaluator build()
      Builds the evaluator.
      Returns:
      a new evaluator