Package dev.dokimos.server.judge

Class JudgeScorer

java.lang.Object

dev.dokimos.server.judge.JudgeScorer

public final class JudgeScorer
extends Object

Drives a single judge scoring: builds the prompt from a criteria and the selected parameters, calls the underlying JudgeLM, and parses the response. A failed parse yields a non-successful outcome with the failure reason rather than throwing; an HTTP failure propagates as a JudgeCallException so the worker can apply retry logic.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final record	JudgeScorer.ScoreOutcome	The result of scoring one item: a numeric score, the judge's reasoning, and the pass decision.

Constructor Summary

Constructors

Constructor	Description
JudgeScorer(JudgeLM judge, String criteria, List<EvalTestCaseParam> params, double minScore, double maxScore, Double threshold)

Method Summary

Modifier and Type	Method	Description
JudgeScorer.ScoreOutcome	score(String input, String expectedOutput, String actualOutput)	Scores one item.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

JudgeScorer

public JudgeScorer(JudgeLM judge,
 String criteria,
 List<EvalTestCaseParam> params,
 double minScore,
 double maxScore,
 Double threshold)

Method Details

score

public JudgeScorer.ScoreOutcome score(String input,
 String expectedOutput,
 String actualOutput)

Scores one item.

Parameters:

input - the rendered input value

expectedOutput - the rendered expected output value

actualOutput - the rendered actual output value

Returns:

the score, reason, and pass/fail decision

Throws:

JudgeCallException - if the underlying judge call fails