Skip to content

datarobot_genai.dragent.eval.task_adherence

task_adherence

nat eval plugin: in-process task adherence (DataRobot moderations DeepEval scorer).

DataRobotTaskAdherenceEvaluatorConfig

Bases: EvaluatorLLMConfig

Task adherence evaluator using the DataRobot moderations DeepEval judge.

Source code in datarobot_genai/dragent/eval/task_adherence.py 
36
37
class DataRobotTaskAdherenceEvaluatorConfig(EvaluatorLLMConfig, name="task_adherence"):  # type: ignore[call-arg]
    """Task adherence evaluator using the DataRobot moderations DeepEval judge."""