Skip to content

datarobot_genai.dragent.eval.faithfulness

faithfulness

nat eval plugin: in-process faithfulness (DataRobot moderations OOTB scorer).

DataRobotFaithfulnessEvaluatorConfig

Bases: EvaluatorLLMConfig

Faithfulness evaluator using the DataRobot moderations LlamaIndex judge.

Source code in datarobot_genai/dragent/eval/faithfulness.py 
36
37
class DataRobotFaithfulnessEvaluatorConfig(EvaluatorLLMConfig, name="faithfulness"):  # type: ignore[call-arg]
    """Faithfulness evaluator using the DataRobot moderations LlamaIndex judge."""