comparison_evaluator

langsmith.evaluation.evaluator.comparison_evaluator(

func: Callable[[Sequence[Run], Example | None], ComparisonEvaluationResult | dict | Awaitable[ComparisonEvaluationResult | dict]],

) → DynamicComparisonRunEvaluator

Create a comaprison evaluator from a function.

Parameters:

func (Callable[[Sequence[Run], Example | None], ComparisonEvaluationResult | dict | Awaitable[ComparisonEvaluationResult | dict]])

Return type:

DynamicComparisonRunEvaluator