Skip to content

Evaluator

Base class for all evaluators.

Authors

Surya Mahadi (made.r.s.mahadi@gdplabs.id)

References

NONE

BaseEvaluator(name)

Bases: ABC

Base class for all evaluators.

Attributes:

Name Type Description
name str

The name of the evaluator.

Initialize the evaluator.

Parameters:

Name Type Description Default
name str

The name of the evaluator.

required

evaluate(data) async

Evaluate the data.

Parameters:

Name Type Description Default
data MetricInput

The data to be evaluated.

required

Returns:

Name Type Description
EvaluateOutput EvaluationOutput

The evaluation output.