Evaluator
Base class for all evaluators.
References
NONE
BaseEvaluator(name)
Bases: ABC
Base class for all evaluators.
Attributes:
Name | Type | Description |
---|---|---|
name |
str
|
The name of the evaluator. |
Initialize the evaluator.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
name |
str
|
The name of the evaluator. |
required |
evaluate(data)
async
Evaluate the data.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
data |
MetricInput
|
The data to be evaluated. |
required |
Returns:
Name | Type | Description |
---|---|---|
EvaluateOutput |
EvaluationOutput
|
The evaluation output. |