Evaluate

Evaluate Module.

This module is used to evaluate the model using a convenience function.

Authors

Christina Alexandra (christina.alexandra@gdplabs.id)

References

NONE

evaluate(data, inference_fn, evaluators, experiment_tracker=None, batch_size=10, **kwargs) async

Evaluate the model.

Parameters:

Name	Type	Description	Default
data	str | BaseDataset	The data to evaluate.	required
inference_fn	Callable	The inference function to use.	required
evaluators	list[BaseEvaluator | BaseMetric]	The evaluators to use.	required
experiment_tracker	BaseExperimentTracker | None	The experiment tracker to use.	None
batch_size	int	The batch size to use for evaluation.	10
**kwargs	Any	Additional configuration parameters.	{}

Returns:

Type	Description
list[list[EvaluationOutput]]	list[list[EvaluationOutput]]: The evaluation results.