Gllm Evals

This documentation covers the Gllm Evals library, which is part of the GLLM Monorepo.

API Reference

The following modules are available in this library:

• Constant: Constants for the gllm_evals package.
• Constants
• Dataset: Dataset init file.
• Evaluate: Evaluate Module.
• Evaluator: Evaluator init file.
• Experiment Tracker: Experiment tracker init file.
• Judge: Judge module for multiple LLM evaluation and ensemble calculation.
• Metrics: Metrics module.
• Prompts
• Runner: Init file for the Runner module.
• Simple Runner: Runner class for evaluating datasets.
• Types: Types for the evaluator.
• Utils