Gllm Training

This documentation covers the Gllm Training library, which is part of the GLLM Monorepo.

API Reference

The following modules are available in this library:

• Cloud Storage: Cloud storage module for GLLM training.
• Config: Configuration module for GLLM training.
• Constants: Contains all constants used throughout the gllm_training package.
• Data Loader: Module for data loading and handling.
• Preprocessor: Preprocessor module for data preprocessing and template processing.
• Schema: Schema package for gllm_training.
• Sft Trainer: SFT trainer package for fine-tuning language models.
• Utils