Gllm Generation

This documentation covers the Gllm Generation library, which is part of the GLLM Monorepo.

API Reference

The following modules are available in this library:

• Compressor: Modules used to compress prompt components.
• Context Enricher: Modules concerning the context enrichers used in Gen AI applications.
• Reference Formatter: Modules concerning the reference formatters used in Gen AI applications.
• Relevance Filter: Modules used to filter chunks based on its relevance to a given query.
• Repacker: Modules for repacking, a process of incorporating retrieved chunks into a prompt as context.
• Response Synthesizer: Modules concerning the response synthesizers used in Gen AI applications.