Skip to content

Gllm Inference

A library containing components related to model inferences in Gen AI applications.

API Reference

The following modules are available in this library:

  • Builder: Modules concerning the builder utilities of GLLM Inference modules.
  • Catalog: Modules concerning the catalog to manage and load prompt builders used in Gen AI applications.
  • Constants: Contains constants used throughout the gllm_inference package.
  • Em Invoker: Modules concerning the embedding model invokers used in Gen AI applications.
  • Exceptions: Provides custom exception classes, error handling and parsing utilities.
  • Lm Invoker: Modules concerning the language model invokers used in Gen AI applications.
  • Multimodal Em Invoker: Modules concerning the multimodal embedding model invokers used in Gen AI applications.
  • Multimodal Lm Invoker: Modules concerning the multimodal language model invokers used in Gen AI applications.
  • Multimodal Prompt Builder: Modules concerning the prompt builders used in multimodal Gen AI applications.
  • Output Parser: Modules concerning the output parsers used in Gen AI applications.
  • Prompt Builder: Modules concerning the prompt builders used in Gen AI applications.
  • Prompt Formatter: Modules concerning the prompt formatters used in Gen AI applications.
  • Request Processor: Modules concerning the request processor modules to perform model inferences in Gen AI applications.
  • Schema: Modules concerning the schema of GLLM Inference modules.
  • Utils: Defines utilities for gllm_inference.