Config
Configuration schemas for gllm-inference.
TruncationConfig
Bases: BaseModel
Configuration for text truncation behavior.
Attributes:
| Name | Type | Description |
|---|---|---|
max_length |
int
|
Maximum length of text content. Required. |
truncate_side |
TruncateSide | None
|
Side to truncate from when max_length is exceeded. 1. TruncateSide.RIGHT: Keep the beginning of the text, truncate from the end (default) 2. TruncateSide.LEFT: Keep the end of the text, truncate from the beginning If None, defaults to TruncateSide.RIGHT |