Module llm

Structs

LlmRequest

Minimal request structure passed to a language model.

LlmResponse

Enums

StreamChunk

A chunk of streaming response from the LLM

Traits

LanguageModel

Type Aliases

ChunkStream

Type alias for a pinned boxed stream of chunks