llama.ctx

Undocumented in source.

Members

Functions

contextParams llama_context_params contextParams(uint nCtx, uint nBatch, bool noPerf): Context params with the given window and batch size. nCtx = 0 uses the model's training length.

Structs

LlamaContext struct LlamaContext: A llama_context that frees itself on destruction.

Meta

Source

See Source File

llama modules