llama.model

Undocumented in source.

Members

Functions

modelParams llama_model_params modelParams(int nGpuLayers): Default model params with nGpuLayers GPU layers.

Structs

LlamaModel struct LlamaModel: A loaded llama model that frees itself on destruction.

Meta

Source

See Source File

llama modules