llama-cpp-d ~master (2026-03-20T18:06:26.5280947)
Dub
Repo
LlamaContext.fromModel
llama
ctx
LlamaContext
Create from a window size and batch size.
LlamaContext
fromModel
(LlamaModel model, llama_context_params params)
LlamaContext
fromModel
(LlamaModel model, uint nCtx, uint nBatch)
struct
LlamaContext
static @
nogc
nothrow
LlamaContext
fromModel
(
ref
LlamaModel
model
,
uint
nCtx
,
uint
nBatch
= 512
)
Meta
Source
See Implementation
llama
ctx
LlamaContext
functions
decode
encode
getEmbeddings
getEmbeddingsIth
getEmbeddingsSeq
getLogits
memoryClear
printPerf
stateGetData
stateGetSize
stateLoadFile
stateSaveFile
stateSeqGetData
stateSeqGetSize
stateSeqSetData
stateSetData
mixins
__anonymous
properties
memory
nCtx
poolingType
static functions
fromModel
Create from a window size and batch size.