batchAdd

Append one token to a pre-allocated batch (created via allocBatch).

@trusted @nogc nothrow

void

batchAdd

(

ref llama_batch batch

,

llama_token id

,

llama_pos pos

,

llama_seq_id seqId

,

)

Parameters

batch llama_batch: target batch; must have been allocated with allocBatch
id llama_token: token id
pos llama_pos: position in the sequence
seqId llama_seq_id: sequence this token belongs to
logits bool: request logit output for this position

Meta

Source

See Implementation

llama batch functions

structs

OwnedBatch