llama-cpp-d ~master (2026-03-20T18:06:26.5280947)
Dub
Repo
detokenize
llama
vocab
Decode a token sequence back into text.
@
trusted
string
detokenize
(
const
(
llama_vocab
)*
vocab
,
const
(
llama_token
)[]
tokens
,
bool
removeSpecial
= false
,
bool
unparseSpecial
= false
)
Meta
Source
See Implementation
llama
vocab
functions
bosToken
detokenize
eosToken
eotToken
fimMidToken
fimPadToken
fimPreToken
fimRepToken
fimSepToken
fimSufToken
isControl
isEog
nlToken
padToken
sepToken
tokenAttr
tokenScore
tokenText
tokenToString
tokenize
vocabType
Decode a token sequence back into text.