MtmdContext.tokenize

Tokenise a prompt string that contains mtmd_default_marker() placeholders. bitmaps must have exactly as many entries as markers in text.text. Returns 0 on success, 1 on count mismatch, 2 on preprocessing error.

struct MtmdContext
@trusted @nogc nothrow
int
tokenize
(,,
const(mtmd_bitmap*)[] bitmaps = null
)

Meta