SamplerChain.dry

Adds DRY (Don't Repeat Yourself) sampling. seqBreakers lists token strings that reset the repetition check (e.g. ["\n"]). Pass seqBreakers = [] to use no breakers.

struct SamplerChain

ref @trusted return

SamplerChain

dry

(

const(llama_vocab)* vocab

int nCtxTrain

float multiplier = 0.0f

float base = 1.75f

int allowedLength = 2

int penaltyLastN = -1

string[] seqBreakers = []

)

SamplerChain.dry

Meta

Source