nucleus sampling
/ˈnjuːkliəs ˌsæmplɪŋ/
sampling from tokens comprising the top cumulative probability mass (top-p)
“Nucleus sampling with p=0.95 adapts vocabulary size to context certainty.”
Origin: Latin nucleus kernel from nux nut
/ˈnjuːkliəs ˌsæmplɪŋ/
sampling from tokens comprising the top cumulative probability mass (top-p)
“Nucleus sampling with p=0.95 adapts vocabulary size to context certainty.”
Origin: Latin nucleus kernel from nux nut