top-k sampling
/ˌtɒp ˈkeɪ ˌsæmplɪŋ/
Limiting word choices to the k most likely options
top-k sampling in a sentence
“Top-k sampling prevents the model from choosing unlikely tokens.”
Origin of top-k sampling
Modern English compound; top (highest) + k (mathematical variable) + sample from Latin exemplum
Related Words
chain of thought
Prompting technique that encourages step-by-step reasoning
retrieval augmented generation
Combining search results with generative AI for grounded responses
multimodal
AI capable of processing multiple types of input like text and images
zero-shot learning
Performing tasks without any task-specific training examples
few-shot learning
Learning from just a handful of examples
in-context learning
Learning patterns from examples provided in the prompt