beam search

beam search

/ˈbiːm ˌsɜːrtʃ/

LLM Inference

a search algorithm that explores multiple candidate sequences simultaneously

Beam search with width 5 tracks the five most promising response paths.

Origin: Old English bēam tree, ray of light + Old French cerchier to search