foundation model
/faʊnˈdeɪʃən ˌmɒdəl/
A large model trained on broad data that can be adapted to many tasks
foundation model in a sentence
“Foundation models serve as the base for numerous downstream applications.”
Origin of foundation model
From Latin fundatio (bottom, foundation), from fundare (to lay the bottom, establish)
Related Words
context window
The amount of text a model can consider at once
temperature
A parameter controlling randomness in AI outputs
top-k sampling
Limiting word choices to the k most likely options
chain of thought
Prompting technique that encourages step-by-step reasoning
retrieval augmented generation
Combining search results with generative AI for grounded responses
multimodal
AI capable of processing multiple types of input like text and images