emergent ability
/ɪˈmɜːrdʒənt əˌbɪlɪti/
capabilities that suddenly appear at certain model scales without being explicitly trained
emergent ability in a sentence
“Chain-of-thought reasoning emerged only in models above a certain size.”
Origin of emergent ability
Latin emergere to rise out + ability
Related Words
in-context learning
learning to perform new tasks from examples provided in the prompt without weight updates
transfer learning
applying knowledge learned from one task to perform better on different tasks
multimodal
capable of processing multiple types of input like text, images, and audio
reasoning
the ability to draw conclusions through logical steps from given information
world model
an internal representation of how the world works used for prediction and planning
compositionality
building complex meanings from combinations of simpler parts