backpropagation
/ˌbækˌprɒpəˈɡeɪʃən/
the algorithm for computing gradients by propagating errors backward through the network
backpropagation in a sentence
“Backpropagation calculates how each weight contributed to the prediction error.”
Origin of backpropagation
Latin back + propagare to extend, spread
Related Words
overfitting
when a model memorizes training data rather than learning generalizable patterns
regularization
techniques to prevent overfitting by constraining model complexity
pre-training
initial training on vast text data to learn language patterns before task-specific fine-tuning
fine-tuning
additional training on specific data to adapt a pre-trained model for particular tasks
RLHF
reinforcement learning from human feedback—training models using human preference judgments
supervised learning
training on labeled examples where correct outputs are provided