gradient
/ˈɡɹeɪdiənt/
the direction and rate of steepest increase of a function
gradient in a sentence
“Backpropagation computes gradients to update weights.”
Origin of gradient
Latin gradiens (stepping)
Related Words
inference
using a trained model to make predictions on new data
fine-tuning
adapting a pre-trained model for a specific task
context window
the maximum amount of text a model can process at once
softmax
a function converting raw scores into a probability distribution
transformer
a neural network architecture using self-attention for sequence processing
embedding
a dense vector representation of discrete items like words