weight
/ˈweɪt/
a learnable parameter that determines connection strength in a network
weight in a sentence
“Training adjusts weights to minimize prediction errors.”
Origin of weight
Old English gewiht (heaviness)
Related Words
activation
the output of a neuron after applying a non-linear function
gradient
the direction and rate of steepest increase of a function
inference
using a trained model to make predictions on new data
fine-tuning
adapting a pre-trained model for a specific task
context window
the maximum amount of text a model can process at once
softmax
a function converting raw scores into a probability distribution