transformer
/tɹænsˈfɔɹmɝ/
A neural network architecture using self-attention mechanisms
transformer in a sentence
“Transformer models like GPT have transformed natural language processing.”
Origin of transformer
From Latin trans- (across) + formare (to form); transforms input sequences to output
Related Words
embedding
A dense vector representation of data in continuous space
fine-tuning
Adapting a pre-trained model for a specific task
inference
Using a trained model to make predictions on new data
hallucination
When an AI generates false or fabricated information
prompt engineering
Crafting inputs to elicit desired outputs from AI models
tokenization
Breaking text into smaller units for processing