self-supervised learning

self-supervised learning

/ˌself ˌsuːpərˌvaɪzd ˈlɜːrnɪŋ/

🎓 LLM Training

training where labels are derived from the data itself, like predicting masked words

Self-supervised learning on next-token prediction requires no human labeling.

Origin: Greek auto- self + Latin super- over + videre to see