catastrophic forgetting

catastrophic forgetting

/ˌkætəˈstrɒfɪk fərˈɡetɪŋ/

⚠️ LLM Failure Modes

losing previously learned capabilities when trained on new data

Fine-tuning on legal texts caused catastrophic forgetting of medical knowledge.

Origin: Greek katastrophē overturning + Old English forgiettan to lose from memory