distillation

Training a smaller model to mimic a larger one

“Model distillation created a faster version suitable for mobile devices.”

Etymology — From Latin `distillare` (to drip down), from `de-` (down) + `stillare` (to drip)