
distillation
/ˌdɪstəˈɫeɪʃən/
Training a smaller model to mimic a larger one
“Model distillation created a faster version suitable for mobile devices.”
Origin: From Latin distillare (to drip down), from de- (down) + stillare (to drip)

/ˌdɪstəˈɫeɪʃən/
Training a smaller model to mimic a larger one
“Model distillation created a faster version suitable for mobile devices.”
Origin: From Latin distillare (to drip down), from de- (down) + stillare (to drip)