distillation

distillation

/ˌdɪstəˈɫeɪʃən/

Generative AI

Training a smaller model to mimic a larger one

Model distillation created a faster version suitable for mobile devices.

Origin: From Latin distillare (to drip down), from de- (down) + stillare (to drip)