quantization

quantization

/ˌkwɒntaɪˈzeɪʃən/

Generative AI

Reducing model precision to decrease size and increase speed

Quantization made the model run efficiently on consumer hardware.

Origin: From Latin quantus (how much) + -ization suffix; creating discrete quantities from continuous values