Quantization & distillation

Established

Shrinking models with low-bit quantization and distillation to cut inference cost while holding quality.

Trend score: 50

Trend over time

Monthly assigned-paper counts from arXiv (scored: trend_v1, confidence: High). History is still short, so scores are preliminary and sharpen over time.

Evidence papers — 50 most recent of 3590