Quantization

post-image
January 9, 2026 · 8 min read
Quantizing SLMs to 4-Bit with GGUF Without Wrecking Accuracy
post-image
January 13, 2025 · 10 min read
llama.cpp Deep Dive, Quantization, GGUF, and Inference Speed