https://infinite-joy.github.io Writing on LLM inference, ML systems, and deep learning. https://infinite-joy.github.io/blog/llm-inference-on-a-budget/ https://infinite-joy.github.io/blog/llm-inference-on-a-budget/ 2026-06-22 How to run large language models on consumer hardware using quantization, GGUF, and the right tooling choices.