Quantization

What Ternary Weights Taught Me About Why Models Hallucinate The C64 Runs a Transformer and You're Still Paying $25/Million Tokens