Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint

My comment on Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint — Hacker News.If you want to try out out the GGUFs from https://huggingface.co/prism-ml/Ternary-Bonsai-2-27B-gguf#th... be aware that you need Prism's llama.cpp fork to get them to work, from https://github.com/PrismML-Eng/llama.cpp/releases/tag/prism-... This should work: cd /tmp # Get the Prism macOS runtime curl -fL…