r/LocalLLaMA
· Communities
Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels
Very impressive release by the PrismML team. 1-bit quantization shrinks it from 54GB to just 3.8GB (-93%), while retaining 90% of its intelligence. - Collection on Hugging Face: https://huggingface.co/collections/prism-ml/bonsai-27b - Demo link: https://huggingface.co/spaces/webml-community/bonsai-webgpu-kernels submit