r/LocalLLaMA
· Communities
Has anyone tried running PrismML Bonsai 27B yet?
It can only run the 1_0 quant in LM Studio. Only 3.8GB and runs on low-end hardware. Even a phone! https://prismml.com/news/bonsai-27b https://huggingface.co/prism-ml/Bonsai-27B-gguf 1 upvote submitted by /u/tony10000 [link] [comments]