r/LocalLLaMA
· Communities
Kimi K3 (Unsloth) IQ2-XXS from 711GB down to 478GB!!! Only Multi-language was removed to trim the size
Firstly a big thanks to the poster hellohazine, he basically only removed the multi-lingual fat of the model and just kept the english language intact. It is the exact model, and the rest of the model still intact and keeping high intelligence. I think that was a brilliant move, and more of these approaches should be m