r/LocalLLaMA
· Communities
[llama.cpp PR #26608] Ling-3.0 support (unmerged)
aetherbird has done some great work getting Ling-3.0 to work in llama.cpp. The architecture is generally identical to deepseekv2. I recently added a microscopic 40 line PR to his that adds support for the Tiny model, works great. Using it for home assistant voice with decent results. It has a very solid tendency to adm