DFlash makes Qwen3.6 27B 2.2x faster with no quality loss
We ran the same Qwen3.6-27B locally three ways on one RTX 6000: baseline, MTP, DFlash. The tasks were: quicksort, write a Steam library in JSON, solve…
Latest
Kimi K3 Release Video [Made with Kimi K3]
Everyone's probably seen the remotion thing that went viral a couple months back with CC. Its basically that with Kimi K3 as the model provider. Prev.…
Kimi K3 Blogpost
submitted by /u/Charuru [link] [comments]
Kimi K3 Benchmarks
submitted by /u/WhyLifeIs4 [link] [comments]
OpenLLM-France/Luciole-23B-Instruct-1.1 (Apache 2.0 license, 8B and 1B also available)
Luciole-23B-Instruct-1.1 is a fine-tuned and aligned version of Luciole-23B-Base, an open-source, multilingual causal language model created by OpenLLM-France. Luciole-23B-Instruct-1.1 was developed by LINAGORA and the OpenLLM-Franceconsortium…
Kimi k3 is 2.8t! Will need to have an aggressive iQ2_XXS or IQ1.8!
I was hopping that Kimi would be 2t, but nope is huge @ 2.8t!! (tears falling) That will make it more difficult to run decently. I…
To KL Diverge, or Not to KL Diverge: A Question for Quants
Hey r/LocalLLaMA! Apparently, if you draw enough arrows between proxy rankings like KLD, perplexity, and BPW, and real deployment measurements, quantization evaluation starts to look like…
Kimi K3 API Pricing
https://platform.kimi.ai/docs/guide/kimi-k3-quickstart submitted by /u/WhyLifeIs4 [link] [comments]
Q2 DeepSeek V4 Flash on 2x 3080 20GB, 64GB DDR5 | 17 tk/s gen, 270 tk/s prefill
Hey, it's my first time posting here and I thought I'd share my progress on getting Antirez's imatrix Q2 DeepSeek V4 Flash GGUF (86.7 GB) running…
LL·Mirror: C++ tool for Jacobian lens
Someone had shared similar tools. Here is one in C++. I have been thinking of this "ocean" graph for a long time. Yes, it is useless,…