TLDR: I trained Qwen3.5-4B and gemma-4-12b on self-distilled, compressed reasoning traces; compression was section-aware (compute and verification spans remain, fillers/narration/transitions get dropped/compressed). The models match or…
Standing on the shoulders of giants, I vibe-coded a port of Colibri to work with Hy3 so you can run it on even smaller hardware specs…
Just came across OvisOCR2, a new 0.8B end-to-end OCR model based on Qwen3.5-0.8B. https://preview.redd.it/adj3m8wu9zch1.png?width=5108&format=png&auto=webp&s=c4f14a0f7bfd6e1417fa8f476479db76498af51b It converts full document pages directly into structured Markdown, including text, tables,…
Hey everyone. Trying to figure out the best setup for my hardware. I've got a 64GB DDR5 RAM laptop and A 20GB 7900xt egpu. Usecase is…
I wanted to see if an LLM could run inside Godot without llama.cpp, Python, a server, or a GDExtension. It works. This Godot 4.7 project runs…
The startup, PrismML, said it has shrunk down Qwen 3.6, an open-source large language model developed by Chinese internet giant Alibaba, to run on an iPhone…
When JetBrains introduced Mellum 2, they advertised its latency being as low as Qwen2.5-Coder 7B. This was achieved via MTP. In the GGUFs they've published, I…
This weekend I got to what I consider a shareable state with this experiment to create little characters that can run commands to do funny things.…
submitted by /u/nullc [link] [comments]
I've been thinking, if Google really wanted to win this race they would embrace the open source, stop policing, enable training, create good ai not use,…