50% of my networth
Help submitted by /u/one-escape-left [link] [comments]
Latest
Why does preserve thinking flag exist?
Isn't it something that the harness should manage? Why bake it into the lower levels? I'm talking about Qwen3.6 27B submitted by /u/Glad_Claim_6287 [link] [comments]
Best direction forward from 4080
I currently am running a solo 4080 for local models such as Qwen3.6 35B, Gemma and stuff like that. However, the VRAM is super limiting. Would…
Hermes Agent with local LLMs
Hey all, I have a 4090 + 5060ti setup with 64gb ram. I have been using opencode with MiMoV2 pro and its great but I don't…
My Frankenbox: I mounted 3 GPUs in and on-top of my case only fits only one GPU. 9070xt + 1080 ti + 5700xt
...I have no explanation why I did this, I don't even use my Local AI 🤷🏽♂️. But I did a lot of 3d printing to get…
I just don’t get it. These big tech companies can illegally scrape the entire internet and gatekeep their better models behind higher prices. So it’s natural that people look for affordable options, and there will be providers who apparently distill models from them.
The irony? They cry existential threat when they were the ones who made us feel that way first. submitted by /u/Blue-Sea2255 [link] [comments]
Molt — a ~9K-line, PyTorch-native RL framework for agentic post-training that scales to hundred-B MoE
TL;DR — We built Molt, an agentic-first, PyTorch-native RL post-training framework. It's about 9K lines of core RL code you can actually read end to end,…
CPTR is wonderful! open-webui/computer: Your Computer. Anywhere.
submitted by /u/6jarjar6 [link] [comments]
model: add Hy3 (hy_v3) support with MTP speculative decoding by satindergrewal · Pull Request #25395 · ggml-org/llama.cpp
Adds support for Tencent's Hy3 (hy_v3 / HYV3ForCausalLM, 299B MoE, 80 layers + 1 MTP layer), including its multi-token-prediction head as a draft-mtp speculative target. submitted…
Why aren’t any American open-source AI labs even close to Chinese ones on benchmarks yet?
I know there are a few american labs working on open-source AI but none of them show up in the benchmarks like Chinese open source does,…