I built Encode Bench, an open benchmark that asks a model to solve a task and return the answer as a Base64 payload. The initial result…
https://github.com/ggml-org/llama.cpp/releases/tag/b10087 submitted by /u/LaurentPayot [link] [comments]
Today, we're sharing the recipe behind the new tokenizer in LFM2.5-8B-A1B. It upgrades a pre-trained model's tokenizer in place, without retraining from scratch. We doubled the…
From Peter Gostev on 𝕏: https://x.com/petergostev/status/2079825961718046974 submitted by /u/Nunki08 [link] [comments]
Solar Open 2 is Upstage’s 250B-A15B open-weight large language model, built for agentic use cases such as office productivity, document-intensive work, and coding. Its Hybrid-Attention Mixture-of-Experts…
Benchmark Solar Open 2 250B-A15B Solar Open 100B 102B-A12B Command A+ 218B-A25B Mistral Medium 3.5 128B dense, high MiMo-V2.5 310B-A15B DeepSeek-V4-Flash 284B-A13B, max Know. & Reasoning…
Those who have tested the new Laguna model might have noticed how reluctant it is to think through medium-hard questions, and it does impact the output…
https://huggingface.co/poolside/Laguna-XS.2 Laguna XS.2 is a 33B total parameter Mixture-of-Experts model with 3B activated parameters per token designed for agentic coding and long-horizon work on a local…
this strategy effectively uses vram as cache over disk to keep MoE experts on cuda compute path in llama.cpp. numbers first. detailed explanation down below. Numbers…
Laguna is the first model I'm trying, Q4_K_M fits with 256K context @ F16. Doing the html flight simulator test now. These cards are getting 400…