b9936
server : respect min-step when splitting prompt batches (#25420) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
Infrastructure 950 stories
b9935
hexagon: add VISION RoPE support (#25216) hexagon: add VISION RoPE support hexagon: support RoPE on strided half-dim views for all modes hex-rope: decouple src0 DMA copy…
b9934
ggml-webgpu: tune subgroup split (d_split) in flash_attn_vec (#25418) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux:…
Ollama: all aboard open models
Serving 8.9 million developers, Ollama has raised $88M from Benchmark, Theory Ventures, 8VC, and many incredible angel investors.
b9933
opencl: Q6_K GEMM/GEMV fix for ne01 of weights that are not multiples of 128. (#25464) opencl: fix garbled output for Q6_K weights with ne01 % 128…
b9932
vulkan: disable FA mask_opt on GCN to improve performance (#24362) vulkan: disable FA mask_opt on GCN to improve performance reenable mask opt over attention head size…
b9931
opencl: ragged-tile MoE prefill FP16 GEMM optimization (skip padded expert tiles) (#25433) opencl: ragged-tile MoE prefill GEMM (skip padded expert tiles) The MoE prefill GEMM groups…
Enterprise-managed OpenTelemetry export for VS Code and CLI
Organizations can now mandate where GitHub Copilot sends OpenTelemetry (OTel) data, so telemetry flows to an approved collector without each developer setting OTEL_* environment variables. The…
Deploy managed Copilot settings via MDM in VS Code and CLI
Enterprise administrators can now deliver managed GitHub Copilot settings directly to devices through native mobile device management (MDM) and file-based configuration, in addition to the existing…
b9930
llama-batch: fix allowed decreasing pos in a seq (#25449) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
b9929
vulkan: for small AMD GPUs, reduce submission threshold based on CU count (#25240) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS…
b9928
hexagon: new vtcm layouts and improved pipelines for MUL_MAT, MUL_MAT_ID and FLASH_ATTN_EXT (#25425) hex-fa: refactor kernel param compute to use common layout builder hmx: add explicit…
b9927
cli : move to HTTP-based implementation (#24948) cli: move to HTTP-based implementation wip working remote server ok cli support router mode Co-authored-by: Piotr Wilkin ilintar@gmail.com case:…
GitHub Copilot in Visual Studio Code, June 2026 releases
This changelog covers VS Code v1.123 through v1.127, shipped throughout June and early July 2026. The latest VS Code releases build on the Copilot experience developers…
b9925
cuda : add support for f16->f16 GGML_OP_SET_ROWS (#25367) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux:…
b9924
llama: refactor fused ops (#24646) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU)…
Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72
Presto is an open source, distributed SQL engine for running fast, interactive queries on very large datasets. On NVIDIA GPUs, Presto delivers peak performance...
b9923
server-stream: follow-up on SSE Replay Buffer (#23226) (#25047) server-stream : pimpl server-stream: prefix free functions with server_stream_ address review from ggerganov: scope the public stream functions…
NVIDIA Nemotron Achieves Benchmark-Leading Performance With LangChain Deep Agents Harness
NVIDIA Nemotron 3 Ultra is offering leading performance at lower cost than top closed models with the largest and most widely adopted AI agent orchestration platform.…
Create a LangChain Deep Agents Harness Profile for NVIDIA Nemotron 3 Ultra to Improve Performance
Agentic systems often face a trade-off between accuracy and cost. The highest-performing proprietary frontier models and harnesses provide top accuracy but are...
b9922
llama-batch: add n_keep_tail in split_equal for recurrent models (#25278) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework…
b9918
metal : add set_rows with src0 f16 (#25434) Co-authored-by: Georgi Gerganov ggerganov@gmail.com macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel…
b9916
ggml : fix A indexing in simd_gemm scalar tail-column path (#25390) simd_gemm() has an incorrect A-matrix index in the scalar tail-column path for full row blocks.…
b9915
ggml : add support for CPU f16->f16 GGML_OP_SET_ROWS (#25344) ggml : add support for CPU f16->f16 GGML_OP_SET_ROWS ggml : add missing type checks in f16 GGML_OP_SET_ROWS…