Skip to content

Infrastructure 949 stories

GitHub Copilot changelog Infrastructure

Enterprise-managed settings now support strictKnownMarketplaces in VS Code and GitHub Copilot CLI

Enterprises can now control which plugins their users can install in GitHub Copilot CLI and VS Code. This setting is now available in public preview. Add…

NVIDIA Developer Infrastructure

Scaling AI Inference Across Multiple GPUs Using NVIDIA TensorRT with Multi-Device Inference Support

Generative AI workloads are rapidly outgrowing the memory and compute budget of single GPUs. For inference developers building media generation pipelines, the...

NVIDIA Developer Infrastructure

How KRAFTON Built PUBG Ally, a Co-Playable Character Powered by NVIDIA ACE

AI companions in games have long been constrained by scripted behavior trees and fixed dialogue. PUBG Ally is a different kind of system. Built by KRAFTON…

NVIDIA Blog Infrastructure

The Ultimate Summer Sale Pairing: Steam Sale Meets GeForce NOW Discounts

Summer savings are heating up. From the Steam Summer Sale to GeForce NOW membership discounts, this week’s GFN Thursday delivers double the deals and more ways…

Cursor Infrastructure

Reward hacking is swamping model intelligence gains

On SWE-bench Pro, 63% of successful Opus 4.8 Max resolutions retrieved the fix rather than derived it. Stricter eval harnesses show how benchmark scores can conflate…

llama.cpp releases Infrastructure

b9789

quant : fix quantizing moe with mtp (#24986) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux:…

llama.cpp releases Infrastructure

b9788

sycl : support --split-mode tensor (#24152) Sycl tp stage1 (#1) SYCL: tensor parallelism (--split-mode tensor) for dual-GPU Adds the comm_init/comm_free/comm_allreduce_tensor trio that the meta-backend queries via…

llama.cpp releases Infrastructure

b9787

sycl : fix the failed UT cases of conv_3d (#24900) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS…

llama.cpp releases Infrastructure

b9786

opencl: support non-contig rows in norm (#24965) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu…

llama.cpp releases Infrastructure

b9785

chat: harden caps check (#24973) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU)…

llama.cpp releases Infrastructure

b9785

chat: harden caps check (#24973) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU)…

Weaviate Infrastructure

Weaviate 1.38 Release

This release brings the HFresh disk-based vector index and the built-in MCP Server to general availability, rebuilds cluster-wide async replication to run from a single scheduler…

GitHub Copilot changelog Infrastructure

GitHub Copilot for Jira is now generally available

GitHub Copilot for Jira is now generally available. Since launching the public preview in March 2026, we have shipped a series of enhancements based on your…

llama.cpp releases Infrastructure

b9784

hexagon: MUL_MAT and MUL_MAT_ID rework : 32x32 tiled weight repack, kernel-params, cached graphs (#24954) hex-mm: new weight layout and fusion updates hvx-mm: unroll the new tiled…

llama.cpp releases Infrastructure

b9782

common: remove unused json-partial (#24968) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU)…

NVIDIA Developer Infrastructure

Accelerating BEV Pooling on NVIDIA GPUs for Physical AI Applications

An increasingly common design pattern for autonomous vehicles (AVs), robotics, and spatial AI systems is bird's-eye-view (BEV) perception. BEV models project...

GitHub Copilot changelog Infrastructure

Changes to model selection for Free and Student plans

Copilot Free and Student plans will now use Copilot auto model selection as the default and only model selection experience. Auto dynamically selects the best model…

llama.cpp releases Infrastructure

b9781

vulkan: allow reducing the graph submission batches to avoid timeouts (#24872) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64)…

X · @huggingface Infrastructure

RT BitRobot 🦾: 1/ Introducing HIW-500 (Humanoids-in-the-Wild 500): the largest open-source humanoid teleop dataset collected in real homes Built w/…

RT BitRobot 🦾1/ Introducing HIW-500 (Humanoids-in-the-Wild 500):the largest open-source humanoid teleop dataset collected in real homesBuilt w/ @UnitreeRobotics @huggingface across 12 homes in Southeast Asia, it…

llama.cpp releases Infrastructure

b9780

vulkan: fail the build when a shader fails to compile (#24450) vulkan-shaders-gen: fail the build when a shader fails to compile vulkan-shaders-gen did not detect shader-compile…

llama.cpp releases Infrastructure

b9777

model : Add LFM2.5-ColBERT-350M and LFM2.5-Embedding-350M (#24913) model : Add LFM2.5-ColBERT-350M and LFM2.5-Embedding-350M Restore LFM2 models in README.md macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon…

llama.cpp releases Infrastructure

b9776

vulkan: Apply bias before softmax in FA, to avoid overflow (#24909) macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64)…

NVIDIA Blog Infrastructure

NVIDIA and AWS Collaborate to Bring AI to Production at Scale

Building AI systems at scale is demanding, requiring low-latency inference, fast vector search, strong GPU price-performance and infrastructure that can grow without multiplying operational complexity. NVIDIA’s…

X · @huggingface Infrastructure

RT clem 🤗: Shot a video this morning to announce a new collaboration with …

RT clem 🤗Shot a video this morning to announce a new collaboration with ...