Now in Preview: Groq’s First Compound AI System
Now in Preview: Groq’s First Compound AI System
Infrastructure 333 stories
Llama 4 Inference Fast & Affordable – Now Live on GroqCloud
Llama 4 Inference Fast & Affordable – Now Live on GroqCloud
Build Fast with Text-to-Speech AI – Dialog Model on Groq
Build Fast with Text-to-Speech AI – Dialog Model on Groq
Alternative DeepSeek V3 providers
DeepSeek's API has been experiencing reliability issues. Here are alternative providers you can use.
R1+Sonnet set SOTA on aider’s polyglot benchmark
R1+Sonnet has set a new SOTA on the aider polyglot benchmark. At 14X less cost compared to o1.
Using uv as an installer
Reliably packaging & distributing python CLI tools is hard. Aider uses uv in novel ways to make it easy to install the aider CLI, its dependencies…
o1 tops aider’s new polyglot leaderboard
o1 scores the top result on aider's new multi-language, more challenging coding benchmark.
QwQ is a code architect, not an editor
QwQ is reasoning model like o1, and needs to be used as an architect with another model as editor.
Details matter with open source models
Open source LLMs are becoming very powerful, but pay attention to how you (or your provider) are serving the model. It can affect code editing skill.
Separating code reasoning and editing
An Architect model describes how to solve the coding problem, and an Editor model translates that into file edits. This Architect/Editor approach produces SOTA benchmark results.
o1-preview is SOTA on the aider leaderboard
Preliminary benchmark results for the new OpenAI o1 models.
Unlocking the 3rd Dimension for Generative AI (Part 1)
It would be an understatement to say that generative AI has been taking the world by storm over the past couple of years. While text (1D)…
Querying a network of knowledge with llama-index-networks
The new llama-index extension package enables rapid creations of networks of RAG systems. Data suppliers can build powerful RAGs over their data and expose it behind…
LlamaIndex Newsletter 2024–02–27
This week’s llama is cool enough to wear shades for reading.Yo, LlamaIndex Fans 🦙,Dive into a week brimming with thrilling developments at LlamaIndex! The dynamic input…
Bridging the Gap in Crisis Counseling: Introducing Counselor Copilot
Co-authored by: Riya Jagetia, Tarun Malik, Divija N, Sharon Tan, Zehra Rizvi, Amanda PiyapaneeAt the recent LlamaIndex RAG-a-thon [1], our team’s “Counselor Copilot” won 2nd prize…
LlamaIndex Newsletter 2024–02–20: introducing LlamaCloud
Hi there, LlamaIndex Enthusiasts 🦙,Today marks a milestone for the LlamaIndex ecosystem with the introduction of LlamaCloud, a next-generation suite of managed parsing, ingestion, and retrieval…
Introducing LlamaCloud and LlamaParse
Today is a big day for the LlamaIndex ecosystem: we are announcing LlamaCloud, a new generation of managed parsing, ingestion, and retrieval services, designed to bring…
MultiModal RAG for Advanced Video Processing with LlamaIndex & LanceDB
The widespread consumption of videos on platforms like YouTube, Instagram, and others highlights the importance of efficiently processing and analyzing video content. This capability unlocks vast…
Pioneering the Future of Housing: Introducing GenAI-Driven ADU Planning
ADU Planner in actionIn the midst of a pressing housing shortage, the American dream of homeownership is being reimagined through the innovative concept of Accessory Dwelling…
LlamaIndex Newsletter 2023–02–13
They are keeping the newsletter afloat through telekinesisGreetings, LlamaIndex Adventurers 🦙,Welcome to an exhilarating week of discoveries at LlamaIndex! Our community’s lively input and the abundance…
LlamaIndex v0.10
Today we’re excited to launch LlamaIndex v0.10.0. It is by far the biggest update to our Python package to date (see this gargantuan PR), and it…