Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
Latest
Do text embeddings perfectly encode text?
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Unlocking the 3rd Dimension for Generative AI (Part 1)
It would be an understatement to say that generative AI has been taking the world by storm over the past couple of years. While text (1D)…
The Foundation Model Development Cheatsheet
Announcing a new resource, the FM Dev Cheatsheet.
Predictive Human Preference: From Model Ranking to Model Routing
A challenge of building AI applications is choosing which model to use. What if we don’t have to? What if we can predict the best model…
Querying a network of knowledge with llama-index-networks
The new llama-index extension package enables rapid creations of networks of RAG systems. Data suppliers can build powerful RAGs over their data and expose it behind…
LlamaIndex Newsletter 2024–02–27
This week’s llama is cool enough to wear shades for reading.Yo, LlamaIndex Fans 🦙,Dive into a week brimming with thrilling developments at LlamaIndex! The dynamic input…
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good…
Bridging the Gap in Crisis Counseling: Introducing Counselor Copilot
Co-authored by: Riya Jagetia, Tarun Malik, Divija N, Sharon Tan, Zehra Rizvi, Amanda PiyapaneeAt the recent LlamaIndex RAG-a-thon [1], our team’s “Counselor Copilot” won 2nd prize…
LlamaIndex Newsletter 2024–02–20: introducing LlamaCloud
Hi there, LlamaIndex Enthusiasts 🦙,Today marks a milestone for the LlamaIndex ecosystem with the introduction of LlamaCloud, a next-generation suite of managed parsing, ingestion, and retrieval…
Introducing LlamaCloud and LlamaParse
Today is a big day for the LlamaIndex ecosystem: we are announcing LlamaCloud, a new generation of managed parsing, ingestion, and retrieval services, designed to bring…
MultiModal RAG for Advanced Video Processing with LlamaIndex & LanceDB
The widespread consumption of videos on platforms like YouTube, Instagram, and others highlights the importance of efficiently processing and analyzing video content. This capability unlocks vast…
Pioneering the Future of Housing: Introducing GenAI-Driven ADU Planning
ADU Planner in actionIn the midst of a pressing housing shortage, the American dream of homeownership is being reimagined through the innovative concept of Accessory Dwelling…
LlamaIndex Newsletter 2023–02–13
They are keeping the newsletter afloat through telekinesisGreetings, LlamaIndex Adventurers 🦙,Welcome to an exhilarating week of discoveries at LlamaIndex! Our community’s lively input and the abundance…
LlamaIndex v0.10
Today we’re excited to launch LlamaIndex v0.10.0. It is by far the biggest update to our Python package to date (see this gargantuan PR), and it…
Thinking about High-Quality Human Data
[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data…
Generation configurations: temperature, top-k, top-p, and test time compute
ML models are probabilistic. Imagine that you want to know what’s the best cuisine in the world. If you ask someone this question twice, a minute…
Deep learning for single-cell sequencing: a microscope to see the diversity of cells
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell sequencing technologies.
Least-Squares Concept Erasure with Oracle Concept Labels
Achieving even more surgical edits than LEACE when we have concept labels at inference time.
Salmon in the Loop
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
Diff-in-Means Concept Editing is Worst-Case Optimal
Explaining a result by Sam Marks and Max Tegmark
The third New England RLHF Hackers Hackathon
Introduction At the third New England RLHF Hackathon, several interesting projects were showcased, each focusing on different aspects of machine learning and reinforcement learning. Participants and…
Adversarial Attacks on LLMs
The use of large language models in the real world has strongly accelerated by the launch of ChatGPT. We (including my team at OpenAI, shoutout to…
Neural algorithmic reasoning
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures…