NirDiamant/RAG_Techniques

★ 29,503⑂ 0

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

About NirDiamant/RAG_Techniques

NirDiamant/RAG_Techniques is an open-source project on GitHub, mainly written in Jupyter Notebook. This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial. It currently holds 29,503 stars and 0 forks with 0 open issues, and was last pushed on an unknown date (repository created unknown).

Project Overview

AI Homed tracks it on the AI Models & LLM Tools board.

GitHub Repository Details

Repository NirDiamant/RAG_Techniques · default branch - · size 0 KB · watchers 0 · source: GitHub REST API and repository README

README

Advanced RAG Techniques 🚀

Elevating Your Retrieval-Augmented Generation Systems

A community-driven hub of 42+ runnable notebooks covering RAG techniques from foundational to cutting-edge - the intuition, the code, and the references to build more accurate, context-rich retrieval systems.

---

PRs Welcome LinkedIn Twitter Reddit Discord Sponsor

🎓 From RAG prototypes to production

Prompt to Production - my full course on building software with AI the way professionals do: the methods and paradigms behind reliable, efficient, modular production systems, taught systematically. 17 modules, each pairing a video lecture with a hands-on lab, from your first structured prompt to a working production system.

The course is live. Every module is out, lecture and lab.

🎁 Try a full module, free

🎬
7-minute
video lecture
🛠️
Hands-on
tutorial
🤖
AI assistant
inside Claude Code

One npm install adds the module's AI assistant to your Claude Code, and it guides you through the tutorial as you build.

https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/Claim your free module

👉 Get the full course

Sponsors ❤️

We gratefully acknowledge the organizations and individuals who have made significant contributions to this project.

Company Sponsors

https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/Contextual AI https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/Contextual AI https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/CodeRabbit https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/CodeRabbit https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/Qodo

Individual Sponsors

https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/

📫 Stay Updated!

🚀
Cutting-edge
Updates
💡
Expert
Insights
🎯
Top 0.1%
Content

Subscribe to DiamantAI Newsletter

Join over 50,000 AI enthusiasts getting unique cutting-edge insights and free tutorials! Plus, subscribers get exclusive early access and special 33% discounts to my book and the upcoming RAG Techniques course!

DiamantAI's newsletter

🎬 Prefer video?

I break these ideas down into short, one-idea-per-episode explainers on YouTube.

https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/
🆕 AI Is Rewarded for Guessing [Hallucination]

why a model guesses instead of saying I don't know, watched on its own token probabilities, and where retrieval moves the fact out of the guess

https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/
RAG Explained: Why AI Gets Your Own Documents Wrong

why chunks overlap, what "meaning space" is, and where simple RAG breaks down
https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/
How Do You Search a Spreadsheet by Meaning?

turn each row into one labelled line and search the table by meaning
https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/
How Do You Know Your RAG Answer Isn't Made Up?

three checkpoints that catch a bad chunk on the way in and an unsupported claim on the way out
https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/
Why Does RAG Return a Paragraph When You Asked for One Fact?

why a paragraph's embedding is a blend that points at nothing in particular

Subscribe on YouTube   Browse every episode →

Introduction

Retrieval-Augmented Generation (RAG) is revolutionizing the way we combine information retrieval with generative AI. This repository showcases a curated collection of advanced techniques designed to supercharge your RAG systems, enabling them to deliver more accurate, contextually relevant, and comprehensive responses.

Our goal is to provide a valuable resource for researchers and practitioners looking to push the boundaries of what's possible with RAG. By fostering a collaborative environment, we aim to accelerate innovation in this exciting field.

📖 Go deeper: the book

https://github.com/NirDiamant/RAG_Techniques/blob/HEAD/RAG Made Simple

RAG Made Simple - the 400-page visual companion to this repo. Amazon Bestseller in Generative AI · 1,500+ readers · ⭐ 4.6

Get it on Amazon (paperback · Kindle · free on Kindle Unlimited) → · Read Chapter 1 free

Related Projects

🚀 Agents Towards Production - code-first tutorials for shipping production-grade GenAI agents, prototype to scale.

🤖 GenAI Agents - a broad collection of AI agent implementations and tutorials.

🖋️ Prompt Engineering Techniques - prompting strategies from basics to advanced.

🧠 Agent Memory Techniques - 30 notebooks on agent memory: vector stores, knowledge graphs, Mem0, MemGPT, Zep, Graphiti.

Join the community

Contributions make this better - propose ideas, share techniques, or give feedback via CONTRIBUTING.md.

r/EducationalAI · Discord · LinkedIn

Key Features

Advanced Techniques

Explore our extensive list of cutting-edge RAG techniques:

Recently added: MemoRAG (memory-augmented retrieval), End-to-End RAG Evaluation, Open-RAG-Eval, JSON RAG. 42 notebooks and growing.

| # | Category | Technique | View | |---|----------|-----------|------| | 1 | Foundational 🌱 | Basic RAG | | | 2 | Foundational 🌱 | RAG with CSV Files | | | 3 | Foundational 🌱 | Reliable RAG | | | 4 | Foundational 🌱 | Optimizing Chunk Sizes | | | 5 | Foundational 🌱 | Proposition Chunking | | | 6 | Query Enhancement 🔍 | Query Transformations | | | 7 | Query Enhancement 🔍 | HyDE (Hypothetical Document Embedding) | | | 8 | Query Enhancement 🔍 | HyPE (Hypothetical Prompt Embedding) | | | 9 | Context Enrichment 📚 | Contextual Chunk Headers | | | 10 | Context Enrichment 📚 | Relevant Segment Extraction | | | 11 | Context Enrichment 📚 | Context Window Enhancement | | | 12 | Context Enrichment 📚 | Semantic Chunking | | | 13 | Context Enrichment 📚 | Contextual Compression | | | 14 | Context Enrichment 📚 | Document Augmentation | | | 15 | Advanced Retrieval 🚀 | Fusion Retrieval | [](https://colab.research.google.com/

GitHub Stars & Activity

29,503Stars
0Forks
0Open issues
Jupyter NotebookLanguage

GitHub Popularity

GitHub stars29,503
Forks0
Open issues0
Primary languageJupyter Notebook
License-
Stars gained today0
Created-
Last pushed-

Trending History

Trending statusnot on today's boards

Related AI Projects

1

rasbt / LLMs-from-scratch

Jupyter Notebook★ 105,049⑂ 0
2

pathwaycom / llm-app

Jupyter Notebook★ 58,927⑂ 0
3

patchy631 / ai-engineering-hub

Jupyter Notebook★ 37,557⑂ 0
4

lyogavin / airllm

Jupyter Notebook★ 34,377⑂ 0
5

datawhalechina / happy-llm

Jupyter Notebook★ 33,833⑂ 0
6

datawhalechina / self-llm

Jupyter Notebook★ 32,225⑂ 0
7

affaan-m / ECC

JavaScript★ 259,477⑂ 0
8

NousResearch / hermes-agent

Python★ 245,944⑂ 0

More AI Rankings