Glossary · Updated Sep 2, 2026

Retrieval-augmented generation (RAG)

A technique where a system fetches relevant documents and gives them to the model so answers are grounded in your data.

Definition

Retrieval-augmented generation combines search with generation: documents are split into chunks, embedded as vectors, and stored; at query time the most relevant chunks are retrieved and inserted into the prompt so the model answers from them, often with citations. RAG underpins knowledge assistants, support bots, and research tools because it keeps answers current and specific without retraining models.

Why it matters when choosing a tool

Tools that use RAG can answer from your own documents with sources, which is usually what businesses mean when they ask for an AI that knows their content.

Where you will meet it

AI Knowledge Management, AI Customer Support, AI Agent & Chatbot Builders

Related terms

Embedding · Vector database · Grounding · Knowledge base

Tools where this matters

Reviewed products in the related categories