Pricing

How much does a RAG knowledge assistant cost?

The short answer

A RAG knowledge assistant that answers questions from your company's documents with citations typically costs $12,000 to $45,000 to build and takes three to eight weeks. One clean source such as a SharePoint library sits at the low end, while several sources with per-user permissions, scanned files and regulated data sit at the high end. Running costs are embeddings, a vector database, model usage per question and hosting, all of which scale with document volume and query volume.

TierPriceWhat is included
Single-source assistant$12,000–$20,000One document source of mostly text files, everyone sees the same content, a Slack, Teams or simple web interface, cited answers, and a test set of common questions. About three to four weeks.
Multi-source assistant with permissions$20,000–$32,000Two to four sources, per-user access filtering, scheduled sync, OCR for scanned files, reranking, and a feedback loop for wrong answers. Four to six weeks.
Regulated or high-stakes assistant$32,000–$45,000Compliance controls, audit logging, private deployment in your cloud, structured data alongside documents, a graded evaluation set and a formal sign-off process. Up to eight weeks.

What drives the cost

Number of sources
Each source such as SharePoint, Google Drive, Notion, a ticketing system or a database needs its own connector, sync schedule and parsing rules.
Document formats
Clean text and web pages are cheap to process. Scanned PDFs need OCR, and spreadsheets, tables and slide decks need special handling or answers come back garbled.
Permissions
If different people may see different documents, the assistant must filter results by each user's access. It is often skipped in early quotes and is expensive to add later.
Freshness
A one-time index of a static policy library is simple. Content that changes daily needs incremental sync, deletion handling and re-embedding.
Answer quality bar
An internal research helper can tolerate the odd miss. An assistant whose answers people act on needs a graded test set, reranking and strict citation rules.
Where people use it
Slack and Microsoft Teams are popular entry points. A standalone web app with login, history and feedback buttons adds front-end work.
Compliance
Healthcare data requires HIPAA safeguards and a BAA with every vendor that touches it. Other regulated data may need private hosting, audit logs and retention rules.

The short answer

A RAG knowledge assistant costs $12,000 to $45,000 to build with Lumeor and takes three to eight weeks. The low end is one clean document library that everyone can read. The high end is several sources, per-user permissions, messy file formats and compliance requirements.

The question that moves the price most is permissions. If everyone in the company may see every document, the build is much simpler. If HR files, contracts or client folders are restricted, the assistant must enforce the same rules your file system does.

If your content is a public help center and the audience is customers, you probably want a lighter AI chatbot instead.

Where the money goes

PhaseShare of effortWhat happens
Source audit10–15%Find where the knowledge really lives, decide what is in and out of scope, check access
Ingestion and parsing20–30%Connectors, OCR, table handling, chunking strategy, metadata
Retrieval tuning15–20%Embeddings, hybrid keyword and vector search, reranking, permission filters
Answer generation10–15%Prompts, citation format, refusal when sources are thin
Evaluation15–20%Graded question set, retrieval accuracy checks, fixes and retests
Interface and deployment10–15%Slack, Teams or web app, sign-in, feedback buttons, monitoring

Ingestion is the surprise for most buyers. A 40-page policy PDF with tables, headers on every page and scanned appendices can take more care than a thousand clean web pages.

What it costs to run

A RAG assistant has more moving parts than a simple chatbot, and each running cost scales with something different:

  • Embeddings. Billed per token to convert documents into vectors. Large up front for big libraries, then small as only changed files are re-embedded.
  • Vector database. A managed service such as Pinecone is billed on stored vectors and queries. pgvector inside a Postgres database you already run adds little beyond storage. See Pinecone vs pgvector for the trade-offs.
  • Model usage per question. Billed per token. It scales with the number of questions and with how many retrieved passages are sent with each one, so retrieval tuning directly affects the bill.
  • Reranking and OCR. Rerankers are usually billed per query. OCR services bill per page processed, mostly during the initial load.
  • Sync jobs and hosting. Scheduled jobs that pull changed files, plus the app server. Small for most companies.
  • Monitoring. Logs of questions, retrieved sources and feedback, so you can see where answers go wrong.

How to keep the cost down

  • Index less. Archive folders and duplicate drafts make answers worse and cost money to embed. Start with the documents people actually ask about.
  • Settle permissions early. Decide on day one whether the assistant needs per-user filtering. Adding it later means rebuilding the index.
  • Reuse your database. If you already run Postgres, pgvector avoids another vendor at small and medium scale.
  • Use Slack or Teams first. Meeting people where they already work avoids building a full web app.

When not to build one

If your knowledge base is small and lives in one suite with correct permissions, test the AI search built into that suite before paying for a custom build. If the real problem is that nobody has written the answers down, an assistant will not fix it. If you are weighing training a model on your files instead, read RAG vs fine-tuning first.

How Lumeor prices RAG projects

We start by sampling your documents and collecting 30 to 50 real questions people ask today. The fixed-price quote lists the sources, file types, permission model, interface and the question set we will grade against at sign-off. Everything runs in your accounts, so the index and the code stay with you. Our step-by-step guide to building a RAG knowledge assistant shows the architecture in more detail.

Frequently asked questions

What is a RAG knowledge assistant?

RAG stands for retrieval-augmented generation. When someone asks a question, the system searches your documents for the most relevant passages and gives only those passages to the language model, which writes an answer and cites where it came from. The model is not retrained on your data.

Should we use Microsoft 365 Copilot or ChatGPT Enterprise instead?

Possibly. If your documents live mostly in one suite and its permissions are already correct, enterprise assistants such as Microsoft 365 Copilot, ChatGPT Enterprise or Claude Enterprise can search connected files with little setup and are billed per seat. A custom assistant makes sense when you need sources those tools do not reach, strict answer rules, the assistant inside your own product, or per-seat pricing gets costly for occasional users.

Is RAG better than fine-tuning a model on our documents?

For answering questions from changing documents, almost always. RAG picks up new content as soon as it is indexed and can cite sources. Fine-tuning changes how a model writes, not what it reliably knows, and has to be redone when content changes.

How do you stop people seeing documents they should not?

We carry each document's access rules into the index and filter search results by the signed-in user before anything reaches the model. If the user cannot open the file in SharePoint or Drive, the assistant will not quote it.

How long does a RAG assistant take to build?

Three to eight weeks. Single-source assistants are at the short end. Permissions, scanned files and compliance reviews push toward eight weeks, and getting admin access to document systems is a common source of delay.

Next steps