Build a RAG system with automatic citations using Qdrant, Gemini & OpenAI
This workflow implements a Retrieval-Augmented Generation (RAG) system that:
- Stores vectorized documents in Qdrant,
- Retrieves relevant content based on user input,
- Generates AI answers using Google Gemini,
- Automatically cites the document sources (from Google Drive).
Workflow Steps
-
Create Qdrant Collection A REST API node creates a new collection in Qdrant with specified vector size (1536) and cosine similarity.
-
Load Files from Google Drive The workflow lists all files in a Google Drive folder, downloads them as plain text, and loops through each.
-
Text Preprocessing & Embedding
- Documents are split into chunks (500 characters, with 50-character overlap).
- Embeddings are created using OpenAI embeddings (
text-embedding-3-smallassumed). - Metadata (file name and ID) is attached to each chunk.
-
Store in Qdrant All vectors, along with metadata, are inserted into the Qdrant collection.
-
Chat Input & Retrieval
- When a chat message is received, the question is embedded and matched against Qdrant.
- Top 5 relevant document chunks are retrieved.
- A Gemini model is used to generate the answer based on those sources.
-
Source Aggregation & Response
-
File IDs and names are deduplicated.
-
The AI response is combined with a list of cited documents (filenames).
-
Final output:
AI Response Sources: ["Document1", "Document2"]
-
Main Advantages
- End-to-end Automation: From document ingestion to chat response generation, fully automated with no manual steps.
- Scalable Knowledge Base: Easy to expand by simply adding files to the Google Drive folder.
- Traceable Responses: Each answer includes its source files, increasing transparency and trustworthiness.
- Modular Design: Each step (embedding, storage, retrieval, response) is isolated and reusable.
- Multi-provider AI: Combines OpenAI (for embeddings) and Google Gemini (for chat), optimizing performance and flexibility.
- Secure & Customizable: Uses API credentials and configurable chunk size, collection name, etc.
How It Works
-
Document Processing & Vectorization
- The workflow retrieves documents from a specified Google Drive folder.
- Each file is downloaded, split into chunks (using a recursive text splitter), and converted into embeddings via OpenAI.
- The embeddings, along with metadata (file ID and name), are stored in a Qdrant vector database under the collection
negozio-emporio-verde.
-
Query Handling & Response Generation
- When a user submits a chat message, the workflow:
- Embeds the query using OpenAI.
- Retrieves the top 5 relevant document chunks from Qdrant.
- Uses Google Gemini to generate a response based on the retrieved context.
- Aggregates and deduplicates the source file names from the retrieved chunks.
- The final output includes both the AI-generated response and a list of source documents (e.g.,
Sources: ["FAQ.pdf", "Policy.txt"]).
- When a user submits a chat message, the workflow:
Set Up Steps
-
Configure Qdrant Collection
- Replace
QDRANTURLandCOLLECTIONin the "Create collection" HTTP node to initialize the Qdrant collection with:- Vector size:
1536(OpenAI embedding dimension). - Distance metric:
Cosine.
- Vector size:
- Ensure the "Clear collection" node is configured to reset the collection if needed.
- Replace
-
Google Drive & OpenAI Integration
- Link the Google Drive node to the target folder (
Test Negozioin this example). - Verify OpenAI and Google Gemini API credentials are correctly set in their respective nodes.
- Link the Google Drive node to the target folder (
-
Metadata & Output Customization
- Adjust the "Aggregate" and "Response" nodes if additional metadata fields are needed.
- Modify the "Output" node to format the response (e.g., changing
Sources: {{...}}to match your preferred style).
-
Testing
- Trigger the workflow manually to test document ingestion.
- Use the chat interface to verify responses include accurate source attribution.
Note: Replace placeholder values (e.g., QDRANTURL) with actual endpoints before deployment.
Need help customizing?
Contact me for consulting and support or add me on Linkedin.
n8n RAG System with Automatic Citations using Qdrant, Gemini, and OpenAI
This n8n workflow demonstrates how to build a Retrieval Augmented Generation (RAG) system capable of answering questions based on provided documents and automatically generating citations for the answers. It leverages Google Drive for document ingestion, Qdrant as a vector store, and integrates both Google Gemini and OpenAI for language model capabilities and embeddings.
What it does
This workflow automates the following steps:
- Triggers on Manual Execution or Chat Message: The workflow can be initiated manually for testing or by receiving a chat message (e.g., from a user query).
- Loads Documents from Google Drive: It fetches documents (e.g., PDFs, text files) from a specified folder in Google Drive.
- Splits Documents into Chunks: The
Recursive Character Text Splitterintelligently breaks down the loaded documents into smaller, manageable chunks to optimize for vector embedding and retrieval. - Generates Embeddings (OpenAI): It uses OpenAI's embedding model to convert the text chunks into numerical vector representations.
- Stores Vectors in Qdrant: These generated vectors are then stored in a Qdrant vector database, creating a searchable index of your document content.
- Retrieves Relevant Information: When a query is received, the
Vector Store Retrieversearches Qdrant for document chunks whose embeddings are most similar to the query's embedding. - Generates Answers with Citations: The
Question and Answer Chain(LangChain) takes the retrieved relevant document chunks and the user's query to generate a comprehensive answer. It is configured to automatically include citations from the source documents. - Utilizes Google Gemini Chat Model: The workflow uses the Google Gemini chat model for the language generation part of the RAG system.
- Aggregates Output: The results, including the generated answer and citations, are aggregated for a clear and structured output.
- Includes a Wait Node (Optional): A
Waitnode is included, potentially for rate limiting or to simulate processing time, which can be adjusted or removed.
Prerequisites/Requirements
To use this workflow, you will need:
- n8n Instance: A running n8n instance (self-hosted or cloud).
- Google Drive Account: With access to the documents you wish to use for your RAG system.
- Google Gemini API Key: For the
Google Gemini Chat Model. - OpenAI API Key: For the
Embeddings OpenAInode. - Qdrant Instance: A running Qdrant vector database instance (local or cloud). You'll need its API URL and potentially an API key.
- LangChain Nodes: Ensure the
@n8n/n8n-nodes-langchainpackage is installed in your n8n instance.
Setup/Usage
- Import the Workflow: Download the provided JSON and import it into your n8n instance.
- Configure Credentials:
- Google Drive: Set up a Google Drive credential to access your documents.
- Google Gemini: Configure a Google Gemini credential with your API key.
- OpenAI: Set up an OpenAI credential with your API key.
- Qdrant: Configure a Qdrant credential with your Qdrant instance URL and API key (if required).
- Configure Google Drive Node (58):
- Specify the "Folder ID" where your source documents are located.
- Adjust the "File Type" if you are using specific document formats (e.g.,
application/pdf,text/plain).
- Configure Qdrant Vector Store Node (1248):
- Provide your Qdrant "Collection Name".
- Ensure the "Qdrant API" credential is correctly selected.
- Configure Embeddings OpenAI Node (1141):
- Ensure the "OpenAI API" credential is correctly selected.
- Configure Google Gemini Chat Model Node (1262):
- Ensure the "Google Gemini API" credential is correctly selected.
- Test the Workflow:
- You can manually execute the workflow using the
Manual Triggernode to test document ingestion and vector storage. - To test the RAG query, use the
Chat Triggernode and provide a sample question.
- You can manually execute the workflow using the
- Activate the Workflow: Once configured and tested, activate the workflow to enable it to respond to chat messages or other triggers you might connect.
Related Templates
Track competitor SEO keywords with Decodo + GPT-4.1-mini + Google Sheets
This workflow automates competitor keyword research using OpenAI LLM and Decodo for intelligent web scraping. Who this is for SEO specialists, content strategists, and growth marketers who want to automate keyword research and competitive intelligence. Marketing analysts managing multiple clients or websites who need consistent SEO tracking without manual data pulls. Agencies or automation engineers using Google Sheets as an SEO data dashboard for keyword monitoring and reporting. What problem this workflow solves Tracking competitor keywords manually is slow and inconsistent. Most SEO tools provide limited API access or lack contextual keyword analysis. This workflow solves that by: Automatically scraping any competitor’s webpage with Decodo. Using OpenAI GPT-4.1-mini to interpret keyword intent, density, and semantic focus. Storing structured keyword insights directly in Google Sheets for ongoing tracking and trend analysis. What this workflow does Trigger — Manually start the workflow or schedule it to run periodically. Input Setup — Define the website URL and target country (e.g., https://dev.to, france). Data Scraping (Decodo) — Fetch competitor web content and metadata. Keyword Analysis (OpenAI GPT-4.1-mini) Extract primary and secondary keywords. Identify focus topics and semantic entities. Generate a keyword density summary and SEO strength score. Recommend optimization and internal linking opportunities. Data Structuring — Clean and convert GPT output into JSON format. Data Storage (Google Sheets) — Append structured keyword data to a Google Sheet for long-term tracking. Setup Prerequisites If you are new to Decode, please signup on this link visit.decodo.com n8n account with workflow editor access Decodo API credentials OpenAI API key Google Sheets account connected via OAuth2 Make sure to install the Decodo Community node. Create a Google Sheet Add columns for: primarykeywords, seostrengthscore, keyworddensity_summary, etc. Share with your n8n Google account. Connect Credentials Add credentials for: Decodo API credentials - You need to register, login and obtain the Basic Authentication Token via Decodo Dashboard OpenAI API (for GPT-4o-mini) Google Sheets OAuth2 Configure Input Fields Edit the “Set Input Fields” node to set your target site and region. Run the Workflow Click Execute Workflow in n8n. View structured results in your connected Google Sheet. How to customize this workflow Track Multiple Competitors → Use a Google Sheet or CSV list of URLs; loop through them using the Split In Batches node. Add Language Detection → Add a Gemini or GPT node before keyword analysis to detect content language and adjust prompts. Enhance the SEO Report → Expand the GPT prompt to include backlink insights, metadata optimization, or readability checks. Integrate Visualization → Connect your Google Sheet to Looker Studio for SEO performance dashboards. Schedule Auto-Runs → Use the Cron Node to run weekly or monthly for competitor keyword refreshes. Summary This workflow automates competitor keyword research using: Decodo for intelligent web scraping OpenAI GPT-4.1-mini for keyword and SEO analysis Google Sheets for live tracking and reporting It’s a complete AI-powered SEO intelligence pipeline ideal for teams that want actionable insights on keyword gaps, optimization opportunities, and content focus trends, without relying on expensive SEO SaaS tools.
Generate song lyrics and music from text prompts using OpenAI and Fal.ai Minimax
Spark your creativity instantly in any chat—turn a simple prompt like "heartbreak ballad" into original, full-length lyrics and a professional AI-generated music track, all without leaving your conversation. 📋 What This Template Does This chat-triggered workflow harnesses AI to generate detailed, genre-matched song lyrics (at least 600 characters) from user messages, then queues them for music synthesis via Fal.ai's minimax-music model. It polls asynchronously until the track is ready, delivering lyrics and audio URL back in chat. Crafts original, structured lyrics with verses, choruses, and bridges using OpenAI Submits to Fal.ai for melody, instrumentation, and vocals aligned to the style Handles long-running generations with smart looping and status checks Returns complete song package (lyrics + audio link) for seamless sharing 🔧 Prerequisites n8n account (self-hosted or cloud with chat integration enabled) OpenAI account with API access for GPT models Fal.ai account for AI music generation 🔑 Required Credentials OpenAI API Setup Go to platform.openai.com → API keys (sidebar) Click "Create new secret key" → Name it (e.g., "n8n Songwriter") Copy the key and add to n8n as "OpenAI API" credential type Test by sending a simple chat completion request Fal.ai HTTP Header Auth Setup Sign up at fal.ai → Dashboard → API Keys Generate a new API key → Copy it In n8n, create "HTTP Header Auth" credential: Name="Fal.ai", Header Name="Authorization", Header Value="Key [Your API Key]" Test with a simple GET to their queue endpoint (e.g., /status) ⚙️ Configuration Steps Import the workflow JSON into your n8n instance Assign OpenAI API credentials to the "OpenAI Chat Model" node Assign Fal.ai HTTP Header Auth to the "Generate Music Track", "Check Generation Status", and "Fetch Final Result" nodes Activate the workflow—chat trigger will appear in your n8n chat interface Test by messaging: "Create an upbeat pop song about road trips" 🎯 Use Cases Content Creators: YouTubers generating custom jingles for videos on the fly, streamlining production from idea to audio export Educators: Music teachers using chat prompts to create era-specific folk tunes for classroom discussions, fostering interactive learning Gift Personalization: Friends crafting anniversary R&B tracks from shared memories via quick chats, delivering emotional audio surprises Artist Brainstorming: Songwriters prototyping hip-hop beats in real-time during sessions, accelerating collaboration and iteration ⚠️ Troubleshooting Invalid JSON from AI Agent: Ensure the system prompt stresses valid JSON; test the agent standalone with a sample query Music Generation Fails (401/403): Verify Fal.ai API key has minimax-music access; check usage quotas in dashboard Status Polling Loops Indefinitely: Bump wait time to 45-60s for complex tracks; inspect fal.ai queue logs for bottlenecks Lyrics Under 600 Characters: Tweak agent prompt to enforce fuller structures like [V1][C][V2][B][C]; verify output length in executions
Automate Dutch Public Procurement Data Collection with TenderNed
TenderNed Public Procurement What This Workflow Does This workflow automates the collection of public procurement data from TenderNed (the official Dutch tender platform). It: Fetches the latest tender publications from the TenderNed API Retrieves detailed information in both XML and JSON formats for each tender Parses and extracts key information like organization names, titles, descriptions, and reference numbers Filters results based on your custom criteria Stores the data in a database for easy querying and analysis Setup Instructions This template comes with sticky notes providing step-by-step instructions in Dutch and various query options you can customize. Prerequisites TenderNed API Access - Register at TenderNed for API credentials Configuration Steps Set up TenderNed credentials: Add HTTP Basic Auth credentials with your TenderNed API username and password Apply these credentials to the three HTTP Request nodes: "Tenderned Publicaties" "Haal XML Details" "Haal JSON Details" Customize filters: Modify the "Filter op ..." node to match your specific requirements Examples: specific organizations, contract values, regions, etc. How It Works Step 1: Trigger The workflow can be triggered either manually for testing or automatically on a daily schedule. Step 2: Fetch Publications Makes an API call to TenderNed to retrieve a list of recent publications (up to 100 per request). Step 3: Process & Split Extracts the tender array from the response and splits it into individual items for processing. Step 4: Fetch Details For each tender, the workflow makes two parallel API calls: XML endpoint - Retrieves the complete tender documentation in XML format JSON endpoint - Fetches metadata including reference numbers and keywords Step 5: Parse & Merge Parses the XML data and merges it with the JSON metadata and batch information into a single data structure. Step 6: Extract Fields Maps the raw API data to clean, structured fields including: Publication ID and date Organization name Tender title and description Reference numbers (kenmerk, TED number) Step 7: Filter Applies your custom filter criteria to focus on relevant tenders only. Step 8: Store Inserts the processed data into your database for storage and future analysis. Customization Tips Modify API Parameters In the "Tenderned Publicaties" node, you can adjust: offset: Starting position for pagination size: Number of results per request (max 100) Add query parameters for date ranges, status filters, etc. Add More Fields Extend the "Splits Alle Velden" node to extract additional fields from the XML/JSON data, such as: Contract value estimates Deadline dates CPV codes (procurement classification) Contact information Integrate Notifications Add a Slack, Email, or Discord node after the filter to get notified about new matching tenders. Incremental Updates Modify the workflow to only fetch new tenders by: Storing the last execution timestamp Adding date filters to the API query Only processing publications newer than the last run Troubleshooting No data returned? Verify your TenderNed API credentials are correct Check that you have setup youre filter proper Need help setting this up or interested in a complete tender analysis solution? Get in touch 🔗 LinkedIn – Wessel Bulte