Consolidate data from 5 sources for automated reporting with SQL, MongoDB & Google tools
How it works
This workflow consolidates data from five different systems — Google Sheets, PostgreSQL, MongoDB, Microsoft SQL Server, and Google Analytics — into a single master Google Sheet. It runs on a scheduled trigger three times a week. Each dataset is tagged with a unique source identifier before merging, ensuring data traceability. Finally, the merged dataset is cleaned, standardized, and written into the output Google Sheet for reporting and analysis.
Step-by-step
1. Trigger the workflow
- Schedule Trigger – Runs the workflow at set weekly intervals.
2. Collect data from sources
- Google Sheets Source – Retrieves records from a specific sheet.
- PostgreSQL Source – Extracts customer data from the database.
- MongoDB Source – Pulls documents from the defined collection.
- Microsoft SQL Server – Executes a SQL query and returns results.
- Google Analytics – Captures user activity and engagement metrics.
3. Tag each dataset
- Add Sheets Source ID – Marks data from Google Sheets.
- Add PostgreSQL Source ID – Marks data from PostgreSQL.
- Add MongoDB Source ID – Marks data from MongoDB.
- Add SQL Server Source ID – Marks data from SQL Server.
- Add Analytics Source ID – Marks data from Google Analytics.
4. Merge and process
- Merge – Combines all tagged datasets into a single structure.
- Process Merged Data – Cleans, aligns schemas, and standardizes key fields.
5. Store consolidated output
- Final Google Sheet – Appends or updates the master sheet with the processed data.
Why use this?
- Centralizes multiple data sources into a single, consistent dataset.
- Ensures data traceability by tagging each source.
- Reduces manual effort in data cleaning and consolidation.
- Provides a reliable reporting hub for business analysis.
- Enables scheduled, automated updates for up-to-date visibility.
# n8n Workflow: Consolidate Data from Multiple Sources for Automated Reporting
This n8n workflow is designed to automate the process of collecting and consolidating data from various sources, including SQL databases (Postgres, Microsoft SQL), MongoDB, and Google services (Google Sheets, Google Analytics). The consolidated data can then be used for automated reporting or further analysis.
## What it does
This workflow orchestrates the retrieval of data from five distinct sources, preparing it for a unified reporting system.
1. **Triggers on a Schedule**: The workflow starts automatically based on a predefined schedule.
2. **Retrieves Data from Google Sheets**: Fetches data from a specified Google Sheet.
3. **Retrieves Data from Postgres**: Queries a PostgreSQL database to extract relevant information.
4. **Retrieves Data from MongoDB**: Connects to a MongoDB instance to pull document data.
5. **Retrieves Data from Microsoft SQL**: Executes a query against a Microsoft SQL Server database.
6. **Retrieves Data from Google Analytics**: Gathers analytics data from a Google Analytics account.
7. **Merges Data**: Combines the data retrieved from all five sources into a single, unified dataset.
8. **Processes Consolidated Data**: A `Function` node is included, likely for custom JavaScript logic to transform, clean, or further process the merged data before it's used for reporting.
9. **Provides Documentation**: Includes a sticky note for internal documentation or comments within the workflow.
## Prerequisites/Requirements
To use this workflow, you will need:
* **n8n Instance**: A running n8n instance to import and execute the workflow.
* **Google Sheets Account**: With access to the specific spreadsheet(s) you wish to query.
* **Postgres Database**: Access credentials for a PostgreSQL database.
* **MongoDB Instance**: Connection details for a MongoDB database.
* **Microsoft SQL Server**: Access credentials for a Microsoft SQL Server database.
* **Google Analytics Account**: With appropriate permissions to retrieve data.
* **n8n Credentials**: Configured credentials for Google Sheets, Postgres, MongoDB, Microsoft SQL, and Google Analytics within your n8n instance.
## Setup/Usage
1. **Import the Workflow**: Download the provided JSON and import it into your n8n instance.
2. **Configure Credentials**: For each service node (Google Sheets, Postgres, MongoDB, Microsoft SQL, Google Analytics), select or create the necessary credentials. Ensure these credentials have the required permissions to access your data.
3. **Customize Nodes**:
* **Schedule Trigger**: Adjust the schedule to your desired frequency for data consolidation.
* **Google Sheets**: Specify the Spreadsheet ID and sheet name.
* **Postgres, MongoDB, Microsoft SQL**: Configure the queries or collection operations to retrieve the specific data you need.
* **Google Analytics**: Define the view ID, date ranges, and metrics/dimensions for your analytics reports.
* **Function**: Modify the JavaScript code within the `Function` node to perform any custom data transformations or cleaning required for your reporting needs.
4. **Activate the Workflow**: Once configured, activate the workflow to enable it to run on the defined schedule.
This workflow provides a robust foundation for building automated reporting pipelines by centralizing data from diverse sources.
Related Templates
Track competitor SEO keywords with Decodo + GPT-4.1-mini + Google Sheets
This workflow automates competitor keyword research using OpenAI LLM and Decodo for intelligent web scraping. Who this is for SEO specialists, content strategists, and growth marketers who want to automate keyword research and competitive intelligence. Marketing analysts managing multiple clients or websites who need consistent SEO tracking without manual data pulls. Agencies or automation engineers using Google Sheets as an SEO data dashboard for keyword monitoring and reporting. What problem this workflow solves Tracking competitor keywords manually is slow and inconsistent. Most SEO tools provide limited API access or lack contextual keyword analysis. This workflow solves that by: Automatically scraping any competitor’s webpage with Decodo. Using OpenAI GPT-4.1-mini to interpret keyword intent, density, and semantic focus. Storing structured keyword insights directly in Google Sheets for ongoing tracking and trend analysis. What this workflow does Trigger — Manually start the workflow or schedule it to run periodically. Input Setup — Define the website URL and target country (e.g., https://dev.to, france). Data Scraping (Decodo) — Fetch competitor web content and metadata. Keyword Analysis (OpenAI GPT-4.1-mini) Extract primary and secondary keywords. Identify focus topics and semantic entities. Generate a keyword density summary and SEO strength score. Recommend optimization and internal linking opportunities. Data Structuring — Clean and convert GPT output into JSON format. Data Storage (Google Sheets) — Append structured keyword data to a Google Sheet for long-term tracking. Setup Prerequisites If you are new to Decode, please signup on this link visit.decodo.com n8n account with workflow editor access Decodo API credentials OpenAI API key Google Sheets account connected via OAuth2 Make sure to install the Decodo Community node. Create a Google Sheet Add columns for: primarykeywords, seostrengthscore, keyworddensity_summary, etc. Share with your n8n Google account. Connect Credentials Add credentials for: Decodo API credentials - You need to register, login and obtain the Basic Authentication Token via Decodo Dashboard OpenAI API (for GPT-4o-mini) Google Sheets OAuth2 Configure Input Fields Edit the “Set Input Fields” node to set your target site and region. Run the Workflow Click Execute Workflow in n8n. View structured results in your connected Google Sheet. How to customize this workflow Track Multiple Competitors → Use a Google Sheet or CSV list of URLs; loop through them using the Split In Batches node. Add Language Detection → Add a Gemini or GPT node before keyword analysis to detect content language and adjust prompts. Enhance the SEO Report → Expand the GPT prompt to include backlink insights, metadata optimization, or readability checks. Integrate Visualization → Connect your Google Sheet to Looker Studio for SEO performance dashboards. Schedule Auto-Runs → Use the Cron Node to run weekly or monthly for competitor keyword refreshes. Summary This workflow automates competitor keyword research using: Decodo for intelligent web scraping OpenAI GPT-4.1-mini for keyword and SEO analysis Google Sheets for live tracking and reporting It’s a complete AI-powered SEO intelligence pipeline ideal for teams that want actionable insights on keyword gaps, optimization opportunities, and content focus trends, without relying on expensive SEO SaaS tools.
Two-way property repair management system with Google Sheets & Drive
This workflow automates the repair request process between tenants and building managers, keeping all updates organized in a single spreadsheet. It is composed of two coordinated workflows, as two separate triggers are required — one for new repair submissions and another for repair updates. A Unique Unit ID that corresponds to individual units is attributed to each request, and timestamps are used to coordinate repair updates with specific requests. General use cases include: Property managers who manage multiple buildings or units. Building owners looking to centralize tenant repair communication. Automation builders who want to learn multi-trigger workflow design in n8n. --- ⚙️ How It Works Workflow 1 – New Repair Requests Behind the Scenes: A tenant fills out a Google Form (“Repair Request Form”), which automatically adds a new row to a linked Google Sheet. Steps: Trigger: Google Sheets rowAdded – runs when a new form entry appears. Extract & Format: Collects all relevant form data (address, unit, urgency, contacts). Generate Unit ID: Creates a standardized identifier (e.g., BUILDING-UNIT) for tracking. Email Notification: Sends the building manager a formatted email summarizing the repair details and including a link to a Repair Update Form (which activates Workflow 2). --- Workflow 2 – Repair Updates Behind the Scenes:\ Triggered when the building manager submits a follow-up form (“Repair Update Form”). Steps: Lookup by UUID: Uses the Unit ID from Workflow 1 to find the existing row in the Google Sheet. Conditional Logic: If photos are uploaded: Saves each image to a Google Drive folder, renames files consistently, and adds URLs to the sheet. If no photos: Skips the upload step and processes textual updates only. Merge & Update: Combines new data with existing repair info in the same spreadsheet row — enabling a full repair history in one place. --- 🧩 Requirements Google Account (for Forms, Sheets, and Drive) Gmail/email node connected for sending notifications n8n credentials configured for Google API access --- ⚡ Setup Instructions (see more detail in workflow) Import both workflows into n8n, then copy one into a second workflow. Change manual trigger in workflow 2 to a n8n Form node. Connect Google credentials to all nodes. Update spreadsheet and folder IDs in the corresponding nodes. Customize email text, sender name, and form links for your organization. Test each workflow with a sample repair request and a repair update submission. --- 🛠️ Customization Ideas Add Slack or Telegram notifications for urgent repairs. Auto-create folders per building or unit for photo uploads. Generate monthly repair summaries using Google Sheets triggers. Add an AI node to create summaries/extract relevant repair data from repair request that include long submissions.
Generate song lyrics and music from text prompts using OpenAI and Fal.ai Minimax
Spark your creativity instantly in any chat—turn a simple prompt like "heartbreak ballad" into original, full-length lyrics and a professional AI-generated music track, all without leaving your conversation. 📋 What This Template Does This chat-triggered workflow harnesses AI to generate detailed, genre-matched song lyrics (at least 600 characters) from user messages, then queues them for music synthesis via Fal.ai's minimax-music model. It polls asynchronously until the track is ready, delivering lyrics and audio URL back in chat. Crafts original, structured lyrics with verses, choruses, and bridges using OpenAI Submits to Fal.ai for melody, instrumentation, and vocals aligned to the style Handles long-running generations with smart looping and status checks Returns complete song package (lyrics + audio link) for seamless sharing 🔧 Prerequisites n8n account (self-hosted or cloud with chat integration enabled) OpenAI account with API access for GPT models Fal.ai account for AI music generation 🔑 Required Credentials OpenAI API Setup Go to platform.openai.com → API keys (sidebar) Click "Create new secret key" → Name it (e.g., "n8n Songwriter") Copy the key and add to n8n as "OpenAI API" credential type Test by sending a simple chat completion request Fal.ai HTTP Header Auth Setup Sign up at fal.ai → Dashboard → API Keys Generate a new API key → Copy it In n8n, create "HTTP Header Auth" credential: Name="Fal.ai", Header Name="Authorization", Header Value="Key [Your API Key]" Test with a simple GET to their queue endpoint (e.g., /status) ⚙️ Configuration Steps Import the workflow JSON into your n8n instance Assign OpenAI API credentials to the "OpenAI Chat Model" node Assign Fal.ai HTTP Header Auth to the "Generate Music Track", "Check Generation Status", and "Fetch Final Result" nodes Activate the workflow—chat trigger will appear in your n8n chat interface Test by messaging: "Create an upbeat pop song about road trips" 🎯 Use Cases Content Creators: YouTubers generating custom jingles for videos on the fly, streamlining production from idea to audio export Educators: Music teachers using chat prompts to create era-specific folk tunes for classroom discussions, fostering interactive learning Gift Personalization: Friends crafting anniversary R&B tracks from shared memories via quick chats, delivering emotional audio surprises Artist Brainstorming: Songwriters prototyping hip-hop beats in real-time during sessions, accelerating collaboration and iteration ⚠️ Troubleshooting Invalid JSON from AI Agent: Ensure the system prompt stresses valid JSON; test the agent standalone with a sample query Music Generation Fails (401/403): Verify Fal.ai API key has minimax-music access; check usage quotas in dashboard Status Polling Loops Indefinitely: Bump wait time to 45-60s for complex tracks; inspect fal.ai queue logs for bottlenecks Lyrics Under 600 Characters: Tweak agent prompt to enforce fuller structures like [V1][C][V2][B][C]; verify output length in executions