Multi-platform source discovery with SerpAPI, DuckDuckGo, GitHub, Reddit & Bluesky

Hybroht

810 views

2/3/2026

AI Image Analysis Google Gemini Vision Artificial Intelligence

Official Page

Source Discovery - Automatically Search More Up-to-Date Information Sources

🎬 Overview

Version : 1.0

This workflow utilizes various nodes to discover and analyze potential sources of information from platforms like Google, Reddit, GitHub, Bluesky, and others. It is designed to streamline the process of finding relevant sources based on specified search themes.

✨ Features

Automated source discovery from multiple platforms.
Filtering of existing and undesired sources.
Error handling for API requests.
User-friendly configuration options.

👤 Who is this for?

This workflow is ideal for researchers, content marketers, journalists, and anyone looking to efficiently gather and analyze information from various online sources.

💡 What problem does this solve?

This workflow addresses the challenge of manually searching for relevant information sources, saving time and effort while ensuring that users have access to the most pertinent content. Ideal use-cases include:

Resource Compilation for Academic and Educational Purposes
Journalism and Research
Content Marketing
Competitor Analysis

🔍 What this workflow does

The workflow gathers data from selected platforms through search terms. It filters out known and undesired sources, analyzes the content, and provides insights into potential sources relevant to the user's needs.

🔄 Workflow Steps

1. Search Queries

Fetch sources using SerpAPI search, DuckDuckGo, and Bluesky.
Utilizes GitHub repositories to find relevant links.
Leverages RSS feeds from subreddits to identify potential sources.

2. Filtering Step

Removes existing and undesired sources from the results.

3. Source Selection

Analyzes the content of the identified sources for relevance.

📌 Expected Input / Configuration

The workflow is primarily configured via the Configure Workflow Args (Manual) node or the Global Variables custom node.

Search themes: Keywords or phrases relevant to the desired content.
Lists of known sources and undesired sources for filtering.

📦 Expected Output

A curated list of potential sources relevant to the specified search themes, along with insights into their content.

📌 Example

⚙️ n8n Setup Used

n8n version: 1.105.3
n8n-nodes-serpapi: 0.1.6
n8n-nodes-globals: 1.1.0
n8n-nodes-bluesky-enhanced: 1.6.0
n8n-nodes-duckduckgo-search: 30.0.4
LLM Model: mistral-small-latest (API)
Platform: Podman 4.3.1 on Linux
Date: 2025-08-06

⚡ Requirements to Use / Setup

Self-hosted or cloud n8n instance.
Install the following custom nodes: SerpAPI, Bluesky, and DuckDuckGo Search.
Install the Global Variables Node for enhanced configuration:
- n8n-nodes-globals (or use Edit Field (Set) node instead)
Provide valid credentials to nodes for your preferred LLM model, SerpAPI, and Bluesky. Credentials for GitHub recommended.

⚠️ Notes, Assumptions & Warnings

Ensure compliance with the terms of service of any platforms accessed or discovered in this workflow, particularly concerning data usage and attribution.
Monitor API usage to avoid hitting rate limits.
The workflow may encounter errors such as 403 responses; in such cases, it will continue by ignoring the affected substep.
Duplicate removal is applied, but occasional overlaps might still appear depending on the sources.
This workflow assumes familiarity with n8n, APIs, and search engines.
Using AI agents (Mistral or substitute LLMs) requires access to their API services and keys.
This is not a Curator of News. It is designed to find websites that are relevant and useful to your searches. If you are looking for a relevant news selector, please check this workflow.

ℹ️ About Us

This workflow was developed by the Hybroht team. Our goal is to create tools that harness the possibilities of technology and more. We aim to continuously improve and expand functionalities based on community feedback and evolving use cases. For questions, reach out via contact@hybroht.com.

⚖️ Warranty & Legal Notice

This free workflow is provided "as-is" without any warranties of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

By using this workflow, you acknowledge that you do so at your own risk. We shall not be held responsible for any damages, losses, or liabilities arising from the use or inability to use this workflow, including but not limited to any direct, indirect, incidental, or consequential damages.

It is your responsibility to ensure that your use of this workflow complies with all applicable laws and regulations.

Multi-Platform Source Discovery with SerpApi, DuckDuckGo, GitHub, Reddit, and Bluesky

This n8n workflow is designed to automate the discovery and aggregation of information from various online platforms, including search engines (via SerpApi and DuckDuckGo), code repositories (GitHub), social media (Reddit, Bluesky), and RSS feeds. It allows users to define a search query and then systematically gather relevant results from these diverse sources, process them, and present them in a structured format.

What it does

This workflow performs the following key steps:

Manual or Scheduled Trigger: The workflow can be initiated manually by clicking "Execute workflow" or automatically on a predefined schedule.
Define Search Query: A "Sticky Note" node is used to hold the primary search query, which acts as the central topic for discovery.
Search GitHub: It makes an HTTP request to the GitHub API to search for repositories related to the defined query.
Search Reddit: It queries the Reddit API to find posts and discussions matching the search query.
Search SerpApi (Google Search): It uses SerpApi to perform a Google search, extracting organic results and potentially other structured data.
Search DuckDuckGo: It makes an HTTP request to DuckDuckGo to perform a search and retrieve results.
Read RSS Feeds: It reads content from a specified RSS feed, likely for news or updates related to the query.
Process Bluesky (Placeholder): An "HTTP Request" node is present, likely intended for interacting with the Bluesky API to fetch relevant content, though its specific configuration is not detailed in the provided JSON.
Combine and Process Results:
- All results from the various sources are brought together using a "Merge" node.
- A "Code" node is used to process and potentially standardize the data structure of the combined results.
- "Remove Duplicates" ensures that unique items are retained based on a specified key.
- "Limit" can be used to control the number of items passed down the workflow.
- "Split Out" might be used to further break down nested data structures.
Extract Information with AI: An "Information Extractor" node (from Langchain) is used, likely in conjunction with a "Mistral Cloud Chat Model" (also Langchain), to parse and extract structured information (e.g., entities, summaries) from the aggregated text content using AI.
Filter Results: A "Filter" node allows for conditional processing of the extracted information, enabling the workflow to act only on items that meet specific criteria.
Aggregate Final Output: An "Aggregate" node likely combines the processed and filtered information into a final, consolidated output.
Loop Over Items: A "Loop Over Items (Split in Batches)" node suggests that if there are many results, they might be processed in batches to manage API rate limits or computational load.
Edit Fields: A "Set" node is used to modify or add fields to the data at various stages of the workflow.

Prerequisites/Requirements

To use this workflow, you will need:

n8n Instance: A running n8n instance.
SerpApi Account and API Key: For Google search results.
GitHub Personal Access Token (or similar authentication): For accessing GitHub API (if private repos or higher rate limits are needed).
Reddit API Credentials: For interacting with the Reddit API (OAuth credentials for posting/more advanced actions, or simple client ID for public reads).
Bluesky API Credentials (if configured): For interacting with the Bluesky platform.
Mistral Cloud API Key: For the Mistral Cloud Chat Model used by the Information Extractor.
RSS Feed URLs: One or more RSS feed URLs to monitor.

Setup/Usage

Import the workflow: Download the JSON file and import it into your n8n instance.
Configure Credentials:
- For the "HTTP Request" nodes (GitHub, DuckDuckGo, Bluesky), ensure you configure any necessary API keys, tokens, or authentication headers.
- For the "Reddit" node, set up your Reddit API credentials.
- For the "SerpApi" node, provide your SerpApi API key.
- For the "Mistral Cloud Chat Model" and "Information Extractor" nodes, configure your Mistral Cloud API key.
Define Search Query: Update the "Sticky Note" node named "Search Query" with the topic or keywords you want to discover.
Configure RSS Feeds: In the "RSS Read" node, specify the URLs of the RSS feeds you wish to monitor.
Customize Logic (Optional):
- Adjust the "Code" nodes to modify data processing logic as needed.
- Refine the "Filter" node's conditions to narrow down results.
- Modify "Remove Duplicates" and "Limit" settings to suit your data volume and uniqueness requirements.
Activate the Workflow:
- If using the "Schedule Trigger", configure the desired execution interval (e.g., daily, hourly).
- If using the "Manual Trigger", simply click "Execute Workflow" to run it on demand.

Related Templates

AI multi-agent executive team for entrepreneurs with Gemini, Perplexity and WhatsApp

This workflow is an AI-powered multi-agent system built for startup founders and small business owners who want to automate decision-making, accountability, research, and communication, all through WhatsApp. The “virtual executive team,” is designed to help small teams to work smarter. This workflow sends you market analysis, market and sales tips, It can also monitor what your competitors are doing using perplexity (Research agent) and help you stay a head, or make better decisions. And when you feeling stuck with your start-up accountability director is creative enough to break the barrier 🎯 Core Features 🧑‍💼 1. President (Super Agent) Acts as the main controller that coordinates all sub-agents. Routes messages, assigns tasks, and ensures workflow synchronization between the AI Directors. 📊 2. Sales & Marketing Director Uses SerpAPI to search for market opportunities, leads, and trends. Suggests marketing campaigns, keywords, or outreach ideas. Can analyze current engagement metrics to adjust content strategy. 🕵️‍♀️ 3. Business Research Director Powered by Perplexity AI for competitive and market analysis. Monitors competitor moves, social media engagement, and product changes. Provides concise insights to help the founder adapt and stay ahead. ⏰ 4. Accountability Director Keeps the founder and executive team on track. Sends motivational nudges, task reminders, and progress reports. Promotes consistency and discipline — key traits for early-stage success. 🗓️ 5. Executive Secretary Handles scheduling, email drafting, and reminders. Connects with Google Calendar, Gmail, and Sheets through OAuth. Automates follow-ups, meeting summaries, and notifications directly via WhatsApp. 💬 WhatsApp as the Main Interface Interact naturally with your AI team through WhatsApp Business API. All responses, updates, and summaries are delivered to your chat. Ideal for founders who want to manage operations on the go. ⚙️ How It Works Trigger: The workflow starts from a WhatsApp Trigger node (via Meta Developer Account). Routing: The President agent analyzes the incoming message and determines which Director should handle it. Processing: Marketing or sales queries go to the Sales & Marketing Director. Research questions are handled by the Business Research Director. Accountability tasks are assigned to the Accountability Director. Scheduling or communication requests are managed by the Secretary. Collaboration: Each sub-agent returns results to the President, who summarizes and sends the reply back via WhatsApp. Memory: Context is maintained between sessions, ensuring personalized and coherent communication. 🧩 Integrations Required Gemini API – for general intelligence and task reasoning Supabase- for RAG and postgres persistent memory Perplexity API – for business and competitor analysis SerpAPI – for market research and opportunity scouting Google OAuth – to connect Sheets, Calendar, and Gmail WhatsApp Business API – for message triggers and responses 🚀 Benefits Acts like a team of tireless employees available 24/7. Saves time by automating research, reminders, and communication. Enhances accountability and strategy consistency for founders. Keeps operations centralized in a simple WhatsApp interface. 🧰 Setup Steps Create API credentials for: WhatsApp (via Meta Developer Account) Gemini, Perplexity, and SerpAPI Google OAuth (Sheets, Calendar, Gmail) Create a supabase account at supabase Add the credentials in the corresponding n8n nodes. Customize the system prompts for each Director based on your startup’s needs. Activate and start interacting with your virtual executive team on WhatsApp. Use Case You are a small organisation or start-up that can not afford hiring; marketing department, research department and secretar office, then this workflow is for you 💡 Need Customization? Want to tailor it for your startup or integrate with CRM tools like Notion or HubSpot? You can easily extend the workflow or contact the creator for personalized support. Consider adjusting the system prompt to suite your business

By Shadrack

331

🎓 How to transform unstructured email data into structured format with AI agent

This workflow automates the process of extracting structured, usable information from unstructured email messages across multiple platforms. It connects directly to Gmail, Outlook, and IMAP accounts, retrieves incoming emails, and sends their content to an AI-powered parsing agent built on OpenAI GPT models. The AI agent analyzes each email, identifies relevant details, and returns a clean JSON structure containing key fields: From – sender’s email address To – recipient’s email address Subject – email subject line Summary – short AI-generated summary of the email body The extracted information is then automatically inserted into an n8n Data Table, creating a structured database of email metadata and summaries ready for indexing, reporting, or integration with other tools. --- Key Benefits ✅ Full Automation: Eliminates manual reading and data entry from incoming emails. ✅ Multi-Source Integration: Handles data from different email providers seamlessly. ✅ AI-Driven Accuracy: Uses advanced language models to interpret complex or unformatted content. ✅ Structured Storage: Creates a standardized, query-ready dataset from previously unstructured text. ✅ Time Efficiency: Processes emails in real time, improving productivity and response speed. *✅ Scalability: Easily extendable to handle additional sources or extract more data fields. --- How it works This workflow automates the transformation of unstructured email data into a structured, queryable format. It operates through a series of connected steps: Email Triggering: The workflow is initiated by one of three different email triggers (Gmail, Microsoft Outlook, or a generic IMAP account), which constantly monitor for new incoming emails. AI-Powered Parsing & Structuring: When a new email is detected, its raw, unstructured content is passed to a central "Parsing Agent." This agent uses a specified OpenAI language model to intelligently analyze the email text. Data Extraction & Standardization: Following a predefined system prompt, the AI agent extracts key information from the email, such as the sender, recipient, subject, and a generated summary. It then forces the output into a strict JSON structure using a "Structured Output Parser" node, ensuring data consistency. Data Storage: Finally, the clean, structured data (the from, to, subject, and summarize fields) is inserted as a new row into a specified n8n Data Table, creating a searchable and reportable database of email information. --- Set up steps To implement this workflow, follow these configuration steps: Prepare the Data Table: Create a new Data Table within n8n. Define the columns with the following names and string type: From, To, Subject, and Summary. Configure Email Credentials: Set up the credential connections for the email services you wish to use (Gmail OAuth2, Microsoft Outlook OAuth2, and/or IMAP). Ensure the accounts have the necessary permissions to read emails. Configure AI Model Credentials: Set up the OpenAI API credential with a valid API key. The workflow is configured to use the model, but this can be changed in the respective nodes if needed. Connect the Nodes: The workflow canvas is already correctly wired. Visually confirm that the email triggers are connected to the "Parsing Agent," which is connected to the "Insert row" (Data Table) node. Also, ensure the "OpenAI Chat Model" and "Structured Output Parser" are connected to the "Parsing Agent" as its AI model and output parser, respectively. Activate the Workflow: Save the workflow and toggle the "Active" switch to ON. The triggers will begin polling for new emails according to their schedule (e.g., every minute), and the automation will start processing incoming messages. --- Need help customizing? Contact me for consulting and support or add me on Linkedin.

By Davide

1616

Send WooCommerce discount coupons to customers via WhatsApp using Rapiwa API

Who is this for? This workflow is ideal for WooCommerce store owners who want to automatically send promotional WhatsApp messages to their customers when new coupons are created. It’s designed for marketers and eCommerce managers looking to boost engagement, streamline coupon sharing, and track campaign performance effortlessly through Google Sheets. Overview This workflow listens for WooCommerce coupon creation events (coupon.created) and uses customer billing data to send promotional WhatsApp messages via the Rapiwa API. The flow formats the coupon data, cleans phone numbers, verifies WhatsApp registration with Rapiwa, sends the promotional message when verified, and logs each attempt to Google Sheets (separate sheets for verified/sent and unverified/not sent). What this Workflow Does Listens for new coupon creation events in WooCommerce via the WooCommerce Trigger node Retrieves all customer data from the WooCommerce store Processes customers in batches to control throughput Cleans and formats customer phone numbers for WhatsApp Verifies if phone numbers are valid WhatsApp accounts using Rapiwa API Sends personalized WhatsApp messages with coupon details to verified numbers Logs all activities to Google Sheets for tracking and analysis Handles both verified and unverified numbers appropriately Key Features Automated coupon distribution: Triggers when new coupons are created in WooCommerce Customer data retrieval: Fetches all customer information from WooCommerce Phone number validation: Verifies WhatsApp numbers before sending messages Personalized messaging: Includes customer name and coupon details in messages Dual logging system: Tracks both successful and failed message attempts Rate limiting: Uses batching and wait nodes to prevent API overload Data formatting: Structures coupon information for consistent messaging Google Sheet Column Structure A Google Sheet formatted like this ➤ sample The workflow uses a Google Sheet with the following columns to track coupon distribution: | name | number | email | address1 | couponCode | couponTitle | couponType | couponAmount | createDate | expireDate | validity | status | | ----------- | ------------- | --------------------------------------------------- | --------- | ---------- | -------------- | ---------- | ------------ | ------------------- | ------------------- | ---------- | -------- | | Abdul Mannan | 8801322827799 | contact@spagreen.net | mirpur-DOHS | 62dhryst | eid offer 2025 | percent | 20.00 | 2025-09-11 06:08:02 | 2025-09-15 00:00:00 | unverified | not sent | | Abdul Mannan | 8801322827799 | contact@spagreen.net | mirpur-DOHS | 62dhryst | eid offer 2025 | percent | 20.00 | 2025-09-11 06:08:02 | 2025-09-15 00:00:00 | verified | sent | Requirements n8n instance with the following nodes: WooCommerce Trigger, Code, SplitInBatches, HTTP Request, IF, Google Sheets, Wait WooCommerce store with API access Rapiwa account with API access for WhatsApp verification and messaging Google account with Sheets access Customer phone numbers in WooCommerce (stored in billing.phone field) Important Notes Phone Number Format: The workflow cleans phone numbers by removing all non-digit characters. Ensure your WooCommerce phone numbers are in a compatible format. API Rate Limits: Rapiwa and WooCommerce APIs have rate limits. Adjust batch sizes and wait times accordingly. Data Privacy: Ensure compliance with data protection regulations when sending marketing messages. Error Handling: The workflow logs unverified numbers but doesn't have extensive error handling. Consider adding error notifications for failed API calls. Message Content: The current message template references the first coupon only (coupons[0]). Adjust if you need to handle multiple coupons. Useful Links Dashboard: https://app.rapiwa.com Official Website: https://rapiwa.com Documentation: https://docs.rapiwa.com Support & Help WhatsApp: Chat on WhatsApp Discord: SpaGreen Community Facebook Group: SpaGreen Support Website: https://spagreen.net Developer Portfolio: Codecanyon SpaGreen

By Rapiwa

110