Back to Catalog

Automated SEO content engine with Claude AI, Scrapeless, and competitor analysis

scrapeless officialscrapeless official
1495 views
2/3/2026
Official Page

This workflow contains community nodes that are only compatible with the self-hosted version of n8n.

How it works

This n8n workflow helps you build a fully automated SEO content engine using Scrapeless and AI. It’s designed for teams running international websites—such as SaaS products, e-commerce platforms, or content-driven businesses—who want to grow targeted search traffic through high-conversion content, without relying on manual research or hit-or-miss topics.

The flow runs in three key phases:

🔍 Phase 1: Topic Discovery

Automatically find high-potential long-tail keywords based on a seed keyword using Google Trends via Scrapeless. Each keyword is analyzed for trend strength and categorized by priority (P0–P3) with the help of an AI agent.

🧠 Phase 2: Competitor Research

For each P0–P2 keyword, the flow performs a Google Search (via Deep SerpAPI) and extracts the top 3 organic results. Scrapeless then crawls each result to extract full article content in clean Markdown. This gives you a structured, comparable view of how competitors are writing about each topic.

✍️ Phase 3: AI Article Generation

Using AI (OpenAI or other LLM), the workflow generates a complete SEO article draft, including:

  • SEO title
  • Slug
  • Meta description
  • Trend-based strategy summary
  • Structured JSON-based article body with H2/H3 blocks

Finally, the article is stored in Supabase (or any other supported DB), making it ready for review, API-based publishing, or further automation.

Set up steps

This flow requires intermediate familiarity with n8n and API key setup. Full configuration may take 30–60 minutes.

✅ Prerequisites

  • Scrapeless account (for Google Trends and web crawling)
  • LLM provider (e.g. OpenAI or Claude)
  • Supabase or Google Sheets (to store keywords & article output)

🧩 Required Credentials in n8n

  • Scrapeless API Key
  • OpenAI (or other LLM) credentials
  • Supabase or Google Sheets credentials

🔧 Setup Instructions (Simplified)

  1. Input Seed Keyword
    Edit the “Set Seed Keyword” node to define your niche, e.g., "project management".

  2. Google Trends via Scrapeless
    Use Scrapeless to retrieve “related queries” and their interest-over-time data.

  3. Trend Analysis with AI Agent
    AI evaluates each keyword's trend strength and assigns a priority (P0–P3).

  4. Filter & Store Keyword Data
    Group and sort keywords by priority, then store them in Google Sheets.

  5. Competitor Research
    Use Deep SerpAPI to get top 3 Google results. Crawl each using Scrapeless.

  6. AI Content Generation
    Feed competitor content + trend data into AI. Output a structured SEO blog article.

  7. Store Final Article
    Save full article JSON (title, meta, slug, content) to Supabase.

Automated SEO Content Engine with Claude AI, Scrapeless, and Competitor Analysis

This n8n workflow automates the generation of SEO-optimized content by leveraging AI for competitor analysis, content planning, and article creation. It streamlines the process from a simple keyword input to a fully structured content plan and article draft, with options to store data in Google Sheets and Supabase.

What it does

This workflow performs the following key steps:

  1. Triggers Manually: The workflow is initiated manually, allowing you to provide a target keyword.
  2. Initial Data Setup (Edit Fields): Sets up initial variables, including the targetKeyword from the manual trigger.
  3. Competitor Analysis (AI Agent):
    • Utilizes an AI Agent (powered by Anthropic Chat Model) to act as an SEO expert.
    • It performs a Google search for the targetKeyword to identify top-ranking competitors.
    • It then analyzes the top 3 competitor URLs to extract their content structure, headings, and key themes.
    • This analysis helps in understanding the competitive landscape and identifying content gaps.
  4. Content Plan Generation (AI Agent):
    • Based on the competitor analysis, the AI Agent generates a comprehensive content plan for a new article.
    • This plan includes the article title, meta description, main headings (H1), subheadings (H2, H3), and key points to cover under each section.
    • It also suggests relevant keywords to incorporate.
  5. Article Draft Generation (AI Agent):
    • Using the generated content plan, the AI Agent drafts a full article.
    • It ensures the article adheres to SEO best practices, incorporates relevant keywords, and follows a logical structure.
  6. Data Structuring (Structured Output Parser): The AI-generated content plan and article are parsed into a structured JSON format for easier handling and storage.
  7. Data Aggregation: Combines the structured data from the content plan and article into a single item.
  8. Data Storage (Google Sheets): The generated content plan and article are appended as new rows to a specified Google Sheet, providing a centralized record.
  9. Data Storage (Supabase): The content plan and article are also inserted into a Supabase database, offering another persistent storage option.
  10. Conditional Supabase Update (Filter & Code):
    • A filter checks if the Supabase insertion was successful.
    • If successful, a "Code" node is executed (though its specific action is not detailed in the JSON, it's typically for post-insertion logic or logging).

Prerequisites/Requirements

  • n8n Instance: A running n8n instance (self-hosted or cloud).
  • Anthropic (Claude AI) API Key: For the AI Agent and Chat Model nodes to function.
  • Google Sheets Account: With a spreadsheet prepared for storing content data.
  • Supabase Account: With a database and table configured to receive content data.

Setup/Usage

  1. Import the workflow: Download the JSON and import it into your n8n instance.
  2. Configure Credentials:
    • Set up your Anthropic API Key credential for the "Anthropic Chat Model" node.
    • Set up your Google Sheets credential for the "Google Sheets" node.
    • Set up your Supabase credential for the "Supabase" node.
  3. Customize Google Sheets Node:
    • Specify the Spreadsheet ID and Sheet Name where you want to store the content plan and article.
  4. Customize Supabase Node:
    • Specify the Table Name where you want to insert the content data.
  5. Run the workflow: Click "Execute workflow" on the "Manual Trigger" node.
  6. Provide Input: When prompted, enter your desired targetKeyword (e.g., "best vegan recipes for beginners").
  7. Review Output: The workflow will then execute, generating the content plan and article, and storing them in your configured Google Sheet and Supabase database.

Related Templates

Track competitor SEO keywords with Decodo + GPT-4.1-mini + Google Sheets

This workflow automates competitor keyword research using OpenAI LLM and Decodo for intelligent web scraping. Who this is for SEO specialists, content strategists, and growth marketers who want to automate keyword research and competitive intelligence. Marketing analysts managing multiple clients or websites who need consistent SEO tracking without manual data pulls. Agencies or automation engineers using Google Sheets as an SEO data dashboard for keyword monitoring and reporting. What problem this workflow solves Tracking competitor keywords manually is slow and inconsistent. Most SEO tools provide limited API access or lack contextual keyword analysis. This workflow solves that by: Automatically scraping any competitor’s webpage with Decodo. Using OpenAI GPT-4.1-mini to interpret keyword intent, density, and semantic focus. Storing structured keyword insights directly in Google Sheets for ongoing tracking and trend analysis. What this workflow does Trigger — Manually start the workflow or schedule it to run periodically. Input Setup — Define the website URL and target country (e.g., https://dev.to, france). Data Scraping (Decodo) — Fetch competitor web content and metadata. Keyword Analysis (OpenAI GPT-4.1-mini) Extract primary and secondary keywords. Identify focus topics and semantic entities. Generate a keyword density summary and SEO strength score. Recommend optimization and internal linking opportunities. Data Structuring — Clean and convert GPT output into JSON format. Data Storage (Google Sheets) — Append structured keyword data to a Google Sheet for long-term tracking. Setup Prerequisites If you are new to Decode, please signup on this link visit.decodo.com n8n account with workflow editor access Decodo API credentials OpenAI API key Google Sheets account connected via OAuth2 Make sure to install the Decodo Community node. Create a Google Sheet Add columns for: primarykeywords, seostrengthscore, keyworddensity_summary, etc. Share with your n8n Google account. Connect Credentials Add credentials for: Decodo API credentials - You need to register, login and obtain the Basic Authentication Token via Decodo Dashboard OpenAI API (for GPT-4o-mini) Google Sheets OAuth2 Configure Input Fields Edit the “Set Input Fields” node to set your target site and region. Run the Workflow Click Execute Workflow in n8n. View structured results in your connected Google Sheet. How to customize this workflow Track Multiple Competitors → Use a Google Sheet or CSV list of URLs; loop through them using the Split In Batches node. Add Language Detection → Add a Gemini or GPT node before keyword analysis to detect content language and adjust prompts. Enhance the SEO Report → Expand the GPT prompt to include backlink insights, metadata optimization, or readability checks. Integrate Visualization → Connect your Google Sheet to Looker Studio for SEO performance dashboards. Schedule Auto-Runs → Use the Cron Node to run weekly or monthly for competitor keyword refreshes. Summary This workflow automates competitor keyword research using: Decodo for intelligent web scraping OpenAI GPT-4.1-mini for keyword and SEO analysis Google Sheets for live tracking and reporting It’s a complete AI-powered SEO intelligence pipeline ideal for teams that want actionable insights on keyword gaps, optimization opportunities, and content focus trends, without relying on expensive SEO SaaS tools.

Ranjan DailataBy Ranjan Dailata
161

Auto-reply & create Linear tickets from Gmail with GPT-5, gotoHuman & human review

This workflow automatically classifies every new email from your linked mailbox, drafts a personalized reply, and creates Linear tickets for bugs or feature requests. It uses a human-in-the-loop with gotoHuman and continuously improves itself by learning from approved examples. How it works The workflow triggers on every new email from your linked mailbox. Self-learning Email Classifier: an AI model categorizes the email into defined categories (e.g., Bug Report, Feature Request, Sales Opportunity, etc.). It fetches previously approved classification examples from gotoHuman to refine decisions. Self-learning Email Writer: the AI drafts a reply to the email. It learns over time by using previously approved replies from gotoHuman, with per-classification context to tailor tone and style (e.g., different style for sales vs. bug reports). Human Review in gotoHuman: review the classification and the drafted reply. Drafts can be edited or retried. Approved values are used to train the self-learning agents. Send approved Reply: the approved response is sent as a reply to the email thread. Create ticket: if the classification is Bug or Feature Request, a ticket is created by another AI agent in Linear. Human Review in gotoHuman: How to set up Most importantly, install the gotoHuman node before importing this template! (Just add the node to a blank canvas before importing) Set up credentials for gotoHuman, OpenAI, your email provider (e.g. Gmail), and Linear. In gotoHuman, select and create the pre-built review template "Support email agent" or import the ID: 6fzuCJlFYJtlu9mGYcVT. Select this template in the gotoHuman node. In the "gotoHuman: Fetch approved examples" http nodes you need to add your formId. It is the ID of the review template that you just created/imported in gotoHuman. Requirements gotoHuman (human supervision, memory for self-learning) OpenAI (classification, drafting) Gmail or your preferred email provider (for email trigger+replies) Linear (ticketing) How to customize Expand or refine the categories used by the classifier. Update the prompt to reflect your own taxonomy. Filter fetched training data from gotoHuman by reviewer so the writer adapts to their personalized tone and preferences. Add more context to the AI email writer (calendar events, FAQs, product docs) to improve reply quality.

gotoHumanBy gotoHuman
353

Ai website scraper & company intelligence

AI Website Scraper & Company Intelligence Description This workflow automates the process of transforming any website URL into a structured, intelligent company profile. It's triggered by a form, allowing a user to submit a website and choose between a "basic" or "deep" scrape. The workflow extracts key information (mission, services, contacts, SEO keywords), stores it in a structured Supabase database, and archives a full JSON backup to Google Drive. It also features a secondary AI agent that automatically finds and saves competitors for each company, building a rich, interconnected database of company intelligence. --- Quick Implementation Steps Import the Workflow: Import the provided JSON file into your n8n instance. Install Custom Community Node: You must install the community node from: https://www.npmjs.com/package/n8n-nodes-crawl-and-scrape FIRECRAWL N8N Documentation https://docs.firecrawl.dev/developer-guides/workflow-automation/n8n Install Additional Nodes: n8n-nodes-crawl-and-scrape and n8n-nodes-mcp fire crawl mcp . Set up Credentials: Create credentials in n8n for FIRE CRAWL API,Supabase, Mistral AI, and Google Drive. Configure API Key (CRITICAL): Open the Web Search tool node. Go to Parameters → Headers and replace the hardcoded Tavily AI API key with your own. Configure Supabase Nodes: Assign your Supabase credential to all Supabase nodes. Ensure table names (e.g., companies, competitors) match your schema. Configure Google Drive Nodes: Assign your Google Drive credential to the Google Drive2 and save to Google Drive1 nodes. Select the correct Folder ID. Activate Workflow: Turn on the workflow and open the Webhook URL in the “On form submission” node to access the form. --- What It Does Form Trigger Captures user input: “Website URL” and “Scraping Type” (basic or deep). Scraping Router A Switch node routes the flow: Deep Scraping → AI-based MCP Firecrawler agent. Basic Scraping → Crawlee node. Deep Scraping (Firecrawl AI Agent) Uses Firecrawl and Tavily Web Search. Extracts a detailed JSON profile: mission, services, contacts, SEO keywords, etc. Basic Scraping (Crawlee) Uses Crawl and Scrape node to collect raw text. A Mistral-based AI extractor structures the data into JSON. Data Storage Stores structured data in Supabase tables (companies, company_basicprofiles). Archives a full JSON backup to Google Drive. Automated Competitor Analysis Runs after a deep scrape. Uses Tavily web search to find competitors (e.g., from Crunchbase). Saves competitor data to Supabase, linked by company_id. --- Who's It For Sales & Marketing Teams: Enrich leads with deep company info. Market Researchers: Build structured, searchable company databases. B2B Data Providers: Automate company intelligence collection. Developers: Use as a base for RAG or enrichment pipelines. --- Requirements n8n instance (self-hosted or cloud) Supabase Account: With tables like companies, competitors, social_links, etc. Mistral AI API Key Google Drive Credentials Tavily AI API Key (Optional) Custom Nodes: n8n-nodes-crawl-and-scrape --- How It Works Flow Summary Form Trigger: Captures “Website URL” and “Scraping Type”. Switch Node: deep → MCP Firecrawler (AI Agent). basic → Crawl and Scrape node. Scraping & Extraction: Deep path: Firecrawler → JSON structure. Basic path: Crawlee → Mistral extractor → JSON. Storage: Save JSON to Supabase. Archive in Google Drive. Competitor Analysis (Deep Only): Finds competitors via Tavily. Saves to Supabase competitors table. End: Finishes with a No Operation node. --- How To Set Up Import workflow JSON. Install community nodes (especially n8n-nodes-crawl-and-scrape from npm). Configure credentials (Supabase, Mistral AI, Google Drive). Add your Tavily API key. Connect Supabase and Drive nodes properly. Fix disconnected “basic” path if needed. Activate workflow. Test via the webhook form URL. --- How To Customize Change LLMs: Swap Mistral for OpenAI or Claude. Edit Scraper Prompts: Modify system prompts in AI agent nodes. Change Extraction Schema: Update JSON Schema in extractor nodes. Fix Relational Tables: Add Items node before Supabase inserts for arrays (social links, keywords). Enhance Automation: Add email/slack notifications, or replace form trigger with a Google Sheets trigger. --- Add-ons Automated Trigger: Run on new sheet rows. Notifications: Email or Slack alerts after completion. RAG Integration: Use the Supabase database as a chatbot knowledge source. --- Use Case Examples Sales Lead Enrichment: Instantly get company + competitor data from a URL. Market Research: Collect and compare companies in a niche. B2B Database Creation: Build a proprietary company dataset. --- WORKFLOW IMAGE --- Troubleshooting Guide | Issue | Possible Cause | Solution | |-------|----------------|-----------| | Form Trigger 404 | Workflow not active | Activate the workflow | | Web Search Tool fails | Missing Tavily API key | Replace the placeholder key | | FIRECRAWLER / find competitor fails | Missing MCP node | Install n8n-nodes-mcp | | Basic scrape does nothing | Switch node path disconnected | Reconnect “basic” output | | Supabase node error | Wrong table/column names | Match schema exactly | --- Need Help or More Workflows? Want to customize this workflow for your business or integrate it with your existing tools? Our team at Digital Biz Tech can tailor it precisely to your use case from automation logic to AI-powered enhancements. Contact: shilpa.raju@digitalbiz.tech For more such offerings, visit us: https://www.digitalbiz.tech ---

DIGITAL BIZ TECHBy DIGITAL BIZ TECH
923