Bright Data
Bright Data is the leading web data infrastructure powering AI and BI, trusted by over 20,000 companies - from top AI innovators to global leaders in eCommerce, financial services, market research, cybersecurity, travel, martech, and beyond.
Templates by Bright Data
Automate Glassdoor job search with Bright Data scraping & Google Sheets storage
š Glassdoor Job Finder: Bright Data Scraping + Keyword-Based Automation A comprehensive n8n automation that scrapes Glassdoor job listings using Bright Data's web scraping service based on user-defined keywords, location, and country parameters, then automatically stores the results in Google Sheets. š Overview This workflow provides an automated job search solution that extracts job listings from Glassdoor using form-based inputs and stores organized results in Google Sheets. Perfect for recruiters, job seekers, market research, and competitive analysis. Workflow Description: Automates Glassdoor job searches using Bright Data's web scraping capabilities. Users submit keywords, location, and country via form trigger. The workflow scrapes job listings, extracts company details, ratings, and locations, then automatically stores organized results in Google Sheets for easy analysis and tracking. āØ Key Features šÆ Form-Based Input: Simple web form for job type, location, and country š Glassdoor Integration: Uses Bright Data's Glassdoor dataset for accurate job data š Smart Data Processing: Automatically extracts key job information š Google Sheets Storage: Organized data storage with automatic updates š Status Monitoring: Built-in progress tracking and retry logic ā” Fast & Reliable: Professional scraping with error handling šÆ Keyword Flexibility: Search any job type with location filters š Structured Output: Clean, organized job listing data šÆ What This Workflow Does Input Job Keywords: Job title or role (e.g., "Software Engineer", "Marketing Manager") Location: City or region for job search Country: Target country for job listings Processing Form Submission Data Scraping via Bright Data Status Monitoring Data Extraction Data Processing Sheet Update Output Data Points | Field | Description | Example | |-------|-------------|---------| | Job Title | Position title from listing | Senior Software Engineer | | Company Name | Employer name | Google Inc. | | Location | Job location | San Francisco, CA | | Rating | Company rating score | 4.5 | | Job Link | Direct URL to listing | https://glassdoor.com/job/... | š Setup Instructions Prerequisites n8n instance (self-hosted or cloud) Google account with Sheets access Bright Data account with Glassdoor scraping dataset access 5ā10 minutes for setup Step 1: Import the Workflow Copy the JSON workflow code from the provided file In n8n: Workflows ā + Add workflow ā Import from JSON Paste JSON and click Import Step 2: Configure Bright Data Set up Bright Data credentials in n8n Ensure access to dataset: gd_lpfbbndm1xnopbrcr0 Update API tokens in: "Scrape Job Data" node "Check Delivery Status of Snap ID" node "Getting Job Lists" node Step 3: Configure Google Sheets Integration Create a new Google Sheet (e.g., "Glassdoor Job Tracker") Set up Google Sheets OAuth2 credentials in n8n Prepare columns: Column A: Job Title Column B: Company Name Column C: Location Column D: Rating Column E: Job Link Step 4: Update Workflow Settings Update "Update Job List" node with your Sheet ID and credentials Test the form trigger and webhook URL Step 5: Test & Activate Submit test data (e.g., "Software Engineer" in "New York") Activate the workflow Verify Google Sheet updates and field extraction š Usage Guide Submitting Job Searches Navigate to your workflow's webhook URL Fill in: Search Job Type Location Country Submit the form Reading the Results Real-time job listing data Company ratings and reviews Direct job posting links Location-specific results Processing timestamps š§ Customization Options More Data Points: Add job descriptions, salary, company size, etc. Search Parameters: Add filters for salary, experience, remote work Data Processing: Add validation, deduplication, formatting šØ Troubleshooting Bright Data connection failed: Check API credentials and dataset access No job data extracted: Validate search terms and location format Google Sheets permission denied: Re-authenticate and check sharing Form submission failed: Check webhook URL and form config Workflow execution failed: Check logs, add retry logic Advanced Troubleshooting Check execution logs in n8n Test individual nodes Verify data formats Monitor rate limits Add error handling š Use Cases & Examples Recruitment Pipeline: Track job postings, build talent database Market Research: Analyze job trends, hiring patterns Career Development: Monitor opportunities, salary trends Competitive Intelligence: Track competitor hiring activity āļø Advanced Configuration Batch Processing: Accept multiple keywords, loop logic, delays Search History: Track trends, compare results over time External Tools: Integrate with CRM, Slack, databases, BI tools š Performance & Limits Single search: 2ā5 minutes Data accuracy: 95%+ Success rate: 90%+ Concurrent searches: 1ā3 (depends on plan) Daily capacity: 50ā200 searches Memory: ~50MB per execution API calls: 3 Bright Data + 1 Google Sheets per search š¤ Support & Community n8n Community Forum: community.n8n.io Documentation: docs.n8n.io Bright Data Support: Via your dashboard GitHub Issues: Report bugs and features Contributing: Share improvements, report issues, create variations, document best practices. Need Help? Check the full documentation or visit the n8n Community for support and workflow examples.
By Bright DataScrape Yelp business data with Gemini AI, Bright Data & Google Sheets
š Yelp Business Finder: Scraping Local Businesses by Keyword, Category & Location Using Bright Data and Google Sheets Description: Automate local business data collection from Yelp using AI-powered input validation, Bright Data scraping, and automatic Google Sheets integration. Perfect for market research, lead generation, and competitive analysis. š ļø How It Works Form Submission: Users submit a simple form with country, location, and business category parameters. AI Validation: Google Gemini AI validates and cleans input data, ensuring proper formatting and Yelp category alignment. Data Scraping: Bright Data's Yelp dataset API scrapes business information based on the cleaned parameters. Status Monitoring: The workflow monitors scraping progress and waits for data completion. Data Export: Final business data is automatically appended to your Google Sheets for easy analysis. š Setup Steps ā±ļø Estimated Setup Time: 10-15 minutes Prerequisites ā Active n8n instance (cloud or self-hosted) ā Google account with Sheets access ā Bright Data account with Yelp scraping dataset ā Google Gemini API access Configuration Steps Import Workflow: Copy the provided JSON workflow In n8n: Go to Workflows ā + Add workflow ā Import from JSON Paste the JSON and click Import Configure Google Sheets: Create a new Google Sheet or use an existing one Set up OAuth2 credentials in n8n Update the Google Sheets node with your document ID Configure column mappings for business data Setup Bright Data: Add your Bright Data API credentials to n8n Replace BRIGHTDATAAPI_KEY with your actual API key Verify your Yelp dataset ID in the HTTP request nodes Test the connection Configure Google Gemini: Add your Google Gemini API credentials Test the AI Agent connection Verify the model configuration Test & Activate: Activate the workflow using the toggle switch Test with sample data: country="US", location="New York", category="restaurants" Verify data appears correctly in your Google Sheet š Data Output š Business Name Official business name from Yelp ā Overall Rating Average customer rating (1-5 stars) š Reviews Count Total number of customer reviews š·ļø Categories Business categories and tags š Website URL Official business website š Phone Number Contact phone number š Address Full business address š Yelp URL Direct link to Yelp listing šÆ Use Cases š Market Research Analyze local business landscapes and competition š Lead Generation Build prospect lists for B2B outreach šŖ Location Analysis Research business density by area and category š Competitive Intelligence Monitor competitor ratings and customer feedback ā ļø Important Notes: Ensure you comply with Yelp's terms of service and rate limits Bright Data usage may incur costs based on your plan AI validation helps improve data quality and reduce errors Monitor your Google Sheets for data accuracy š§ Troubleshooting Common Issues: API Rate Limits: Implement delays between requests if needed Invalid Categories: AI agent helps standardize category names Empty Results: Verify location spelling and category alignment Authentication Errors: Check all API credentials and permissions š Ready to start scraping Yelp business data efficiently!
By Bright Data