Scrape Job Postings to Google Sheets

This n8n workflow automates the process of scraping job postings from various platforms (like Indeed, LinkedIn, etc.) using the RapidAPI Job Scraper and then saving the extracted data into a Google Sheet. It provides a convenient way to collect and organize job market data for analysis or personal use.

What it does

1. Triggers on Form Submission: The workflow starts when a form is submitted, likely containing search parameters for job postings.
2. Scrapes Job Postings: It makes an HTTP request to the RapidAPI Job Scraper (or a similar job scraping API) to fetch job listings based on the provided criteria.
3. Processes Scraped Data: A Code node then processes the raw data received from the API, likely extracting relevant fields and formatting them for storage.
4. Saves to Google Sheets: Finally, the processed job data is appended as new rows to a specified Google Sheet.

Prerequisites/Requirements

• n8n Instance: A running n8n instance to host the workflow.
• RapidAPI Account: An account with RapidAPI and a subscription to a Job Scraper API (e.g., "Job Scraper by RapidAPI"). You will need an API key.
• Google Account: A Google account with access to Google Sheets.
• Google Sheets Credential in n8n: An n8n credential configured for Google Sheets to allow the workflow to write data.
• HTTP Request Credential in n8n: An n8n credential for the HTTP Request node, likely for the RapidAPI key.

Setup/Usage

1. Import the Workflow:

   • Download the provided JSON file.
   • In your n8n instance, click "Workflows" in the left sidebar.
   • Click "New Workflow" and then "Import from JSON".
   • Paste the workflow JSON or upload the file.

2. Configure Credentials:

   • Google Sheets:
     • Click on the "Google Sheets" node.
     • Under "Credentials", select an existing Google Sheets credential or click "Create New" to set one up. Follow the n8n documentation for Google Sheets authentication (OAuth2 is recommended).
   • HTTP Request:
     • Click on the "HTTP Request" node.
     • Under "Authentication", select an appropriate credential type (e.g., "API Key" or "Header Auth") and enter your RapidAPI key. Ensure the header name matches what RapidAPI expects (e.g., X-RapidAPI-Key).

3. Configure Nodes:

   • On form submission: This node acts as the trigger. You will need to design the form that users will fill out to initiate the job scraping. The form fields should correspond to the parameters expected by your job scraping API (e.g., job title, location, number of results).
   • HTTP Request:
     • Verify the "URL" field points to the correct RapidAPI Job Scraper endpoint.
     • Adjust "Method" (likely GET or POST) and "Headers" as required by the RapidAPI documentation.
     • Ensure the "Query Parameters" or "Body Parameters" are correctly mapped to the data received from the "On form submission" node (e.g., {{$json.jobTitle}}, {{$json.location}}).
   • Code:
     • Review the JavaScript code within this node. It's responsible for parsing the API response and transforming it into a format suitable for Google Sheets. You may need to adjust the code based on the exact structure of the data returned by your chosen job scraping API.
   • Google Sheets:
     • Specify the "Spreadsheet ID" and "Sheet Name" where you want the job data to be saved.
     • Ensure the "Operation" is set to "Append Row".
     • Map the data from the "Code" node to the columns in your Google Sheet.

4. Activate the Workflow:

   • Once configured, save the workflow and activate it by toggling the "Active" switch in the top right corner of the n8n editor.

5. Use the Form:

   • Share the URL for the n8n form trigger (found in the "On form submission" node settings) with users.
   • When the form is submitted, the workflow will execute, scrape job postings, and add them to your Google Sheet.