n8n Workflow: Pulling Data from Services Without Pre-built Integrations

This n8n workflow demonstrates a common pattern for interacting with web services that do not have a dedicated n8n integration. It uses the generic HTTP Request node to fetch data and then processes that data using core n8n nodes for filtering and transformation.

What it does

This workflow is designed to:

1. Make an HTTP Request: It initiates a request to an external web service or API using the HTTP Request node. This is the entry point for pulling raw data from a service that n8n doesn't have a pre-built integration for.
2. Extract HTML Content: The HTML Extract node is used, suggesting that the HTTP Request likely returns HTML content. This node is capable of parsing HTML and extracting specific elements based on CSS selectors.
3. Process Extracted Data: The Item Lists node is included, which is typically used for manipulating lists of items, such as aggregating, sorting, or filtering. This indicates further processing of the extracted data.
4. Conditional Logic: An If node is present, allowing the workflow to branch based on certain conditions evaluated from the data. This enables dynamic behavior depending on the data fetched.
5. Edit Fields (Set): The Edit Fields (Set) node is used for transforming or setting new fields on the incoming data. This is useful for cleaning up data, renaming fields, or adding calculated values before further steps.

Prerequisites/Requirements

• n8n Instance: A running n8n instance (cloud or self-hosted).
• Target API/Service: Access to the external web service or API you wish to pull data from. You will need its endpoint URL and any required authentication details (if applicable).

Setup/Usage

1. Import the workflow:
   • Copy the provided JSON code.
   • In your n8n instance, click on "Workflows" in the left sidebar.
   • Click "New" or the "+" icon, then select "Import from JSON".
   • Paste the JSON code and click "Import".
2. Configure the HTTP Request node (ID: 19):
   • Open the "HTTP Request" node.
   • Set the URL to the endpoint of the service you want to pull data from.
   • Configure the Method (e.g., GET, POST) and any other necessary options like Headers, Query Parameters, or Body data based on the API documentation of your target service.
   • If authentication is required, configure the appropriate Authentication method (e.g., API Key, OAuth2, Basic Auth).
3. Configure the HTML Extract node (ID: 114):
   • If your HTTP Request returns HTML, open the "HTML Extract" node.
   • Define the CSS Selectors to extract the specific data points you need from the HTML content.
4. Configure the Item Lists node (ID: 516):
   • Open the "Item Lists" node.
   • Adjust its settings based on how you want to manipulate the list of items (e.g., sort, split, unique).
5. Configure the If node (ID: 20):
   • Open the "If" node.
   • Define the Conditions that will determine which branch of the workflow the data should follow.
6. Configure the Edit Fields (Set) node (ID: 38):
   • Open the "Edit Fields (Set)" node.
   • Add or modify fields as needed to transform the data into your desired format.
7. Activate the workflow:
   • Once configured, click the "Activate" toggle in the top right corner of the workflow editor to enable it.
   • You can test the workflow manually by clicking "Execute Workflow" to ensure it runs as expected.