Scheduled FTP/SFTP to MinIO Backup with Preserved Folder Structure

This n8n workflow automates the process of backing up files from an FTP or SFTP server to a MinIO S3-compatible storage bucket, ensuring that the original folder structure is maintained. It's designed for reliable, scheduled data synchronization, offering a robust solution for offsite backups or data migration.

What it does

1. Triggers on a Schedule: The workflow starts automatically at predefined intervals (e.g., daily, hourly).
2. Connects to FTP/SFTP: It connects to a specified FTP or SFTP server.
3. Lists Files: It lists all files and directories on the configured FTP/SFTP path.
4. Uploads to MinIO: For each file found, it uploads the file to a MinIO bucket, recreating the original directory structure within the bucket.
5. Transforms Data (Optional): An "Edit Fields" node is present, which can be configured to modify or filter data before it's processed further, though it's currently a pass-through in the provided JSON.

Prerequisites/Requirements

• n8n Instance: A running n8n instance.
• FTP/SFTP Server Access: Credentials (host, port, username, password/private key) for your FTP or SFTP server.
• MinIO Instance: Access to a MinIO server or any S3-compatible storage.
• MinIO Credentials: Access Key ID and Secret Access Key for your MinIO bucket.
• MinIO Bucket: A pre-configured MinIO bucket where the backups will be stored.

Setup/Usage

1. Import the Workflow:
   • Copy the provided JSON code.
   • In your n8n instance, go to "Workflows" and click "New".
   • Click the "Import from JSON" button and paste the copied JSON.
2. Configure Credentials:
   • FTP Node:
     • Click on the "FTP" node.
     • Click "New Credential" for the FTP/SFTP account.
     • Enter your FTP/SFTP server details (host, port, username, password, or private key).
     • Specify the "Remote Path" from which you want to start the backup.
   • S3 Node:
     • Click on the "S3" node.
     • Click "New Credential" for the S3 account.
     • Select "MinIO" as the service provider.
     • Enter your MinIO "Access Key ID" and "Secret Access Key".
     • Provide the "Endpoint" URL for your MinIO instance (e.g., http://localhost:9000).
     • Specify the "Bucket Name" where files will be uploaded.
3. Configure Schedule Trigger:
   • Click on the "Schedule Trigger" node.
   • Set your desired schedule (e.g., "Every Day" at a specific time, "Every Hour").
4. Activate the Workflow:
   • Ensure all nodes are correctly configured.
   • Click the "Active" toggle in the top right corner of the workflow editor to enable the workflow.

The workflow will now run automatically based on your defined schedule, backing up files from your FTP/SFTP server to MinIO.