Pull from S3
Configuration reference for the S3 Pull block — an alternative source block for reading files from an AWS S3 bucket.
The S3 Pull block is an alternative source block used when data files are stored in an AWS S3 bucket rather than an FTP/SFTP server.
Block type: s3_pull
Polls an S3 bucket, downloads files in the specified path, and moves them for downstream processing.
Configuration fields
| Field | Description |
|---|---|
| S3 Bucket Name * | Name of the S3 bucket where source files are stored |
| S3 Object Path * | Path prefix within the bucket where files are located |
| AWS Access Key * | AWS access key ID for authentication |
| AWS Secret Key * | AWS secret access key for authentication |
| AWS Region * | AWS region hosting the S3 bucket (e.g., us-east-1, eu-west-1) |
* Required field
Updated about 10 hours ago