S3 (Write) block
The s3_write block puts an S3 object, writing processed files to a destination Amazon S3 bucket. It acts as the destination block in a Connect+ dataflow, receiving output from upstream blocks and uploading the resulting file to a specified S3 bucket using AWS credentials. The block supports configurable content types, AWS credential-based authentication, and an optional AWS Credentials Provider service for internal authentication.
When to use this block
Use this block when the processed output of your dataflow needs to be stored in an Amazon S3 bucket.
Prerequisites
Before configuring this block, make sure you have:
- AWS access key ID and secret access key with write permissions on the destination bucket
- The destination S3 bucket name and AWS region
Configuration fields
| Field name | Required | Description |
|---|---|---|
| Block name | Yes | A name for the block instance. The name must be alphanumeric. There is no character limit. |
| S3 Object name/Filename | Yes | The name given to the file uploaded to S3. Default value: ${filename}. |
| S3 Bucket Name | Yes | The name of the destination S3 bucket. Select a value from the dropdown. The list shows all values configured in the Extension Configuration section of the Dev Console. Default value: us-east-1. |
| Content Type | Yes | The type of the file being uploaded. Default value: application/octet-stream. |
| Access Key | Yes | The AWS access key ID used to authenticate with the S3 bucket. Select a value from the dropdown. The list shows all values configured in the Extension Configuration section of the Dev Console. |
| Secret Key | Yes | The AWS secret access key used for authentication. Select a value from the dropdown. The list shows configurations marked as secret in the Extension Configuration section of the Dev Console. Note: When creating the configuration in the Extension Configuration section of the Dev Console, Is Secret must be set to make it available in the dropdown. |
| AWS Region | Yes | The AWS region of the destination S3 bucket. |
| AWS Credentials Provider service | Yes | The credentials provider to use for authentication. Select None to use the Access Key and Secret Key, or InternalService to use Capillary's internal credentials provider.For example, when using the campaign bucket, you can skip providing the Access Key and Secret Key, as authentication is handled by Capillary. |

Updated about 1 month ago
