S3 Filesystem Connector
File system connectors like S3 enable seamless integration between applications and cloud storage services, facilitating efficient file management, sharing, and storage across platforms.
Getting started with S3
To get started, you can do the following to acquire an Access key, Secret key and endpoint URL before heading over to Unstract to connect your S3 account.
1. Sign in to AWS IAM Console
- Go to the AWS IAM Console
- Log in with your AWS account.
2. Create a New IAM User (Recommended)
- Navigate to Users → Click Add User.
- Provide a User Name.
- Under Access Type, check Programmatic access (this will generate an Access Key and Secret Key).
- Click Next: Permissions.
3. Assign Permissions
- Choose one of the following:
- Attach existing policies directly: Select AmazonS3FullAccess (or create a custom policy with restricted access).
- Add the user to a group: If you have a group with S3 permissions, add the user to it.
4. Generate Access Keys
- After setting permissions, click Next: Tags → Next: Review → Create user.
- You will see the Access Key ID and Secret Access Key.
- Download the credentials (CSV file) and store them securely.
4.S3 Region
- Note down the region of the s3.It will be used to construct the endpoint url
Adding S3 Connector in Unstract
info
For the common steps on adding connectors in Unstract, see Working with Connectors.
When configuring the S3 connector, you'll need to provide the following connection details:
Required Configuration Fields
- Name of the connector: Enter a descriptive name for this connector
- Key: Enter your S3 Access Key ID
- Secret: Enter your S3 Secret Access Key
- Endpoint URL: Enter the S3 connection URL in the format:
https://s3.(your_s3_region).amazonaws.com
- Example: If your S3 region is
ap-south-1
, usehttps://s3.ap-south-1.amazonaws.com
- Region Name (Mandatory): Enter the region name of your AWS S3 account
- Example:
ap-south-1
- Example: