Skip to main content

S3 Filesystem Connector

File system connectors like S3 enable seamless integration between applications and cloud storage services, facilitating efficient file management, sharing, and storage across platforms.

Getting started with S3​

To get started, you can do the following to acquire an Access key, Secret key and endpoint URL before heading over to Unstract to connect your S3 account.

1. Sign in to AWS IAM Console​

  1. Navigate to Users → Click Add User.
  2. Provide a User Name.
  3. Under Access Type, check Programmatic access (this will generate an Access Key and Secret Key).
  4. Click Next: Permissions.

3. Assign Permissions​

  • Choose one of the following:
    • Attach existing policies directly: Select AmazonS3FullAccess (or create a custom policy with restricted access).
    • Add the user to a group: If you have a group with S3 permissions, add the user to it.

4. Generate Access Keys​

  • After setting permissions, click Next: Tags → Next: Review → Create user.
  • You will see the Access Key ID and Secret Access Key.
  • Download the credentials (CSV file) and store them securely.

4.S3 Region​

  • Note down the region of the s3.It will be used to construct the endpoint url

Setting up the S3 connector in Unstract​

Head over to the Unstract console, From the side navigation, select Workflows 🞂 + New Workflow 🞂 Create Workflow 🞂 Select Connector Type 🞂 File System 🞂 Settings icon.

  • For Name of the connector, enter a name for this connector
  • For Key, enter the S3 access key ID
  • For Secret, enter the S3 Secret access key
  • For Endpoint URL, enter the S3 connection URL.It should be in below format
  • For Region Name(Mandatory), enter region name of the AWS S3 account
  • Click Test Connection
  • Once the test is successful, Submit your changes.

Connector Options​

The Configuration panel offers a few options:

  • Folder to Process: The top-level directory Unstract should have access to.
  • File types to process: Limit Unstract to processing certain file types only.
  • Max files to process: The number of files Unstract should process in each batch.
  • Click on save once the configuration changes are made.

img S3_Filesysem Configuration