Skip to main content

Connectors

Connector endpoints manage filesystem (S3, GCS, Dropbox, Google Drive) and database (PostgreSQL, BigQuery, Snowflake, etc.) connections. Credentials are encrypted at rest. Some connectors support OAuth flows.

Permissions: List, retrieve, and create operations use IsOwnerOrSharedUserOrSharedToOrg. Update and delete operations use IsOwner.

Connector Discovery​

List Supported Connectors​

Get Connector Schema​

Test Connector​

Connector Instances​

List Connectors​

Create Connector​

Retrieve Connector​

Update Connector (Full)​

Partial Update Connector​

Delete Connector​

OAuth Flow​

For connectors that support OAuth (e.g., Google Drive), credentials are obtained through a browser-based authorization flow.

Get OAuth Cache Key​

OAuth Flow Steps​

OAuth Integration Flow
  1. Get a cache key -- Call GET /oauth/cache-key/{backend} to obtain a cache_key.
  2. Initiate OAuth -- Redirect the user to GET /oauth/login/{backend}/. This redirects to the OAuth provider's consent screen.
  3. Provider callback -- After the user authorizes, the provider redirects to /oauth/complete/{backend}/, which caches the credentials in Redis.
  4. Create or update the connector -- Pass the cache key as the ?oauth-key={cache_key} query parameter when calling the create or update endpoint.
  5. Credential retrieval -- The backend retrieves the cached credentials from Redis and stores them encrypted with the connector instance.
  6. Token refresh -- Token refresh is handled automatically by the platform. No manual intervention is required.

Connector Modes​

ValueDescription
FILE_SYSTEMFilesystem connector (S3, GCS, Google Drive, Dropbox, etc.)
DATABASEDatabase connector (PostgreSQL, BigQuery, Snowflake, etc.)