Skip to main content

Connectors

Connector endpoints manage filesystem (S3, GCS, Dropbox, Google Drive) and database (PostgreSQL, BigQuery, Snowflake, etc.) connections. Credentials are encrypted at rest. Some connectors support OAuth flows.

Permissions: List, retrieve, and create operations use IsOwnerOrSharedUserOrSharedToOrg. Update and delete operations use IsOwner.

Connector Discovery

List Supported Connectors

Get Connector Schema

Test Connector

Connector Instances

List Connectors

Create Connector

Retrieve Connector

Update Connector (Full)

Partial Update Connector

Delete Connector

OAuth Flow

For connectors that support OAuth (e.g., Google Drive), credentials are obtained through a browser-based authorization flow.

Get OAuth Cache Key

OAuth Flow Steps

OAuth Integration Flow
  1. Get a cache key -- Call GET /oauth/cache-key/{backend} to obtain a cache_key.
  2. Initiate OAuth -- Redirect the user to GET /oauth/login/{backend}/. This redirects to the OAuth provider's consent screen.
  3. Provider callback -- After the user authorizes, the provider redirects to /oauth/complete/{backend}/, which caches the credentials in Redis.
  4. Create or update the connector -- Pass the cache key as the ?oauth-key={cache_key} query parameter when calling the create or update endpoint.
  5. Credential retrieval -- The backend retrieves the cached credentials from Redis and stores them encrypted with the connector instance.
  6. Token refresh -- Token refresh is handled automatically by the platform. No manual intervention is required.

Connector Modes

ValueDescription
FILE_SYSTEMFilesystem connector (S3, GCS, Google Drive, Dropbox, etc.)
DATABASEDatabase connector (PostgreSQL, BigQuery, Snowflake, etc.)