Custom S3 Storage

If your S3 storage is already available under one of the predefined storage providers (for example, IBM COS, Ceph, or AWS S3), use the respective provider instead of the Custom S3 option.

You can configure any S3 compatible object storage in watsonx.data using the Custom S3 Storage option. This feature supports a wide range of third-party storage providers that implement the S3 API standard.

IBM supports NetApp and Oracle Cloud Infrastructure (OCI).

If you select Custom S3 Storage from the Storage section, configure the following details:

Custom S3 Storage
Field Description
Display name Enter the name to be displayed.
Bucket name Enter the name of your existing bucket.
Region Enter the S3 storage region if required for access. If not, leave this field blank.
Endpoint Type Select the endpoint access type. Options are Path style access or Virtual host.

Note: Verify which access type your storage uses and select the appropriate option accordingly.
Endpoint Enter the Endpoint URL. Test connection is enabled when the endpoint is provided. The endpoint represents only the base service endpoint and must be provided in standard base URL format, regardless of whether you select Path style access or Virtual host in the Endpoint Type field. For example, https://s3.us-east-1.amazonaws.com or https://s3.amazonaws.com. You do not need to modify the endpoint format based on the bucket addressing style.

Note: For OCI storage, the endpoint must follow this format:
https://<namespace>.compat.objectstorage.<region>.oraclecloud.com
Access key Enter your access key.
Secret key Enter your secret key.
Connection status Click the Test connection link to test the bucket connection. If the bucket connection is successful, a success message appears.
Associate catalog Enable the toggle switch to add a catalog for your storage. This catalog is associated with your storage and serves as your query interface with the data stored within.
Catalog name Enter the name of the associated catalog.
Base path (optional)
Note: This field is available only in the watsonx.data Lite instance. This field appears only when you select Apache Iceberg as the catalog type..
Enter the base path for the catalog in the object storage. This allows you to associate multiple Iceberg catalogs with a single storage.
Note: You cannot share a storage between Iceberg and non-Iceberg catalogs.
Associate Click Associate to create the storage.