Introduction
IBM® watsonx.data is a data management solution for collecting, storing, querying, and analyzing all your enterprise data (structured, semi-structured, and unstructured) with a single unified data platform. It provides a flexible and reliable platform that is optimized to work on open data formats.
The api are in beta state and expected to change.
Endpoint URLs
The base URLs come from the service instance. Use the value of the URL. Add the method to form the complete API endpoint for your request.
List of valid regions example on aws to access the Multiple Cloud SaaS Platform(MCSP) endpoints
- console-aws-useast1.lakehouse.saas.ibm.com
- console-aws-uswest2.lakehouse.saas.ibm.com
- console-aws-eucentral1.lakehouse.saas.ibm.com
- console-aws-apnortheast1.lakehouse.saas.ibm.com
- console-aws-apnortheast2.lakehouse.saas.ibm.com
- console-aws-cacentral1.lakehouse.saas.ibm.com
- console-aws-apsoutheast1.lakehouse.saas.ibm.com
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" "https://{region}.lakehouse.saas.ibm.com/"
Replace {region} with the region info of your MCSP instance.
Authentication
Required Purpose: To work with the API in Multiple Cloud SaaS Platform(MCSP), you must use either a MCSP API key or a MCSP token. The API key or token is used to determine the actions that a user or service ID has access to when they use the API.
With the MCSP console, you can Access a watsonx.data instance and generate the service ID and MCSP_APIKEY.
Service Instance ID and MCSP_APIKEY Example:
WXD service instanceID(SERVICE_INSTANCE_ID): 20240527-0304-3748-903b-a7e67216c1bb
MCSP_APIKEY : az************************************************************************************************************k9
You can generate a MCSP token with the Service Instance ID and MCSP APIKEY via the API on the right.
To use the MCSP API key or the MCSP token when you call the APIs of the IBM watsonx.data as a Service on AWS, there are two options
- add a valid MCSP_TOKEN token to the HTTP Authorization request header, for example,
-H 'Authorization: Bearer ${MCSP_TOKEN}' - add a MCSP API key to the HTTP Authorization request header, for example,
-u "apikey:${MCSP_APIKEY}"
In the APIs exmaple section, the default is to use the MCSP_TOKEN token. You can manully change to use the API key based on your needs.
To retrieve MCSP token:
curl -X POST https://account-iam.platform.saas.ibm.com/api/2.0/services/<SERVICE_INSTANCE_ID>/apikeys/token -H 'accept: application/json' -H 'Content-Type: application/json' -d '{ "apikey": "<MCSP_APIKEY>" }'
Replace <MCSP_APIKEY> with your MCSP_APIKEY
Auditing
Required if applicable Purpose: Describes that the API generates auditing events that can be consumed by the Activity Tracker service, and links to your related product docs for more information. Required only if any of the API's methods is enabled to generate auditing events.
Example:
You can monitor API activity within your account by using the IBM Cloud Activity Tracker service. Whenever an API method is called, an event is generated that you can then track and audit from within Activity Tracker. The specific event type is listed for each individual method.
For more information about how to track Certificate Manager activity, see Auditing events for Certificate Manager.
Error handling
This API uses standard HTTP response codes to indicate whether a method completed successfully. A 200 response indicates success. A 400 type response indicates a failure, and a 500 type response indicates an internal system error.
| HTTP Error Code | Description | Recovery |
|---|---|---|
200 |
Success | The request was successful. |
201 |
Created | The requested resource successfully created in a synchronous manner. |
204 |
No Content | The server successfully processed the request and is not returning any content. |
400 |
Bad Request | The input parameters in the request body are either incomplete or in the wrong format. Be sure to include all required parameters in your request. |
401 |
Unauthorized | You are not authorized to make this request. Log in to IBM Cloud and try again. If this error persists, contact the account owner to check your permissions. |
403 |
Forbidden | The supplied authentication is not authorized to access '{namespace}'. |
404 |
Not Found | The requested resource could not be found. |
409 |
Conflict | The entity is already in the requested state. |
500 |
Internal Server Error | Your request could not be processed. Wait a few minutes and try again. |
Pagination
Some API requests might return many results. To avoid performance issues, these results are returned one page at a time, with a limited number of results on each page. GET requests for the following resources use pagination:
/v1/statement
For the request that uses pagination, the response does include following urls to make subsequent requests :
infoUri: The URL for requesting the first page of results.nextUri: The URL for requesting the next page of results.
Methods
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations"
Response
List bucket registrations
Buckets
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "bucket_registrations": [ { "actions": [ "browse", "view", "modify", "create", "grant", "revoke", "update", "remove", "activate", "register" ], "associated_catalog": { "catalog_name": "iceberg_catalog", "catalog_tags": [] }, "bucket_details": { "bucket_name": "iceberg-bucket", "endpoint": "http://xyz-minio-svc:9000" }, "bucket_display_name": "hive-bucket", "bucket_id": "iceberg-bucket", "bucket_type": "minio", "created_by": "user", "created_on": "1699457595", "description": "default bucket", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }, { "actions": [ "browse", "view", "modify", "create", "grant", "revoke", "update", "remove", "activate", "register" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_tags": [] }, "bucket_details": { "bucket_name": "hive-bucket", "endpoint": "http://xyz-minio-svc:9000" }, "bucket_display_name": "hive-bucket", "bucket_id": "hive-bucket", "bucket_type": "minio", "created_by": "user", "created_on": "1699457595", "description": "default bucket", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
bucket details
bucket type
Allowable values: [
aws_s3,minio,ibm_cos,ibm_ceph]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
ibm_cosbucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*Example:
COS bucket for customer datamanaged by
Allowable values: [
ibm,customer]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
ibmbucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
sample-bucket-displaynameregion where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southtags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*Examples:[ "bucket-tag1", "bucket-tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Content-Type: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "bucket_details": { "access_key": "<access_key>", "bucket_name": "sample-bucket", "endpoint": "https://s3.{region}.cloud-object-storage.appdomain.cloud/", "secret_key": "secret_key" }, "bucket_display_name": "sample-bucket-displayname", "bucket_tags": [ "read customer data", "write customer data'" ], "bucket_type": "ibm_cos", "catalog_name": "sampleCatalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "description": "COS bucket for customer data", "managed_by": "ibm", "region": "us-south", "state": "active", "table_type": "iceberg" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations"
Response
Bucket
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }bucket type
Possible values: [
amazon_s3,aws_s3,minio,ibm_cos,ibm_ceph]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
ibm_cosUsername who created the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
1686120645bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*Example:
COS bucket for customer datamanaged by
Possible values: [
ibm,customer]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
ibmmark bucket active or inactive
Possible values: [
active,inactive]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
activeActions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "read", "update" ]bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
sample-bucket-displaynamebucket ID auto generated during bucket registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
samplebucket123Region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southtags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*Examples:[ "testbucket", "write customer data'" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_type": "hive" }, "bucket_display_name": "samplebucketdisplayname", "bucket_id": "samplebucketid", "bucket_name": "samplebucket", "bucket_type": "minio", "created_by": "username@domain.com", "created_on": "1699457595", "description": "default bucket", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}"
Response
Bucket
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }bucket type
Possible values: [
amazon_s3,aws_s3,minio,ibm_cos,ibm_ceph]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
ibm_cosUsername who created the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
1686120645bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*Example:
COS bucket for customer datamanaged by
Possible values: [
ibm,customer]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
ibmmark bucket active or inactive
Possible values: [
active,inactive]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
activeActions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "read", "update" ]bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
sample-bucket-displaynamebucket ID auto generated during bucket registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
samplebucket123Region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southtags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*Examples:[ "testbucket", "write customer data'" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_type": "hive" }, "bucket_display_name": "samplebucketdisplayname", "bucket_id": "samplebucketid", "bucket_name": "samplebucket", "bucket_type": "minio", "created_by": "username@domain.com", "created_on": "1699457595", "description": "default bucket", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
{
"bucket_display_name": "samplebucketdisplayname",
"bucket_id": "samplebucketid",
"created_by": "username@domain.com",
"description": "default bucket",
"tags": [
"tag1",
"tag2"
]
}bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
sample-bucket-displaynamemodified description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
COS bucket for customer dataTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*Examples:[ "testbucket", "userbucket" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Content-Type: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "access_key": "<access_key>", "bucket_display_name": "sample-bucket-displayname", "description": "COS bucket for customer data", "secret_key": "<secret_key>", "tags": [ "testbucket", "userbucket" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}"
Response
Bucket
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }bucket type
Possible values: [
amazon_s3,aws_s3,minio,ibm_cos,ibm_ceph]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
ibm_cosUsername who created the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
1686120645bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*Example:
COS bucket for customer datamanaged by
Possible values: [
ibm,customer]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
ibmmark bucket active or inactive
Possible values: [
active,inactive]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
activeActions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "read", "update" ]bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
sample-bucket-displaynamebucket ID auto generated during bucket registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
samplebucket123Region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southtags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*Examples:[ "testbucket", "write customer data'" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_type": "hive" }, "bucket_display_name": "samplebucketdisplayname", "bucket_id": "samplebucketid", "bucket_name": "samplebucket", "bucket_type": "minio", "created_by": "username@domain.com", "created_on": "1699457595", "description": "default bucket", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d "" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}/activate"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}/deactivate"
List bucket objects
Fetch all objects from a given bucket
GET /bucket_registrations/{bucket_id}/objectsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}/objects"
Response
List bucket objects
bucket object
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-/]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "objects": [ "/path/file1.json", "/path/file2.txt", "/path/file3.csv", "/path/file4.parquet" ] }
Check bucket credentials to be valid
Check whether provided bucket credentials are valid or not
POST /test_bucket_connection
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Check if given credentials for the bucket are valid
access key to access the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<access_key>name of the bucket to be checked
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sample-buckettype of bucket that is selected
Allowable values: [
amazon_s3,aws_s3,minio,ibm_cos,ibm_ceph]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibm_cosendpoint to reach the bucket
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/@?=.]+Example:
https://s3.<region>.cloud-object-storage.appdomain.cloud/bucket region
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southsecret key to access the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
secret_key
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "access_key": "<access_key>", "bucket_name": "sample-bucket", "bucket_type": "ibm_cos", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "region": "us-south", "secret_key": "<secret_key>" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/test_bucket_connection"
Response
ValidateBucketRegistrationCredentials OK
object defining the response of checking if the credentials of a bucket are valid
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal Server Error
{ "bucket_status": { "state": true, "state_message": "Credentials provided for <bucket-name> bucket are correct." }, "response": { "message": "Test bucket connection", "message_code": "success" } }
Add/Create database with driver
Add or create a new database with driver
POST /database_driver_registrations
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Form Parameters
Driver file to upload
Possible values: 1 ≤ length ≤ 104857600
Name of the driver file
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Host name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Port
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Username
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Psssword
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Database name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+contents of a pem/crt file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[a-zA-Z0-9\-]+extension of the certificate file
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+SSL Mode
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' -H "Content-Type: multipart/form-data" -F "port = t" -F "driver = " -F "database_display_name = t" -F "ssl = " -F "database_name =" -F "catalog_name =t" -F "hostname =t" -F "username =" -F "created_on =" -F "driver_file_name =" -F "certificate =" -F "certificate_extension =" -F "password =" -F "description =" -F "database_type =t" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_driver_registrations"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_databaseConnector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezzaactions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogCreated by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
user1@bim.comCreated on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1686792721Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_database_idThis will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Description of the external Databasetags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations"
Response
list database registrations
Database body
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "database_registrations": [ { "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "hive" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://ps.fyre.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the external Database", "tags": [ "testdatabase", "userdatabase" ] } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
Database display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
new_databaseConnector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
db2database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1686792721database details
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
db2 extenal database descriptiontags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "testdatabase", "userdatabase" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' -H "Content-Type: application/json" -d '{ "catalog_name": "sampleCatalog", "created_on": 0, "database_details": { "certificate": "contents of a pem/crt file", "certificate_extension": "pem/crt", "database_name": "new_database", "hostname": "db2@<hostname>.com", "hosts": "abc.com:1234,xyz.com:4321", "password": "samplepassword", "port": 4553, "sasl": true, "ssl": true, "tables": "kafka_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_properties": [ { "encrypt": true, "key": "abc", "value": "xyz" } ], "database_type": "db2", "description": "db2 extenal database description", "tags": [ "tag_1", "tag_2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_databaseConnector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezzaactions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogCreated by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
user1@bim.comCreated on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1686792721Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_database_idThis will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Description of the external Databasetags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations/{database_id}"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_databaseConnector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezzaactions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogCreated by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
user1@bim.comCreated on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1686792721Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_database_idThis will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Description of the external Databasetags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations/{database_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
New database details
New database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
new_databaseNew database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
External database descriptionNew tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 10000, Value must match regular expression
.*Examples:[ "testdatabase", "userdatabase" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' -H "Content-Type: application/json-patch+json" -d '{ "database_details": { "password": "samplepassword", "username": "sampleuser" }, "database_display_name": "new_database", "description": "External database description", "tags": [ "testdatabase", "userdatabase" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations/{database_id}"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_databaseConnector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezzaactions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogCreated by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
user1@bim.comCreated on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1686792721Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_database_idThis will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Description of the external Databasetags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
database details
Type of db connection
Allowable values: [
mysql,postgresql,netezza,db2,mongodb,kafka,sqlserver,mycustomdb]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezzacontents of a pem/crt file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[a-zA-Z0-9\-=]+Example:
contents of a pem/crt file
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "certificate": "contents of a pem/crt file", "database_details": { "database_name": "sampledatabase", "hostname": "db2@hostname.com", "password": "samplepassword", "port": 4553, "sasl": true, "ssl": true, "tables": "kafka_table_name", "username": "sampleuser" }, "database_type": "netezza", }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/test_database_connection"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/instance' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Response body structure for get deployments
DeploymentsResponse
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "deploymentresponse": { "deployment": { "cloud_type": "aws", "enable_private_endpoints": true, "enable_public_endpoints": true, "first_time_use": false, "formation_id": "new_form_id", "id": "dep_id", "plan_id": "new_plan_id", "platform_options": { "backup_encryption_key_crn": "2nf8f8b3kd8wknfkf", "disk_encryption_key_crn": "hjdkd8wjnnd93ujd9", "key_protect_key_id": "8ndkenkwjdciendj" }, "region": "us-south", "type": "deployment_type", "version": "1.0.2" } }, "response": { "message": "get instance", "message_code": "success" } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/other_engines"
Response
list other engines
list other engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "other_engines": [ { "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "other engine for running queries", "engine_details": { "connection_string": "https://other-connection-string-sample.com", "engine_type": "netezza" }, "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "origin": "external", "status": "registered", "type": "other" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create other Engine Body
External engine details
engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine01engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*Example:
external engine descriptionOrigin - created or registered
Allowable values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalother engine tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezza
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "external engine description", "engine_details": { "connection_string": "1.2.3.4", "engine_type": "netezza", "metastore_host": "1.2.3.4" }, "engine_display_name": "sampleEngine01", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/other_engines"
Response
external engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comcreated time in epoch format
engine description
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
.*Example:
engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineengine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
xyz-netezza-01-netezza-svcorigin
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmEngine port
engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
registeredTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Type like presto, netezza, external,..
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
external
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "OtherEngine": { "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "other engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "origin": "external", "status": "registered", "type": "other" } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/other_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines"
Response
list db2 engines
list db2 engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "db2_engines": [ { "created_by": "user@test.com", "created_on": 1700322436, "description": "db2 engine for running sql queries", "engine_details": { "connection_string": "jdbc:db2://<hostname>:<port>/<database>", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "db2", "engine_id": "db2505", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create db2 engine body
Origin - created or registered
Allowable values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalEngine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
db2Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
db2 engine descriptionExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "description": "db2 engine description", "engine_details": { "connection_string": "1.2.3.4" }, "engine_display_name": "sampleEngine", "origin": "external", "tags": [ "tag1", "tag2" ], "type": "db2" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines"
Response
Db2 engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
db2 engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
xyz-db2-01-db2-svcOrigin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmEngine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
REGISTEREDTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
db2
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "Db2Engine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for db2 engine.", "engine_details": { "connection_string\"": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample db2 Engine Display Name", "engine_id": "sample db2 Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
db2 engine updated descriptionEngine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json-patch+json" -d '{ "description": "db2 engine updated description", "engine_display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines/{engine_id}"
Response
Db2 engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
db2 engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
xyz-db2-01-db2-svcOrigin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmEngine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
REGISTEREDTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
db2
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "Db2Engine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for db2 engine.", "engine_details": { "connection_string\"": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample db2 Engine Display Name", "engine_id": "sample db2 Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines"
Response
list Netezza engines
list Netezza engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "netezza_engines": [ { "created_by": "user@test.com", "created_on": 1700322469, "description": "netezza engine for running sql queries", "engine_details": { "connection_string": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "netezza", "engine_id": "netezza170", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create netezza engine body
Origin - created or registered
Allowable values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalEngine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezzaEngine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
netezza engine descriptionExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "description": "netezza engine description", "engine_details": { "connection_string": "1.2.3.4" }, "engine_display_name": "sampleEngine", "origin": "external", "tags": [ "tag1", "tag2" ], "type": "netezza" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines"
Response
Netezza engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
netezza engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
xyz-netezza-01-netezza-svcOrigin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmEngine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
REGISTEREDTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezza
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "NetezzaEngine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for netezza engine.", "engine_details": { "connection_string\"": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample Netezza Engine Display Name", "engine_id": "sample Netezza Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */* " -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
netezza engine updated descriptionEngine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json-patch+json" -d '{ "description": "netezza engine updated description", "engine_display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines/{engine_id}"
Response
Netezza engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
netezza engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
xyz-netezza-01-netezza-svcOrigin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmEngine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
REGISTEREDTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
netezza
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "NetezzaEngine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for netezza engine.", "engine_details": { "connection_string\"": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample Netezza Engine Display Name", "engine_id": "sample Netezza Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines"
Response
list Prestissimo Engines
list prestissimo engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "prestissimo_engines": [ { "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "prestissimo511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "prestissimo511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "prestissimo", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create Engine Body
Origin - created or registered
Allowable values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
nativeEngine type prestissimo, others like netezza
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
prestissimoAssociated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "hive_data" ]Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
prestissimo engine descriptionExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineRegion (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
us-southTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Version like 0.278 for prestissimo or else
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
1.2.3
curl -X 'POST' \'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines' \-H 'accept: application/json' \-H 'Authorization: Bearer {MCSP_TOKEN}' \-H 'Content-Type: application/json' \-d '{ "associated_catalogs": [ "iceberg_data", "hive_data" ], "description": "prestissimo engine description", "engine_details": { "api_key": "<api_key>", "connection_string": "1.2.3.4", "coordinator": { "node_type": "worker", "quantity": 0 }, "instance_id": "instance_id", "managed_by": "fully/self", "size_config": "starter", "worker": { "node_type": "worker", "quantity": 0 } }, "engine_display_name": "sampleEngine", "first_time_use": true, "origin": "native", "region": "us-south", "tags": [ "tag1", "tag2" ], "type": "prestissimo", "version": "1.2.3"}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.comEngine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "update", "delete" ]Associated catalog
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0Node details
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
prestissimo engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngine123Engine properties
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceGroup ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
new_group_idEngine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
xyz-prestissimo-01-prestissimo-svcOrigin - place holder
Possible values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
nativeEngine port
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
us-southRemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
starterEngine status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
prestissimoVersion of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
1.2.0Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "prestissimo engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}"
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.comEngine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "update", "delete" ]Associated catalog
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0Node details
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
prestissimo engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngine123Engine properties
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceGroup ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
new_group_idEngine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
xyz-prestissimo-01-prestissimo-svcOrigin - place holder
Possible values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
nativeEngine port
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
us-southRemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
starterEngine status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
prestissimoVersion of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
1.2.0Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "prestissimo engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Update prestissimo engine
Update details of prestissimo engine
PATCH /prestissimo_engines/{engine_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update prestissimo engine body
Modified description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
updated description for prestissimo engineEngine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine properties
- engine_properties
catalog description
Configuration settings for the engine properties
velox description
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceRemoveEngine properties
- remove_engine_properties
catalog description
remove engine properties configuration
velox description
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H 'Content-Type: application/json-patch+json' -H "AuthInstanceId: {CRN}" -d '{ "description": "updated description for prestissimo engine", "engine_display_name": "sampleEngine", "engine_properties": { "configuration": { "coordinator": { "property_1": "property_value", "property_2": "property_value" }, "worker": { "property_1": "property_value", "property_2": "property_value" } }, "catalog": { "catalog_name": { "property_1": "property_value", "property_2": "property_value" } }, "velox": { "property_1": "property_value", "property_2": "property_value" } }, "engine_restart": "force", "remove_engine_properties": { "configuration": { "coordinator": [ "property1", "property2" ], "worker": [ "property1", "property2" ] }, "catalog": { "catalog_name": [ "property1", "property2" ] }, "velox": [ "property1", "property2" ] }, "tags": [ "tag1", "tag2" ]}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.comEngine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "update", "delete" ]Associated catalog
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0Node details
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
prestissimo engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngine123Engine properties
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceGroup ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
new_group_idEngine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
xyz-prestissimo-01-prestissimo-svcOrigin - place holder
Possible values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
nativeEngine port
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
us-southRemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
starterEngine status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
prestissimoVersion of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
1.2.0Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "prestissimo engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
Get prestissimo engine catalogs
Get list of all catalogs attached a prestissimo engine
GET /prestissimo_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Associate catalogs to a prestissimo engine
Associate one or more catalogs to a prestissimo engine
PUT /prestissimo_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
comma separated catalog names
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Disassociate catalogs from a prestissimo engine
Disassociate one or more catalogs from a prestissimo engine
DELETE /prestissimo_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-,_]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Get prestissimo engine catalog
Get catalog attached to a prestissimo engine
GET /prestissimo_engines/{engine_id}/catalogs/{catalog_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+catalog id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogTable type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
icebergCreated by
Example:
<username>@<domain>.comCreated on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Iceberg catalog descriptionIBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
s3a://samplehost.comLast sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Managed by
Possible values: [
ibm,customer]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmCatalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
glueIBM thrift uri port
Example:
3232Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningSync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Table registration was successfulTables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
SUCCESSTags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "update", "delete" ], "associated_buckets": [ "ibm_cos_bucket" ], "associated_databases": [ "iceberg_data" ], "associated_engines": [ "presto367" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@domain.com", "created_on": "1700633239", "description": "catalog description", "hostname": "1234-xyz456-abc4321.lakehouse.dev.appdomain.cloud", "port": "31504", "sync_exception": [ "table is corrupted", "table metadata not there" ], "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354" }
Pause prestissimo engine
Pause a running prestissimo engine
POST /prestissimo_engines/{engine_id}/pauseRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/pause' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to determine explain plan
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
show schemas in catalog_nameFormat
Allowable values: [
,text,graphviz,json]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
jsonType
Allowable values: [
,logical,distributed,validate,io]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
io
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/query_explain' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "format": "json", "statement": "show schemas in catalog_name", "type": "io"}'
Explain analyze
Return query metrics after query is complete
POST /prestissimo_engines/{engine_id}/query_explain_analyzeRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to show explain analyze
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
show schemas in catalog_nameVerbose
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/query_explain_analyze' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "statement": "show schemas in catalog_name", "verbose": true}'
Restart a prestissimo engine
Restart an existing prestissimo engine
POST /prestissimo_engines/{engine_id}/restartRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/restart' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d ''
Resume prestissimo engine
Resume a paused prestissimo engine
POST /prestissimo_engines/{engine_id}/resumeRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/resume' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d ''
Scale a prestissimo engine
Scale an existing prestissimo engine
POST /prestissimo_engines/{engine_id}/scaleRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Scale Engine Body
Node details
Node details
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/scale' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' -H "AuthInstanceId: {CRN}" -d '{ "coordinator": { "node_type": "worker", "quantity": 0 }, "worker": { "node_type": "worker", "quantity": 0 }}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines"
Response
List Presto engines
Presto engine
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "presto_engines": [ { "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create Engine Body
Origin - created or registered
Allowable values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeEngine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
prestoAssociated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "iceberg_data", "hive_data" ]Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*Example:
presto engine for running sql queriesNode details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineRegion (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Version like 0.278 for presto or else
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1.2.3
curl -X 'POST' \'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines' \-H 'accept: application/json' \-H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' \-d '{ "associated_catalogs": [ "iceberg_data", "hive_data" ], "description": "presto engine description", "engine_details": { "api_key": "<api_key>", "connection_string": "1.2.3.4", "coordinator": { "node_type": "worker", "quantity": 0 }, "instance_id": "instance_id", "managed_by": "fully/self", "size_config": "starter", "worker": { "node_type": "worker", "quantity": 0 } }, "engine_display_name": "sampleEngine", "first_time_use": true, "origin": "native", "region": "us-south", "tags": [ "tag1", "tag2" ], "type": "presto", "version": "1.2.3"}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.comEngine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Examples:[ "iceberg_data", "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0NodeDescription
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*Example:
presto engine for running sql queriesDriver details
Possible values: 0 ≤ number of items ≤ 10000
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine properties
engine will restart accordingily
Possible values: [
force,false]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceGroup ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_group_idEngine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/_.?=@]+Example:
ibm-lh-lakehouse-presto-01-presto-svcOrigin - created or registered
Possible values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeEngine port
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southRemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
starterEngine status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
prestoVersion of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1.2.0NodeDescription
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.comEngine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Examples:[ "iceberg_data", "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0NodeDescription
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*Example:
presto engine for running sql queriesDriver details
Possible values: 0 ≤ number of items ≤ 10000
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine properties
engine will restart accordingily
Possible values: [
force,false]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceGroup ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_group_idEngine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/_.?=@]+Example:
ibm-lh-lakehouse-presto-01-presto-svcOrigin - created or registered
Possible values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeEngine port
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southRemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
starterEngine status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
prestoVersion of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1.2.0NodeDescription
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
updated description for presto engineEngine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine properties
- engine_properties
Configuration settings
JVM settings
engine will restart accordingily
Allowable values: [
force,false]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceRemoveEngine properties
- remove_engine_properties
Configuration settings for removing engine properties
JVM properties
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H 'Content-Type: application/json-patch+json' -H "AuthInstanceId: {CRN}" -d '{ "description": "updated description for presto engine", "engine_display_name": "sampleEngine", "engine_properties": { "configuration": { "coordinator": { "property1": "value1" }, "worker": { "property1": "value1" } }, "jvm": { "coordinator": { "property1": "value1" }, "worker": { "property1": "value1" } }, }, "engine_restart": "force", "remove_engine_properties": { "configuration": { "coordinator": [ ], "worker": [ ] }, "jvm": { "coordinator": [ ], "worker": [ ] }, }, "tags": [ "tag1", "tag2" ]}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.comEngine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Examples:[ "iceberg_data", "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0NodeDescription
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*Example:
presto engine for running sql queriesDriver details
Possible values: 0 ≤ number of items ≤ 10000
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Engine properties
engine will restart accordingily
Possible values: [
force,false]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
forceGroup ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
new_group_idEngine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/_.?=@]+Example:
ibm-lh-lakehouse-presto-01-presto-svcOrigin - created or registered
Possible values: [
native,external,discover]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeEngine port
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
us-southRemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
starterEngine status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
prestoVersion of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1.2.0NodeDescription
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
Get presto engine catalogs
Get list of all catalogs attached to a presto engine
GET /presto_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Associate catalogs to presto engine
Associate one or more catalogs to a presto engine
PUT /presto_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
comma separated catalog names
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Disassociate catalogs from a presto engine
Disassociate one or more catalogs from a presto engine
DELETE /presto_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_,]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Get presto engine catalog
Get catalog attached to presto engine
GET /presto_engines/{engine_id}/catalogs/{catalog_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+catalog id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogTable type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
icebergCreated by
Example:
<username>@<domain>.comCreated on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Iceberg catalog descriptionIBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
s3a://samplehost.comLast sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Managed by
Possible values: [
ibm,customer]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmCatalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
glueIBM thrift uri port
Example:
3232Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningSync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Table registration was successfulTables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
SUCCESSTags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "update", "delete" ], "associated_buckets": [ "ibm_cos_bucket" ], "associated_databases": [ "iceberg_data" ], "associated_engines": [ "presto367" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@domain.com", "created_on": "1700633239", "description": "catalog description", "hostname": "1234-xyz456-abc4321.lakehouse.dev.appdomain.cloud", "port": "31504", "sync_exception": [ "table is corrupted", "table metadata not there" ], "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/pause' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to determine explain plan
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
show schemas in catalog_nameFormat
Allowable values: [
,text,graphviz,json]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
jsonType
Allowable values: [
,logical,distributed,validate,io]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
io
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/query_explain' -H 'accept: application/json' -H 'Content-Type: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d '{ "format": "json", "statement": "show schemas in catalog_name", "type": "io"}'
Response
ExplainStatement OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }Result
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "explain statement", "message_code": "success" }, "result": "explain statement" }
Explain presto analyze
Return query metrics after query is complete
POST /presto_engines/{engine_id}/query_explain_analyzeRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to show explain analyze
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
show schemas in catalog_nameVerbose
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/query_explain_analyze' -H 'accept: application/json' -H 'Content-Type: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d '{ "statement": "show schemas in catalog_name", "verbose": true}'
Response
explainAnalyzeStatement OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }explainAnalyzeStatement result
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "explain presto analyze", "message_code": "success" }, "result": "explain statement" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/restart' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/resume' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Scale Engine Body
NodeDescription
NodeDescription
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/scale' -H 'accept: application/json' -H 'Content-Type: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d '{ "coordinator": { "node_type": "worker", "quantity": 0 }, "worker": { "node_type": "worker", "quantity": 0 }}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines"
Response
List spark engines
List spark engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "spark_engines": [ { "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "connection_string": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop", "applications_api": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop/applications", "history_server_endpoint": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_api/v1", "view_history_server": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_ui", "application_endpoint": "https://example.com/lakehouse/api/v2/abcd-efgh-ijkl-mnop/spark_engines/spark119/applications" }, "engine_display_name": "Engine-Name", "engine_id": "spark678", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "spark" }, { "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [ "iceberg_data", "hudi_catalog", "delta_lake" ], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" }, "default_version": "3.3", "endpoints": { "application_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/applications", "engine_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123", "history_server_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/history_server" }, "engine_home_bucket_display_name": "bucket-name", "engine_home_bucket_name": "bucket-id", "scale_config": { "current_number_of_nodes": 1, "node_type": "type", "number_of_nodes": 1 } }, "engine_display_name": "Engine-Name", "engine_id": "spark123", "origin": "native", "status": "running", "tags": [], "type": "spark" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create spark engine Body
{
"description": "",
"engine_details": {
"default_version": "3.3",
"scale_config": {
"node_type": "small",
"number_of_nodes": 5
},
"engine_home_bucket_name": "4fec0f8b-888a-4c16-8f38-250c8499e6ce-customer"
},
"engine_display_name": "test-native",
"associated_catalogs": [
"iceberg_data"
],
"origin": "native",
"type": "spark"
}{
"description": "",
"engine_details": {
"connection_string": "https://<host>/<version>/analytics_engines/<instance_id>",
"api_key": "api_Key",
"managed_by": "fully"
},
"engine_display_name": "sample-external-spark",
"origin": "external",
"type": "spark"
}Origin - created or registered
Allowable values: [
external,discover,native]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalAssociated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "iceberg_data", "hive_data" ]Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
spark engine descriptionNode details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine status
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
provisioningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Engine type spark
Allowable values: [
spark]Example:
spark
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "", "engine_details": { "default_version": "3.3", "scale_config": { "node_type": "small", "number_of_nodes": 5 }, "engine_home_bucket_name": "4fec0f8b-888a-4c16-8f38-250c8499e6ce-customer" }, "engine_display_name": "test-native", "associated_catalogs": [ "iceberg_data" ], "origin": "native", "type": "spark" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines"curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "", "engine_details": { "connection_string": "https://<host>/<version>/analytics_engines/<instance_id>", "api_key": "<api_Key>", "managed_by": "fully" }, "engine_display_name": "sample-external-spark", "origin": "external", "type": "spark" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Examples:[ "iceberg_data", "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
spark engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Origin - created or registered
Possible values: [
external,discover,native]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalEngine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
RegisteredTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Type like spark, netezza,..
Possible values: [
spark]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
spark
Status Code
Accepted
Error
Unauthorized
Not found
Internal server error
{ "actions": [], "associated_catalogs": [ "iceberg_data" ], "engine_id": "spark123", "origin": "native", "status": "provisioning", "tags": [ "tag1", "tag2" ] }{ "actions": [], "associated_catalogs": [], "engine_id": "spark123", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Examples:[ "iceberg_data", "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
spark engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Origin - created or registered
Possible values: [
external,discover,native]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalEngine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
RegisteredTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Type like spark, netezza,..
Possible values: [
spark]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
spark
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [ "iceberg_data", "hudi_catalog", "delta_lake" ], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" }, "default_version": "3.3", "endpoints": { "application_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/applications", "engine_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123", "history_server_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/history_server" }, "engine_home_bucket_display_name": "bucket-name", "engine_home_bucket_name": "bucket-id", "scale_config": { "current_number_of_nodes": 1, "node_type": "type", "number_of_nodes": 1 } }, "engine_display_name": "Engine-Name", "engine_id": "spark123", "origin": "native", "status": "running", "tags": [], "type": "spark" }{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "connection_string": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop", "applications_api": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop/applications", "history_server_endpoint": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_api/v1", "view_history_server": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_ui", "application_endpoint": "https://example.com/lakehouse/api/v2/abcd-efgh-ijkl-mnop/spark_engines/spark119/applications" }, "engine_display_name": "Engine-Name", "engine_id": "spark456", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "spark" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
{
"engine_display_name": "Updated Display Name",
"description": "Updated Description",
"tags": [
"tag1",
"tag2"
],
"engine_details": {
"default_config": {
"config1": "value1",
"config2": "value2"
},
"default_version": "3.4"
}
}{
"engine_display_name": "Updated Display Name",
"description": "Updated description ",
"tags": [
"tag1"
]
}Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
updated description for spark engineEngine details
- engine_details
Dynamic dict
- default_config
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
The default spark version for the native engine
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-\.]+Example:
4.8.3
Engine display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*Example:
sampleEngineTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "Updated Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" }, "default_version": "3.4" }, "engine_display_name": "Updated Display Name", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"curl -X PATCH -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "Updated description", "engine_display_name": "Updated Display Name", "tags": [ "tag1" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Examples:[ "iceberg_data", "hive_data" ]watsonx.data build version
Example:
1.0.3.0.0Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
spark engine for running sql queriesExternal engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngineEngine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleEngine123Origin - created or registered
Possible values: [
external,discover,native]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
externalEngine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
RegisteredTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]Type like spark, netezza,..
Possible values: [
spark]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
spark
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [ "iceberg_data" ], "description": "Updated Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" } }, "engine_display_name": "Native Spark Engine", "engine_id": "spark422", "tags": [ "tag1" ] }{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [], "description": "Updated description", "engine_details": {}, "engine_display_name": "External Engine 1", "engine_id": "spar123", "tags": [ "tag1" ] }
List all applications in a spark engine
List all applications in a spark engine
GET /spark_engines/{engine_id}/applicationsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
state
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
.*
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications"
Response
Engine Application Detail
Application body
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "applications": [ { "application_id": "93b1a765-e3bc-4972-acc4-5b3d1a0f5d62", "auto_termination_time": "2024-05-15T18:11:54.615Z", "id": "93b1a765-e3bc-4972-acc4-5b3d1a0f5d62", "spark_application_id": "app-20240415181154-0000", "spark_application_name": "auto-scale-test", "spark_version": "3.4", "start_time": "2024-04-15T18:11:54.615Z", "state": "running", "submission_time": "2024-04-15T18:11:21.458Z" }, { "application_id": "b2d3f4g5-h6i7-j8k9-l0m1-n2o3p4q5r6s7", "auto_termination_time": "2025-06-16T19:12:55.716Z", "id": "b2d3f4g5-h6i7-j8k9-l0m1-n2o3p4q5r6s7", "spark_application_id": "app-20250516191255-0001", "spark_application_name": "data-processing-test", "spark_version": "3.3", "start_time": "2025-05-16T19:12:55.716Z", "state": "finished", "submission_time": "2025-05-16T19:12:22.559Z" } ] }{ "applications": [ { "application_id": "abcd-efgh-5806ab96-a5ba-4488-871b-162e13f6bf90", "id": "abcd-efgh-5806ab96-a5ba-4488-871b-162e13f6bf90", "runtime": { "spark_version": "3.3" }, "state": "accepted", "submission_time": "2024-04-15T18:13:17.507Z" }, { "application_id": "abcd-efgh-0969c82b-2980-48f4-8896-800e311a4696", "auto_termination_time": "2024-03-25T15:57:06.762Z", "end_time": "2024-03-22T15:57:24.703Z", "finish_time": "2024-03-22T15:57:24.703Z", "id": "abcd-efgh-0969c82b-2980-48f4-8896-800e311a4696", "runtime": { "spark_version": "3.3" }, "spark_application_id": "app-20240322155706-0000", "spark_application_name": "PythonWordCount", "start_time": "2024-03-22T15:57:06.762Z", "state": "finished", "submission_time": "2024-03-22T15:56:41.400Z" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
state
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
.*
Create spark application parameters
{
"application_details": {
"application": "/opt/ibm/spark/examples/src/main/python/wordcount.py",
"arguments": [
"/opt/ibm/spark/examples/src/main/resources/people.txt"
]
}
}Application details
Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applicationsService Instance ID for POST
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$Engine Type
Allowable values: [
iae,emr]Example:
iaeSpark application volumes to mount
Possible values: 0 ≤ number of items ≤ 100
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "application_details": { "application": "s3://mybucket/wordcount.py", "arguments": [ "people.txt" ], "conf": { "additionalProp1": "key:value", "additionalProp2": "key:value", "additionalProp3": "key:value" }, "env": { "additionalProp1": "key:value", "additionalProp2": "key:value", "additionalProp3": "key:value" }, "name": "SparkApplicaton1" }, "job_endpoint": "<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications", "service_instance_id": "3FGeNUZqcdu6rOFbaHhGBoNdCHj98UoHd6nUFqkfsKhgacYD8ImM6iSA_F-TjHUdEZuVsoQTmOn", "type": "iae" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications"
Response
Engine Application Status
Application details
Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99Auto Termination Time
Example:
2020-12-08T10:00:00.000ZCreation time
Example:
Saturday 28 October 2023 07:17:06.856+0000Deployment mode
Example:
stand-aloneEnd Time
Example:
2020-12-08T10:00:00.000ZFailed time
Finish time
Example:
Saturday 28 October 2023 07:17:38.966+0000Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applicationsReturn code
Example:
0application run time
Service Instance ID for POST
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$Spark application ID
Example:
app-20231028071726-0000Spark application name
Example:
PythonWordCountSpark Version
Possible values: 1 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-\.]+Example:
3.3Start time
Example:
Saturday 28 October 2023 07:17:26.649+0000Application state
Example:
FINISHEDApplication state details
Possible values: 0 ≤ number of items ≤ 10000
Application submission time
Example:
2023-11-01T11:18:49.758ZTemplate ID
Example:
spark-3.3-jaas-v2-cp4d-templateEngine Type
Possible values: [
iae,emr]Example:
iaeSpark application volumes to mount
Possible values: 0 ≤ number of items ≤ 100
Wxd history_server endpoint
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "id": "2ad2af4b-9747-4652-8e6e-d0a91599f9a2", "state": "accepted" }
Stop Spark Applications
Stop a running spark application
DELETE /spark_engines/{engine_id}/applicationsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Application id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+state
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
.*
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications?application_id={application_id}"
Get spark application
Get status of spark application
GET /spark_engines/{engine_id}/applications/{application_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+Application id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications/{application_id}"
Response
Engine Application Status
Application details
Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99Auto Termination Time
Example:
2020-12-08T10:00:00.000ZCreation time
Example:
Saturday 28 October 2023 07:17:06.856+0000Deployment mode
Example:
stand-aloneEnd Time
Example:
2020-12-08T10:00:00.000ZFailed time
Finish time
Example:
Saturday 28 October 2023 07:17:38.966+0000Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applicationsReturn code
Example:
0application run time
Service Instance ID for POST
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$Spark application ID
Example:
app-20231028071726-0000Spark application name
Example:
PythonWordCountSpark Version
Possible values: 1 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-\.]+Example:
3.3Start time
Example:
Saturday 28 October 2023 07:17:26.649+0000Application state
Example:
FINISHEDApplication state details
Possible values: 0 ≤ number of items ≤ 10000
Application submission time
Example:
2023-11-01T11:18:49.758ZTemplate ID
Example:
spark-3.3-jaas-v2-cp4d-templateEngine Type
Possible values: [
iae,emr]Example:
iaeSpark application volumes to mount
Possible values: 0 ≤ number of items ≤ 100
Wxd history_server endpoint
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "application_details": { "application": "/opt/ibm/spark/examples/src/main/python/wordcount.py", "conf": { "ae.spark.executor.count": "1", "spark.app.name": "MyJob", "spark.driver.cores": "1", "spark.driver.memory": "4G", "spark.eventLog.enabled": "true", "spark.executor.cores": "1", "spark.executor.memory": "4G" }, "env": { "SAMPLE_ENV_KEY": "SAMPLE_VALUE" }, "spark_version": "3.3" }, "application_id": "ff053468-9d89-468e-a5af-bd96b88c5bf5", "auto_termination_time": "2024-05-16T06:56:51.469Z", "end_time": "2024-04-16T06:57:19.912Z", "finish_time": "2024-04-16T06:57:19.912Z", "id": "ff053468-9d89-468e-a5af-bd96b88c5bf5", "return_code": "0", "spark_application_id": "app-20240416065651-0000", "spark_application_name": "PythonWordCount", "spark_version": "3.3", "start_time": "2024-04-16T06:56:51.469Z", "state": "finished", "submission_time": "2024-04-16T06:56:22.909Z" }
Get spark engine catalogs
Get list of all catalogs attached to a spark engine
GET /spark_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
GetCatalogs OK
Catalogs
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "action1", "action2" ], "catalog_name": "iceberg_data", "sync_exception": [], "tags": [ "tag1", "tag2" ] }, { "actions": [ "action3", "action4" ], "catalog_name": "hudi", "sync_exception": [], "tags": [ "tag3", "tag4" ] }, { "actions": [ "action5", "action6" ], "catalog_name": "delta_lake", "sync_exception": [], "tags": [ "tag5", "tag6" ] } ] }
Associate catalogs to spark engine
Associate one or more catalogs to a spark engine
PUT /spark_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
comma separated catalog names
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
GetCatalogs OK
Catalogs
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "action1", "action2" ], "catalog_name": "iceberg_data", "sync_exception": [], "tags": [ "tag1", "tag2" ] } ] }
Disassociate catalogs from a spark engine
Disassociate one or more catalogs from a spark engine
DELETE /spark_engines/{engine_id}/catalogsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_,]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Get spark engine catalog
Get catalog attached to spark engine
GET /spark_engines/{engine_id}/catalogs/{catalog_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+catalog id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogTable type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
icebergCreated by
Example:
<username>@<domain>.comCreated on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Iceberg catalog descriptionIBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
s3a://samplehost.comLast sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Managed by
Possible values: [
ibm,customer]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmCatalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
glueIBM thrift uri port
Example:
3232Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningSync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Table registration was successfulTables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
SUCCESSTags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [], "associated_buckets": [ "d501dc2b-05db-4d93-9aed-edf93c7bb0f6-customer" ], "associated_databases": [], "associated_engines": [ "presto459", "spark422" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@example.com", "created_on": "1713155437", "description": "icebarg_data", "hostname": "hostname", "port": "<port>", "sync_exception": [], "tags": [], "thrift_uri": "thrift://<hostname>:<port>" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/history_server"
Response
Native spark history server
History server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
2022-02-24T07:37:47ZHistory server cores
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1History server memory
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
4GHistory server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
2022-02-21T07:37:47ZHistory server state
Possible values: 1 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
started
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auto_termination_time": "2022-02-24T07:37:47Z", "cores": "1", "memory": "4G", "start_time": "2022-02-21T07:37:47Z", "state": "started" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Start history server parameter
CPU count
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^\d+$Example:
1Memory in GiB
Possible values: 2 ≤ length ≤ 10, Value must match regular expression
^[0-9]+G$Example:
4G
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/history_server"
Response
Native spark history server
History server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
2022-02-24T07:37:47ZHistory server cores
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1History server memory
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
4GHistory server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
2022-02-21T07:37:47ZHistory server state
Possible values: 1 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
started
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auto_termination_time": "2022-02-24T07:37:47Z", "cores": "1", "memory": "4G", "start_time": "2022-02-21T07:37:47Z", "state": "started" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/history_server"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/pause"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/resume"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Scale spark application parameters
Node count
Possible values: 0 ≤ value ≤ 5
Example:
2
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/scale"-d '{ "number_of_nodes": 2}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Response
List spark version
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }Spark versions list
Possible values: 1 ≤ number of items ≤ 100
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "List spark versions", "message_code": "success" }, "spark_versions": [ { "display_name": "3.3" } ] }
Get catalog properties by catalog_id
Get catalog properties of a catalog identified by catalog_id
GET /catalogs/{catalog_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog ID
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sampleCatalogTable type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
icebergCreated by
Example:
<username>@<domain>.comCreated on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Iceberg catalog descriptionIBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
s3a://samplehost.comLast sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
1602839833Managed by
Possible values: [
ibm,customer]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
ibmCatalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
glueIBM thrift uri port
Example:
3232Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningSync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
Table registration was successfulTables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
SUCCESSTags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "update", "delete" ], "associated_buckets": [ "ibm_cos_bucket" ], "associated_databases": [ "iceberg_data" ], "associated_engines": [ "presto367" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@domain.com", "created_on": "1700633239", "description": "catalog description", "hostname": "1234-xyz456-abc4321.lakehouse.dev.appdomain.cloud", "port": "31504", "sync_exception": [ "table is corrupted", "table metadata not there" ], "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
GetSchemas OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }Schemas
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "create schema", "message_code": "success" }, "schemas": [ "schema1", "schema2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Path associated with bucket
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
.*Example:
sample-pathSchema name
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
SampleSchema1Bucket associated to metastore where schema will be added
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Example:
sample-bucket
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' -d '{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "schema_name": "SampleSchema1" }'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+URL encoded Schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}?engine_id={engine_id}' -H 'accept: */*' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
List all tables
List all tables in a schema in a catalog for a given engine
GET /catalogs/{catalog_id}/schemas/{schema_id}/tablesRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
tables list
List of the tables present in the schema
Possible values: 0 ≤ number of items ≤ 1000000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "tables": [ "customer_data", "user_data" ] }
Get table details
Get details of a given table in a catalog and schema
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
GetColumns OK
Columns
Possible values: 0 ≤ number of items ≤ 1000000
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" } ], "table_name": "newtable," }
Delete table
Delete table for a given schema and catalog
DELETE /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: */*' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
New table name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
updated_table_name
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json-patch+json' -d '{ "new_table_name": "updated_table_name", }'
Response
GetColumns OK
Columns
Possible values: 0 ≤ number of items ≤ 1000000
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" } ], "table_name": "newtable," }
List all columns of a table
List all columns of a table in a given a schema for a given catalog
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columnsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Add column(s)
Add one or multiple columns to a table in a schema for a given catalog
POST /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columnsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
{
"columns": [
{
"column_name": "expenses",
"comment": "expenses column",
"extra": "varchar",
"type": "varchar"
}
]
}List of the tables present in the schema
Possible values: 0 ≤ number of items ≤ 1000000
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' -d '{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "schema_name": "SampleSchema1" }'
Delete column
Delete column in a table for a given schema and catalog
DELETE /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns/{column_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: */*' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Alter column
Update the given column - rename column
PATCH /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns/{column_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
{
"column_name": "expenses"
}Column name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
expenses
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json-patch+json' -d '{ "add_columns": [ { "column_comment": "income column", "column_name": "income", "data_type": "varchar" } ], "drop_columns": [ { "column_name": "expenditure" } ], "new_table_name": "updated_table_name", "rename_columns": [ { "column_name": "expenditure", "new_column_name": "expenses" } ] }'
Response
Column
Column name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
expensesComment
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
expenses columnExtra
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
varcharlength
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
30scale
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*Example:
2Data type
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
varchar
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "column_name": "expenses,", "comment": "expenses column", "extra": "varchar,", "type": "varchar," }
Get table snapshots
List all table snapshots
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshotsRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+Schema ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Table ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Rollback snapshot
Rollback to a table snapshot
PUT /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots/{snapshot_id}Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Schema ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Table ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*Snapshot ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots/{snapshot_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
External Iceberg table registration
Synchronize the external Iceberg table registration for a catalog identified by catalog_id.
PATCH /catalogs/{catalog_id}/syncRequest
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog ID
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+
Request body
Auto add new table
Example:
trueSync iceberg metadata
Example:
true
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/sync' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json-patch+json' -d '{ "auto_add_new_tables": true, "sync_iceberg_md": true }'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services"
Response
List milvus services
milvus service body
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "milvus_services": [ { "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create milvus service
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeservice type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
milvusService description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
milvus service for running sql queriesService display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleServiceTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X 'POST' \'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services' \-H 'accept: application/json' \-H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" \-H 'Content-Type: application/json' \-d '{ "bucket_name": "Sample bucket name", "bucket_type": "Sample bucket type", "description": "milvus service for running sql queries", "origin": "native", "root_path": "Sample path", "service_display_name": "sampleService", "tags": [ "tag1", "tag2" ], "tshirt_size": "small", "type": "milvus", }'
Response
milvus service details
milvus status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
milvus service for running sql queriesmilvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
example.grpc.hostmilvus port
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
sampleMilvusmilvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
example.https.hostmilvus port
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeService display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleServiceService programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleService123milvus status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
milvus
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "milvus_service": null, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services/{service_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H "AuthInstanceId: {CRN}"
Response
milvus service details
milvus status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
milvus service for running sql queriesmilvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
example.grpc.hostmilvus port
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
sampleMilvusmilvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
example.https.hostmilvus port
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeService display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleServiceService programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleService123milvus status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
milvus
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "milvus_service": null, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services/{service_id}' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update milvus service
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*Example:
updated description for milvus serviceService display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleServiceTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services/{service_id}' -H 'accept: application/json' -H 'Content-Type: application/json-patch+json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "updated description for milvus service", "engine_display_name": "sampleService", "tags": [ "tag1", "tag2" ]}'
Response
milvus service details
milvus status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Examples:[ "update", "delete" ]Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
<username>@<domain>.comCreated time in epoch format
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*Example:
milvus service for running sql queriesmilvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
example.grpc.hostmilvus port
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
sampleMilvusmilvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+Example:
example.https.hostmilvus port
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
nativeService display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleServiceService programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
sampleService123milvus status
Possible values: [
running,pending,stopped]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
runningTags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*Examples:[ "tag1", "tag2" ]service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+Example:
milvus
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "milvus_service": null, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" }