Introduction
IBM® watsonx.data is a data management solution for collecting, storing, querying, and analyzing all your enterprise data (structured, semi-structured, and unstructured) with a single unified data platform. It provides a flexible and reliable platform that is optimized to work on open data formats.
The api are in beta state and expected to change.
Endpoint URLs
The base URLs come from the service instance. Use the value of the URL. Add the method to form the complete API endpoint for your request.
List of valid regions example on aws to access the Multiple Cloud SaaS Platform(MCSP) endpoints
- console-aws-useast1.lakehouse.saas.ibm.com
- console-aws-uswest2.lakehouse.saas.ibm.com
- console-aws-eucentral1.lakehouse.saas.ibm.com
- console-aws-apnortheast1.lakehouse.saas.ibm.com
- console-aws-apnortheast2.lakehouse.saas.ibm.com
- console-aws-cacentral1.lakehouse.saas.ibm.com
- console-aws-apsoutheast1.lakehouse.saas.ibm.com
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" "https://{region}.lakehouse.saas.ibm.com/"
Replace {region} with the region info of your MCSP instance.
Authentication
Required Purpose: To work with the API in Multiple Cloud SaaS Platform(MCSP), you must use either a MCSP API key or a MCSP token. The API key or token is used to determine the actions that a user or service ID has access to when they use the API.
With the MCSP console, you can Access a watsonx.data instance and generate the service ID and MCSP_APIKEY.
Service Instance ID and MCSP_APIKEY Example:
WXD service instanceID(SERVICE_INSTANCE_ID): 20240527-0304-3748-903b-a7e67216c1bb
MCSP_APIKEY : az************************************************************************************************************k9
You can generate a MCSP token with the Service Instance ID and MCSP APIKEY via the API on the right.
To use the MCSP API key or the MCSP token when you call the APIs of the IBM watsonx.data as a Service on AWS, there are two options
- add a valid MCSP_TOKEN token to the HTTP Authorization request header, for example,
-H 'Authorization: Bearer ${MCSP_TOKEN}'
- add a MCSP API key to the HTTP Authorization request header, for example,
-u "apikey:${MCSP_APIKEY}"
In the APIs exmaple section, the default is to use the MCSP_TOKEN token. You can manully change to use the API key based on your needs.
To retrieve MCSP token:
curl -X POST https://account-iam.platform.saas.ibm.com/api/2.0/services/<SERVICE_INSTANCE_ID>/apikeys/token -H 'accept: application/json' -H 'Content-Type: application/json' -d '{ "apikey": "<MCSP_APIKEY>" }'
Replace <MCSP_APIKEY> with your MCSP_APIKEY
Auditing
Required if applicable Purpose: Describes that the API generates auditing events that can be consumed by the Activity Tracker service, and links to your related product docs for more information. Required only if any of the API's methods is enabled to generate auditing events.
Example:
You can monitor API activity within your account by using the IBM Cloud Activity Tracker service. Whenever an API method is called, an event is generated that you can then track and audit from within Activity Tracker. The specific event type is listed for each individual method.
For more information about how to track Certificate Manager activity, see Auditing events for Certificate Manager.
Error handling
This API uses standard HTTP response codes to indicate whether a method completed successfully. A 200
response indicates success. A 400
type response indicates a failure, and a 500
type response indicates an internal system error.
HTTP Error Code | Description | Recovery |
---|---|---|
200 |
Success | The request was successful. |
201 |
Created | The requested resource successfully created in a synchronous manner. |
204 |
No Content | The server successfully processed the request and is not returning any content. |
400 |
Bad Request | The input parameters in the request body are either incomplete or in the wrong format. Be sure to include all required parameters in your request. |
401 |
Unauthorized | You are not authorized to make this request. Log in to IBM Cloud and try again. If this error persists, contact the account owner to check your permissions. |
403 |
Forbidden | The supplied authentication is not authorized to access '{namespace}'. |
404 |
Not Found | The requested resource could not be found. |
409 |
Conflict | The entity is already in the requested state. |
500 |
Internal Server Error | Your request could not be processed. Wait a few minutes and try again. |
Pagination
Some API requests might return many results. To avoid performance issues, these results are returned one page at a time, with a limited number of results on each page. GET requests for the following resources use pagination:
/v1/statement
For the request that uses pagination, the response does include following urls to make subsequent requests :
infoUri
: The URL for requesting the first page of results.nextUri
: The URL for requesting the next page of results.
Methods
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations"
Response
List bucket registrations
Buckets
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "bucket_registrations": [ { "actions": [ "browse", "view", "modify", "create", "grant", "revoke", "update", "remove", "activate", "register" ], "associated_catalog": { "catalog_name": "iceberg_catalog", "catalog_tags": [] }, "bucket_details": { "bucket_name": "iceberg-bucket", "endpoint": "http://xyz-minio-svc:9000" }, "bucket_display_name": "hive-bucket", "bucket_id": "iceberg-bucket", "bucket_type": "minio", "created_by": "user", "created_on": "1699457595", "description": "default bucket", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }, { "actions": [ "browse", "view", "modify", "create", "grant", "revoke", "update", "remove", "activate", "register" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_tags": [] }, "bucket_details": { "bucket_name": "hive-bucket", "endpoint": "http://xyz-minio-svc:9000" }, "bucket_display_name": "hive-bucket", "bucket_id": "hive-bucket", "bucket_type": "minio", "created_by": "user", "created_on": "1699457595", "description": "default bucket", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
bucket details
bucket type
Allowable values: [
aws_s3
,minio
,ibm_cos
,ibm_ceph
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
ibm_cos
bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
COS bucket for customer data
managed by
Allowable values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
ibm
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
sample-bucket-displayname
region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*
Examples:[ "bucket-tag1", "bucket-tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Content-Type: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "bucket_details": { "access_key": "<access_key>", "bucket_name": "sample-bucket", "endpoint": "https://s3.{region}.cloud-object-storage.appdomain.cloud/", "secret_key": "secret_key" }, "bucket_display_name": "sample-bucket-displayname", "bucket_tags": [ "read customer data", "write customer data'" ], "bucket_type": "ibm_cos", "catalog_name": "sampleCatalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "description": "COS bucket for customer data", "managed_by": "ibm", "region": "us-south", "state": "active", "table_type": "iceberg" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations"
Response
Bucket
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
bucket type
Possible values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
ibm_cos
Username who created the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
1686120645
bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
COS bucket for customer data
managed by
Possible values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
ibm
mark bucket active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
active
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "read", "update" ]
bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
sample-bucket-displayname
bucket ID auto generated during bucket registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
samplebucket123
Region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*
Examples:[ "testbucket", "write customer data'" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_type": "hive" }, "bucket_display_name": "samplebucketdisplayname", "bucket_id": "samplebucketid", "bucket_name": "samplebucket", "bucket_type": "minio", "created_by": "username@domain.com", "created_on": "1699457595", "description": "default bucket", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}"
Response
Bucket
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
bucket type
Possible values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
ibm_cos
Username who created the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
1686120645
bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
COS bucket for customer data
managed by
Possible values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
ibm
mark bucket active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
active
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "read", "update" ]
bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
sample-bucket-displayname
bucket ID auto generated during bucket registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
samplebucket123
Region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*
Examples:[ "testbucket", "write customer data'" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_type": "hive" }, "bucket_display_name": "samplebucketdisplayname", "bucket_id": "samplebucketid", "bucket_name": "samplebucket", "bucket_type": "minio", "created_by": "username@domain.com", "created_on": "1699457595", "description": "default bucket", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
{
"bucket_display_name": "samplebucketdisplayname",
"bucket_id": "samplebucketid",
"created_by": "username@domain.com",
"description": "default bucket",
"tags": [
"tag1",
"tag2"
]
}
bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
sample-bucket-displayname
modified description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
COS bucket for customer data
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*
Examples:[ "testbucket", "userbucket" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Content-Type: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "access_key": "<access_key>", "bucket_display_name": "sample-bucket-displayname", "description": "COS bucket for customer data", "secret_key": "<secret_key>", "tags": [ "testbucket", "userbucket" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}"
Response
Bucket
bucket catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
bucket type
Possible values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
ibm_cos
Username who created the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
1686120645
bucket description
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
COS bucket for customer data
managed by
Possible values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
ibm
mark bucket active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
active
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "read", "update" ]
bucket details
bucket display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
sample-bucket-displayname
bucket ID auto generated during bucket registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
samplebucket123
Region where the bucket is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 1024, Value must match regular expression
.*
Examples:[ "testbucket", "write customer data'" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_type": "hive" }, "bucket_display_name": "samplebucketdisplayname", "bucket_id": "samplebucketid", "bucket_name": "samplebucket", "bucket_type": "minio", "created_by": "username@domain.com", "created_on": "1699457595", "description": "default bucket", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d "" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}/activate"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}/deactivate"
List bucket objects
Fetch all objects from a given bucket
GET /bucket_registrations/{bucket_id}/objects
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
bucket id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/bucket_registrations/{bucket_id}/objects"
Response
List bucket objects
bucket object
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-/]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "objects": [ "/path/file1.json", "/path/file2.txt", "/path/file3.csv", "/path/file4.parquet" ] }
Check bucket credentials to be valid
Check whether provided bucket credentials are valid or not
POST /test_bucket_connection
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Check if given credentials for the bucket are valid
access key to access the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<access_key>
name of the bucket to be checked
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sample-bucket
type of bucket that is selected
Allowable values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm_cos
endpoint to reach the bucket
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/@?=.]+
Example:
https://s3.<region>.cloud-object-storage.appdomain.cloud/
bucket region
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
secret key to access the bucket
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
secret_key
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "access_key": "<access_key>", "bucket_name": "sample-bucket", "bucket_type": "ibm_cos", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "region": "us-south", "secret_key": "<secret_key>" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/test_bucket_connection"
Response
ValidateBucketRegistrationCredentials OK
object defining the response of checking if the credentials of a bucket are valid
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal Server Error
{ "bucket_status": { "state": true, "state_message": "Credentials provided for <bucket-name> bucket are correct." }, "response": { "message": "Test bucket connection", "message_code": "success" } }
Add/Create database with driver
Add or create a new database with driver
POST /database_driver_registrations
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Form Parameters
Driver file to upload
Possible values: 1 ≤ length ≤ 104857600
Name of the driver file
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Host name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Port
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Username
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Psssword
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Database name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
contents of a pem/crt file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[a-zA-Z0-9\-]+
extension of the certificate file
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
SSL Mode
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' -H "Content-Type: multipart/form-data" -F "port = t" -F "driver = " -F "database_display_name = t" -F "ssl = " -F "database_name =" -F "catalog_name =t" -F "hostname =t" -F "username =" -F "created_on =" -F "driver_file_name =" -F "certificate =" -F "certificate_extension =" -F "password =" -F "description =" -F "database_type =t" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_driver_registrations"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
actions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
user1@bim.com
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1686792721
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database_id
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Description of the external Database
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations"
Response
list database registrations
Database body
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "database_registrations": [ { "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "hive" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://ps.fyre.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the external Database", "tags": [ "testdatabase", "userdatabase" ] } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
Database display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
new_database
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
db2
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1686792721
database details
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
db2 extenal database description
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "testdatabase", "userdatabase" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' -H "Content-Type: application/json" -d '{ "catalog_name": "sampleCatalog", "created_on": 0, "database_details": { "certificate": "contents of a pem/crt file", "certificate_extension": "pem/crt", "database_name": "new_database", "hostname": "db2@<hostname>.com", "hosts": "abc.com:1234,xyz.com:4321", "password": "samplepassword", "port": 4553, "sasl": true, "ssl": true, "tables": "kafka_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_properties": [ { "encrypt": true, "key": "abc", "value": "xyz" } ], "database_type": "db2", "description": "db2 extenal database description", "tags": [ "tag_1", "tag_2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
actions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
user1@bim.com
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1686792721
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database_id
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Description of the external Database
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations/{database_id}"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
actions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
user1@bim.com
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1686792721
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database_id
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Description of the external Database
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations/{database_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
New database details
New database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
new_database
New database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
External database description
New tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 10000, Value must match regular expression
.*
Examples:[ "testdatabase", "userdatabase" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' -H "Content-Type: application/json-patch+json" -d '{ "database_details": { "password": "samplepassword", "username": "sampleuser" }, "database_display_name": "new_database", "description": "External database description", "tags": [ "testdatabase", "userdatabase" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/database_registrations/{database_id}"
Response
database registration object
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
actions
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ "update", "delete" ]
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
user1@bim.com
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1686792721
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_database_id
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 10000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
Database description
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Description of the external Database
tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "testdatabase", "userdatabase" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_type": "iceberg" }, "created_by": "user1@bim.com", "created_on": "1686792721", "database_details": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "database_display_name": "new_database", "database_id": "new_database_id", "database_type": "netezza", "description": "Description of the database", "tags": [ "testdatabase", "userdatabase" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
database details
Type of db connection
Allowable values: [
mysql
,postgresql
,netezza
,db2
,mongodb
,kafka
,sqlserver
,mycustomdb
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
contents of a pem/crt file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[a-zA-Z0-9\-=]+
Example:
contents of a pem/crt file
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "certificate": "contents of a pem/crt file", "database_details": { "database_name": "sampledatabase", "hostname": "db2@hostname.com", "password": "samplepassword", "port": 4553, "sasl": true, "ssl": true, "tables": "kafka_table_name", "username": "sampleuser" }, "database_type": "netezza", }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/test_database_connection"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/instance' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Response body structure for get deployments
DeploymentsResponse
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "deploymentresponse": { "deployment": { "cloud_type": "aws", "enable_private_endpoints": true, "enable_public_endpoints": true, "first_time_use": false, "formation_id": "new_form_id", "id": "dep_id", "plan_id": "new_plan_id", "platform_options": { "backup_encryption_key_crn": "2nf8f8b3kd8wknfkf", "disk_encryption_key_crn": "hjdkd8wjnnd93ujd9", "key_protect_key_id": "8ndkenkwjdciendj" }, "region": "us-south", "type": "deployment_type", "version": "1.0.2" } }, "response": { "message": "get instance", "message_code": "success" } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/other_engines"
Response
list other engines
list other engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "other_engines": [ { "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "other engine for running queries", "engine_details": { "connection_string": "https://other-connection-string-sample.com", "engine_type": "netezza" }, "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "origin": "external", "status": "registered", "type": "other" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create other Engine Body
External engine details
engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine01
engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
external engine description
Origin - created or registered
Allowable values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
other engine tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "external engine description", "engine_details": { "connection_string": "1.2.3.4", "engine_type": "netezza", "metastore_host": "1.2.3.4" }, "engine_display_name": "sampleEngine01", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/other_engines"
Response
external engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
created time in epoch format
engine description
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
xyz-netezza-01-netezza-svc
origin
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Engine port
engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
registered
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Type like presto, netezza, external,..
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "OtherEngine": { "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "other engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "origin": "external", "status": "registered", "type": "other" } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/other_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H 'Authorization: Bearer {MCSP_TOKEN}' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines"
Response
list db2 engines
list db2 engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "db2_engines": [ { "created_by": "user@test.com", "created_on": 1700322436, "description": "db2 engine for running sql queries", "engine_details": { "connection_string": "jdbc:db2://<hostname>:<port>/<database>", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "db2", "engine_id": "db2505", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create db2 engine body
Origin - created or registered
Allowable values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
db2
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
db2 engine description
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "description": "db2 engine description", "engine_details": { "connection_string": "1.2.3.4" }, "engine_display_name": "sampleEngine", "origin": "external", "tags": [ "tag1", "tag2" ], "type": "db2" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines"
Response
Db2 engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
db2 engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
xyz-db2-01-db2-svc
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Engine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
REGISTERED
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
db2
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "Db2Engine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for db2 engine.", "engine_details": { "connection_string\"": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample db2 Engine Display Name", "engine_id": "sample db2 Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
db2 engine updated description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json-patch+json" -d '{ "description": "db2 engine updated description", "engine_display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/db2_engines/{engine_id}"
Response
Db2 engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
db2 engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
xyz-db2-01-db2-svc
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Engine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
REGISTERED
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
db2
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "Db2Engine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for db2 engine.", "engine_details": { "connection_string\"": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample db2 Engine Display Name", "engine_id": "sample db2 Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines"
Response
list Netezza engines
list Netezza engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "netezza_engines": [ { "created_by": "user@test.com", "created_on": 1700322469, "description": "netezza engine for running sql queries", "engine_details": { "connection_string": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "netezza", "engine_id": "netezza170", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create netezza engine body
Origin - created or registered
Allowable values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
netezza engine description
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json" -d '{ "description": "netezza engine description", "engine_details": { "connection_string": "1.2.3.4" }, "engine_display_name": "sampleEngine", "origin": "external", "tags": [ "tag1", "tag2" ], "type": "netezza" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines"
Response
Netezza engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
netezza engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
xyz-netezza-01-netezza-svc
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Engine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
REGISTERED
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "NetezzaEngine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for netezza engine.", "engine_details": { "connection_string\"": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample Netezza Engine Display Name", "engine_id": "sample Netezza Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */* " -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
netezza engine updated description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -H "Content-Type: application/json-patch+json" -d '{ "description": "netezza engine updated description", "engine_display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/netezza_engines/{engine_id}"
Response
Netezza engine details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
netezza engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
xyz-netezza-01-netezza-svc
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Engine port
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
REGISTERED
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
netezza
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "NetezzaEngine": null, "created_by": "user@test.com", "created_on": 1700322469, "description": "updated description for netezza engine.", "engine_details": { "connection_string\"": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "engine_display_name": "sample Netezza Engine Display Name", "engine_id": "sample Netezza Engine Name", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines"
Response
list Prestissimo Engines
list prestissimo engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "prestissimo_engines": [ { "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "prestissimo511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "prestissimo511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "prestissimo", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create Engine Body
Origin - created or registered
Allowable values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
native
Engine type prestissimo, others like netezza
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
prestissimo
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "hive_data" ]
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
prestissimo engine description
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
us-south
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Version like 0.278 for prestissimo or else
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
1.2.3
curl -X 'POST' \'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines' \-H 'accept: application/json' \-H 'Authorization: Bearer {MCSP_TOKEN}' \-H 'Content-Type: application/json' \-d '{ "associated_catalogs": [ "iceberg_data", "hive_data" ], "description": "prestissimo engine description", "engine_details": { "api_key": "<api_key>", "connection_string": "1.2.3.4", "coordinator": { "node_type": "worker", "quantity": 0 }, "instance_id": "instance_id", "managed_by": "fully/self", "size_config": "starter", "worker": { "node_type": "worker", "quantity": 0 } }, "engine_display_name": "sampleEngine", "first_time_use": true, "origin": "native", "region": "us-south", "tags": [ "tag1", "tag2" ], "type": "prestissimo", "version": "1.2.3"}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.com
Engine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "update", "delete" ]
Associated catalog
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
Node details
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
prestissimo engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine123
Engine properties
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
xyz-prestissimo-01-prestissimo-svc
Origin - place holder
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
native
Engine port
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
us-south
RemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
starter
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
prestissimo
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
1.2.0
Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "prestissimo engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}"
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.com
Engine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "update", "delete" ]
Associated catalog
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
Node details
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
prestissimo engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine123
Engine properties
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
xyz-prestissimo-01-prestissimo-svc
Origin - place holder
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
native
Engine port
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
us-south
RemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
starter
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
prestissimo
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
1.2.0
Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "prestissimo engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Update prestissimo engine
Update details of prestissimo engine
PATCH /prestissimo_engines/{engine_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update prestissimo engine body
Modified description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
updated description for prestissimo engine
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine properties
- engine_properties
catalog description
Configuration settings for the engine properties
velox description
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
RemoveEngine properties
- remove_engine_properties
catalog description
remove engine properties configuration
velox description
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H 'Content-Type: application/json-patch+json' -H "AuthInstanceId: {CRN}" -d '{ "description": "updated description for prestissimo engine", "engine_display_name": "sampleEngine", "engine_properties": { "configuration": { "coordinator": { "property_1": "property_value", "property_2": "property_value" }, "worker": { "property_1": "property_value", "property_2": "property_value" } }, "catalog": { "catalog_name": { "property_1": "property_value", "property_2": "property_value" } }, "velox": { "property_1": "property_value", "property_2": "property_value" } }, "engine_restart": "force", "remove_engine_properties": { "configuration": { "coordinator": [ "property1", "property2" ], "worker": [ "property1", "property2" ] }, "catalog": { "catalog_name": [ "property1", "property2" ] }, "velox": [ "property1", "property2" ] }, "tags": [ "tag1", "tag2" ]}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.com
Engine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "update", "delete" ]
Associated catalog
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
Node details
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
prestissimo engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine123
Engine properties
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
xyz-prestissimo-01-prestissimo-svc
Origin - place holder
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
native
Engine port
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
us-south
RemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
starter
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
prestissimo
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
1.2.0
Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_by": "<username>@<domain>.com", "created_on": 163788384993, "description": "prestissimo engine for running sql queries", "engine_display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
Get prestissimo engine catalogs
Get list of all catalogs attached a prestissimo engine
GET /prestissimo_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Associate catalogs to a prestissimo engine
Associate one or more catalogs to a prestissimo engine
PUT /prestissimo_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
comma separated catalog names
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Disassociate catalogs from a prestissimo engine
Disassociate one or more catalogs from a prestissimo engine
DELETE /prestissimo_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-,_]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Get prestissimo engine catalog
Get catalog attached to a prestissimo engine
GET /prestissimo_engines/{engine_id}/catalogs/{catalog_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
catalog id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]
Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]
Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]
Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]
Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Table type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
iceberg
Created by
Example:
<username>@<domain>.com
Created on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Iceberg catalog description
IBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
s3a://samplehost.com
Last sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Catalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
glue
IBM thrift uri port
Example:
3232
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Sync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Table registration was successful
Tables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]
Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
SUCCESS
Tags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]
Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "update", "delete" ], "associated_buckets": [ "ibm_cos_bucket" ], "associated_databases": [ "iceberg_data" ], "associated_engines": [ "presto367" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@domain.com", "created_on": "1700633239", "description": "catalog description", "hostname": "1234-xyz456-abc4321.lakehouse.dev.appdomain.cloud", "port": "31504", "sync_exception": [ "table is corrupted", "table metadata not there" ], "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354" }
Pause prestissimo engine
Pause a running prestissimo engine
POST /prestissimo_engines/{engine_id}/pause
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/pause' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to determine explain plan
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
show schemas in catalog_name
Format
Allowable values: [
,
text
,graphviz
,json
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
json
Type
Allowable values: [
,
logical
,distributed
,validate
,io
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
io
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/query_explain' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "format": "json", "statement": "show schemas in catalog_name", "type": "io"}'
Explain analyze
Return query metrics after query is complete
POST /prestissimo_engines/{engine_id}/query_explain_analyze
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to show explain analyze
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
show schemas in catalog_name
Verbose
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/query_explain_analyze' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "statement": "show schemas in catalog_name", "verbose": true}'
Restart a prestissimo engine
Restart an existing prestissimo engine
POST /prestissimo_engines/{engine_id}/restart
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/restart' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d ''
Resume prestissimo engine
Resume a paused prestissimo engine
POST /prestissimo_engines/{engine_id}/resume
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/resume' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d ''
Scale a prestissimo engine
Scale an existing prestissimo engine
POST /prestissimo_engines/{engine_id}/scale
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Scale Engine Body
Node details
Node details
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/prestissimo_engines/{engine_id}/scale' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' -H "AuthInstanceId: {CRN}" -d '{ "coordinator": { "node_type": "worker", "quantity": 0 }, "worker": { "node_type": "worker", "quantity": 0 }}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines"
Response
List Presto engines
Presto engine
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "presto_engines": [ { "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create Engine Body
Origin - created or registered
Allowable values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
presto
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "iceberg_data", "hive_data" ]
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
presto engine for running sql queries
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Version like 0.278 for presto or else
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1.2.3
curl -X 'POST' \'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines' \-H 'accept: application/json' \-H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' \-d '{ "associated_catalogs": [ "iceberg_data", "hive_data" ], "description": "presto engine description", "engine_details": { "api_key": "<api_key>", "connection_string": "1.2.3.4", "coordinator": { "node_type": "worker", "quantity": 0 }, "instance_id": "instance_id", "managed_by": "fully/self", "size_config": "starter", "worker": { "node_type": "worker", "quantity": 0 } }, "engine_display_name": "sampleEngine", "first_time_use": true, "origin": "native", "region": "us-south", "tags": [ "tag1", "tag2" ], "type": "presto", "version": "1.2.3"}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.com
Engine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Examples:[ "iceberg_data", "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
NodeDescription
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
presto engine for running sql queries
Driver details
Possible values: 0 ≤ number of items ≤ 10000
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine properties
engine will restart accordingily
Possible values: [
force
,false
]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/_.?=@]+
Example:
ibm-lh-lakehouse-presto-01-presto-svc
Origin - created or registered
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Engine port
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
RemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
starter
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
presto
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1.2.0
NodeDescription
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.com
Engine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Examples:[ "iceberg_data", "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
NodeDescription
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
presto engine for running sql queries
Driver details
Possible values: 0 ≤ number of items ≤ 10000
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine properties
engine will restart accordingily
Possible values: [
force
,false
]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/_.?=@]+
Example:
ibm-lh-lakehouse-presto-01-presto-svc
Origin - created or registered
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Engine port
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
RemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
starter
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
presto
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1.2.0
NodeDescription
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
updated description for presto engine
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine properties
- engine_properties
Configuration settings
JVM settings
engine will restart accordingily
Allowable values: [
force
,false
]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
RemoveEngine properties
- remove_engine_properties
Configuration settings for removing engine properties
JVM properties
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H 'Content-Type: application/json-patch+json' -H "AuthInstanceId: {CRN}" -d '{ "description": "updated description for presto engine", "engine_display_name": "sampleEngine", "engine_properties": { "configuration": { "coordinator": { "property1": "value1" }, "worker": { "property1": "value1" } }, "jvm": { "coordinator": { "property1": "value1" }, "worker": { "property1": "value1" } }, }, "engine_restart": "force", "remove_engine_properties": { "configuration": { "coordinator": [ ], "worker": [ ] }, "jvm": { "coordinator": [ ], "worker": [ ] }, }, "tags": [ "tag1", "tag2" ]}'
Response
EngineDetail
Applicable only for OCP based clusters. This is typically servicename+route
Example:
your-hostname.apps.your-domain.com
Engine status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Examples:[ "iceberg_data", "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
NodeDescription
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
presto engine for running sql queries
Driver details
Possible values: 0 ≤ number of items ≤ 10000
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Engine properties
engine will restart accordingily
Possible values: [
force
,false
]Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
force
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:/_.?=@]+
Example:
ibm-lh-lakehouse-presto-01-presto-svc
Origin - created or registered
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Engine port
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
us-south
RemoveEngine properties
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
starter
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
presto
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1.2.0
NodeDescription
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "engine_display_name": "starter", "engine_id": "presto511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
Get presto engine catalogs
Get list of all catalogs attached to a presto engine
GET /presto_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Associate catalogs to presto engine
Associate one or more catalogs to a presto engine
PUT /presto_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
comma separated catalog names
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Disassociate catalogs from a presto engine
Disassociate one or more catalogs from a presto engine
DELETE /presto_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_,]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Get presto engine catalog
Get catalog attached to presto engine
GET /presto_engines/{engine_id}/catalogs/{catalog_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
catalog id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]
Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]
Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]
Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]
Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Table type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
iceberg
Created by
Example:
<username>@<domain>.com
Created on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Iceberg catalog description
IBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
s3a://samplehost.com
Last sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Catalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
glue
IBM thrift uri port
Example:
3232
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Sync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Table registration was successful
Tables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]
Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
SUCCESS
Tags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]
Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "update", "delete" ], "associated_buckets": [ "ibm_cos_bucket" ], "associated_databases": [ "iceberg_data" ], "associated_engines": [ "presto367" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@domain.com", "created_on": "1700633239", "description": "catalog description", "hostname": "1234-xyz456-abc4321.lakehouse.dev.appdomain.cloud", "port": "31504", "sync_exception": [ "table is corrupted", "table metadata not there" ], "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/pause' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to determine explain plan
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
show schemas in catalog_name
Format
Allowable values: [
,
text
,graphviz
,json
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
json
Type
Allowable values: [
,
logical
,distributed
,validate
,io
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
io
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/query_explain' -H 'accept: application/json' -H 'Content-Type: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d '{ "format": "json", "statement": "show schemas in catalog_name", "type": "io"}'
Response
ExplainStatement OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Result
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "explain statement", "message_code": "success" }, "result": "explain statement" }
Explain presto analyze
Return query metrics after query is complete
POST /presto_engines/{engine_id}/query_explain_analyze
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Presto query to show explain analyze
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
show schemas in catalog_name
Verbose
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/query_explain_analyze' -H 'accept: application/json' -H 'Content-Type: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d '{ "statement": "show schemas in catalog_name", "verbose": true}'
Response
explainAnalyzeStatement OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
explainAnalyzeStatement result
Possible values: 0 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "explain presto analyze", "message_code": "success" }, "result": "explain statement" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/restart' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/resume' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d ''
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Scale Engine Body
NodeDescription
NodeDescription
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/presto_engines/{engine_id}/scale' -H 'accept: application/json' -H 'Content-Type: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" -d '{ "coordinator": { "node_type": "worker", "quantity": 0 }, "worker": { "node_type": "worker", "quantity": 0 }}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines"
Response
List spark engines
List spark engines
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "spark_engines": [ { "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "connection_string": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop", "applications_api": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop/applications", "history_server_endpoint": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_api/v1", "view_history_server": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_ui", "application_endpoint": "https://example.com/lakehouse/api/v2/abcd-efgh-ijkl-mnop/spark_engines/spark119/applications" }, "engine_display_name": "Engine-Name", "engine_id": "spark678", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "spark" }, { "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [ "iceberg_data", "hudi_catalog", "delta_lake" ], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" }, "default_version": "3.3", "endpoints": { "application_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/applications", "engine_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123", "history_server_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/history_server" }, "engine_home_bucket_display_name": "bucket-name", "engine_home_bucket_name": "bucket-id", "scale_config": { "current_number_of_nodes": 1, "node_type": "type", "number_of_nodes": 1 } }, "engine_display_name": "Engine-Name", "engine_id": "spark123", "origin": "native", "status": "running", "tags": [], "type": "spark" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create spark engine Body
{
"description": "",
"engine_details": {
"default_version": "3.3",
"scale_config": {
"node_type": "small",
"number_of_nodes": 5
},
"engine_home_bucket_name": "4fec0f8b-888a-4c16-8f38-250c8499e6ce-customer"
},
"engine_display_name": "test-native",
"associated_catalogs": [
"iceberg_data"
],
"origin": "native",
"type": "spark"
}
{
"description": "",
"engine_details": {
"connection_string": "https://<host>/<version>/analytics_engines/<instance_id>",
"api_key": "api_Key",
"managed_by": "fully"
},
"engine_display_name": "sample-external-spark",
"origin": "external",
"type": "spark"
}
Origin - created or registered
Allowable values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "iceberg_data", "hive_data" ]
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
spark engine description
Node details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine status
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
provisioning
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Engine type spark
Allowable values: [
spark
]Example:
spark
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "", "engine_details": { "default_version": "3.3", "scale_config": { "node_type": "small", "number_of_nodes": 5 }, "engine_home_bucket_name": "4fec0f8b-888a-4c16-8f38-250c8499e6ce-customer" }, "engine_display_name": "test-native", "associated_catalogs": [ "iceberg_data" ], "origin": "native", "type": "spark" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines"
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "", "engine_details": { "connection_string": "https://<host>/<version>/analytics_engines/<instance_id>", "api_key": "<api_Key>", "managed_by": "fully" }, "engine_display_name": "sample-external-spark", "origin": "external", "type": "spark" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Examples:[ "iceberg_data", "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
spark engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Origin - created or registered
Possible values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Registered
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Type like spark, netezza,..
Possible values: [
spark
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
spark
Status Code
Accepted
Error
Unauthorized
Not found
Internal server error
{ "actions": [], "associated_catalogs": [ "iceberg_data" ], "engine_id": "spark123", "origin": "native", "status": "provisioning", "tags": [ "tag1", "tag2" ] }
{ "actions": [], "associated_catalogs": [], "engine_id": "spark123", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Examples:[ "iceberg_data", "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
spark engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Origin - created or registered
Possible values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Registered
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Type like spark, netezza,..
Possible values: [
spark
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
spark
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [ "iceberg_data", "hudi_catalog", "delta_lake" ], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" }, "default_version": "3.3", "endpoints": { "application_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/applications", "engine_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123", "history_server_endpoint": "https://example.com/lakehouse/api/v2/spark_engines/spark123/history_server" }, "engine_home_bucket_display_name": "bucket-name", "engine_home_bucket_name": "bucket-id", "scale_config": { "current_number_of_nodes": 1, "node_type": "type", "number_of_nodes": 1 } }, "engine_display_name": "Engine-Name", "engine_id": "spark123", "origin": "native", "status": "running", "tags": [], "type": "spark" }
{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [], "created_by": "user@example.com", "created_on": 1234567890, "description": "Sample Description", "engine_details": { "connection_string": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop", "applications_api": "https://api.example.com/v3/analytics_engines/abcd-efgh-ijkl-mnop/applications", "history_server_endpoint": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_api/v1", "view_history_server": "https://console.example.com/v3/analytic_engines/abcd-efgh-ijkl-mnop/spark_history_ui", "application_endpoint": "https://example.com/lakehouse/api/v2/abcd-efgh-ijkl-mnop/spark_engines/spark119/applications" }, "engine_display_name": "Engine-Name", "engine_id": "spark456", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "spark" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update Engine Body
{
"engine_display_name": "Updated Display Name",
"description": "Updated Description",
"tags": [
"tag1",
"tag2"
],
"engine_details": {
"default_config": {
"config1": "value1",
"config2": "value2"
},
"default_version": "3.4"
}
}
{
"engine_display_name": "Updated Display Name",
"description": "Updated description ",
"tags": [
"tag1"
]
}
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
updated description for spark engine
Engine details
- engine_details
Dynamic dict
- default_config
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
The default spark version for the native engine
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-\.]+
Example:
4.8.3
Engine display name
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
.*
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "Updated Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" }, "default_version": "3.4" }, "engine_display_name": "Updated Display Name", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
curl -X PATCH -H "content-type: application/json" -H "accept: application/json" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "Updated description", "engine_display_name": "Updated Display Name", "tags": [ "tag1" ] }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Associated catalogs
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Examples:[ "iceberg_data", "hive_data" ]
watsonx.data build version
Example:
1.0.3.0.0
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Engine description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
spark engine for running sql queries
External engine details
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleEngine123
Origin - created or registered
Possible values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
external
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Registered
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
Type like spark, netezza,..
Possible values: [
spark
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
spark
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [ "iceberg_data" ], "description": "Updated Description", "engine_details": { "default_config": { "config1": "value1", "config2": "value2" } }, "engine_display_name": "Native Spark Engine", "engine_id": "spark422", "tags": [ "tag1" ] }
{ "actions": [ "action1", "action2", "action3" ], "associated_catalogs": [], "description": "Updated description", "engine_details": {}, "engine_display_name": "External Engine 1", "engine_id": "spar123", "tags": [ "tag1" ] }
List all applications in a spark engine
List all applications in a spark engine
GET /spark_engines/{engine_id}/applications
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
state
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
.*
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications"
Response
Engine Application Detail
Application body
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "applications": [ { "application_id": "93b1a765-e3bc-4972-acc4-5b3d1a0f5d62", "auto_termination_time": "2024-05-15T18:11:54.615Z", "id": "93b1a765-e3bc-4972-acc4-5b3d1a0f5d62", "spark_application_id": "app-20240415181154-0000", "spark_application_name": "auto-scale-test", "spark_version": "3.4", "start_time": "2024-04-15T18:11:54.615Z", "state": "running", "submission_time": "2024-04-15T18:11:21.458Z" }, { "application_id": "b2d3f4g5-h6i7-j8k9-l0m1-n2o3p4q5r6s7", "auto_termination_time": "2025-06-16T19:12:55.716Z", "id": "b2d3f4g5-h6i7-j8k9-l0m1-n2o3p4q5r6s7", "spark_application_id": "app-20250516191255-0001", "spark_application_name": "data-processing-test", "spark_version": "3.3", "start_time": "2025-05-16T19:12:55.716Z", "state": "finished", "submission_time": "2025-05-16T19:12:22.559Z" } ] }
{ "applications": [ { "application_id": "abcd-efgh-5806ab96-a5ba-4488-871b-162e13f6bf90", "id": "abcd-efgh-5806ab96-a5ba-4488-871b-162e13f6bf90", "runtime": { "spark_version": "3.3" }, "state": "accepted", "submission_time": "2024-04-15T18:13:17.507Z" }, { "application_id": "abcd-efgh-0969c82b-2980-48f4-8896-800e311a4696", "auto_termination_time": "2024-03-25T15:57:06.762Z", "end_time": "2024-03-22T15:57:24.703Z", "finish_time": "2024-03-22T15:57:24.703Z", "id": "abcd-efgh-0969c82b-2980-48f4-8896-800e311a4696", "runtime": { "spark_version": "3.3" }, "spark_application_id": "app-20240322155706-0000", "spark_application_name": "PythonWordCount", "start_time": "2024-03-22T15:57:06.762Z", "state": "finished", "submission_time": "2024-03-22T15:56:41.400Z" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
state
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
.*
Create spark application parameters
{
"application_details": {
"application": "/opt/ibm/spark/examples/src/main/python/wordcount.py",
"arguments": [
"/opt/ibm/spark/examples/src/main/resources/people.txt"
]
}
}
Application details
Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$
Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications
Service Instance ID for POST
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Engine Type
Allowable values: [
iae
,emr
]Example:
iae
Spark application volumes to mount
Possible values: 0 ≤ number of items ≤ 100
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "application_details": { "application": "s3://mybucket/wordcount.py", "arguments": [ "people.txt" ], "conf": { "additionalProp1": "key:value", "additionalProp2": "key:value", "additionalProp3": "key:value" }, "env": { "additionalProp1": "key:value", "additionalProp2": "key:value", "additionalProp3": "key:value" }, "name": "SparkApplicaton1" }, "job_endpoint": "<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications", "service_instance_id": "3FGeNUZqcdu6rOFbaHhGBoNdCHj98UoHd6nUFqkfsKhgacYD8ImM6iSA_F-TjHUdEZuVsoQTmOn", "type": "iae" }' "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications"
Response
Engine Application Status
Application details
Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99
Auto Termination Time
Example:
2020-12-08T10:00:00.000Z
Creation time
Example:
Saturday 28 October 2023 07:17:06.856+0000
Deployment mode
Example:
stand-alone
End Time
Example:
2020-12-08T10:00:00.000Z
Failed time
Finish time
Example:
Saturday 28 October 2023 07:17:38.966+0000
Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99
Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$
Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications
Return code
Example:
0
application run time
Service Instance ID for POST
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Spark application ID
Example:
app-20231028071726-0000
Spark application name
Example:
PythonWordCount
Spark Version
Possible values: 1 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-\.]+
Example:
3.3
Start time
Example:
Saturday 28 October 2023 07:17:26.649+0000
Application state
Example:
FINISHED
Application state details
Possible values: 0 ≤ number of items ≤ 10000
Application submission time
Example:
2023-11-01T11:18:49.758Z
Template ID
Example:
spark-3.3-jaas-v2-cp4d-template
Engine Type
Possible values: [
iae
,emr
]Example:
iae
Spark application volumes to mount
Possible values: 0 ≤ number of items ≤ 100
Wxd history_server endpoint
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "id": "2ad2af4b-9747-4652-8e6e-d0a91599f9a2", "state": "accepted" }
Stop Spark Applications
Stop a running spark application
DELETE /spark_engines/{engine_id}/applications
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Application id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
state
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
.*
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications?application_id={application_id}"
Get spark application
Get status of spark application
GET /spark_engines/{engine_id}/applications/{application_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Application id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/applications/{application_id}"
Response
Engine Application Status
Application details
Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99
Auto Termination Time
Example:
2020-12-08T10:00:00.000Z
Creation time
Example:
Saturday 28 October 2023 07:17:06.856+0000
Deployment mode
Example:
stand-alone
End Time
Example:
2020-12-08T10:00:00.000Z
Failed time
Finish time
Example:
Saturday 28 October 2023 07:17:38.966+0000
Application ID
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99
Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$
Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications
Return code
Example:
0
application run time
Service Instance ID for POST
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Spark application ID
Example:
app-20231028071726-0000
Spark application name
Example:
PythonWordCount
Spark Version
Possible values: 1 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-\.]+
Example:
3.3
Start time
Example:
Saturday 28 October 2023 07:17:26.649+0000
Application state
Example:
FINISHED
Application state details
Possible values: 0 ≤ number of items ≤ 10000
Application submission time
Example:
2023-11-01T11:18:49.758Z
Template ID
Example:
spark-3.3-jaas-v2-cp4d-template
Engine Type
Possible values: [
iae
,emr
]Example:
iae
Spark application volumes to mount
Possible values: 0 ≤ number of items ≤ 100
Wxd history_server endpoint
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "application_details": { "application": "/opt/ibm/spark/examples/src/main/python/wordcount.py", "conf": { "ae.spark.executor.count": "1", "spark.app.name": "MyJob", "spark.driver.cores": "1", "spark.driver.memory": "4G", "spark.eventLog.enabled": "true", "spark.executor.cores": "1", "spark.executor.memory": "4G" }, "env": { "SAMPLE_ENV_KEY": "SAMPLE_VALUE" }, "spark_version": "3.3" }, "application_id": "ff053468-9d89-468e-a5af-bd96b88c5bf5", "auto_termination_time": "2024-05-16T06:56:51.469Z", "end_time": "2024-04-16T06:57:19.912Z", "finish_time": "2024-04-16T06:57:19.912Z", "id": "ff053468-9d89-468e-a5af-bd96b88c5bf5", "return_code": "0", "spark_application_id": "app-20240416065651-0000", "spark_application_name": "PythonWordCount", "spark_version": "3.3", "start_time": "2024-04-16T06:56:51.469Z", "state": "finished", "submission_time": "2024-04-16T06:56:22.909Z" }
Get spark engine catalogs
Get list of all catalogs attached to a spark engine
GET /spark_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
GetCatalogs OK
Catalogs
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "action1", "action2" ], "catalog_name": "iceberg_data", "sync_exception": [], "tags": [ "tag1", "tag2" ] }, { "actions": [ "action3", "action4" ], "catalog_name": "hudi", "sync_exception": [], "tags": [ "tag3", "tag4" ] }, { "actions": [ "action5", "action6" ], "catalog_name": "delta_lake", "sync_exception": [], "tags": [ "tag5", "tag6" ] } ] }
Associate catalogs to spark engine
Associate one or more catalogs to a spark engine
PUT /spark_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
comma separated catalog names
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
GetCatalogs OK
Catalogs
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "action1", "action2" ], "catalog_name": "iceberg_data", "sync_exception": [], "tags": [ "tag1", "tag2" ] } ] }
Disassociate catalogs from a spark engine
Disassociate one or more catalogs from a spark engine
DELETE /spark_engines/{engine_id}/catalogs
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_,]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Get spark engine catalog
Get catalog attached to spark engine
GET /spark_engines/{engine_id}/catalogs/{catalog_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
catalog id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}"
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]
Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]
Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]
Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]
Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Table type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
iceberg
Created by
Example:
<username>@<domain>.com
Created on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Iceberg catalog description
IBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
s3a://samplehost.com
Last sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Catalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
glue
IBM thrift uri port
Example:
3232
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Sync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Table registration was successful
Tables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]
Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
SUCCESS
Tags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]
Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [], "associated_buckets": [ "d501dc2b-05db-4d93-9aed-edf93c7bb0f6-customer" ], "associated_databases": [], "associated_engines": [ "presto459", "spark422" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@example.com", "created_on": "1713155437", "description": "icebarg_data", "hostname": "hostname", "port": "<port>", "sync_exception": [], "tags": [], "thrift_uri": "thrift://<hostname>:<port>" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/history_server"
Response
Native spark history server
History server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
2022-02-24T07:37:47Z
History server cores
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1
History server memory
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
4G
History server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
2022-02-21T07:37:47Z
History server state
Possible values: 1 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
started
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auto_termination_time": "2022-02-24T07:37:47Z", "cores": "1", "memory": "4G", "start_time": "2022-02-21T07:37:47Z", "state": "started" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Start history server parameter
CPU count
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^\d+$
Example:
1
Memory in GiB
Possible values: 2 ≤ length ≤ 10, Value must match regular expression
^[0-9]+G$
Example:
4G
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/history_server"
Response
Native spark history server
History server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
2022-02-24T07:37:47Z
History server cores
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1
History server memory
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
4G
History server start time
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
2022-02-21T07:37:47Z
History server state
Possible values: 1 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
started
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auto_termination_time": "2022-02-24T07:37:47Z", "cores": "1", "memory": "4G", "start_time": "2022-02-21T07:37:47Z", "state": "started" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X DELETE -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/history_server"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/pause"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/resume"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Scale spark application parameters
Node count
Possible values: 0 ≤ value ≤ 5
Example:
2
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" "https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/spark_engines/{engine_id}/scale"-d '{ "number_of_nodes": 2}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Response
List spark version
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Spark versions list
Possible values: 1 ≤ number of items ≤ 100
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "List spark versions", "message_code": "success" }, "spark_versions": [ { "display_name": "3.3" } ] }
Get catalog properties by catalog_id
Get catalog properties of a catalog identified by catalog_id
GET /catalogs/{catalog_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog ID
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
Define the catalog details
list of allowed actions
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "update", "delete" ]
Associated buckets items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "bucket_1", "bucket_2" ]
Associated databases items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "database_1", "database_2" ]
Associated engines items
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "engine_1", "engine_2" ]
Name for the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sampleCatalog
Table type
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
iceberg
Created by
Example:
<username>@<domain>.com
Created on
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Iceberg catalog description
IBM thrift uri hostname
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
s3a://samplehost.com
Last sync time
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
1602839833
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
ibm
Catalog name
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
glue
IBM thrift uri port
Example:
3232
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Sync description
Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
Table registration was successful
Tables not sync because data is corrupted
Possible values: 0 ≤ number of items ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+
, 1 ≤ length ≤ 1000Examples:[ "table is corrupted", "table metadata not there" ]
Sync status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
SUCCESS
Tags
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ "tag1", "tag2" ]
Customer thrift uri
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
thrift://samplehost-catalog:4354
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "update", "delete" ], "associated_buckets": [ "ibm_cos_bucket" ], "associated_databases": [ "iceberg_data" ], "associated_engines": [ "presto367" ], "catalog_name": "iceberg_data", "catalog_type": "iceberg", "created_by": "user@domain.com", "created_on": "1700633239", "description": "catalog description", "hostname": "1234-xyz456-abc4321.lakehouse.dev.appdomain.cloud", "port": "31504", "sync_exception": [ "table is corrupted", "table metadata not there" ], "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
GetSchemas OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Schemas
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "create schema", "message_code": "success" }, "schemas": [ "schema1", "schema2" ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
Path associated with bucket
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
.*
Example:
sample-path
Schema name
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
SampleSchema1
Bucket associated to metastore where schema will be added
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Example:
sample-bucket
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' -d '{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "schema_name": "SampleSchema1" }'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
URL encoded Schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}?engine_id={engine_id}' -H 'accept: */*' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
List all tables
List all tables in a schema in a catalog for a given engine
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
tables list
List of the tables present in the schema
Possible values: 0 ≤ number of items ≤ 1000000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "tables": [ "customer_data", "user_data" ] }
Get table details
Get details of a given table in a catalog and schema
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Response
GetColumns OK
Columns
Possible values: 0 ≤ number of items ≤ 1000000
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" } ], "table_name": "newtable," }
Delete table
Delete table for a given schema and catalog
DELETE /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: */*' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
New table name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
updated_table_name
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json-patch+json' -d '{ "new_table_name": "updated_table_name", }'
Response
GetColumns OK
Columns
Possible values: 0 ≤ number of items ≤ 1000000
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" } ], "table_name": "newtable," }
List all columns of a table
List all columns of a table in a given a schema for a given catalog
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Add column(s)
Add one or multiple columns to a table in a schema for a given catalog
POST /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
{
"columns": [
{
"column_name": "expenses",
"comment": "expenses column",
"extra": "varchar",
"type": "varchar"
}
]
}
List of the tables present in the schema
Possible values: 0 ≤ number of items ≤ 1000000
curl -X 'POST' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json' -d '{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "schema_name": "SampleSchema1" }'
Delete column
Delete column in a table for a given schema and catalog
DELETE /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns/{column_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: */*' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Alter column
Update the given column - rename column
PATCH /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/columns/{column_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%]+
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Request body
{
"column_name": "expenses"
}
Column name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
expenses
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json-patch+json' -d '{ "add_columns": [ { "column_comment": "income column", "column_name": "income", "data_type": "varchar" } ], "drop_columns": [ { "column_name": "expenditure" } ], "new_table_name": "updated_table_name", "rename_columns": [ { "column_name": "expenditure", "new_column_name": "expenses" } ] }'
Response
Column
Column name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
expenses
Comment
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
expenses column
Extra
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
varchar
length
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
30
scale
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
.*
Example:
2
Data type
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
varchar
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "column_name": "expenses,", "comment": "expenses column", "extra": "varchar,", "type": "varchar," }
Get table snapshots
List all table snapshots
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+
Schema ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Table ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
Rollback snapshot
Rollback to a table snapshot
PUT /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots/{snapshot_id}
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Schema ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Table ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
.*
Snapshot ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'PUT' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/snapshots/{snapshot_id}?engine_id={engine_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'AuthInstanceId: {CRN}'
External Iceberg table registration
Synchronize the external Iceberg table registration for a catalog identified by catalog_id.
PATCH /catalogs/{catalog_id}/sync
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog ID
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+
Request body
Auto add new table
Example:
true
Sync iceberg metadata
Example:
true
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/catalogs/{catalog_id}/sync' -H 'accept: application/json' -H 'AuthInstanceId: {CRN}' -H 'Authorization: Bearer {MCSP_TOKEN}' -H 'Content-Type: application/json-patch+json' -d '{ "auto_add_new_tables": true, "sync_iceberg_md": true }'
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services"
Response
List milvus services
milvus service body
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "milvus_services": [ { "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" } ] }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create milvus service
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
milvus
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
milvus service for running sql queries
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X 'POST' \'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services' \-H 'accept: application/json' \-H "Authorization: Bearer {MCSP_TOKEN}" -H "AuthInstanceId: {CRN}" \-H 'Content-Type: application/json' \-d '{ "bucket_name": "Sample bucket name", "bucket_type": "Sample bucket type", "description": "milvus service for running sql queries", "origin": "native", "root_path": "Sample path", "service_display_name": "sampleService", "tags": [ "tag1", "tag2" ], "tshirt_size": "small", "type": "milvus", }'
Response
milvus service details
milvus status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
milvus service for running sql queries
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
example.grpc.host
milvus port
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
example.https.host
milvus port
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService
Service programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService123
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
milvus
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "milvus_service": null, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'GET' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services/{service_id}' -H 'accept: application/json' -H 'Authorization: Bearer {MCSP_TOKEN}' -H "AuthInstanceId: {CRN}"
Response
milvus service details
milvus status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
milvus service for running sql queries
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
example.grpc.host
milvus port
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
example.https.host
milvus port
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService
Service programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService123
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
milvus
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "milvus_service": null, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" }
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
curl -X 'DELETE' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services/{service_id}' -H 'accept: application/json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}"
Request
Custom Headers
CRN
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+
Update milvus service
Modified description
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
.*
Example:
updated description for milvus service
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.saas.ibm.com/lakehouse/api/v2/milvus_services/{service_id}' -H 'accept: application/json' -H 'Content-Type: application/json-patch+json' -H "AuthInstanceId: {CRN}" -H "Authorization: Bearer {MCSP_TOKEN}" -d '{ "description": "updated description for milvus service", "engine_display_name": "sampleService", "tags": [ "tag1", "tag2" ]}'
Response
milvus service details
milvus status code
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Examples:[ "update", "delete" ]
Created user name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
<username>@<domain>.com
Created time in epoch format
Service description
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
.*
Example:
milvus service for running sql queries
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
example.grpc.host
milvus port
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+
Example:
example.https.host
milvus port
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
native
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService
Service programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
sampleService123
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
running
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
.*
Examples:[ "tag1", "tag2" ]
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+
Example:
milvus
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_on": 1700201877, "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "milvus_service": null, "service_display_name": "test-milvus", "service_id": "milvus76", "status": "running", "status_code": 11, "type": "milvus" }