Introduction
IBM® watsonx.data is a data management solution for collecting, storing, querying, and analyzing all your enterprise data (structured, semi-structured, and unstructured) with a single unified data platform. It provides a flexible and reliable platform that is optimized to work on open data formats.
Endpoint URLs
The base URLs come from the service instance. To find the URL, view the service credentials by clicking the name of the service in the Resource list. Use the value of the URL. Add the method to form the complete API endpoint for your request.
Authentication
Required Purpose: To work with the API, you must use an IBM Cloud Identity and Access Management (IAM) access token. The token is used to determine the actions that a user or service ID has access to when they use the API.
You can generate an IAM token for an authenticated user or service ID by using the IAM Identity Services API. IAM tokens are generated by using the user or service ID's API key. For more information, see Generating an IBM Cloud IAM token by using an API key.
To use the API, add a valid IAM token to the HTTP Authorization request header, for example, -H 'Authorization: Bearer {TOKEN}'
.
To retrieve your access token:
curl -X POST "https://iam.cloud.ibm.com/identity/token" --header 'Content-Type: application/x-www-form-urlencoded' --header 'Accept: application/json' --data-urlencode 'grant_type=urn:ibm:params:oauth:grant-type:apikey' --data-urlencode 'apikey={API_KEY}'
Replace {API_KEY}
with your IAM API key.
Auditing
Required if applicable Purpose: Describes that the API generates auditing events that can be consumed by the Activity Tracker service, and links to your related product docs for more information. Required only if any of the API's methods is enabled to generate auditing events.
Example:
You can monitor API activity within your account by using the IBM Cloud Activity Tracker service. Whenever an API method is called, an event is generated that you can then track and audit from within Activity Tracker. The specific event type is listed for each individual method.
For more information about how to track Certificate Manager activity, see Auditing events for Certificate Manager.
Error handling
This API uses standard HTTP response codes to indicate whether a method completed successfully. A 200
response indicates success. A 400
type response indicates a failure, and a 500
type response indicates an internal system error.
HTTP Error Code | Description | Recovery |
---|---|---|
200 |
Success | The request was successful. |
201 |
Created | The requested resource successfully created in a synchronous manner. |
204 |
No Content | The server successfully processed the request and is not returning any content. |
400 |
Bad Request | The input parameters in the request body are either incomplete or in the wrong format. Be sure to include all required parameters in your request. |
401 |
Unauthorized | You are not authorized to make this request. Log in to IBM Cloud and try again. If this error persists, contact the account owner to check your permissions. |
403 |
Forbidden | The supplied authentication is not authorized to access '{namespace}'. |
404 |
Not Found | The requested resource could not be found. |
409 |
Conflict | The entity is already in the requested state. |
500 |
Internal Server Error | Your request could not be processed. Wait a few minutes and try again. |
Pagination
Some API requests might return many results. To avoid performance issues, these results are returned one page at a time, with a limited number of results on each page. GET requests for the following resources use pagination:
/v1/statement
For the request that uses pagination, the response does include following urls to make subsequent requests :
infoUri
: The URL for requesting the first page of results.nextUri
: The URL for requesting the next page of results.
Methods
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance id}" https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services"
Response
List milvus services
List of milvus services
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "milvus_services": [ { "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_at": 1700201877, "display_name": "test-milvus", "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "id": "milvus76", "index_type": "flat", "proxy_port": 31019, "status": "running", "status_code": 11, "storage": { "storage_type": "ibm_cos", "root_path": "", "storage_name": "milvusstorage" }, "tags": [ "tag1" ], "tshirt_size": "small", "type": "milvus" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create milvus service
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleService
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
Milvus storage details
data coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
Service description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
milvus service for running sql queries
data worker cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
etcd cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
etcd memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
index type
Allowable values: [
flat
,ivf_flat
,ivf_sq8
,ivf_pq
,hnsw
,scann
,gpu
,gpu_cagra
,gpu_ivf_flat
,gpu_ivf_pq
,gpu_brute_force
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]*$
Example:
flat
index worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
index worker memory
Possible values: 0.01 ≤ value ≤ 1000000
index worker replicas
Possible values: 1 ≤ value ≤ 1000000
kafka cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
kafka memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
How is the Milvus instance managed
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
customer
proxy cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
proxy memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
proxy replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
query worker memory
Possible values: 0.01 ≤ value ≤ 1000000
query worker replicas
Possible values: 1 ≤ value ≤ 1000000
root coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coodinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[A-Za-z0-9!@#$%^&*()_+\-=\[\]{}|;:',.<>\/? ]*$
Examples:[ "tag1", "tag2" ]
tshirt size
Allowable values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
small
vector
Possible values: 1 ≤ value ≤ 1000000000
vector dimension
Possible values: 384 ≤ value ≤ 4000
curl -X POST -H "content-type: application/json" -H "accept: application/json" -d '{ "display_name": "milvus-01", "origin": "native", "tshirt_size": "starter", "storage_name": "cos-cypress-bucket", "root_path": "/cos-cypress-bucket" }' "https://{cpd-host}.cp.fyre.ibm.com/lakehouse/api/v3/milvus_services"
Response
milvus service details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
Index type of milvus engine
Possible values: [
flat
,ivf_flat
,ivf_sq8
,ivf_pq
,hnsw
,scann
,gpu
,gpu_cagra
,gpu_ivf_flat
,gpu_ivf_pq
,gpu_brute_force
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
flat
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
milvus status code
Possible values: 1 ≤ value ≤ 65535
Milvus storage details
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[A-Za-z0-9!@#$%^&*()_+\-=\[\]{}|;:',.<>\/? ]*$
Examples:[ "tag1", "tag2" ]
tshirt size
Possible values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
small
storage access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage access key
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
data coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
Service description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^.*$
Example:
milvus service for running sql queries
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService
data worker cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
etcd cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
etcd memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.grpc.host
milvus port
Possible values: 1 ≤ value ≤ 65535
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-_]+$
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.https.host
milvus port
Possible values: 1 ≤ value ≤ 65535
Id of the Milvus service
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService123
index worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
index worker memory
Possible values: 0.01 ≤ value ≤ 1000000
index worker replicas
Possible values: 1 ≤ value ≤ 1000000
kafka cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
kafka memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
How is the Milvus instance managed
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
customer
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
proxy cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.proxy.host
proxy memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy port
Possible values: 1 ≤ value ≤ 65535
proxy replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
query worker memory
Possible values: 0.01 ≤ value ≤ 1000000
query worker replicas
Possible values: 1 ≤ value ≤ 1000000
root coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coodinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage secret access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage secret access key
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
milvus
Vector for milvus engine
Possible values: 1 ≤ value ≤ 65535
Dimension for milvus engine
Possible values: 384 ≤ value ≤ 1024
Milvus version
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]*$
Example:
3.5
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_at": 1700201877, "display_name": "test-milvus", "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "id": "milvus76", "index_type": "flat", "milvus_service": null, "proxy_port": 31019, "status": "running", "status_code": 11, "storage": { "storage_type": "ibm_cos", "root_path": "", "storage_name": "milvusstorage" }, "tags": [ "tag1" ], "tshirt_size": "small", "type": "milvus", "vector": 20000, "vector_dimension": 384 }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
milvus service details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
Index type of milvus engine
Possible values: [
flat
,ivf_flat
,ivf_sq8
,ivf_pq
,hnsw
,scann
,gpu
,gpu_cagra
,gpu_ivf_flat
,gpu_ivf_pq
,gpu_brute_force
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
flat
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
milvus status code
Possible values: 1 ≤ value ≤ 65535
Milvus storage details
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[A-Za-z0-9!@#$%^&*()_+\-=\[\]{}|;:',.<>\/? ]*$
Examples:[ "tag1", "tag2" ]
tshirt size
Possible values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
small
storage access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage access key
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
data coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
Service description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^.*$
Example:
milvus service for running sql queries
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService
data worker cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
etcd cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
etcd memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.grpc.host
milvus port
Possible values: 1 ≤ value ≤ 65535
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-_]+$
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.https.host
milvus port
Possible values: 1 ≤ value ≤ 65535
Id of the Milvus service
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService123
index worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
index worker memory
Possible values: 0.01 ≤ value ≤ 1000000
index worker replicas
Possible values: 1 ≤ value ≤ 1000000
kafka cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
kafka memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
How is the Milvus instance managed
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
customer
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
proxy cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.proxy.host
proxy memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy port
Possible values: 1 ≤ value ≤ 65535
proxy replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
query worker memory
Possible values: 0.01 ≤ value ≤ 1000000
query worker replicas
Possible values: 1 ≤ value ≤ 1000000
root coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coodinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage secret access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage secret access key
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
milvus
Vector for milvus engine
Possible values: 1 ≤ value ≤ 65535
Dimension for milvus engine
Possible values: 384 ≤ value ≤ 1024
Milvus version
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]*$
Example:
3.5
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_at": 1700201877, "display_name": "test-milvus", "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "id": "milvus76", "index_type": "flat", "milvus_service": null, "proxy_port": 31019, "status": "running", "status_code": 11, "storage": { "storage_type": "ibm_cos", "root_path": "", "storage_name": "milvusstorage" }, "tags": [ "tag1" ], "tshirt_size": "small", "type": "milvus", "vector": 20000, "vector_dimension": 384 }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Update milvus service
Modified description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
updated description for milvus service
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleService
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[A-Za-z0-9!@#$%^&*()_+\-=\[\]{}|;:',.<>\/? ]*$
Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{id}' -H 'accept: application/json' -H 'Content-Type: application/merge-patch+json' -H "AuthInstanceId: {instance id}" -d '{ "description": "updated description for milvus service", "display_name": "sampleService", "tags": [ "tag1", "tag2" ]}'
Response
milvus service details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
Index type of milvus engine
Possible values: [
flat
,ivf_flat
,ivf_sq8
,ivf_pq
,hnsw
,scann
,gpu
,gpu_cagra
,gpu_ivf_flat
,gpu_ivf_pq
,gpu_brute_force
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
flat
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
milvus status code
Possible values: 1 ≤ value ≤ 65535
Milvus storage details
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[A-Za-z0-9!@#$%^&*()_+\-=\[\]{}|;:',.<>\/? ]*$
Examples:[ "tag1", "tag2" ]
tshirt size
Possible values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
small
storage access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage access key
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
data coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
Service description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^.*$
Example:
milvus service for running sql queries
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService
data worker cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
etcd cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
etcd memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.grpc.host
milvus port
Possible values: 1 ≤ value ≤ 65535
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-_]+$
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.https.host
milvus port
Possible values: 1 ≤ value ≤ 65535
Id of the Milvus service
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService123
index worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
index worker memory
Possible values: 0.01 ≤ value ≤ 1000000
index worker replicas
Possible values: 1 ≤ value ≤ 1000000
kafka cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
kafka memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
How is the Milvus instance managed
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
customer
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
proxy cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.proxy.host
proxy memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy port
Possible values: 1 ≤ value ≤ 65535
proxy replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
query worker memory
Possible values: 0.01 ≤ value ≤ 1000000
query worker replicas
Possible values: 1 ≤ value ≤ 1000000
root coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coodinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage secret access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage secret access key
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
milvus
Vector for milvus engine
Possible values: 1 ≤ value ≤ 65535
Dimension for milvus engine
Possible values: 384 ≤ value ≤ 1024
Milvus version
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]*$
Example:
3.5
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_at": 1700201877, "display_name": "test-milvus", "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "id": "milvus76", "index_type": "flat", "milvus_service": null, "proxy_port": 31019, "status": "running", "status_code": 11, "storage": { "storage_type": "ibm_cos", "root_path": "", "storage_name": "milvusstorage" }, "tags": [ "tag1" ], "tshirt_size": "small", "type": "milvus", "vector": 20000, "vector_dimension": 384 }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{id}/pause' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{id}/resume' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Scale Service Body
{
"dc_cpu": 45,
"dc_memory": 26,
"dc_replicas": 5,
"dw_cpu": 45,
"dw_memory": 26,
"dw_replicas": 5,
"etcd_cpu": 45,
"etcd_memory": 26,
"index_type": "flat",
"iw_cpu": 54,
"iw_memory": 100,
"iw_replicas": 2,
"kafka_cpu": 45,
"kafka_memory": 26,
"proxy_cpu": 45,
"proxy_memory": 26,
"proxy_replicas": 5,
"qc_cpu": 54,
"qc_memory": 100,
"qc_replicas": 2,
"qw_cpu": 45,
"qw_memory": 26,
"qw_replicas": 5,
"rc_cpu": 54,
"rc_memory": 100,
"rc_replicas": 2,
"tshirt_size": "custom",
"vector": 20000,
"vector_dimension": 384
}
tshirt size
Allowable values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
small
data coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000
data worker cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000
etcd cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
etcd memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
index type, required for custom size
Allowable values: [
flat
,ivf_flat
,ivf_sq8
,ivf_pq
,hnsw
,scann
,gpu
,gpu_cagra
,gpu_ivf_flat
,gpu_ivf_pq
,gpu_brute_force
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
flat
index worker cpus
Possible values: 0.01 ≤ value ≤ 1000000
index worker memory
Possible values: 0.01 ≤ value ≤ 1000000
index worker replicas
Possible values: 1 ≤ value ≤ 1000
kafka cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
kafka memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
proxy cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
proxy memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
proxy replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000
query coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000
query worker cpus
Possible values: 0.01 ≤ value ≤ 1000000
query worker memory
Possible values: 0.01 ≤ value ≤ 1000000
query worker replicas
Possible values: 1 ≤ value ≤ 1000
root coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coodinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000
vector
Possible values: 1 ≤ value ≤ 1000000000
vector dimension
Possible values: 384 ≤ value ≤ 4000
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{id}/scale' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get milvus service databases
Get milvus service databases
GET /milvus_services/{service_id}/databases
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
List milvus service databases
List of milvus service databases
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "databases": [ { "id": "default" }, { "id": "db-02" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get milvus database collections
Get milvus database collections
GET /milvus_services/{service_id}/databases/{database_id}/collections
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
database_id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
List Milvus database collections
List of Milvus database collections
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "collections": [ { "id": 12345, "name": "collection-1", "physical_channels": [ "physical_channel_1" ], "virtual_channels": [ "virtual_channel_1" ] }, { "id": 67890, "name": "collection-2", "physical_channels": [ "physical_channel_2a", "physical_channel_2b" ], "virtual_channels": [ "virtual_channel_2a", "virtual_channel_2b" ] } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get milvus database collection partitions
Get milvus database collection partitions
GET /milvus_services/{service_id}/databases/{database_id}/collections/{collection_id}/partitions
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
database id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
collection id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
List milvus database collection partitions
List of milvus database collection partitions
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "partitions": [ { "id": 1000, "name": "partition1" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Update milvus service storage
Update details of milvus service bucket
PATCH /milvus_services/{id}/storage
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
service id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Update milvus service bucket
How is the Milvus instance managed
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
customer
root path
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- /]*$
Example:
Sample path
storage name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage name
tshirt size
Allowable values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
small
curl -X 'PATCH' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/milvus_services/{service_id}/storage' -H 'accept: application/json' -H 'Content-Type: application/merge-patch+json' -H "AuthInstanceId: {instance id}" -d '{ "description": "updated description for milvus service", "display_name": "sampleService", "tags": [ "tag1", "tag2" ]}'
Response
milvus service details
Actions
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
Index type of milvus engine
Possible values: [
flat
,ivf_flat
,ivf_sq8
,ivf_pq
,hnsw
,scann
,gpu
,gpu_cagra
,gpu_ivf_flat
,gpu_ivf_pq
,gpu_brute_force
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
flat
milvus status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
milvus status code
Possible values: 1 ≤ value ≤ 65535
Milvus storage details
Tags
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 128, Value must match regular expression
^[A-Za-z0-9!@#$%^&*()_+\-=\[\]{}|;:',.<>\/? ]*$
Examples:[ "tag1", "tag2" ]
tshirt size
Possible values: [
starter
,small
,medium
,large
,xlarge
,xxlarge
,custom
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
small
storage access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage access key
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
data coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
Service description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^.*$
Example:
milvus service for running sql queries
Service display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService
data worker cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
data worker replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
etcd cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
etcd memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus grpc_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.grpc.host
milvus port
Possible values: 1 ≤ value ≤ 65535
milvus display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-_]+$
Example:
sampleMilvus
milvus https_host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.https.host
milvus port
Possible values: 1 ≤ value ≤ 65535
Id of the Milvus service
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleService123
index worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
index worker memory
Possible values: 0.01 ≤ value ≤ 1000000
index worker replicas
Possible values: 1 ≤ value ≤ 1000000
kafka cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
kafka memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
How is the Milvus instance managed
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]*$
Example:
customer
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
proxy cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy host
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
example.proxy.host
proxy memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
milvus proxy port
Possible values: 1 ≤ value ≤ 65535
proxy replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
query coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
query worker cpu
Possible values: 0.01 ≤ value ≤ 1000000
query worker memory
Possible values: 0.01 ≤ value ≤ 1000000
query worker replicas
Possible values: 1 ≤ value ≤ 1000000
root coordinator cpus, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coodinator memory, only configurable in cpd
Possible values: 0.01 ≤ value ≤ 1000000
root coordinator replicas, only configurable in cpd
Possible values: 1 ≤ value ≤ 1000000
storage secret access key
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\- ]*$
Example:
Sample storage secret access key
service type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
milvus
Vector for milvus engine
Possible values: 1 ≤ value ≤ 65535
Dimension for milvus engine
Possible values: 384 ≤ value ≤ 1024
Milvus version
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]*$
Example:
3.5
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "created_by": "username@domain.com", "created_at": 1700201877, "display_name": "test-milvus", "grpc_port": 31501, "host_name": "<formation_id>.<kubernetes_cluster>.databases.appdomain.cloud", "https_port": 31012, "id": "milvus76", "index_type": "flat", "milvus_service": null, "proxy_port": 31019, "status": "running", "status_code": 11, "storage": { "storage_type": "ibm_cos", "root_path": "", "storage_name": "milvusstorage" }, "tags": [ "tag1" ], "tshirt_size": "small", "type": "milvus", "vector": 20000, "vector_dimension": 384 }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Form Parameters
Storage display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Storage type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
HMS Thrift URI
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\/.@_:_-]+$
HMS Thrift Port
Possible values: 1 ≤ value ≤ 65535
contents of core-site.xml file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[.*\s\S]*$
contents of hdfs-site.xml file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[.*\s\S]*$
Kerberos Flag
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^true$|^false$
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Catalog type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Kerberos configuration file
Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[.*\s\S]*$
Hive keytab file
Possible values: 1 ≤ length ≤ 104857600
HDFS keytab file
Possible values: 1 ≤ length ≤ 104857600
Hive server principal
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\/.@_:_-]+$
Hive client principal
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\/.@_:_-]+$
HDFS principal
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\/.@_:_-]+$
Database description
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
curl -X POST \-H "accept: application/json" \-H "AuthInstanceId: 00000000000" \-H "Content-Type: multipart/form-data" \-F "display_name=Sample_Hdfs" \-F "storage_type=hdfs" \-F "hms_thrift_uri=thrif://hms.example.com" \-F "hms_thrift_port=9083" \-F "core_site=<contents of core-site.xml file>" \-F "hdfs_site=<contents of hdfs-site.xml file>" \-F "kerberos=true" \-F "krb5_config=<contents of krb5.conf file>" \-F "hive_keytab=hive.keytab file" \-F "hdfs_keytab=hdfs.keytab file" \-F "hive_server_principal=hive/_HOST@EXAMPLE.COM" \-F "hive_client_principal=hive/_HOST@EXAMPLE.COM" \-F "hdfs_principal=hdfs/_HOST@EXAMPLE.COM" \-F "catalog_name=sample_catalog" \-F "catalog_type=hive-hadoop2" \-F "description=Sample description" \-F "created_at=1686120645" \"https://us.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_hdfs_registrations"
Response
HDFS storage registration
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "read", "update" ]
storage catalog
Examples:{ "base_path": "/iceberg_catalog/path1", "catalog_name": "iceberg_catalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "iceberg" }
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
1686120645
Username who created the HDFS storage
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
HDFS description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
HDFS description for storage
managed by
Possible values: [
customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
customer
mark hdfs active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
active
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "test", "write customer data'" ]
HDFS type
Possible values: [
hdfs
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
hdfs
HDFS storage display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sample hdfs displayname
HDFS Storage ID auto generated during registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Example:
hdfs123
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "hive" }, "created_at": "1699457595", "created_by": "username@domain.com", "description": "default hdfs", "display_name": "samplehdfsdisplayname", "id": "hdfs123", "managed_by": "customer", "state": "active", "tags": [ "tag1", "tag2" ], "type": "hdfs" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations"
Response
List storage registrations
Storages
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "storage_registrations": [ { "actions": [ "browse", "view", "modify", "create", "grant", "revoke", "update", "remove", "activate", "register" ], "associated_catalogs": [ { "catalog_name": "iceberg_catalog", "catalog_tags": [] } ], "configuration": { "auth_mode": "account_key", "container_name": "conatiner_name", "endpoint": "https://s3.us-south.cloud-object-storage.appdomain.cloud/", "storage_account_name": "storage_account_name", "storage_name": "iceberg-storage" }, "created_at": "1699457595", "created_by": "user", "description": "default storage", "display_name": "hive-storage", "id": "iceberg-storage", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ], "type": "minio" }, { "actions": [ "browse", "view", "modify", "create", "grant", "revoke", "update", "remove", "activate", "register" ], "associated_catalogs": [ { "catalog_name": "hive_data", "catalog_tags": [] } ], "configuration": { "endpoint": "http://xyz-minio-svc:9000", "storage_name": "hive-storage" }, "created_at": "1699457595", "created_by": "user", "description": "default storage", "display_name": "hive-storage", "id": "hive-storage", "managed_by": "ibm", "region": "us-south", "state": "active", "tags": [ "tag1", "tag2" ], "type": "minio" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
storage description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
COS storage for customer data
Storage display name
Possible values: 3 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sample-storage-displayname
managed by
Allowable values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
ibm
storage type
Allowable values: [
aws_s3
,minio
,ibm_cos
,ibm_ceph
,adls_gen1
,adls_gen2
,google_cs
,ozone
,ibm_storage_scale
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
ibm_cos
storage catalog
Examples:{ "base_path": "/iceberg_catalog/path1", "catalog_name": "iceberg_catalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "iceberg" }
bucket use to define whether the bucket is for query monitoring or acl
Allowable values: [
qhmm
,acl
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
storage details
Region where the storage is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
us-south
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "storage-tag1", "storage-tag2" ]
curl -X POST 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/json' -d '{ "display_name": "cos-cypress-bucket", "type": "ibm_cos", "description": "", "managed_by": "customer", "region": "us-south", "connection": { "name": "cos-cypress-bucket", "endpoint": "https://s3.us-west.cloud-object-storage.test.appdomain.cloud", "access_key": "ssdef", "secret_key": "29c92" }, "associated_catalog": { "catalog_name": "testcat", "catalog_type": "iceberg" } }'
Response
Storage
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "read", "update" ]
associated catalogs
Possible values: 0 ≤ number of items ≤ 1000
- associated_catalogs
catalog tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "catalog_tag_1", "catalog_tag_2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
catalog type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
iceberg
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
1686120645
Username of the user who created the storage
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
storage description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
COS storage for customer data
Storage display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-storage-displayname
managed by
Possible values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
ibm
Mark storage as active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
active
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "teststorage", "write customer data'" ]
storage type
Possible values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
,adls_gen1
,adls_gen2
,google_cs
,ibm_storage_scale
,ozone
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
ibm_cos
storage details
storage ID auto generated during storage registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Example:
samplestorage123
Region where the storage is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
us-south
Boolean value to specify whether updating HMAC credentials for internal system storage
Example:
true
Boolean value to specify whether vault enabled or not
Example:
true
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalogs": [ { "catalog_name": "hive_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "hive" } ], "created_at": "1699457595", "created_by": "username@domain.com", "description": "default storage", "display_name": "samplestoragedisplayname", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "id": "samplestorageid", "managed_by": "ibm", "region": "us-south", "state": "active", "storage_name": "samplestorage", "tags": [ "tag1", "tag2" ], "type": "minio" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Query Parameters
Skip MDS call when Unity catalog is added
Default:
false
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations/{id}"
Response
Storage
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "read", "update" ]
associated catalogs
Possible values: 0 ≤ number of items ≤ 1000
- associated_catalogs
catalog tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "catalog_tag_1", "catalog_tag_2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
catalog type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
iceberg
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
1686120645
Username of the user who created the storage
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
storage description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
COS storage for customer data
Storage display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-storage-displayname
managed by
Possible values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
ibm
Mark storage as active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
active
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "teststorage", "write customer data'" ]
storage type
Possible values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
,adls_gen1
,adls_gen2
,google_cs
,ibm_storage_scale
,ozone
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
ibm_cos
storage details
storage ID auto generated during storage registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Example:
samplestorage123
Region where the storage is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
us-south
Boolean value to specify whether updating HMAC credentials for internal system storage
Example:
true
Boolean value to specify whether vault enabled or not
Example:
true
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalogs": [ { "catalog_name": "hive_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "hive" } ], "created_at": "1699457595", "created_by": "username@domain.com", "description": "default storage", "display_name": "samplestoragedisplayname", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "id": "samplestorageid", "managed_by": "ibm", "region": "us-south", "state": "active", "storage_name": "samplestorage", "tags": [ "tag1", "tag2" ], "type": "minio" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Query Parameters
Skip MDS call when Unity catalog is added
Default:
false
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations/{id}"
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Query Parameters
Skip MDS call when Unity catalog is added
Default:
false
Request body
{
"configuration": {
"access_key": "<access_key>",
"endpoint": "https://s3.us-south.cloud-object-storage.appdomain.cloud/",
"secret_key": "secret_key",
"storage_name": "sample-storage"
},
"description": "COS storage for customer data",
"display_name": "samplestoragedisplayname",
"system_storage_update_credentials": false,
"tags": [
"teststorage",
"userstorage"
]
}
storage details
Modified description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
COS storage for customer data
Storage display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-storage-displayname
Boolean value to specify whether the patch is for updating HMAC credentials for internal system storage
Example:
true
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "teststorage", "userstorage" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/json" -d '{ "access_key": "<access_key>", "display_name": "sample-storage-displayname", "description": "COS storage for customer data", "secret_key": "<secret_key>", "tags": [ "teststorage", "userstorage" ] }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations/{id}"
Response
Storage
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "read", "update" ]
associated catalogs
Possible values: 0 ≤ number of items ≤ 1000
- associated_catalogs
catalog tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "catalog_tag_1", "catalog_tag_2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
catalog type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
iceberg
Creation date
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
1686120645
Username of the user who created the storage
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
storage description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
COS storage for customer data
Storage display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-storage-displayname
managed by
Possible values: [
ibm
,customer
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
ibm
Mark storage as active or inactive
Possible values: [
active
,inactive
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
active
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "teststorage", "write customer data'" ]
storage type
Possible values: [
amazon_s3
,aws_s3
,minio
,ibm_cos
,ibm_ceph
,adls_gen1
,adls_gen2
,google_cs
,ibm_storage_scale
,ozone
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
ibm_cos
storage details
storage ID auto generated during storage registration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Example:
samplestorage123
Region where the storage is located
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
us-south
Boolean value to specify whether updating HMAC credentials for internal system storage
Example:
true
Boolean value to specify whether vault enabled or not
Example:
true
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "create", "update" ], "associated_catalogs": [ { "catalog_name": "hive_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "hive" } ], "created_at": "1699457595", "created_by": "username@domain.com", "description": "default storage", "display_name": "samplestoragedisplayname", "endpoint": "https://s3.<region>.cloud-object-storage.appdomain.cloud/", "id": "samplestorageid", "managed_by": "ibm", "region": "us-south", "state": "active", "storage_name": "samplestorage", "tags": [ "tag1", "tag2" ], "type": "minio" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -d "" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations/{storage_id}/activate"
Response
Activate storage
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Activate storage", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Query Parameters
Skip MDS call when Unity catalog is added
Default:
false
Request body
{
"base_path": "/iceberg_catalog/path1",
"catalog_name": "iceberg_catalog",
"catalog_tags": [
"catalog_tag_1",
"catalog_tag_2"
],
"catalog_type": "iceberg"
}
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
catalog tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "catalog_tag_1", "catalog_tag_2" ]
catalog type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
iceberg
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/json" -d '{ "associated_catalog": { "catalog_name": "<access_key>", "catalog_type": "sample-storage" } }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations"
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get storage object properties
Get storage object properties
POST /storage_registrations/{storage_id}/object_properties
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Request body
storage object size
Possible values: 1 ≤ number of items ≤ 1000
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/json" -d '{ "associated_catalog": { "catalog_name": "<access_key>", "catalog_type": "sample-storage" } }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations"
Response
muliple storage object properties
muliple storage object properties
Possible values: 1 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "object_properties": [ { "content_type": "application/json", "file_type": "json", "last_modified": "utc-2014-07", "metadata": { "key1": "value1", "key2": "value2" }, "path": "iceberg/test/data", "size": "1024" }, { "content_type": "text/plain", "file_type": "txt", "last_modified": "utc-2023-01", "metadata": { "keyA": "valueA", "keyB": "valueB" }, "path": "xyz/xyz/file", "size": "2048" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List storage objects
Fetch all objects from a given storage
GET /storage_registrations/{storage_id}/objects
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
storage id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Query Parameters
path
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/storage_registrations/{storage_id}/objects"
Response
List storage objects
storage object
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\/\\_.]+$
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
Success
{ "objects": [ "/path/file1.json", "/path/file2.txt", "/path/file3.csv", "/path/file4.parquet" ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines"
Response
Collection of Presto engines.
List of Presto engines.
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "presto_engines": [ { "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "display_name": "starter", "drivers": [], "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "id": "presto511", "origin": "native", "port": 30156, "resource_groups": [], "size_config": "starter", "status": "running", "status_code": 200, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create Engine Body
Origin of presto engine .
Allowable values: [
native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
native
Catalogs associated to the presto engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Engine configuration details.
Engine description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
presto engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleEngine
Region
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
us-south
Tags
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Examples:[ "tag1", "tag2" ]
Version of presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.2.3
curl -X POST "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines" -H "accept: application/json" -H "content-type: application/json" -d '{ "description": "", "configuration": { "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "size_config": "custom", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }, "display_name": "presto-01", "origin": "native", "associated_catalogs": [], "version": "v0.286", "tags": [], "region": "us-south" }'
Response
Presto engine details.
Actions
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "update", "delete" ]
Catalogs associated to the presto engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Driver details
Possible values: 0 ≤ number of items ≤ 100
Applicable only for OCP based clusters. This is typically servicename+route
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@\_\/\\]+$
Example:
your-hostname.apps.your-domain.com
Origin
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
Resource group details
Possible values: 0 ≤ number of items ≤ 100
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
Engine status code
Possible values: 1 ≤ value ≤ 999
Tags
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.0.3.0.0
Engine configuration details.
Presto engine configurations.
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_@.\\\/]+$
Example:
username@domain.com
Engine description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
presto engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleEngine
Engine properties
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@\_\/\\]+$
Example:
ibm-lh-lakehouse-presto-01-presto-svc
The unigue identifier for the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
sampleEngine123
Is QHMM engine
Example:
true
Engine port
Possible values: 1 ≤ value ≤ 65535
Query status
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
completed
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
us-south
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]+$
Example:
starter
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.2.0
Presto engine configurations.
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "display_name": "starter", "drivers": [], "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "id": "presto511", "origin": "native", "port": 30156, "resource_groups": [], "size_config": "starter", "status": "running", "status_code": 200, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get presto engine catalogs
Get list of all catalogs attached to a presto engine
GET /presto_engines/{engine_id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Collection of catalogs
List of catalogs
Possible values: 0 ≤ number of items ≤ 3000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1765338982", "sync_description": "Table registration was successful", "sync_exception": [], "sync_status": "SUCCESS" }, "created_at": "1765338982", "created_by": "<username>@<domain>.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "example.example.lakehouse.dev.appdomain.cloud", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Associate catalogs to presto engine
Associate one or more catalogs to a presto engine
POST /presto_engines/{engine_id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Catalog names
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X POST 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{engine_id}/catalogs' -H 'accept: application/json' -H 'Content-Type: application/json' -H 'AuthInstanceId: {instance id}' -d '{ "catalog_names": [ "hive_data" ] }'
Response
Define the catalog details
List of allowed actions
Possible values: [
select
,use
,show
,view
,create
,drop
,alter
,insert
,grant
,revoke
,delete
,update
,remove
,register
]Possible values: 0 ≤ number of items ≤ 15, 1 ≤ length ≤ 15, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of associated databases
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "database_1", "database_2" ]
List of associated engines
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "engine_1", "engine_2" ]
List of associated storage
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "bucket_1", "bucket_2" ]
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
List of tags added to this catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
Catalog synchronization metadata
Epoch timestamp when the catalog was created
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1602839833
Created by
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
<username>@<domain>.com
Days left for catalog dissociation in case of vulnerability
Possible values: 0 ≤ length ≤ 150, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
30
The description if added, for the catalog
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Iceberg catalog description
catalog location uri
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://testbucket
MDS Thrift server connection details
Underlying catalog or storage backend used for metadata operations.For example,if the database type is
hive_hadoop2
oriceberg
, the metastore is often set toglue
.For HDFS, the metastore may be set tohdfs
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
glue
Name of the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
running
Catalog type like iceberg,hive etc
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iceberg
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "select", "create", "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1602839833", "sync_description": "Table registration was successful", "sync_exception": [ "Table is corrupted", "Table metadata not available" ], "sync_status": "SUCCESS" }, "created_at": "1602839833", "created_by": "user@example.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "mds.host.lakehouse.dev", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Disassociate catalogs from a presto engine
Disassociate one or more catalogs from a presto engine
DELETE /presto_engines/{engine_id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "AuthInstanceId: {instance id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get presto engine catalog
Get catalog attached to presto engine
GET /presto_engines/{engine_id}/catalogs/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
catalog id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{engine_id}/catalogs/{id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Define the catalog details
List of allowed actions
Possible values: [
select
,use
,show
,view
,create
,drop
,alter
,insert
,grant
,revoke
,delete
,update
,remove
,register
]Possible values: 0 ≤ number of items ≤ 15, 1 ≤ length ≤ 15, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of associated databases
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "database_1", "database_2" ]
List of associated engines
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "engine_1", "engine_2" ]
List of associated storage
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "bucket_1", "bucket_2" ]
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
List of tags added to this catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
Catalog synchronization metadata
Epoch timestamp when the catalog was created
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1602839833
Created by
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
<username>@<domain>.com
Days left for catalog dissociation in case of vulnerability
Possible values: 0 ≤ length ≤ 150, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
30
The description if added, for the catalog
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Iceberg catalog description
catalog location uri
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://testbucket
MDS Thrift server connection details
Underlying catalog or storage backend used for metadata operations.For example,if the database type is
hive_hadoop2
oriceberg
, the metastore is often set toglue
.For HDFS, the metastore may be set tohdfs
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
glue
Name of the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
running
Catalog type like iceberg,hive etc
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iceberg
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "select", "create", "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1602839833", "sync_description": "Table registration was successful", "sync_exception": [ "Table is corrupted", "Table metadata not available" ], "sync_status": "SUCCESS" }, "created_at": "1602839833", "created_by": "user@example.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "mds.host.lakehouse.dev", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Presto engine details.
Actions
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "update", "delete" ]
Catalogs associated to the presto engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Driver details
Possible values: 0 ≤ number of items ≤ 100
Applicable only for OCP based clusters. This is typically servicename+route
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@\_\/\\]+$
Example:
your-hostname.apps.your-domain.com
Origin
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
Resource group details
Possible values: 0 ≤ number of items ≤ 100
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
Engine status code
Possible values: 1 ≤ value ≤ 999
Tags
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.0.3.0.0
Engine configuration details.
Presto engine configurations.
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_@.\\\/]+$
Example:
username@domain.com
Engine description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
presto engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleEngine
Engine properties
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@\_\/\\]+$
Example:
ibm-lh-lakehouse-presto-01-presto-svc
The unigue identifier for the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
sampleEngine123
Is QHMM engine
Example:
true
Engine port
Possible values: 1 ≤ value ≤ 65535
Query status
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
completed
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
us-south
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]+$
Example:
starter
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.2.0
Presto engine configurations.
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "display_name": "starter", "drivers": [], "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "id": "presto511", "origin": "native", "port": 30156, "resource_groups": [], "size_config": "starter", "status": "running", "status_code": 200, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}' -H 'accept: */*' -H "AuthInstanceId: {instance id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
updated description for presto engine
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleEngine
Engine properties
- properties
Engine Catalog properties
- catalog
Engine Catalog properties
Engine configuration properties
Event listener engine properties
- event_listener
Event listener properties
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_.:\/\\]+$
Global engine properties
- global
Global properties
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_.:\/\\]+$
JMX engine properties
- jmx_exporter_config
JMX properties
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_.:\/\\]+$
Engine JVM properties
Engine Logconfig properties
The engine properties to be removed which was added through api customisation.
- remove_engine_properties
Catalog properties with dynamic catalog names
- catalog
RemoveEngine configuration properties
The event listener engine properties to be removed which was added through api customisation.
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@_$\\]+$
The global properties to be removed which was added through api customisation.
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@_$\\]+$
The jm properties to be removed which was added through api customisation.
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@_$\\]+$
JVM properties
Remove engine log configuration properties
The type of engine restart . The value can be set to forcefully restart an engine
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9]+$
Example:
force
Tags
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}' -H 'accept: application/json' -H 'Content-Type: application/merge-patch+json' -H "AuthInstanceId: {instance id}" -d '{ "description": "updated description for presto engine", "display_name": "sampleEngine", "tags": [ "tag1", "tag2" ]}'
Response
Presto engine details.
Actions
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "update", "delete" ]
Catalogs associated to the presto engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Driver details
Possible values: 0 ≤ number of items ≤ 100
Applicable only for OCP based clusters. This is typically servicename+route
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@\_\/\\]+$
Example:
your-hostname.apps.your-domain.com
Origin
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
native
Resource group details
Possible values: 0 ≤ number of items ≤ 100
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
running
Engine status code
Possible values: 1 ≤ value ≤ 999
Tags
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.0.3.0.0
Engine configuration details.
Presto engine configurations.
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_@.\\\/]+$
Example:
username@domain.com
Engine description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
presto engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleEngine
Engine properties
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@\_\/\\]+$
Example:
ibm-lh-lakehouse-presto-01-presto-svc
The unigue identifier for the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
sampleEngine123
Is QHMM engine
Example:
true
Engine port
Possible values: 1 ≤ value ≤ 65535
Query status
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
completed
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
us-south
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-._]+$
Example:
starter
Engine type presto
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.]+$
Example:
1.2.0
Presto engine configurations.
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "display_name": "starter", "drivers": [], "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "presto511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "id": "presto511", "origin": "native", "port": 30156, "resource_groups": [], "size_config": "starter", "status": "running", "status_code": 200, "tags": [ "tag1", "tag2" ], "type": "presto", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}/pause' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Pause
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Success", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Presto query to determine explain plan
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_!@#%*.;&_=\]}<> ]+$
Example:
show schemas in catalog_name
Catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
catalog_name
Format
Allowable values: [
text
,graphviz
,json
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
json
Schema name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
Example:
schema_name
Type
Allowable values: [
logical
,distributed
,validate
,io
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
io
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}/query_explain' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d '{ "format": "json", "statement": "show schemas in catalog_name", "type": "io"}'
Response
ExplainStatement OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Result
Possible values: 0 ≤ length ≤ 1000000, Value must match regular expression
^[a-zA-Z0-9\-_.!@#$%^&*() \/\\\s\S]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Success", "message_code": "success" }, "result": "- Output[PlanNodeId 8][Catalog] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 1,210.00}\n Catalog := field\n- RemoteStreamingMerge[PlanNodeId 188][field ASC_NULLS_LAST] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 1,210.00}\n - LocalMerge[PlanNodeId 210][field ASC_NULLS_LAST] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 605.00}\n - PartialSort[PlanNodeId 189][field ASC_NULLS_LAST] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 605.00}\n - RemoteStreamingExchange[PlanNodeId 187][REPARTITION] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 605.00, memory: 0.00, network: 605.00}\n - Values[PlanNodeId 0] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 0.00, memory: 0.00, network: 0.00}\n (VARCHAR'automation_blackhole')\n (VARCHAR'automation_iceberg_ozone')\n (VARCHAR'automation_localfile')\n (VARCHAR'cos_catalog')\n (VARCHAR'cosicebergcaatlog')\n (VARCHAR'db2cat')\n (VARCHAR'jmx')\n (VARCHAR'ms_sql_cat')\n (VARCHAR'system')\n (VARCHAR'tpcds')\n (VARCHAR'tpch')\n" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Explain presto analyze
Return query metrics after query is complete
POST /presto_engines/{id}/query_explain_analyze
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Presto query to show explain analyze
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
Example:
show schemas in catalog_name
Verbose
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}/query_explain_analyze' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d '{ "statement": "show schemas in catalog_name", "verbose": true}'
Response
ExplainStatement OK
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Result
Possible values: 0 ≤ length ≤ 1000000, Value must match regular expression
^[a-zA-Z0-9\-_.!@#$%^&*() \/\\\s\S]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Success", "message_code": "success" }, "result": "- Output[PlanNodeId 8][Catalog] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 1,210.00}\n Catalog := field\n- RemoteStreamingMerge[PlanNodeId 188][field ASC_NULLS_LAST] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 1,210.00}\n - LocalMerge[PlanNodeId 210][field ASC_NULLS_LAST] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 605.00}\n - PartialSort[PlanNodeId 189][field ASC_NULLS_LAST] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 1,210.00, memory: 605.00, network: 605.00}\n - RemoteStreamingExchange[PlanNodeId 187][REPARTITION] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 605.00, memory: 0.00, network: 605.00}\n - Values[PlanNodeId 0] => [field:varchar(24)]\n Estimates: {source: CostBasedSourceInfo, rows: 11 (605B), cpu: 0.00, memory: 0.00, network: 0.00}\n (VARCHAR'automation_blackhole')\n (VARCHAR'automation_iceberg_ozone')\n (VARCHAR'automation_localfile')\n (VARCHAR'cos_catalog')\n (VARCHAR'cosicebergcaatlog')\n (VARCHAR'db2cat')\n (VARCHAR'jmx')\n (VARCHAR'ms_sql_cat')\n (VARCHAR'system')\n (VARCHAR'tpcds')\n (VARCHAR'tpch')\n" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}/restart' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Pause
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "response": { "message": "Success", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}/resume' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Pause
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Success", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Scale Engine Body
Presto engine configurations.
Presto engine configurations.
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{id}/scale' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d '{ "coordinator": { "node_type": "worker", "quantity": 0 }, "worker": { "node_type": "worker", "quantity": 0 }}'
Response
Pause
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Success", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines"
Response
list Prestissimo Engines
list prestissimo engines
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "prestissimo_engines": [ { "actions": [ "view", "use", "update", "select", "access_ui", "associate", "disassociate", "restart", "pause", "resume", "grant", "revoke", "delete", "create", "scale" ], "associated_catalogs": [ "hive_data" ], "build_version": "1.1.0.0.0", "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "display_name": "starter", "id": "prestissimo511", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "prestissimo511", "host_name": "1234-xyz456-abc4321.databases.appdomain.cloud", "origin": "native", "port": 30156, "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "type": "prestissimo", "version": "v0.282", "worker": { "node_type": "bx2.4x16", "quantity": 1 } } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create Engine Body
Origin - created or registered
Allowable values: [
native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
native
Associated catalogs
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "hive_data" ]
External engine details
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo engine description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
sampleEngine
Region (cloud)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
us-south
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
Version like 0.278 for prestissimo or else
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.2.3
curl -X POST 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines' -H 'accept: application/json' -H 'Content-Type: application/json' -d '{ "description": "", "configuration": { "coordinator": { "node_type": "bx2.4x16", "quantity": 1 }, "size_config": "custom", "worker": { "node_type": "bx2.4x16", "quantity": 1 } }, "display_name": "prestissimo-01", "origin": "native", "associated_catalogs": [], "version": "v0.286", "tags": [], "region": "us-south" }'
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of catalogs associated with the the engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "hive_data" ]
Applicable only for OCP based clusters. This is typically servicename+route
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
your-hostname.apps.your-domain.com
Origin - place holder
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
native
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
running
Engine status code
Possible values: 0 ≤ value ≤ 999
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
status of optimizer sync
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-._]+$
Example:
not_started
watsonx.data build version
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
1.0.3.0.0
External engine details
Node details
Created time in epoch format
Possible values: 0 ≤ value ≤ 21474836
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
xyz-prestissimo-01-prestissimo-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
prestissimo
Is QHMM engine
Example:
true
last optimizer sync call
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
not_started
optimizer enabled status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
false
Engine port
Possible values: 0 ≤ value ≤ 65535
Engine properties
Query status
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
completed
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
us-south
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
starter
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.2.0
Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_at": 16378838, "created_by": "<username>@<domain>.com", "description": "prestissimo engine for running sql queries", "display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get prestissimo engine catalog
Get catalog attached to a prestissimo engine
GET /prestissimo_engines/{engine_id}/catalogs/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
catalog id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/catalogs/{catalog_id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Define the catalog details
List of allowed actions
Possible values: [
select
,use
,show
,view
,create
,drop
,alter
,insert
,grant
,revoke
,delete
,update
,remove
,register
]Possible values: 0 ≤ number of items ≤ 15, 1 ≤ length ≤ 15, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of associated databases
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "database_1", "database_2" ]
List of associated engines
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "engine_1", "engine_2" ]
List of associated storage
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "bucket_1", "bucket_2" ]
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
List of tags added to this catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
Catalog synchronization metadata
Epoch timestamp when the catalog was created
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1602839833
Created by
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
<username>@<domain>.com
Days left for catalog dissociation in case of vulnerability
Possible values: 0 ≤ length ≤ 150, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
30
The description if added, for the catalog
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Iceberg catalog description
catalog location uri
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://testbucket
MDS Thrift server connection details
Underlying catalog or storage backend used for metadata operations.For example,if the database type is
hive_hadoop2
oriceberg
, the metastore is often set toglue
.For HDFS, the metastore may be set tohdfs
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
glue
Name of the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
running
Catalog type like iceberg,hive etc
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iceberg
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "select", "create", "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1602839833", "sync_description": "Table registration was successful", "sync_exception": [ "Table is corrupted", "Table metadata not available" ], "sync_status": "SUCCESS" }, "created_at": "1602839833", "created_by": "user@example.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "mds.host.lakehouse.dev", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of catalogs associated with the the engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "hive_data" ]
Applicable only for OCP based clusters. This is typically servicename+route
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
your-hostname.apps.your-domain.com
Origin - place holder
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
native
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
running
Engine status code
Possible values: 0 ≤ value ≤ 999
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
status of optimizer sync
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-._]+$
Example:
not_started
watsonx.data build version
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
1.0.3.0.0
External engine details
Node details
Created time in epoch format
Possible values: 0 ≤ value ≤ 21474836
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
xyz-prestissimo-01-prestissimo-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
prestissimo
Is QHMM engine
Example:
true
last optimizer sync call
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
not_started
optimizer enabled status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
false
Engine port
Possible values: 0 ≤ value ≤ 65535
Engine properties
Query status
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
completed
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
us-south
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
starter
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.2.0
Node details
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_at": 16378838, "created_by": "<username>@<domain>.com", "description": "prestissimo engine for running sql queries", "display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}' -H 'accept: */*' -H "AuthInstanceId: {instance id}"
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Update prestissimo engine body
Modified description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
updated description for prestissimo engine
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Engine properties
- engine_properties
Catalog Properties for Prestissimo
- catalog
Engine Properties for Prestissimo
Global engine properties
- global
Global properties
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_.:\/\\]+$
JVM Properties for Prestissimo
LogConfig Properties for Prestissimo
Velox Properties
- velox
Global properties
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_.:\/\\]+$
RemoveEngine properties
- remove_engine_properties
Catalog properties with dynamic catalog names
- catalog
Catalog properties of prestissimo that should be removed
Configuration properties of prestissimo that should be removed
Global properties of prestissimo that should be removed
Possible values: 0 ≤ number of items ≤ 500, 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-.]+$
JVM properties of prestissimo that should be removed
LogConfig properties of prestissimo that should be removed
Velox properties of prestissimo that should be removed
Possible values: 0 ≤ number of items ≤ 500, 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-.]+$
engine will restart accordingily
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
force
Tags
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X 'PATCH' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}' -H 'accept: application/json' -H 'Content-Type: application/merge-patch+json' -H "AuthInstanceId: {instance id}" -d '{ "description": "updated description for presto engine", "display_name": "sampleEngine", "tags": [ "tag1", "tag2" ]}'
Response
EngineDetail
Actions
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of catalogs associated with the the engine
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "hive_data" ]
Applicable only for OCP based clusters. This is typically servicename+route
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
your-hostname.apps.your-domain.com
Origin - place holder
Possible values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
native
Engine status
Possible values: [
running
,pending
,stopped
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
running
Engine status code
Possible values: 0 ≤ value ≤ 999
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
status of optimizer sync
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-._]+$
Example:
not_started
watsonx.data build version
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
1.0.3.0.0
External engine details
Node details
Created time in epoch format
Possible values: 0 ≤ value ≤ 21474836
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Group ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
new_group_id
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
xyz-prestissimo-01-prestissimo-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
prestissimo
Is QHMM engine
Example:
true
last optimizer sync call
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
not_started
optimizer enabled status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-z0-9\-.]+$
Example:
false
Engine port
Possible values: 0 ≤ value ≤ 65535
Engine properties
Query status
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
completed
Region - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
us-south
CPD supported sizes are: custom, starter, small, medium, large, xlarge, and xxlarge. IBM cloud supported sizes are: custom, starter, small, medium, large, cache_optimized, compute_optimized and lite.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
starter
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
prestissimo
Version of the engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.2.0
Node details
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalogs": [ "hive_data" ], "coordinator": { "node_type": "worker", "quantity": 1 }, "created_at": 16378838, "created_by": "<username>@<domain>.com", "description": "prestissimo engine for running sql queries", "display_name": "sampleEngine", "engine_id": "sampleEngine123", "external_host_name": "your-hostname.apps.your-domain.com", "group_id": "new_group_id", "host_name": "your-hostname.apps.your-domain.com", "origin": "native", "region": "us-south", "size_config": "starter", "status": "running", "status_code": 0, "tags": [ "tag1", "tag2" ], "version": "1.2.0", "worker": { "node_type": "worker", "quantity": 1 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get prestissimo engine catalogs
Get list of all catalogs attached a prestissimo engine
GET /prestissimo_engines/{id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/catalogs' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Collection of catalogs
List of catalogs
Possible values: 0 ≤ number of items ≤ 3000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1765338982", "sync_description": "Table registration was successful", "sync_exception": [], "sync_status": "SUCCESS" }, "created_at": "1765338982", "created_by": "<username>@<domain>.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "example.example.lakehouse.dev.appdomain.cloud", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Associate catalogs to a prestissimo engine
Associate one or more catalogs to a prestissimo engine
POST /prestissimo_engines/{id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Catalog names
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/catalogs' -H 'accept: application/json' -d '{ "catalog_names": "catalog_name", }' -H "AuthInstanceId: {instance id}"
Response
Collection of catalogs
List of catalogs
Possible values: 0 ≤ number of items ≤ 3000
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "catalogs": [ { "actions": [ "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1765338982", "sync_description": "Table registration was successful", "sync_exception": [], "sync_status": "SUCCESS" }, "created_at": "1765338982", "created_by": "<username>@<domain>.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "example.example.lakehouse.dev.appdomain.cloud", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Disassociate catalogs from a prestissimo engine
Disassociate one or more catalogs from a prestissimo engine
DELETE /prestissimo_engines/{id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-,_]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{engine_id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "AuthInstanceId: {instance id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Pause prestissimo engine
Pause a running prestissimo engine ie, only available is SAAS
POST /prestissimo_engines/{id}/pause
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/pause' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Presto query to determine explain plan
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_!@#%*.;&_=\]}<> ]+$
Example:
show schemas in catalog_name
Catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
catalog_name
Format
Allowable values: [
text
,graphviz
,json
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-!@#$%^&*()_+{}:"?\[\]\\;',.\/ ]+$
Example:
json
Schema name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
Example:
schema_name
Type
Allowable values: [
logical
,distributed
,validate
,io
]Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
io
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/query_explain' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d '{ "format": "json", "statement": "show schemas in catalog_name", "type": "io"}'
Response
ExplainStatement OK
result
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-.]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "result": "explain" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Explain analyze
Return query metrics after query is complete
POST /prestissimo_engines/{id}/query_explain_analyze
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Presto query to show explain analyze
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
Example:
show schemas in catalog_name
Verbose
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/presto_engines/{engine_id}/query_explain_analyze' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d '{ "statement": "show schemas in catalog_name", "verbose": true}'
Response
explainAnalyzeStatement OK
explainAnalyzeStatement result
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-z0-9\-]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "result": "statement" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Restart a prestissimo engine
Restart an existing prestissimo engine
POST /prestissimo_engines/{id}/restart
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/prestissimo_engines/{engine_id}/restart' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Resume prestissimo engine
Resume a paused prestissimo engine ie, only available is SAAS
POST /prestissimo_engines/{id}/resume
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/resume' -H 'accept: application/json' -H "AuthInstanceId: {instance id}" -d ''
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Scale a prestissimo engine
Scale an existing prestissimo engine ie, only available is SAAS
POST /prestissimo_engines/{id}/scale
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Scale Engine Body
Node details
Node details
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/prestissimo_engines/{engine_id}/scale' -H 'accept: application/json' -H 'Content-Type: application/json' -H "AuthInstanceId: {instance id}" -d '{ "coordinator": { "node_type": "worker", "quantity": 0 }, "worker": { "node_type": "worker", "quantity": 0 }}'
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/db2_engines"
Response
list db2 engines
list db2 engines
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "db2_engines": [ { "actions": [ "create" ], "created_at": 1700322436, "created_by": "user@test.com", "description": "db2 engine to run sql queries", "display_name": "db2", "engine_details": { "connection_string": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "id": "db2505", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create db2 engine body
Origin - created or registered
Allowable values: [
external
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
external
External engine details
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
db2 engine description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/json" -d '{ "description": "db2 engine description", "configuration": { "connection_string": "1.2.3.4" }, "display_name": "sampleEngine", "origin": "external", "tags": [ "tag1", "tag2" ], "type": "db2" }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/db2_engines"
Response
Db2 engine details
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 0 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
External engine details
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
db2 engine to run sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-engine
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\.-]+$
Example:
xyz-db2-01-db2-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
sampleEngine123
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
Engine port
Possible values: 1 ≤ value ≤ 65535
Status of the engine
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
REGISTERED
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
db2
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "Db2Engine": null, "actions": [ "update", "delete" ], "build_version": "1.0.3.0.0", "created_at": 1700322469, "created_by": "user@test.com", "description": "updated description for db2 engine.", "display_name": "db2-engine", "engine_details": { "connection_string\"": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "host_name": "xyz-db2-01-db2-svc", "id": "db210", "origin": "external", "port": 3449, "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/db2_engines/{id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
db2 engine updated description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/merge-patch+json" -d '{ "description": "db2 engine updated description", "display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/db2_engines/{id}"
Response
Db2 engine details
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 0 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
External engine details
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
db2 engine to run sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-engine
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\.-]+$
Example:
xyz-db2-01-db2-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
sampleEngine123
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
Engine port
Possible values: 1 ≤ value ≤ 65535
Status of the engine
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
REGISTERED
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
db2
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "Db2Engine": null, "actions": [ "update", "delete" ], "build_version": "1.0.3.0.0", "created_at": 1700322469, "created_by": "user@test.com", "description": "updated description for db2 engine.", "display_name": "db2-engine", "engine_details": { "connection_string\"": "jdbc:db2://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "host_name": "xyz-db2-01-db2-svc", "id": "db210", "origin": "external", "port": 3449, "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "db2" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/netezza_engines"
Response
list Netezza engines
list Netezza engines
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "netezza_engines": [ { "actions": [ "create" ], "configuration": { "connection_string": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "created_at": 1700322469, "created_by": "user@test.com", "description": "netezza engine for running sql queries", "display_name": "netezza", "id": "netezza170", "origin": "external", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create netezza engine body
Origin - created or registered
Allowable values: [
external
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
external
External engine details
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
netezza engine description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/json" -d '{ "description": "netezza engine description", "engine_details": { "connection_string": "1.2.3.4" }, "display_name": "sampleEngine", "origin": "external", "tags": [ "tag1", "tag2" ], "type": "netezza" }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/netezza_engines"
Response
Netezza engine details
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 0 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
External engine details
Created time in epoch format
Possible values: 0 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
netezza engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\.-]+$
Example:
xyz-netezza-01-netezza-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
sampleEngine123
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
Engine port
Possible values: 0 ≤ value ≤ 65535
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
REGISTERED
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
netezza
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "build_version": "1.0.3.0.0", "configuration": { "connection_string\"": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "created_at": 1700322469, "created_by": "user@test.com", "description": "updated description for netezza engine.", "display_name": "sample-netezza-engine", "host_name": "xyz-netezza-01-netezza-svc", "id": "netezza904", "origin": "external", "port": 3499, "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
curl -X DELETE -H "accept: */* " -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/netezza_engines/{id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Update Engine Body
Modified description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
netezza engine updated description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/merge-patch+json" -d '{ "description": "netezza engine updated description", "display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/netezza_engines/{id}"
Response
Netezza engine details
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 0 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
External engine details
Created time in epoch format
Possible values: 0 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Engine description
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
netezza engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleEngine
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\.-]+$
Example:
xyz-netezza-01-netezza-svc
Engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
sampleEngine123
Origin - place holder
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
Engine port
Possible values: 0 ≤ value ≤ 65535
Engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
REGISTERED
Engine type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
netezza
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "update", "delete" ], "build_version": "1.0.3.0.0", "configuration": { "connection_string\"": "jdbc:netezza://localhost:5480/database", "metastore_host": "thrift://mh-connection-string-sample.com" }, "created_at": 1700322469, "created_by": "user@test.com", "description": "updated description for netezza engine.", "display_name": "sample-netezza-engine", "host_name": "xyz-netezza-01-netezza-svc", "id": "netezza904", "origin": "external", "port": 3499, "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "netezza" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines"
Response
Collection of Spark engines.
List of spark engines
Possible values: 0 ≤ number of items ≤ 100
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "spark_engines": [ { "actions": [ "update", "delete" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "configuration": { "connection_string": "https://xyz.region.ae.cloud.123.com/v3/analytics_engines/spark_iae_id", "endpoints": { "applications_api": "$HOST/v4/analytics_engines/<spark_id>/spark_applications/<application_id>", "history_server_endpoint": "$HOST/v2/spark/v3/instances/<spark_id>/spark_history_server", "spark_access_endpoint": "$HOST/analytics-engine/details/spark-<instance_id>", "spark_jobs_v4_endpoint": "$HOST/v4/analytics_engines/<spark_id>/spark_applications", "spark_kernel_endpoint": "$HOST/v4/analytics_engines/<spark_id>/jkg/api/kernels", "view_history_server": "View history server", "wxd_application_endpoint": "$HOST/v1/<wxd_instance_id>/engines/<engine_id>/applications" } }, "created_at": 2147483647, "created_by": "<username>@<domain>.com", "description": "Spark engines for running spark applications", "display_name": "sparkEngine", "id": "spark123", "origin": "discover", "status": "REGISTERED", "tags": [ "tag1", "tag2" ], "type": "spark" }, { "actions": [ "update", "delete" ], "associated_catalogs": [ "iceberg_data", "hive_data" ], "configuration": { "default_config": { "key1": "value1", "key2": "value2", "spark.driver.cores": "1", "spark.driver.memory": "4G", "spark.executor.cores": "1", "spark.executor.memory": "4G" }, "default_version": "4.8.3", "endpoints": { "applications_api": "$HOST/v4/analytics_engines/<spark_id>/spark_applications/<application_id>", "history_server_endpoint": "$HOST/v2/spark/v3/instances/<spark_id>/spark_history_server", "spark_access_endpoint": "$HOST/analytics-engine/details/spark-<instance_id>", "spark_jobs_v4_endpoint": "$HOST/v4/analytics_engines/<spark_id>/spark_applications", "spark_kernel_endpoint": "$HOST/v4/analytics_engines/<spark_id>/jkg/api/kernels", "view_history_server": "View history server", "wxd_application_endpoint": "$HOST/v1/<wxd_instance_id>/engines/<engine_id>/applications" }, "engine_home": { "bucket_name": "test-spark-bucket" }, "scale_config": { "auto_scale_enabled": true, "current_number_of_nodes": 2, "maximum_number_of_nodes": 5, "minimum_number_of_nodes": 1, "node_type": "medium", "number_of_nodes": 2 } }, "created_at": 2147483647, "created_by": "<username>@<domain>.com", "description": "spark engine for running spark applications", "display_name": "sampleEngineNative", "id": "sampleEngineNative123", "origin": "native", "status": "RUNNING", "tags": [ "tag1", "tag2" ], "type": "spark" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create spark engine Body
Origin - created or registered
Allowable values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
external
Catalogs to be Associated to the engine.
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Spark engine configuration details
Information on the Spark engine
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
spark engine description
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}<>?\\'`;]+$
Example:
sampleEngine
Status of engine
Possible values: 1 ≤ length ≤ 25, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
provisioning
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
Type of spark engine
Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^(spark|gluten)$
Example:
spark
Mode of spark engine. mode parameter to be set only during creation of serverless spark [ currently only available in lite plan ]
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
serverless
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -d '{ "description": "spark engine description", "configuration": { "api_key": "apikey", "connection_string": "1.2.3.4", "instance_id": "spark-id", "managed_by": "fully/self" }, "display_name": "sampleEngine", "origin": "discover/external", "tags": [ "tag1", "tag2" ], "type": "spark" }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines"
Response
Information on the Spark engine.
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
List of catalogs associated with the the engine.
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Origin - created or registered
Possible values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
external
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 1 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
Spark engine configuration details
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Information on the Spark engine
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
spark engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}<>?\\'`;]+$
Example:
sampleEngine
Unique identifier to distinguish spark engines
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
spark123
Status of the engine
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
Registered
Type of spark engine
Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^(spark|gluten)$
Example:
spark
Mode of spark engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
serverless
Status Code
Accepted
Error
Unauthorized
Not found
Internal server error
{ "actions": [], "associated_catalogs": [], "configuration": { "default_version": "3.3", "endpoints": { "wxd_application_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875/applications", "wxd_engine_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875", "wxd_history_server_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875/history_server" }, "engine_home": { "volume": "cpd-instance::Spark-Volume" } }, "created_at": 1709114146, "created_by": "cpadmin", "description": "", "display_name": "native-102", "id": "spark875", "origin": "native", "status": "running", "tags": [], "type": "spark" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get spark engine application details
Get spark engine application details
GET /spark_engines/{engine_id}/applications/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Application id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{engine_id}/applications/{id}"
Response
Engine Application Status
Application ID
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99
Application state
Possible values: 0 ≤ length ≤ 8, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
FINISHED
Application details
Time when the application is automatically stopped. This property is available only in SAAS
Possible values: 20 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
2020-12-08T10:00:00.000Z
Time when the application request was accepted. Software only.
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:06.856+0000
Deployment mode
Possible values: 0 ≤ length ≤ 16, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
stand-alone
End Time
Possible values: 20 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
2020-12-08T10:00:00.000Z
Failed time
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:26.649+0000
Time when the application finished running or was stopped. This property is available only after the application finishes running.
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:38.966+0000
Initialization scripts to run before the application starts
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 1000, Value must match regular expression
^.*$
Maximum number of retries for the application. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
3
Minimum retry interval in seconds between retry attempts. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
30
Current retry attempt number. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
2
Application runtime configuration
Spark application ID
Possible values: 0 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9:\/?$=#+!*\\u0026._%\"()\\\\@-]+$
Example:
app-20231028071726-0000
Spark application name
Possible values: 0 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9._:=\- ]+$
Example:
PythonWordCount
Spark UI Endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9:\/?$=#+!*\\u0026._%\"()\\\\@-]+$
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Included if spark_version was specified in application creation request or a default value was set in spark engine details.
Possible values: 1 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-\._]+$
Example:
3.4
Time when the application started running. This property is available only if/after the application starts running.
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:26.649+0000
Application state details
Possible values: 0 ≤ number of items ≤ 10000
Time when the request was accepted. SAAS only.
Possible values: 20 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
2023-11-01T11:18:49.758Z
Image template id based on spark version. Software only
Possible values: 0 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
spark-3.3-jaas-v2-cp4d-template
Wxd history_server endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9:\/?$=#+!*\\u0026._%\"()\\\\@-]+$
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "application_details": { "application": "s3://mybucket/wordcount.py", "archives": "s3://mybucket/myarchive.zip", "arguments": [ "people.txt" ], "class": "org.apache.spark.examples.SparkPi", "conf": { "additionalProp1": "key:value" }, "env": { "additionalProp1": "ENV_VAR=value" }, "files": "s3://mybucket/myfile.txt", "jars": "s3://mybucket/libs/dep1.jar", "name": "SparkApplication1", "packages": "org.apache.spark:example_1.2.3", "repositories": "https://repo1.maven.org/maven2/", "spark_version": "3.3" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Stop Spark Applications
Stop a running spark application
DELETE /spark_engines/{engine_id}/applications/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Application id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{engine_id}/applications/{id}"
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get spark engine catalog
Get catalog attached to spark engine
GET /spark_engines/{engine_id}/catalogs/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
catalog id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{engine_id}/catalogs/{id}' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Define the catalog details
List of allowed actions
Possible values: [
select
,use
,show
,view
,create
,drop
,alter
,insert
,grant
,revoke
,delete
,update
,remove
,register
]Possible values: 0 ≤ number of items ≤ 15, 1 ≤ length ≤ 15, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of associated databases
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "database_1", "database_2" ]
List of associated engines
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "engine_1", "engine_2" ]
List of associated storage
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "bucket_1", "bucket_2" ]
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
List of tags added to this catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
Catalog synchronization metadata
Epoch timestamp when the catalog was created
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1602839833
Created by
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
<username>@<domain>.com
Days left for catalog dissociation in case of vulnerability
Possible values: 0 ≤ length ≤ 150, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
30
The description if added, for the catalog
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Iceberg catalog description
catalog location uri
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://testbucket
MDS Thrift server connection details
Underlying catalog or storage backend used for metadata operations.For example,if the database type is
hive_hadoop2
oriceberg
, the metastore is often set toglue
.For HDFS, the metastore may be set tohdfs
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
glue
Name of the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
running
Catalog type like iceberg,hive etc
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iceberg
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "select", "create", "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1602839833", "sync_description": "Table registration was successful", "sync_exception": [ "Table is corrupted", "Table metadata not available" ], "sync_status": "SUCCESS" }, "created_at": "1602839833", "created_by": "user@example.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "mds.host.lakehouse.dev", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X GET -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}"
Response
Information on the Spark engine.
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
List of catalogs associated with the the engine.
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Origin - created or registered
Possible values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
external
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 1 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
Spark engine configuration details
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Information on the Spark engine
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
spark engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}<>?\\'`;]+$
Example:
sampleEngine
Unique identifier to distinguish spark engines
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
spark123
Status of the engine
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
Registered
Type of spark engine
Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^(spark|gluten)$
Example:
spark
Mode of spark engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
serverless
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [], "associated_catalogs": [], "configuration": { "default_version": "3.3", "endpoints": { "wxd_application_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875/applications", "wxd_engine_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875", "wxd_history_server_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875/history_server" }, "engine_home": { "volume": "cpd-instance::Spark-Volume" } }, "created_at": 1709114146, "created_by": "cpadmin", "description": "", "display_name": "native-102", "id": "spark875", "origin": "native", "status": "running", "tags": [], "type": "spark" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Update Engine Body
Engine details
- configuration
Default Spark configuration properties to be updated. To remove a property, set its value to null.
- default_config
Possible values: 0 ≤ length ≤ 20480, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
The default spark version for the native engine
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-\.]+$
Example:
4.8.3
Engine home properties
Resource limit enabled flag
Example:
true
Native spark engine resource quota
Examples:{ "cores": "1", "memory": "4G" }
Update the information related engine.
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
updated description for spark engine
Display name to identify engine.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}<>?\\'`;]+$
Example:
sampleEngine
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X PATCH -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -d '{ "description": "updated description for spark engine", "display_name": "sampleEngine", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}"
Response
Information on the Spark engine.
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
List of catalogs associated with the the engine.
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Examples:[ "iceberg_data", "hive_data" ]
Origin - created or registered
Possible values: [
external
,discover
,native
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
external
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
watsonx.data build version
Possible values: 1 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
1.0.3.0.0
Spark engine configuration details
Created time in epoch format
Possible values: 1 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Information on the Spark engine
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
spark engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}<>?\\'`;]+$
Example:
sampleEngine
Unique identifier to distinguish spark engines
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
spark123
Status of the engine
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
Registered
Type of spark engine
Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^(spark|gluten)$
Example:
spark
Mode of spark engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
serverless
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [], "associated_catalogs": [], "configuration": { "default_version": "3.3", "endpoints": { "wxd_application_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875/applications", "wxd_engine_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875", "wxd_history_server_endpoint": "{$HOST}/lakehouse/api/v2/{$INSTANCE_ID}/spark_engines/spark875/history_server" }, "engine_home": { "volume": "cpd-instance::Spark-Volume" } }, "created_at": 1709114146, "created_by": "cpadmin", "description": "", "display_name": "native-102", "id": "spark875", "origin": "native", "status": "running", "tags": [], "type": "spark" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List all applications in a spark engine
List all applications in a spark engine
GET /spark_engines/{id}/applications
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Query Parameters
state
Possible values: 1 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100, Value must match regular expression
^[\w\s-]+$
Submission time interval in
, format Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9- :,]+$
Start time interval in
, format Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9- :,]+$
End time interval in
, format Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9- :,]+$
limit to specify the rows
Possible values: 1 ≤ value ≤ 1000
Default:
25
Token used to fetch the next or the previous page of the applications list
Possible values: 1 ≤ length ≤ 84, Value must match regular expression
^[A-Za-z0-9_-]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/applications"
Response
Engine Application Detail
Application body
Possible values: 0 ≤ number of items ≤ 1000
- applications
The number of items returned per page
Possible values: 1 ≤ value ≤ 1000
Example:
100
Link to a page of results
Link to a page of results
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "applications": [ { "auto_termination_time": "2023-11-04T15:37:57.775Z", "creation_time": "Saturday 28 October 2023 07:17:06.856+0000", "deploy_mode": "stand-alone", "end_time": "2023-11-01T15:38:07.188Z", "failed_time": "Saturday 28 October 2023 07:17:26.649+0000", "finish_time": "Saturday 28 October 2023 07:17:38.966+0000", "id": "id-ca61-454c-aab3-486d39d8c1d0", "runtime": { "spark_version": "3.4" }, "spark_application_id": "<spark_application_id>", "spark_application_name": "PythonWordCount", "spark_ui": "$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui", "spark_version": "3.4", "start_time": "Saturday 28 October 2023 07:17:26.649+0000", "state": "failed", "state_details": [ { "code": "s", "message": "e", "type": "r" } ], "submission_time": "2023-11-01T15:37:30.982Z", "template_id": "spark-3.3-jaas-v2-cp4d-template", "wxd_application_ui_endpoint": "$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui" } ], "first": { "href": "https://example.com/v1/applications?limit=100" }, "limit": 100, "next": { "href": "https://example.com/v1/applications?limit=100&offset=100" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Create spark engine application
Create spark engine application
POST /spark_engines/{id}/applications
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Create spark application parameters
Application details
mode
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
local
Unique key to ensure idempotent operation
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Initialization scripts to run before the application starts
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Job endpoint
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^.+$
Example:
<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications
Maximum number of retries for the application. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
3
Minimum retry interval in seconds between retry attempts. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
30
Service Instance ID for POST
Allowable values: [
iae
,emr
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iae
Timeout for the application in seconds
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
60
Engine Type
Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^(spark|gluten)$
Spark application volumes to mount. This property is applicable only in watsonx.data software.
Possible values: 0 ≤ number of items ≤ 100
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -d '{ "application_details": { "application": "s3://mybucket/wordcount.py", "arguments": [ "people.txt" ], "conf": { "additionalProp1": "key:value", "additionalProp2": "key:value", "additionalProp3": "key:value" }, "env": { "additionalProp1": "key:value", "additionalProp2": "key:value", "additionalProp3": "key:value" }, "name": "SparkApplicaton1" }, "job_endpoint": "<host>/v4/analytics_engines/c7b3fccf-badb-46b0-b1ef-9b3154424021/engine_applications", "service_instance_id": "3FGeNUZqcdu6rOFbaHhGBoNdCHj98UoHd6nUFqkfsKhgacYD8ImM6iSA_F-TjHUdEZuVsoQTmOn", "type": "iae" }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/applications"
Response
Engine Application Status
Application ID
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
cd7cbf1f-8893-4c51-aa3d-d92729f05e99
Application state
Possible values: 0 ≤ length ≤ 8, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
FINISHED
Time when the application is automatically stopped. This property is available only in SAAS
Possible values: 20 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
2020-12-08T10:00:00.000Z
Time when the application request was accepted. Software only.
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:06.856+0000
Deployment mode
Possible values: 0 ≤ length ≤ 16, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
stand-alone
End Time
Possible values: 20 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
2020-12-08T10:00:00.000Z
Failed time
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:26.649+0000
Time when the application finished running or was stopped. This property is available only after the application finishes running.
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:38.966+0000
Unique key to ensure idempotent operation
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^.*$
Initialization scripts to run before the application starts
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 1000, Value must match regular expression
^.*$
Maximum number of retries for the application. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
3
Minimum retry interval in seconds between retry attempts. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
30
Current retry attempt number. This property is applicable only in watsonx.data software.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[0-9]+$
Example:
2
Application runtime configuration
Spark application ID
Possible values: 0 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
app-20231028071726-0000
Spark application name
Possible values: 0 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
PythonWordCount
Spark UI Endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Included if spark_version was specified in application creation request or a default value was set in spark engine details.
Possible values: 1 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\-\.]+$
Example:
3.4
Time when the application started running. This property is available only if/after the application starts running.
Possible values: 20 ≤ length ≤ 64, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
Saturday 28 October 2023 07:17:26.649+0000
Application state details
Possible values: 1 ≤ number of items ≤ 1000
Time when the request was accepted. SAAS only.
Possible values: 20 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
2023-11-01T11:18:49.758Z
Image template id based on spark version. Software only
Possible values: 0 ≤ length ≤ 32, Value must match regular expression
^[a-zA-Z0-9\-\.:\/]+$
Example:
spark-3.3-jaas-v2-cp4d-template
Wxd history_server endpoint
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
$HOST/v1/1698311655308796/engines/spark817/applications/c7b3fccf-badb-46b0-b1ef-9b3154424021/ui
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "id": "9709ed13-b077-47be-858d-201840180ae2", "spark_ui": "", "state": "accepted" }
{ "id": "9709ed13-b077-47be-858d-201840180ae2", "spark_version": "4.0.0", "state": "accepted", "template_id": "spark-4.0-cpwd-wxd-template" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get spark engine catalogs
Get list of all catalogs attached to a spark engine
GET /spark_engines/{id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/catalogs' -H 'accept: application/json' -H "AuthInstanceId: {instance id}"
Response
Collection of catalogs
List of catalogs
Possible values: 0 ≤ number of items ≤ 3000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1765338982", "sync_description": "Table registration was successful", "sync_exception": [], "sync_status": "SUCCESS" }, "created_at": "1765338982", "created_by": "<username>@<domain>.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "example.example.lakehouse.dev.appdomain.cloud", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Associate catalogs to spark engine
Associate one or more catalogs to a spark engine
POST /spark_engines/{id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Catalog names
Possible values: 0 ≤ number of items ≤ 100, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X POST 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/catalogs' -H 'accept: application/json' -H 'Content-Type: application/json' -H 'AuthInstanceId: {instance id}' -d '{"catalog_names": ["hive_data"]}'
Response
Define the catalog details
List of allowed actions
Possible values: [
select
,use
,show
,view
,create
,drop
,alter
,insert
,grant
,revoke
,delete
,update
,remove
,register
]Possible values: 0 ≤ number of items ≤ 15, 1 ≤ length ≤ 15, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of associated databases
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "database_1", "database_2" ]
List of associated engines
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "engine_1", "engine_2" ]
List of associated storage
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "bucket_1", "bucket_2" ]
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
List of tags added to this catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
Catalog synchronization metadata
Epoch timestamp when the catalog was created
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1602839833
Created by
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
<username>@<domain>.com
Days left for catalog dissociation in case of vulnerability
Possible values: 0 ≤ length ≤ 150, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
30
The description if added, for the catalog
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Iceberg catalog description
catalog location uri
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://testbucket
MDS Thrift server connection details
Underlying catalog or storage backend used for metadata operations.For example,if the database type is
hive_hadoop2
oriceberg
, the metastore is often set toglue
.For HDFS, the metastore may be set tohdfs
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
glue
Name of the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
running
Catalog type like iceberg,hive etc
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iceberg
Status Code
Success
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "actions": [ "select", "create", "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1602839833", "sync_description": "Table registration was successful", "sync_exception": [ "Table is corrupted", "Table metadata not available" ], "sync_status": "SUCCESS" }, "created_at": "1602839833", "created_by": "user@example.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "mds.host.lakehouse.dev", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Disassociate catalogs from a spark engine
Disassociate one or more catalogs from a spark engine
DELETE /spark_engines/{id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Query Parameters
Catalog id(s) to be stopped, comma separated
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_,]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/catalogs?catalog_names=catalog_name1' -H 'accept: */*' -H "AuthInstanceId: {instance id}"
Response
Status Code
No Content
Error
Unauthorized
Forbidden
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get Spark history server details
Get Spark history server details
GET /spark_engines/{id}/history_server
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/history_server"
Response
Native spark history server
History server state
Possible values: 1 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
started
The time when the Spark history server will automatically stop. Applicable only in SAAS.
Possible values: 20 ≤ length ≤ 24, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
2022-02-24T07:37:47Z
CPU cores allocated for the history server. Available when the history server is running.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
1
Memory allocated for the history server. Kubernetes memory units are used. Available when the history server is running
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
4G
History server start time
Possible values: 20 ≤ length ≤ 24, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
2022-02-21T07:37:47Z
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auto_termination_time": "2022-02-24T07:37:47Z", "cores": "1", "memory": "4G", "start_time": "2022-02-21T07:37:47Z", "state": "started" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Start history server parameter
CPU cores to be allocated to the history server.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^\d+$
Example:
1
Memory to be allocated for the history server. Kuberneted memory unit (G) must also be specified.
Possible values: 2 ≤ length ≤ 10, Value must match regular expression
^[0-9]+G$
Example:
4G
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {instance id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/history_server"
Response
Native spark history server
History server state
Possible values: 1 ≤ length ≤ 20, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
started
The time when the Spark history server will automatically stop. Applicable only in SAAS.
Possible values: 20 ≤ length ≤ 24, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
2022-02-24T07:37:47Z
CPU cores allocated for the history server. Available when the history server is running.
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
1
Memory allocated for the history server. Kubernetes memory units are used. Available when the history server is running
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
4G
History server start time
Possible values: 20 ≤ length ≤ 24, Value must match regular expression
^[a-zA-Z0-9\-\.:\/ \+]+$
Example:
2022-02-21T07:37:47Z
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auto_termination_time": "2022-02-24T07:37:47Z", "cores": "1", "memory": "4G", "start_time": "2022-02-21T07:37:47Z", "state": "started" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X DELETE -H "content-type: application/json" -H "AuthInstanceId: {instance id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/history_server"
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Pause spark engine parameters
force spark engine pause. Default value is false.
Example:
true
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {instance id}" -d '{"force": true}' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/pause"
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "pause spark engine", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Resume engine. This feature is only available in SAAS
Resume engine. This feature is only available in SAAS
POST /spark_engines/{id}/resume
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {instance id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/resume"
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "resume spark engine", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Scale engine. This feature is only available in SAAS
Scale engine. This feature is only available in SAAS
POST /spark_engines/{id}/scale
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Scale spark application parameters
Node count
Possible values: 1 ≤ value ≤ 1000
Example:
2
curl -X POST -H "content-type: application/json" -H "AuthInstanceId: {instance id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/spark_engines/{id}/scale"-d '{ "number_of_nodes": 2}'
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "scale spark engine", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
API Authentication service token
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Query Parameters
Default catalogs flag for cornerstone feature
Default:
false
Internal view parameter for cornerstone feature
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Collection of catalogs
List of catalogs
Possible values: 0 ≤ number of items ≤ 3000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "catalogs": [ { "actions": [ "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1765338982", "sync_description": "Table registration was successful", "sync_exception": [], "sync_status": "SUCCESS" }, "created_at": "1765338982", "created_by": "<username>@<domain>.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "example.example.lakehouse.dev.appdomain.cloud", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
External Iceberg table registration
Synchronize the external Iceberg table registration for a catalog identified by catalog_id.
POST /catalogs/{id}/sync
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog ID
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Request body
Automatically detect and add new tables to the system when they appear in the source
Example:
true
Register newly discovered tables in the system so they can be tracked and managed
Example:
true
Synchronize and update metadata for existing tables that are already registered
Example:
true
Indicates whether to synchronize metadata from Iceberg tables with the system
Example:
true
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{id}/sync' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/merge-patch+json' -d '{ "auto_add_new_tables": true, "sync_iceberg_md": true "sync_existing_tables": true "register_new_tables": true }'
Response
success response prototype
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Rollback to a table snapshot", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get catalog properties by catalog_id
Get catalog properties of a catalog identified by catalog_id
GET /catalogs/{name}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{name}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Define the catalog details
List of allowed actions
Possible values: [
select
,use
,show
,view
,create
,drop
,alter
,insert
,grant
,revoke
,delete
,update
,remove
,register
]Possible values: 0 ≤ number of items ≤ 15, 1 ≤ length ≤ 15, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "update", "delete" ]
List of associated databases
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "database_1", "database_2" ]
List of associated engines
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "engine_1", "engine_2" ]
List of associated storage
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "bucket_1", "bucket_2" ]
Managed by
Possible values: [
ibm
,customer
]Possible values: 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
ibm
List of tags added to this catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 100000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
catalog base path
Possible values: 1 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
/abc/def
Catalog synchronization metadata
Epoch timestamp when the catalog was created
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1602839833
Created by
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
<username>@<domain>.com
Days left for catalog dissociation in case of vulnerability
Possible values: 0 ≤ length ≤ 150, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
30
The description if added, for the catalog
Possible values: 0 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Iceberg catalog description
catalog location uri
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://testbucket
MDS Thrift server connection details
Underlying catalog or storage backend used for metadata operations.For example,if the database type is
hive_hadoop2
oriceberg
, the metastore is often set toglue
.For HDFS, the metastore may be set tohdfs
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
glue
Name of the catalog
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Catalog status
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
running
Catalog type like iceberg,hive etc
Possible values: 0 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Example:
iceberg
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "select", "create", "update", "delete" ], "associated_databases": [ "database_1", "database_2" ], "associated_engines": [ "engine_1", "engine_2" ], "associated_storage": [ "bucket_1", "bucket_2" ], "base_path": "/abc/def", "catalog_sync_metadata": { "last_sync_at": "1602839833", "sync_description": "Table registration was successful", "sync_exception": [ "Table is corrupted", "Table metadata not available" ], "sync_status": "SUCCESS" }, "created_at": "1602839833", "created_by": "user@example.com", "days_left": "30", "description": "Iceberg catalog description", "location_uri": "s3a://testbucket", "managed_by": "ibm", "mds_connection_information": { "hostname": "mds.host.lakehouse.dev", "port": "3232" }, "name": "sampleCatalog", "rest_uri": "https://samplehost-catalog:4352", "status": "running", "tags": [ "tag1", "tag2" ], "thrift_uri": "thrift://samplehost-catalog:4354", "type": "iceberg" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Query Parameters
Skip MDS call when Unity catalog is added
Default:
false
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List all tables
List all tables in a schema in a catalog for a given engine
GET /catalogs/{catalog_name}/schemas/{schema_name}/tables
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
Query Parameters
Engine id of presto/prestissimo/spark/db2/netezza other engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
tables list
List of the tables present in the schema
Possible values: 0 ≤ number of items ≤ 1000000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "tables": [ "customer-data", "user-data" ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get table details
Get details of a given table in a catalog and schema
GET /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Query Parameters
Engine id of presto/prestissimo/spark/db2/netezza other engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
URL encoded table type (view,base table)
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-_ ]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Table details
List of columns
Possible values: 0 ≤ number of items ≤ 1000
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" } ], "name": "newtable" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Delete table
Delete table for a given schema and catalog
DELETE /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Query Parameters
Engine id of presto/prestissimo/spark/db2/netezza other engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
URL encoded table type (view,base table)
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-_ ]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}?engine_id={engine_id}&type={type}' -H 'accept: */*' -H 'AuthInstanceId: {instance_id}'
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Query Parameters
Engine id of presto/prestissimo/spark/db2/netezza other engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
URL encoded table type (view,base table)
Possible values: 1 ≤ length ≤ 10, Value must match regular expression
^[a-zA-Z0-9\-_ ]+$
Request body
New table name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
updated_table_name
curl -X 'PATCH' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/merge-patch+json' -d '{ "new_table_name": "updated_table_name", }'
Response
Table details
List of columns
Possible values: 0 ≤ number of items ≤ 1000
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" } ], "name": "newtable" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Rollback snapshot
Rollback table to snapshot
POST /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/rollback
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Query Parameters
Engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
Snapshot Id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/rollback?engine_id={engine_id}' -H 'accept: application/json' -d '{ "snapshot_id": "snapsshot_id", }' -H 'AuthInstanceId: {instance_id}'
Response
success response prototype
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Rollback to a table snapshot", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get table snapshots
List all table snapshots
GET /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/snapshots
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Table name
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Query Parameters
Engine name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/snapshots?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Collection of tablesnapshots
List of snapshots
Possible values: 0 ≤ number of items ≤ 1000000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "snapshots": [ { "committed_at": "2025-01-29T08:36:21.717Z", "operation": "alter", "snapshot_id": "2332342122211222", "summary": {} } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded Schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Query Parameters
Engine id of presto/prestissimo/spark/db2/netezza other engine
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}?engine_id={engine_id}' -H 'accept: */*' -H 'AuthInstanceId: {instance_id}'
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Query Parameters
Engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{id}/schemas?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Collection of schemas
List of schemas fetched from given catalog
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "schemas": [ "schema1", "schema2" ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Query Parameters
Engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Request body
{
"bucket_name": "sample-bucket",
"custom_path": "sample-path",
"hostname": "hdfs://example-host:9000",
"name": "SampleSchema1",
"port": 4553
}
Bucket associated to catalog where schema will be added
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Example:
sample-bucket
Path within bucket where schema will be created
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-path
Unique schema name, schemas with same names are not allowed in a catalog
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
SampleSchema1
Host name of the HDFS bucket. Need to be provided if using HDFS
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@]+$
Example:
db2@hostname.com
Port of the HDFS bucket. Need to be provided if using HDFS
Possible values: 1 ≤ value ≤ 65535
Example:
4553
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{id}/schemas?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/json' -d '{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "schema_name": "SampleSchema1" }'
Response
Schema creation request details
Bucket associated to catalog where schema will be added
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\._\/-]+$
Example:
sample-bucket
Path within bucket where schema will be created
Possible values: 0 ≤ length ≤ 2000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sample-path
Unique schema name, schemas with same names are not allowed in a catalog
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
SampleSchema1
Host name of the HDFS bucket. Need to be provided if using HDFS
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-:\/.?=@]+$
Example:
db2@hostname.com
Port of the HDFS bucket. Need to be provided if using HDFS
Possible values: 1 ≤ value ≤ 65535
Example:
4553
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "hostname": "hdfs://example-host:9000", "name": "SampleSchema1", "port": 4553 }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List all columns of a table
List all columns of a table in a given a schema for a given catalog
GET /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_\-]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%_]+$
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
collection of columns in a table
List of the columns present in the table
Possible values: 0 ≤ number of items ≤ 1000000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "customer_data", "comment": "customer_data column", "extra": "varchar", "type": "varchar" }, { "column_name": "user_data", "comment": "user_data column", "extra": "varchar", "type": "varchar" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Add column(s)
Add one or multiple columns to a table in a schema for a given catalog
POST /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_\-]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%_]+$
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
{
"columns": [
{
"column_name": "expenses",
"comment": "expenses column",
"extra": "varchar",
"type": "varchar"
}
]
}
List of the tables present in the schema
Possible values: 0 ≤ number of items ≤ 1000000
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/json' -d '{ "bucket_name": "sample-bucket", "custom_path": "sample-path", "schema_name": "SampleSchema1" }'
Response
collection of columns in a table
List of the columns present in the table
Possible values: 0 ≤ number of items ≤ 1000000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "columns": [ { "column_name": "customer_data", "comment": "customer_data column", "extra": "varchar", "type": "varchar" }, { "column_name": "user_data", "comment": "user_data column", "extra": "varchar", "type": "varchar" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Delete column
Delete column in a table for a given schema and catalog
DELETE /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns/{column_name}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%_]+$
Url encoded column name
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\[\]!@#%&()_\-=\{\},<>:]+$
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X 'DELETE' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns/{column_name}?engine_id={engine_id}' -H 'accept: */*' -H 'AuthInstanceId: {instance_id}'
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Alter column
Update the given column - rename column
PATCH /catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns/{column_name}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%_]+$
Url encoded column name
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\[\]!@#%&()_\-=\{\},<>:]+$
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
{
"new_column_name": "expenses"
}
Url encoded column name
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
expenses
curl -X 'PATCH' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_name}/schemas/{schema_name}/tables/{table_name}/columns/{column_name}?engine_id={engine_id}' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/merge-patch+json' -d '{\n "column_name": "expenses"\n}'
Response
Column details
Optional comment or description of the column
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9_ ]*$
Example:
Expenses column for each department
Extra column attributes, e.g., AUTO_INCREMENT, DEFAULT, etc.
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_ ]*$
Example:
AUTO_INCREMENT
Length for types like VARCHAR or CHAR. Should be a numeric string.
Possible values: 0 ≤ length ≤ 5, Value must match regular expression
^\d+$
Example:
30
Valid SQL column name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
expenses
Precision (total number of digits) for numeric types like DECIMAL
Possible values: 0 ≤ length ≤ 3, Value must match regular expression
^\d+$
Example:
10
Scale (number of digits after the decimal point) for numeric types like DECIMAL
Possible values: 0 ≤ length ≤ 3, Value must match regular expression
^\d+$
Example:
2
SQL data type, e.g., varchar, int, decimal(10,2), etc.
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_\(\), ]+$
Example:
varchar
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "column_name": "expenses", "comment": "expenses column", "extra": "varchar", "type": "varchar" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
Lakehouse Instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
Page offset
Possible values: 1 ≤ length ≤ 500, Value must match regular expression
^(0|[1-9][0-9]*)$
Page size
Possible values: -1 ≤ value ≤ 100
Default:
10
Response
Paged result for Ingestion Jobs
Pagination Limit
Possible values: 0 ≤ value ≤ 2147483647
Pagination Offset
Possible values: 0 ≤ value ≤ 2147483647
Pagination Result Total Count
Possible values: 0 ≤ value ≤ 2147483647
List ingestion jobs
Possible values: 1 ≤ number of items ≤ 100000
Pagination next/previous page links
Pagination next/previous page links
Pagination next/previous page links
Status Code
Ok
Bad Request
Unauthorized
Forbidden
Not Found
Internal Server Error
{ "offset": 0, "limit": 10, "total_count": 100, "next": { "href": "https://api.example.com/v1/ingestion/jobs?limit=50&token=2b6067d0-8d50-49d9-8cd6-23223d3f24e0" }, "jobs": [ {} ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Submit a Spark ingestion job
Submit a Spark ingestion job with the provided source and target details.
POST /ingestion/jobs
Request
Custom Headers
Lakehouse Instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Input parameters for submitting a lite Spark ingestion job.
Job ID of the ingestion job
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_\.]+$
Details of ingestion source files.
Details of ingestion target table.
Spark Engine Detail
ID of the spark engine to be used for ingestion
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Example:
spark123
Ingestion engine configuration
Iceberg source table information
Comma delimited list of columns to partition by
Possible values: 0 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Example:
column1
Response
Ingestion job
Instance ID of the lakehouse where ingestion job is executed
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Job ID of the ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Application ID of the ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Ingestion job user
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Unix timestamp of ingestion job starting
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:.+]+$
Unix timestamp of ingestion job completing
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:.+]+$
Current state of ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Source data location of the ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9._~:/?#\[\]@!$&'()*+,;=\-\\]+$
Target table name in format catalog.schema.table
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Error messages of failed ingestion job
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[\s\S]*$
Engine application logs
Possible values: 1 ≤ length ≤ 1048576, Value must match regular expression
^[\s\S]*$
ID of the spark engine to be used for ingestion
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Name of the spark engine to be used for ingestion
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Comma delimited list of columns to partition by
Possible values: 0 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Example:
column1
Determine if target schema was created in this ingestion job
Determine if target table was created in this ingestion job
Status Code
Ingestion job submitted successfully
Bad Request
Unauthorized
Forbidden
Not Found
Internal server error
{ "application_id": "1956d96f-805a-4ddf-a230-b767964895a0", "engine_id": "spark604", "engine_name": "spark", "instance_id": "1111111111", "job_id": "ingestion-12345678", "start_timestamp": "2025-05-04T15:27:51.523Z", "status": "starting", "target_table": "catalog_name.schema_name.table_name" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
Lakehouse Instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Ingestion Job ID
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Response
Ingestion job
Instance ID of the lakehouse where ingestion job is executed
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Job ID of the ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Application ID of the ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Ingestion job user
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Unix timestamp of ingestion job starting
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:.+]+$
Unix timestamp of ingestion job completing
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:.+]+$
Current state of ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Source data location of the ingestion job
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9._~:/?#\[\]@!$&'()*+,;=\-\\]+$
Target table name in format catalog.schema.table
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Error messages of failed ingestion job
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[\s\S]*$
Engine application logs
Possible values: 1 ≤ length ≤ 1048576, Value must match regular expression
^[\s\S]*$
ID of the spark engine to be used for ingestion
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Name of the spark engine to be used for ingestion
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Comma delimited list of columns to partition by
Possible values: 0 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\-_.@]+$
Example:
column1
Determine if target schema was created in this ingestion job
Determine if target table was created in this ingestion job
Status Code
Ok
Bad Request
Unauthorized
Forbidden
Not Found
Internal Server Error
{ "application_id": "c36115dc-a9e2-489e-a846-710106c1115a", "details": "Ingestion-Parameters:", "end_timestamp": "2025-05-04T15:27:51.523Z", "engine_id": "spark220", "instance_id": "1746348510473722", "is_new_schema": false, "is_new_table": false, "job_id": "ingestion-1747665516617", "source_data_files": "s3://example_bucket/wxd-local-ingestion/95/1mb_file.csv.gz", "start_timestamp": "2025-05-04T15:27:51.523Z", "status": "completed", "target_table": "iceberg_data.testSchema.testTable", "username": "admin" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/database_registrations"
Response
Database registrations collection
Database body
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "database_registrations": [ { "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "hive_data", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "hive" }, "connection": { "database_name": "new_database", "hostname": "netezza://ps.fyre.com", "password": "samplepassword", "port": 4353, "sasl_mechanism": "plain", "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "created_at": "1686792721", "created_by": "user1@bim.com", "description": "Description of the external database", "display_name": "new_database", "id": "netezza23", "properties": [ { "encrypt": true, "key": "abc", "value": "xyz" } ], "tables": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "schema_name": "testschema123", "table_name": "customer" } ], "tags": [ "testdatabase", "userdatabase" ], "topics": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "topic_name": "customer" } ], "type": "netezza" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
new_database
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
db2
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_type": "iceberg" }
database details
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1686792721
Database description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
db2 extenal database description
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "testdatabase", "userdatabase" ]
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/json" -d '{ "display_name": "BLUDB", "properties": [], "description": "", "tags": [], "type": "db2", "connection": { "name": "BLUDB", "hostname": "db2w-pxuepuj.us-south.db2w.cloud.ibm.com", "port": 50001, "username": "username", "password": "password", "ssl": true, "certificate": "certificate "certificate_extension": "pem" }, "associated_catalog": { "catalog_name": "db2_automation" } }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/database_registrations"
Response
Database registration object
actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
new_database
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
List of tables
Possible values: 0 ≤ number of items ≤ 1000
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "testdatabase", "userdatabase" ]
List of topics
Possible values: 0 ≤ number of items ≤ 1000
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
netezza
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1686792721
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.@]+$
Example:
user1@ibm.com
Database description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Description of the external database
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
mysql123
vault enabled or not
Example:
true
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "iceberg" }, "connection": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "created_at": "1686792721", "created_by": "user1@bim.com", "description": "Description of the database", "display_name": "new_database", "id": "netezza123", "properties": [ { "encrypt": true, "key": "abc", "value": "xyz" } ], "tables": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "schema_name": "testschema123", "table_name": "customer" } ], "tags": [ "testdatabase", "userdatabase" ], "topics": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "topic_name": "customer" } ], "type": "netezza" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Post database catalog
Add catalog to a registered database
POST /database_registrations/{database_id}/catalogs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Request body
{
"catalog_name": "iceberg_catalog"
}
catalog name
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
curl -X POST -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/database_registrations/{database_id}/catalogs"
Response
Response of success
Message
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Message code
Possible values: 1 ≤ length ≤ 200, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "message": "Successful message", "message_code": "success" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/database_registrations/{id}"
Response
Database registration object
actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
new_database
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
List of tables
Possible values: 0 ≤ number of items ≤ 1000
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "testdatabase", "userdatabase" ]
List of topics
Possible values: 0 ≤ number of items ≤ 1000
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
netezza
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1686792721
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.@]+$
Example:
user1@ibm.com
Database description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Description of the external database
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
mysql123
vault enabled or not
Example:
true
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "iceberg" }, "connection": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "created_at": "1686792721", "created_by": "user1@bim.com", "description": "Description of the database", "display_name": "new_database", "id": "netezza123", "properties": [ { "encrypt": true, "key": "abc", "value": "xyz" } ], "tables": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "schema_name": "testschema123", "table_name": "customer" } ], "tags": [ "testdatabase", "userdatabase" ], "topics": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "topic_name": "customer" } ], "type": "netezza" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/database_registrations/{id}"
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
database id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Request body
Database details update. Only credentials can be updated.
New database description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
External database description
New database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
new_database
List of tables
Possible values: 0 ≤ number of items ≤ 1000
New tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "testdatabase", "userdatabase" ]
List of topics
Possible values: 0 ≤ number of items ≤ 1000
curl -X PATCH -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -H "Content-Type: application/merge-patch+json" -d '{ "connection": { "password": "samplepassword", "username": "sampleuser" }, "display_name": "new_database", "description": "External database description", "tags": [ "testdatabase", "userdatabase" ] }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/database_registrations/{id}"
Response
Database registration object
actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Examples:[ "update", "delete" ]
database details
Database display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[^!@#$%^&*()=+:{}?<>';\`]*$
Example:
new_database
This will hold all the properties for a custom database
Possible values: 0 ≤ number of items ≤ 1000
Examples:[ { "encrypt": true, "key": "abc", "value": "xyz" } ]
List of tables
Possible values: 0 ≤ number of items ≤ 1000
tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "testdatabase", "userdatabase" ]
List of topics
Possible values: 0 ≤ number of items ≤ 1000
Connector type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
netezza
database catalog
Examples:{ "catalog_name": "iceberg_catalog", "catalog_tags": [ "catalog_tag_1", "catalog_tag_2" ], "catalog_type": "iceberg" }
Catalog name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
sampleCatalog
Created on
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
1686792721
Created by
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-.@]+$
Example:
user1@ibm.com
Database description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
Description of the external database
Database ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\-]+$
Example:
mysql123
vault enabled or not
Example:
true
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "associated_catalog": { "catalog_name": "iceberg_data", "catalog_tags": [ "tag1", "tag2" ], "catalog_type": "iceberg" }, "connection": { "database_name": "new_database", "hostname": "netezza://abc.efg.com", "password": "samplepassword", "port": 4353, "ssl": true, "tables": "netezza_table_name", "username": "sampleuser" }, "created_at": "1686792721", "created_by": "user1@bim.com", "description": "Description of the database", "display_name": "new_database", "id": "netezza123", "properties": [ { "encrypt": true, "key": "abc", "value": "xyz" } ], "tables": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "schema_name": "testschema123", "table_name": "customer" } ], "tags": [ "testdatabase", "userdatabase" ], "topics": [ { "created_at": "1686792721", "file_contents": "qweerty", "file_name": "test.json", "topic_name": "customer" } ], "type": "netezza" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "content-type: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/other_engines"
Response
list other engines
list other engines
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "other_engines": [ { "actions": [ "create", "update" ], "configuration": { "connection_string": "https://other-connection-string-sample.com", "type": "netezza" }, "created_at": 1234567890, "created_by": "<username>@<domain>.com", "description": "other engine for running queries", "display_name": "sampleEngine", "id": "sampleEngine123", "origin": "external", "status": "registered", "tags": [ "tag1", "tag2" ], "type": "other" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Create other Engine Body
External engine details
engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleEngine01
engine description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
external engine description
Origin - created or registered
Allowable values: [
native
,external
,discover
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
external
other engine tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
curl -X POST -H "content-type: application/json" -H "accept: application/json" -H "AuthInstanceId: {instance_id}" -d '{ "description": "external engine description", "engine_details": { "connection_string": "1.2.3.4", "engine_type": "netezza", "metastore_host": "1.2.3.4" }, "display_name": "sampleEngine01", "tags": [ "tag1", "tag2" ] }' "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/other_engines"
Response
external engine details
Actions
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Examples:[ "update", "delete" ]
Tags
Possible values: 0 ≤ number of items ≤ 1000, 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "tag1", "tag2" ]
External engine details
created time in epoch format
Possible values: 0 ≤ value ≤ 2147483647
Username of the user who created the watsonx.data instance
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
engine description
Possible values: 1 ≤ length ≤ 50, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
engine for running sql queries
Engine display name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleEngine
Engine host name. In case of OCP based clusters, this is internal hostname
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9-]+$
Example:
xyz-netezza-01-netezza-svc
engine programmatic name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
sampleEngine123
origin
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
ibm
Engine port
Possible values: 0 ≤ value ≤ 65535
engine status
Possible values: 0 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
registered
Type like presto, netezza, external,..
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
external
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "actions": [ "update", "delete" ], "configuration": { "connection_string": "1.2.3.4", "type": "netezza" }, "created_at": 1234567890, "created_by": "<username>@<domain>.com", "description": "other engine for running sql queries", "display_name": "sampleEngine", "host_name": "xyz-netezza-01-netezza-svc", "id": "sampleEngine123", "origin": "external", "port": 1243, "status": "registered", "tags": [ "tag1", "tag2" ], "type": "other" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
engine id
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
curl -X DELETE -H "accept: */*" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/other_engines/{id}"
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Register delta and hudi tables
Register delta and hudi tables
POST /catalogs/{catalog_id}/schemas/{schema_id}/register
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
Request body
Metadata location
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://bucketname/path/to/table/metadata_location/_delta_log
Table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
table1
curl -X 'POST' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_id}/schemas/{schema_id}/register' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}' -H 'Content-Type: application/merge-patch+json' -d '{ "table_name": "table1", "metadata_location": "s3a://bucketname/path/to/table/metadata_location/_delta_log" }'
Response
Register table
Response of success
Examples:{ "message": "Successful message", "message_code": "success" }
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": { "message": "Register table success", "message_code": "success" } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Load delta and hudi tables metadata
Load delta and hudi tables metadata
GET /catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/metadata
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
catalog id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
URL encoded schema name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_!@#%&_=\]}<> ]+$
URL encoded table name
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-%_]+$
curl -X 'GET' 'https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/catalogs/{catalog_id}/schemas/{schema_id}/tables/{table_id}/metadata' -H 'accept: application/json' -H 'AuthInstanceId: {instance_id}'
Response
Load table metadata
Metadata location
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://bucketname/path/to/table/metadata_location/_delta_log
Path to the table
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
s3a://bucketname/path/to/table
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "metadata_location": "s3a://test/spark-hudi-warehouse/hudi/spark_hudi_table1/.hoodie", "table_path": "s3a://test/spark-hudi-warehouse/hudi/spark_hudi_table1" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Integration validation parameters
Type of the integration to be integrated. It can only have the following values:
ranger
,ikc
,databand
andmanta
.Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^[a-z]+$
Example:
ranger
Access Token for the integration of type
databand
.Possible values: 1 ≤ length ≤ 4096, Value must match regular expression
^[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+$
Example:
Header.Payload.Signature
ApiKey for the integration of type
manta
andikc
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
apikey
Certificate to be provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[\s\S]*$
Example:
certificate_content_base64_encoded
Password for the integration of type
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
password
SSL enabler/disabler for
ikc
in Cloud Pack for Data.Example:
true
URL of the integration to be integrated. Applicable for all the 4 types:
ranger
,ikc
,databand
andmanta
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://www.abcd.com
Username of the
ikc
/manta
/ranger
integration to be integrated.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_@.-]+$
Example:
username
Response
Validate Integration prototype
A brief description of the
message_code
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9 ]+$
Message code stating if a success or failure
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9]+$
Details realted to the available resources for
ranger
Status Code
Success
Error
Unauthorized
Not found
Internal Server Error
{ "message": "Integration credentials validated successfully", "message_code": "Success", "resources": [ { "name": "test01", "type": "presto" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
API Authentication service token
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Query Parameters
type
Possible values: 0 ≤ number of items ≤ 2, 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
state
Possible values: 0 ≤ number of items ≤ 2, 0 ≤ length ≤ 100, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Response
list all existing integrations
Database body
Possible values: 0 ≤ number of items ≤ 1000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "integrations": [ { "config_properties": "ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\\\\nikc-env.url=ikc\\\\nikc-username=\\\\nikc-enabled-catalogs=\\\\nlh-unique-identifier=1711796957622126\\\\nlh-crn=1711796957622126", "governance_properties": "query-governance.name=external", "id": "ikc543", "modified_at": 1716878292, "modified_by": "admin", "state": "active", "storage_catalogs": { "catalog_names": [ "iceberg_data", "hive_data" ] }, "type": "ikc", "url": "ikc.url", "username": "admin" }, { "enable_data_policy_within_wxd": true, "id": "ranger743", "modified_at": 1716878292, "modified_by": "admin", "resource": "presto-01", "state": "active", "type": "ranger", "url": "http://lh-ranger.fyre.ibm.com:7080/", "username": "admin" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Integration registration parameters
Access Token for the integration of type
databand
.Possible values: 1 ≤ length ≤ 4096, Value must match regular expression
^[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+$
Example:
Header.Payload.Signature
ApiKey for the integration of type
manta
andikc
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
apikey
Certificate to be provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[\s\S]*$
Example:
certificate_content_base64_encoded
Certificate extension of the certificate provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\\/.\-]+$
Example:
pem
To enable/disable cross account integration for
ikc
in IBM Cloud / MCSP.To enable WatsonX.data policies along with
ranger
.The Account ID where the
ikc
is existing with which cross account integration needs to be enabled, to be used compulsorily withcross_account_integration
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9]+$
Example:
abcd1234
Password for the integration of type
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
password
Sets the policy cache type configuration for integration type
ranger
.Possible values: 1 ≤ length ≤ 10000000000, Value must match regular expression
^[0-9]*$
Example:
123456789
Resource type for
ranger
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_-]+$
Example:
presto01
SSL enabler/disabler for
ikc
in Cloud Pack for Data.Example:
true
Details of storage catalogs associated with
ikc
Type of the integration to be integrated. It can only have the following values:
ranger
,ikc
,databand
andmanta
.Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^[a-z]+$
Example:
ranger
URL of the integration to be integrated. Applicable for all the 4 types:
ranger
,ikc
,databand
andmanta
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://www.abcd.com
Username of the
ikc
/manta
/ranger
integration to be integrated.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_@.-]+$
Example:
username
Response
Response body for the POST/GET/PATCH Request for an integration in watsonx.Data
current state
Possible values: [
active
,inactive
,failed
]Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z]+$
Example:
active
Access Token for the integration of type
databand
.Possible values: 1 ≤ length ≤ 4096, Value must match regular expression
^[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+$
Example:
Header.Payload.Signature
ApiKey for the integration of type
manta
andikc
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
apikey
Authentication url for the corresponding
manta
integration in saasPossible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://iam.abc.com
Certificate if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[\s\S]*$
Example:
certificate_content_base64_encoded
Certificate extension of the certificate provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\\/.\-]+$
Example:
pem
Properties
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\nikc-env.url=ikc\nikc-enabled-catalogs=\nikc-username=\nlh-unique-identifier=1711796957622126\nlh-crn=1711796957622126
To enable/disable cross account integration for
ikc
in IBM Cloud / MCSP.To check if WatsonX.data policies are enabled along with
ranger
.Properties
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
query-governance.name=external
Unique id to identigy the integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z0-9]+$
Example:
presto01
The Account ID where the
ikc
is existing with which cross account integration needs to be enabled, to be used compulsorily withcross_account_integration
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9]+$
Example:
abcd1234
Manta specific Url derived from the url provided for
manta
integration in SaasPossible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://abcd.com/gov_lineage/v2/lineage_events/openlineage
Last Modified time for the corresponding integration in epoch format
Possible values: 0 ≤ value ≤ 2147483647
Last Modified user name for the corresponding integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Password for the integration of type
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
password
Displays the policy cache type configuration for integration type
ranger
.Possible values: 1 ≤ length ≤ 10000000000, Value must match regular expression
^[0-9]*$
Example:
123456789
Currently selected resource for
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_.-]+$
Example:
presto01
SSL enabled/disabled for
ikc
in Cloud Pack for Data.Example:
true
Details of storage catalogs associated with
ikc
Type of the integration integrated. It will only have the following values:
ranger
,ikc
,databand
andmanta
.Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^[a-z]+$
Example:
ranger
URL of the integration. Applicable for all the 4 types:
ranger
,ikc
,databand
andmanta
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://www.abcd.com
Username of the
ikc
/manta
/ranger
integration.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_@.-]+$
Example:
username
Zen API key for the integration of type
manta
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
zen_apikey
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auth_url": "https://iam.abc.com", "config_properties": "ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\\\\nikc-env.url=ikc\\\\nikc-username=\\\\nikc-enabled-catalogs=\\\\nlh-unique-identifier=1711796957622126\\\\nlh-crn=1711796957622126", "cross_account_integration": true, "enable_data_policy_within_wxd": true, "governance_properties": "query-governance.name=external", "id": "ranger743", "ikc_user_account_id": "abcdefghijklmnopqrstuvwxyz", "manta_url": "https://abcd.com/gov_lineage/v2/lineage_events/openlineage", "modified_at": 1716878292, "modified_by": "admin", "resource": "presto-01", "state": "active", "storage_catalogs": { "catalog_names": [ "iceberg_data", "hive_data" ] }, "type": "ranger", "url": "http://lh-ranger.fyre.ibm.com:7080/", "username": "admin" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Unique id to identigy the integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z0-9]+$
Response
Response body for the POST/GET/PATCH Request for an integration in watsonx.Data
current state
Possible values: [
active
,inactive
,failed
]Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z]+$
Example:
active
Access Token for the integration of type
databand
.Possible values: 1 ≤ length ≤ 4096, Value must match regular expression
^[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+$
Example:
Header.Payload.Signature
ApiKey for the integration of type
manta
andikc
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
apikey
Authentication url for the corresponding
manta
integration in saasPossible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://iam.abc.com
Certificate if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[\s\S]*$
Example:
certificate_content_base64_encoded
Certificate extension of the certificate provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\\/.\-]+$
Example:
pem
Properties
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\nikc-env.url=ikc\nikc-enabled-catalogs=\nikc-username=\nlh-unique-identifier=1711796957622126\nlh-crn=1711796957622126
To enable/disable cross account integration for
ikc
in IBM Cloud / MCSP.To check if WatsonX.data policies are enabled along with
ranger
.Properties
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
query-governance.name=external
Unique id to identigy the integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z0-9]+$
Example:
presto01
The Account ID where the
ikc
is existing with which cross account integration needs to be enabled, to be used compulsorily withcross_account_integration
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9]+$
Example:
abcd1234
Manta specific Url derived from the url provided for
manta
integration in SaasPossible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://abcd.com/gov_lineage/v2/lineage_events/openlineage
Last Modified time for the corresponding integration in epoch format
Possible values: 0 ≤ value ≤ 2147483647
Last Modified user name for the corresponding integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Password for the integration of type
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
password
Displays the policy cache type configuration for integration type
ranger
.Possible values: 1 ≤ length ≤ 10000000000, Value must match regular expression
^[0-9]*$
Example:
123456789
Currently selected resource for
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_.-]+$
Example:
presto01
SSL enabled/disabled for
ikc
in Cloud Pack for Data.Example:
true
Details of storage catalogs associated with
ikc
Type of the integration integrated. It will only have the following values:
ranger
,ikc
,databand
andmanta
.Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^[a-z]+$
Example:
ranger
URL of the integration. Applicable for all the 4 types:
ranger
,ikc
,databand
andmanta
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://www.abcd.com
Username of the
ikc
/manta
/ranger
integration.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_@.-]+$
Example:
username
Zen API key for the integration of type
manta
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
zen_apikey
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auth_url": "https://iam.abc.com", "config_properties": "ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\\\\nikc-env.url=ikc\\\\nikc-username=\\\\nikc-enabled-catalogs=\\\\nlh-unique-identifier=1711796957622126\\\\nlh-crn=1711796957622126", "cross_account_integration": true, "enable_data_policy_within_wxd": true, "governance_properties": "query-governance.name=external", "id": "ranger743", "ikc_user_account_id": "abcdefghijklmnopqrstuvwxyz", "manta_url": "https://abcd.com/gov_lineage/v2/lineage_events/openlineage", "modified_at": 1716878292, "modified_by": "admin", "resource": "presto-01", "state": "active", "storage_catalogs": { "catalog_names": [ "iceberg_data", "hive_data" ] }, "type": "ranger", "url": "http://lh-ranger.fyre.ibm.com:7080/", "username": "admin" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
Unique id to identigy the integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z0-9]+$
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
API Authentication service token
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Path Parameters
Unique id to identigy the integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z0-9]+$
Integration update parameters
Access Token for the integration of type
databand
.Possible values: 1 ≤ length ≤ 4096, Value must match regular expression
^[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+$
Example:
Header.Payload.Signature
ApiKey for the integration of type
manta
andikc
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
apikey
Certificate to be provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[\s\S]*$
Example:
certificate_content_base64_encoded
Certificate extension of the certificate provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\\/.\-]+$
Example:
pem
To enable/disable cross account integration for
ikc
in IBM Cloud / MCSP.To enable WatsonX.data policies along with
ranger
.The Account ID where the
ikc
is existing with which cross account integration needs to be enabled, to be used compulsorily withcross_account_integration
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9]+$
Example:
abcd1234
Password for the integration of type
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
password
Sets the policy cache type configuration for integration type
ranger
.Possible values: 1 ≤ length ≤ 10000000000, Value must match regular expression
^[0-9]*$
Example:
123456789
Resource type for
ranger
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_-]+$
Example:
presto01
SSL enabler/disabler for
ikc
in Cloud Pack for Data.Example:
true
current state
Allowable values: [
active
,inactive
,failed
]Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z]+$
Example:
active
Details of storage catalogs associated with
ikc
URL of the integration to be integrated. Applicable for all the 4 types:
ranger
,ikc
,databand
andmanta
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://www.abcd.com
Username of the
ikc
/manta
/ranger
integration to be integrated.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_@.-]+$
Example:
username
Response
Response body for the POST/GET/PATCH Request for an integration in watsonx.Data
current state
Possible values: [
active
,inactive
,failed
]Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z]+$
Example:
active
Access Token for the integration of type
databand
.Possible values: 1 ≤ length ≤ 4096, Value must match regular expression
^[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+\.[A-Za-z0-9-_]+$
Example:
Header.Payload.Signature
ApiKey for the integration of type
manta
andikc
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
apikey
Authentication url for the corresponding
manta
integration in saasPossible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://iam.abc.com
Certificate if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 20000, Value must match regular expression
^[\s\S]*$
Example:
certificate_content_base64_encoded
Certificate extension of the certificate provided if ssl is enabled for integration type
ikc
in Cloud Pack for Data.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\\\/.\-]+$
Example:
pem
Properties
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\nikc-env.url=ikc\nikc-enabled-catalogs=\nikc-username=\nlh-unique-identifier=1711796957622126\nlh-crn=1711796957622126
To enable/disable cross account integration for
ikc
in IBM Cloud / MCSP.To check if WatsonX.data policies are enabled along with
ranger
.Properties
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
query-governance.name=external
Unique id to identigy the integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-z0-9]+$
Example:
presto01
The Account ID where the
ikc
is existing with which cross account integration needs to be enabled, to be used compulsorily withcross_account_integration
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9]+$
Example:
abcd1234
Manta specific Url derived from the url provided for
manta
integration in SaasPossible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://abcd.com/gov_lineage/v2/lineage_events/openlineage
Last Modified time for the corresponding integration in epoch format
Possible values: 0 ≤ value ≤ 2147483647
Last Modified user name for the corresponding integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@<>\-]+$
Example:
<username>@<domain>.com
Password for the integration of type
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
password
Displays the policy cache type configuration for integration type
ranger
.Possible values: 1 ≤ length ≤ 10000000000, Value must match regular expression
^[0-9]*$
Example:
123456789
Currently selected resource for
ranger
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_.-]+$
Example:
presto01
SSL enabled/disabled for
ikc
in Cloud Pack for Data.Example:
true
Details of storage catalogs associated with
ikc
Type of the integration integrated. It will only have the following values:
ranger
,ikc
,databand
andmanta
.Possible values: 1 ≤ length ≤ 8, Value must match regular expression
^[a-z]+$
Example:
ranger
URL of the integration. Applicable for all the 4 types:
ranger
,ikc
,databand
andmanta
Possible values: 1 ≤ length ≤ 2048, Value must match regular expression
^[a-zA-Z0-9\\\-:\/_.@=?]+$
Example:
https://www.abcd.com
Username of the
ikc
/manta
/ranger
integration.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_@.-]+$
Example:
username
Zen API key for the integration of type
manta
.Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-:_/.?=]+$
Example:
zen_apikey
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "auth_url": "https://iam.abc.com", "config_properties": "ikc-env.password=ibmlhenc__0001__uMkFATDDZNnxJ7z6BA/QqA==\\\\nikc-env.url=ikc\\\\nikc-username=\\\\nikc-enabled-catalogs=\\\\nlh-unique-identifier=1711796957622126\\\\nlh-crn=1711796957622126", "cross_account_integration": true, "enable_data_policy_within_wxd": true, "governance_properties": "query-governance.name=external", "id": "ranger743", "ikc_user_account_id": "abcdefghijklmnopqrstuvwxyz", "manta_url": "https://abcd.com/gov_lineage/v2/lineage_events/openlineage", "modified_at": 1716878292, "modified_by": "admin", "resource": "presto-01", "state": "active", "storage_catalogs": { "catalog_names": [ "iceberg_data", "hive_data" ] }, "type": "ranger", "url": "http://lh-ranger.fyre.ibm.com:7080/", "username": "admin" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get semantic automation layer Integration of the instance
Get basic details of the semantic automation layer(SAL) integration with IBM Knowledge Catalog(IKC)
GET /sal_integration
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
curl -X GET -H "accept: application/json" -H "AuthInstanceId: {instance_id}" "https://{region}.lakehouse.cloud.ibm.com/lakehouse/api/v3/sal_integration"
Response
Basic Semantic Automation Layer(SAL) integration settings
exceptions happens when creating integration with IKC on remote side
Possible values: 0 ≤ number of items ≤ 10000
IBM Knowledge Catalog(IKC) category UUID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
10e64285-bf37-4d5d-b759-bc6a46589234
SAL integration creation timestamp
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[0-9]+$
Example:
1715056266
registered engine id of the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto-01
SAL integration instance id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
18b49d7a-9519-4539-8db5-ff080623c226
status of the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
provisioning
COS resource CRN
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-:/]+$
Example:
crn:v1:staging:public:cloud-object-storage:global:a/04e9bc47612523rr19ac22759cb69bebd:asd23df-6ada-45ff-bfe8-4343222
COS storage type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
bmcos_object_storage
whether the integration is based on IKC trial plan, which is available on watsonx.data Saas only
ID of the user who enabled the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@\_-]+$
Example:
xyz@abc.com
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "category_id": "10e64285-bf37-4d5d-b759-bc6a46589234", "engine_id": "presto-01", "errors": [], "instance_id": "18b49d7a-9519-4539-8db5-ff080623c226", "status": "active", "storage_resource_crn": "crn:v1:staging:public:cloud-object-storage:global:a/04e9bc47612523rr19ac22759cb69bebd:asd23df-6ada-45ff-bfe8-4343222", "storage_type": "bmcos_object_storage", "timestamp": "1715056266", "trial_plan": false }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Create semantic automation layer integration with IBM Knowledge Catalog
Create semantic automation layer integration(SAL) with IBM Knowledge Catalog(IKC)
POST /sal_integration
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
IAM apikey with IBM Knowledge Catalog access
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-=+/]+$
Example:
67GveYtUdovRFEfnMLYP8x0S1b2mY1BkEGqBYbJK
ID of the engine(support presto or prestissimo) to be registered for SAL integration
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto-01
COS storage resource crn, required on Watsonx.data SaaS and not applicable for CPD
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-:/]+$
Example:
crn:v1:staging:public:cloud-object-storage:global:a/a7026b374f39f570d20984c1ac6ecf63:5778e94f-c8c7-46a8-9878-d5eeadb51161
COS storage type, required on Watsonx.data SaaS and not applicable for CPD
Allowable values: [
bmcos_object_storage
]Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
bmcos_object_storage
whether the integration is based on IKC trial plan, which is available on IBMCloud only
Example:
true
Response
Basic Semantic Automation Layer(SAL) integration settings
exceptions happens when creating integration with IKC on remote side
Possible values: 0 ≤ number of items ≤ 10000
IBM Knowledge Catalog(IKC) category UUID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
10e64285-bf37-4d5d-b759-bc6a46589234
SAL integration creation timestamp
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[0-9]+$
Example:
1715056266
registered engine id of the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto-01
SAL integration instance id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
18b49d7a-9519-4539-8db5-ff080623c226
status of the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
provisioning
COS resource CRN
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-:/]+$
Example:
crn:v1:staging:public:cloud-object-storage:global:a/04e9bc47612523rr19ac22759cb69bebd:asd23df-6ada-45ff-bfe8-4343222
COS storage type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
bmcos_object_storage
whether the integration is based on IKC trial plan, which is available on watsonx.data Saas only
ID of the user who enabled the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@\_-]+$
Example:
xyz@abc.com
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "category_id": "10e64285-bf37-4d5d-b759-bc6a46589234", "engine_id": "presto-01", "errors": [], "instance_id": "18b49d7a-9519-4539-8db5-ff080623c226", "status": "active", "storage_resource_crn": "crn:v1:staging:public:cloud-object-storage:global:a/04e9bc47612523rr19ac22759cb69bebd:asd23df-6ada-45ff-bfe8-4343222", "storage_type": "bmcos_object_storage", "timestamp": "1715056266", "trial_plan": false }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Delete Semantic Automation Layer(SAL) integration
Remove Semantic automation layer integration
DELETE /sal_integration
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Patch Semantic automation layer integration
Update Semantic automation layer(SAL) integration properties
PATCH /sal_integration
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
IAM apikey
Possible values: 1 ≤ length ≤ 1000, Value must match regular expression
^[a-zA-Z0-9\-=+/]+$
Example:
67GveYtUdovRFEfnMLYP8x0S1b2mY1BkEGqBYbJK
Engine ID(support presto and prestissimo) of which registering for integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto-01
Response
Basic Semantic Automation Layer(SAL) integration settings
exceptions happens when creating integration with IKC on remote side
Possible values: 0 ≤ number of items ≤ 10000
IBM Knowledge Catalog(IKC) category UUID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
10e64285-bf37-4d5d-b759-bc6a46589234
SAL integration creation timestamp
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[0-9]+$
Example:
1715056266
registered engine id of the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto-01
SAL integration instance id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
18b49d7a-9519-4539-8db5-ff080623c226
status of the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
provisioning
COS resource CRN
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-:/]+$
Example:
crn:v1:staging:public:cloud-object-storage:global:a/04e9bc47612523rr19ac22759cb69bebd:asd23df-6ada-45ff-bfe8-4343222
COS storage type
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9_]+$
Example:
bmcos_object_storage
whether the integration is based on IKC trial plan, which is available on watsonx.data Saas only
ID of the user who enabled the SAL integration
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9.@\_-]+$
Example:
xyz@abc.com
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "category_id": "10e64285-bf37-4d5d-b759-bc6a46589234", "engine_id": "presto-01", "errors": [], "instance_id": "18b49d7a-9519-4539-8db5-ff080623c226", "status": "active", "storage_resource_crn": "crn:v1:staging:public:cloud-object-storage:global:a/04e9bc47612523rr19ac22759cb69bebd:asd23df-6ada-45ff-bfe8-4343222", "storage_type": "bmcos_object_storage", "timestamp": "1715056266", "trial_plan": false }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
create enrichment jobs of schema(or tables in schema)
create enrichment job of schemas, notifing the schema(tables) changes to IBM Knowledge Catalog(IKC) and kick off an import and metadata enrichment job
POST /sal_integration/enrichment
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
changed to be submitted and processed by the enrichment job
Possible values: 0 ≤ number of items ≤ 10000
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List semantic enriched data_assets in IBM Knowledge catalog
List semantic enrichment data_assets(enriched tables) associated with the schema by IBM Knowledge Catalog project id, which can be fetched from /sal_integration/mappings
GET /sal_integration/enrichment/data_assets
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
project id of enriched schema in IBM Knowledge Catalog
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
Collection if SAL enriched assets in IKC
list of enrichment asset in IKC
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "data_assets": [ { "attributes": [ "data_asset", "discovered_asset", "metadata_enrichment_info" ], "id": "ee0383b9-dcab-4c1a-b03d-bf521837b6ed", "name": "newtable", "resource_key": "0000:0000:0000:0000:0000:FFFF:9EB0:04E2|31134|:/iceberg_data/new_schema/sampletable", "schema_name": "sampleschema" }, { "attributes": [ "data_asset", "processed_asset", "metadata_enrichment_info" ], "id": "a1b2c3d4-5678-90ab-cdef-1234567890ab", "name": "another_table", "resource_key": "0000:0000:0000:0000:0000:FFFF:1234:5678|4321|:/iceberg_data/sample_schema/another_table", "schema_name": "anotherschema" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get semantic enrichment data_asset associated with the table
Get semantic enrichment data_asset associated with the table by IBM Knowledge Catalog project id and asset id, which can be retrived by /sal_integration/enrichement/data_assets
GET /sal_integration/enrichment/data_assets/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
enrichment data asset id in IBM Knowledge Catalog
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Query Parameters
enrichment project id in IBM Knowledge Catalog
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
SAL encrichmed asset in IKC associated with table in Watsonx.data
attributes of the asset
Possible values: 0 ≤ number of items ≤ 10000, 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "data_asset", "discovered_asset", "discovered_asset", "metadata_enrichment_info" ]
data asset id in IKC
Possible values: 1 ≤ length ≤ 5242880, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
ee0383b9-dcab-4c1a-b03d-bf521837b6ed
asset name (table name)
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
newtable
unique resource name of IKC asset
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9_:/|]+$
Example:
0000:0000:0000:0000:0000:FFFF:9EB0:04E2|31134|:/iceberg_data/new_schema/sampletable
schema name
Possible values: 0 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
sampleschema
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "attributes": [ "data_asset", "discovered_asset", "metadata_enrichment_info" ], "id": "ee0383b9-dcab-4c1a-b03d-bf521837b6ed", "name": "newtable", "resource_key": "0000:0000:0000:0000:0000:FFFF:9EB0:04E2|31134|:/iceberg_data/new_schema/sampletable", "schema_name": "sampleschema" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get metadata enrichment global settings
Get metadata enrichment global settings
GET /sal_integration/enrichment/global_settings
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Response
Request payload object of SAL Integration Enrichment Global Settings
semantic expansion
semantic expansion
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "expansion": { "description": true, "description_configuration": { "assignment_threshold": 0.14, "suggestion_threshold": 0.9 }, "name": true, "name_configuration": { "assignment_threshold": 0.1, "suggestion_threshold": 0.1 } }, "term_assignment": { "class_based_assignments": false, "evaluate_negative_assignments": false, "llm_based_assignments": false, "ml_based_assignments_custom": false, "ml_based_assignments_default": false, "name_matching": false, "term_assignment_threshold": 0.3, "term_suggestion_threshold": 0.4 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Create or update metadata enrichment global settings
Create or update metadata enrichment global settings
PUT /sal_integration/enrichment/global_settings
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
semantic expansion
semantic expansion
Response
Request payload object of SAL Integration Enrichment Global Settings
semantic expansion
semantic expansion
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "expansion": { "description": true, "description_configuration": { "assignment_threshold": 0.9, "suggestion_threshold": 0.75 }, "name": true, "name_configuration": { "assignment_threshold": 0.9, "suggestion_threshold": 0.75 } }, "term_assignment": { "class_based_assignments": false, "evaluate_negative_assignments": false, "llm_based_assignments": false, "ml_based_assignments_custom": false, "ml_based_assignments_default": false, "name_matching": false, "term_assignment_threshold": 0.3, "term_suggestion_threshold": 0.4 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List semantic enrichment jobs associated with the schema
List semantic enrichment jobs in wkc that associated with the schema by project id(in the given project from IBM Knowledge Catalog perspective)
GET /sal_integration/enrichment/jobs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
IBM Knowledge Catalog project id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
Collection of SAL integration enrichment jobs
list of enrichment jobs
Possible values: 0 ≤ number of items ≤ 1024, 1 ≤ length ≤ 5242880, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "jobs": [ "{ \"metadata\": { \"name\": \"SAL_MDE job\", \"asset_id\": \"ea73ce44-8aa0-4c75-bd69-6ca7074a1030\", \"owner_id\": \"IBMid-55000832RK\", \"version\": 0, }, \"entity\": { \"job\": { \"asset_ref_type\": \"metadata_enrichment_area\", \"configuration\": { \"env_type\": \"\", \"env_variables\": [] }, \"schedule_info\": {}, \"last_run_initiator\": \"deprecated field\", \"last_run_time\": \"deprecated field\", \"last_run_status\": \"deprecated field\", \"last_run_status_timestamp\": 0, \"future_scheduled_runs\": [], \"enable_notifications\": false, \"task_credentials_support\": { \"task_credentials_enabled\": true, \"user_id\": \"IBMid-55000832RK\", \"account_id\": \"04e9bc4761254b719ac22759cb69bebd\", }, \"project_name\": \"SAL Mapping /iceberg_data/new_schema 9aae5be3-87cf-4c31-b17d-9256ab42c14e\", \"asset_ref\": \"8688a3b6-a946-499e-a93c-b7d099db80dd\", \"schedule_id\": \"\", \"schedule_creator_id\": \"\", }, }, }" ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List semantic enrichment job runs associated with the schema
List runs of an SAL enrichement job associated with the schema(project in IBM Knowledge Catalog perspective)
GET /sal_integration/enrichment/jobs/{job_id}/runs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
enrichment job id, refered as 'asset_id' in '/Sal_integration/enrichment/jobs'
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Query Parameters
enrichment project id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Response
Collection of job runs for a specific enrichment job
list of job runs as response
Possible values: 0 ≤ number of items ≤ 10000, 1 ≤ length ≤ 5242880, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Examples:[ "{ metadata: name: \"job run\" asset_id: \"44d619fd-0512-4f17-ad0f-b3cab978986a\" owner_id: \"IBMid-698000MX2W\" created: 1738266914282 created_at: \"2025-01-30T19:55:14Z\" usage: last_update_time: 1738266916263 last_updated_at: \"2025-01-30T19:55:16Z\" entity: job_run: job_ref: \"cabb089f-c7f8-4849-a7d8-5622229e1e1a\" job_name: \"SAL_MDE job\" job_type: \"metadata_enrichment_area\" state: \"Completed\" is_scheduled_run: true configuration: env_type: \"\" env_variables: [] is_scheduled_run: true skip_notifications: true project_name: \"SAL Mapping /iceberg_data/retail 259093a4-1918-4a3d-8ca0-4fe214efd5d0\" last_state_change_timestamp: \"2025-01-30T19:55:15Z\" location_definition: physical_location_code: \"DAL\" physical_location_code_assigned_by: \"IBMid-698000MX2W\" physical_location_code_rds_id: \"c57cb90f-2126-3800-9c9f-9eab82021cdf\" physical_location_code_rds_version: \"00002025-0128-4211-8930-535241000000_5\" physical_location_code_assignment_method: \"INFERRED\" physical_location_code_added_on: 1738216980123 }" ]
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "runs": [ "{ metadata: name: \"job run\" asset_id: \"da428d4b-50f2-4bb4-acec-d878c748cdf4\" owner_id: \"IBMid-697000CI7N\" created: \"1738200305392\" created_at: \"2025-01-30T01:25:05Z\" usage: last_update_time: 1738200318511 last_updated_at: \"2025-01-30T01:25:18Z\" entity: job_run: job_ref: \"4bd723e7-d734-4b34-be0f-ebfd0979d026\" job_name: \"SAL_MDE job (Publishing)\" job_type: \"metadata_enrichment_area_publish\" state: \"Completed\" isScheduledRun: false configuration: metadata_enrichment_area_id: \"65d31e36-004e-4942-af6c-4d62f64b7924\" env_type: \"metadata_enrichment_area_publish\" env_variables: [] skip_notifications: true catalog_id: \"b2b4bb75-f02a-47e2-a2cd-ff02dd87841d\" duplicate_action: \"UPDATE\" asset_ids: - \"16db5c29-90eb-42d9-9f98-f79ba985f17d\" - \"ae7c6ff8-175d-499c-b1e9-ac945c1fe8c3\" - \"171c1cf8-7270-447f-a8cb-0e38a6f9bee3\" - \"c8d7fdfe-1ef4-4f77-a19d-5fdbf6b5d72e\" project_name: \"SAL Mapping /iceberg_data/retail b2b4bb75-f02a-47e2-a2cd-ff02dd87841d\" last_state_change_timestamp: \"2025-01-30T01:25:18Z\" duration: 12 location_definition: physical_location_code: \"DAL\" physical_location_code_assigned_by: \"IBMid-697000CI7N\" physical_location_code_rds_id: \"c57cb90f-2126-3800-9c9f-9eab82021cdf\" physical_location_code_rds_version: \"00002024-0613-4175-8306-512505000000_4\" physical_location_code_assignment_method: \"INFERRED\" physical_location_code_added_on: \"1738199864932 }" ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get semantic enrichment job run logs associated with the job run
Get semantic enrichment job run logs associated with the job run
GET /sal_integration/enrichment/jobs/{job_id}/runs/{run_id}/logs
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
IBM Knowledge Catalog enrichment job id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
IBM Knowledge Catalog enrichment job run id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Query Parameters
IBM Knowledge Catalog project id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
collection of the enrichment job run log results
response from enrichment job run log request
Possible values: 0 ≤ number of items ≤ 10000, 0 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
name
Possible values: 0 ≤ value ≤ 10000
Example:
12
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "results": [ "Size: 28 Blocks: 0 IO Block: 4096 directory", "Device: 3000eeh/3145966d Inode: 453833649 Links: 3", "Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root)", "Access: 2019-04-08 19:12:21.930122905 +0000", "Modify: 2019-04-08 19:12:21.932122894 +0000", "Change: 2019-04-08 19:12:21.932122894 +0000", "DONE" ], "total_count": 100 }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
get metadata enrichment settings for a IBM Knowledge Catalog project(schema)
get metadata enrichment settings for a IBM Knowledge Catalog project(schema)
GET /sal_integration/enrichment/project_settings
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
IBM Knowledge Catalog project id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
Request payload object of SAL Integration Enrichment Global Settings
semantic expansion
semantic expansion
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "expansion": { "description": true, "description_configuration": { "assignment_threshold": 0.14, "suggestion_threshold": 0.9 }, "name": true, "name_configuration": { "assignment_threshold": 0.1, "suggestion_threshold": 0.1 } }, "term_assignment": { "class_based_assignments": false, "evaluate_negative_assignments": false, "llm_based_assignments": false, "ml_based_assignments_custom": false, "ml_based_assignments_default": false, "name_matching": false, "term_assignment_threshold": 0.3, "term_suggestion_threshold": 0.4 } }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Create or update project level metadata enrichment settings
Create or update metadata enrichment settings for a IBM Knowledge Catalog project(enriched schema)
PUT /sal_integration/enrichment/project_settings
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
IBM Knowledge Catalog project id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Request body
semantic expansion
semantic expansion
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get list of uploaded glossary terms
Get list of uploaded glossary terms
GET /sal_integration/glossary/terms
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Response
Sal Integration Glossary terms list
collection of glossary terms
Possible values: 0 ≤ number of items ≤ 10000
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "glossary_terms": [ { "description": "Inventory ID", "name": "inventoryID" }, { "description": "Inventory date", "name": "inv_date_sk" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Upload semantic enrichment business terms glossary
Upload semantic enrichment business terms glossary
POST /sal_integration/glossary/upload_processes
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Form Parameters
glossary upload replace option
Allowable values: [
all
,specified
,empty
]Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
Glossary CSV file
Possible values: 1 ≤ length ≤ 52428800
Example:
Glossary.cvs
Response
Sal Integration Upload Glossary Process
glossary uploading process id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "id": "18b49d7a-9519-4539-8db5-ff080623c226" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Get status of glossary uploading process(job)
Get status of glossary uploading process(job)
GET /sal_integration/glossary/upload_processes/{id}/status
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
upload process id
Possible values: 1 ≤ length ≤ 10000, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
Sal Integration Upload Glossary
response of the uploading process status in json
Possible values: 1 ≤ length ≤ 5242880, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
completed
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "response": "completed" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Post watsonx.data schema to fetch mapped catalog and project
use the list of watsonx.data catalog and schema to fetch mapped IKC project id and catalog id
GET /sal_integration/mappings
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
catalog name in Watsonx.data
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
schema name in Watsonx.data
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-_]+$
reference as an continue of reading results from earlier query (if the results exceed 100)
Possible values: 1 ≤ length ≤ 300, Value must match regular expression
^[a-zA-Z0-9\-_\.]$
Response
Collection of SAL Mapping details of given watsonx.data schemas
list of results as sal maapping in Watsonx.data vs IKC metadata
Possible values: 0 ≤ number of items ≤ 10000
reference for next part of the query results (if results number exceed 100)
Possible values: 0 ≤ length ≤ 300, Value must match regular expression
^[a-zA-Z0-9._-]+$
Example:
g2wAAAABaANkACpkYmNvcmVAZGIxOC5ibS1jYy11cy1zb3V0aC0yOC5jbG91ZGFudC5uZXRsAAAAAm4EAAAAAKBuBAD___-vamwAAAACbQAAABQyMDI1LTA2LTExVDAyOjA0OjU1WmEAamo
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "mappings": [ { "wkc_catalog_id": "18b49d7a-9519-4539-8db5-ff080623c226", "wkc_project_id": "9519bd7a-9519-8db5-4539-ff080623c226", "wxd_catalog_name": "iceberg_data", "wxd_schema_name": "test_schema" }, { "wkc_catalog_id": "22a73c5e-91bc-4e76-8e59-3f1db8ef75a2", "wkc_project_id": "7451bc19-98de-4bc3-85f9-8125aa789d52", "wxd_catalog_name": "retail_data", "wxd_schema_name": "sales_schema" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
List Semantic Search queries snapshot
List Semantic Search queries snapshot
GET /sal_integration/semantic_search/queries
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
enable schemas search
Default:
true
enable columns search
Default:
true
max history records limitation
Possible values: 1 ≤ value ≤ 30
Default:
5
if the response include actual search result
Response
collection of query results of Semantic search history queries response object
List of semantic search results
Possible values: 0 ≤ number of items ≤ 30
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "queries": [ { "id": "1", "last_search_time": "2024-09-15T14:30:00Z", "results": [ { "artifact_type": "data_asset", "asset_id": "7f9d8270-496f-4bda-96b9-9891b35c80e9", "catalog_name": "iceberg", "description": "Customer transaction data", "highlight": { "metadata.name": [ "<em>Customer</em>_Transactions" ], "metadata.semantic_name": [ "<em>Customer</em> Transactions" ] }, "matched_columns": [ { "asset_id": "7f9d8270-496f-4bda-96b9-9891b35c80e9:customer_id", "description": "Primary key of the customer table", "highlight": { "column.name": [ "<em>customer</em>_id" ] }, "name": "customer_id", "semantic_description": "Unique identifier for a customer", "semantic_name": "Customer ID" } ], "name": "table1", "path": "/iceberg/california_school/table1", "project_id": "b94b3f1c-3808-44d2-b7e6-4df8d5861950", "provider_type": "cams", "schema_name": "california_school", "search_score": 92.5, "semantic_description": "Table contains details of customer transactions", "semantic_name": "Customer Transactions", "state": "active", "table_name": "table1", "tags": [ "analytics", "customer" ], "terms": [ "customer", "transactions" ] } ], "search_query": "catalog_table" } ] }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Trigger a global search among IBM Knowledge Catalog metadata by given query
Execute a query of global search among IBM Knowledge Catalog metadata
POST /sal_integration/semantic_search/queries
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Request body
engine id
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Example:
presto01
search string
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
catalog_table
request payload for semantic search configurations
Response
semantic search object of the returning result
search results of given query
Possible values: 0 ≤ number of items ≤ 200
id of the semantic search query record
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[0-9]+$
Example:
1
last time of searching the same query string
Possible values: 1 ≤ length ≤ 128
Example:
2024-09-15T14:30:00Z
input search query
Possible values: 1 ≤ length ≤ 1024, Value must match regular expression
^[a-zA-Z0-9~!@#$%^&*()_+=\[\]{}|;':\"`,./<>?\\=:\- ]*$
Example:
catalog_table
Status Code
Success
Error
Unauthorized
Not found
Internal server error
{ "last_search_time": "2024-09-15T14:30:00Z", "results": [ { "artifact_type": "data_asset", "asset_id": "7f9d8270-496f-4bda-96b9-9891b35c80e9", "catalog_name": "iceberg", "description": "Customer transaction data", "highlight": { "metadata.name": [ "<em>Customer</em>_Transactions" ], "metadata.semantic_name": [ "<em>Customer</em> Transactions" ] }, "matched_columns": [ { "asset_id": "7f9d8270-496f-4bda-96b9-9891b35c80e9:customer_id", "description": "Primary key of the customer table", "highlight": { "column.name": [ "<em>customer</em>_id" ] }, "name": "customer_id", "semantic_description": "Unique identifier for a customer", "semantic_name": "Customer ID" } ], "name": "table1", "path": "/iceberg/california_school/table1", "project_id": "b94b3f1c-3808-44d2-b7e6-4df8d5861950", "provider_type": "cams", "schema_name": "california_school", "search_score": 92.5, "semantic_description": "Table contains details of customer transactions", "semantic_name": "Customer Transactions", "state": "active", "table_name": "table1", "tags": [ "analytics", "customer" ], "terms": [ "customer", "transactions" ] } ], "search_query": "catalog_table" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Clear semantic search query history
Delete the history records of semantic search in batch, if no batch_size given, entire semantic search history list will be removed
DELETE /sal_integration/semantic_search/queries
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Query Parameters
max number to queries to be deleted (most recent to least), if no number provided all queries history will be clear
Possible values: 1 ≤ value ≤ 30
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Delete semantic search query history by record id
Delete the history records of semantic search by record id
DELETE /sal_integration/semantic_search/queries/{id}
Request
Custom Headers
watsonx.data instance ID
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-\:/]+$
Path Parameters
id of the semanric search query record
Possible values: 1 ≤ length ≤ 128, Value must match regular expression
^[a-zA-Z0-9\-]+$
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
Delete Semantic automation layer(SAL) integration metadata
Delete SAL integration metadata
DELETE /sal_metadata
Response
Status Code
No Content
Error
Unauthorized
Not found
Internal server error
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }
{ "errors": [ { "code": "bad_request", "message": "The 'email' field is required.", "more_info": "https://api.example.com/docs/errors/bad_request" } ], "exception": "BadRequestException: Missing required field", "message": "Invalid request", "message_code": "ERR4001", "more_info": "https://api.example.com/docs/errors/ERR4001", "status_code": 400, "trace": "123e4567-e89b-12d3-a456-426614174000" }