View details of the submitted Spark applications in watsonx.data

1. In the Applications tab, you can view the list of all applications that are submitted to watsonx.data. The tab also displays the details such as the application status, Spark version, creation time, start time, and finish time.

Application status can be : ACCEPTED, FINISHED, FAILED, ERROR, RUNNING, SUBMITTED, STOPPED, or WAITING.

2. Click the arrow to the left of an application ID in the result list, to view more details like Spark application ID and Application name.

You can also filter the applications based on status using the Filter icon.

Track the status of the application by invoking the application status API, see API.

Stopping applications in watsonx.data

You can stop only the applications that are in RUNNING state.

1. In the Applications tab, select the application that you want to stop.
2. Click the overflow menu and select Stop. The application status changes to STOPPED.

Configure filter parameters to list Spark applications by using API

You can use API, which allows to limit the number of Spark Applications listed. Also, you can filter applications by using additional filter options Application Name, Start Time Interval, and End Time Interval.

You can configure the following parameters and use the CURL command to add the filter parameters:

curl -k -X GET
https://<region>/lakehouse/api/v2/spark_engines/<spark_engine_id>/spark_applications\n
/<application_id>?state=accepted,running,finished,failed&limit=<limit_value>&start_time_interval={start_lower timestamp limit},{start_upper timestamp limit}&end_time_interval={end_lower timestamp limit},{end_upper timestamp limit}

Parameter values:

• <region>: The region where the Spark instance is provisioned.

• <spark_engine_id> : The engine ID of the Spark engine.

• <application_id> : The application for which the details are viewed.

• <limit_value> : The instance ID from the watsonx.data cluster instance URL. For example, 1609968577169454.

• start_time_interval : Time interval to use for filtering applications by their start time. Specify {start_lower timestamp limit} and {start_upper timestamp limit} For example, 2025-04-08T00:00:00Z,2025-04-10T23:59:59Z.

• end_time_interval : Time interval to use for filtering applications by their end time. Interval is specified in the format. Specify {end_lower timestamp limit} and {end_upper timestamp limit} For example, 2024-04-08T00:00:00Z,2024-04-08T23:59:59Z.

Related API

For information on related API, see

• List all applications in a spark engine
• Submit engine applications
• Stop spark applications
• Get spark application