watsonx.data Spark engine

Native Spark engine is a compute engine in IBM® watsonx.data. You can use Native Spark engine to submit applications that involve complex analytical operations.

In watsonx.data, native Spark engine is used to achieve the following use cases:

• Ingest large volumes of data into watsonx.data tables.
• Handle complex analytical workload.
• Table maintenance operation to enhance watsonx.data performance of the table
• Develop, run, and debug applications written in Python, R, and Scala.

For more information about using Spark engine, see Working with watsonx.data Spark.