IBM Cloud Docs
Quick start watsonx.data console

Quick start watsonx.data console

When you log in to the IBM® watsonx.data web console for the first time, you are presented with the quick start wizard. In this tutorial, you learn how to use the quick start wizard to configure the core components and get started with watsonx.data in a few minutes.

The wizard guides you through the initial configuration process for the infrastructure components of watsonx.data.

Configure a bucket

Your watsonx.data needs an object storage bucket to store your raw data files. You can provision a new IBM-managed bucket or register your own bucket. You can add more buckets and register them later.

In the Configure bucket page, complete the following steps:

  1. Select one of the following options and provide details.

    • Provision new IBM-managed bucket

    • Register my own

      Table 1. Add bucket
      Field Description
      Bucket Type Select from Amazon S3, IBM Storage Ceph, or IBM Cloud Object Storage.
      Region The region where the data bucket is available.
      Bucket Name Enter your bucket name.
      Display name Enter the bucket name to be displayed on-screen.
      Endpoint Enter the endpoint URL.
      Access key Enter your access key.
      Secret key Enter your secret key.
      Connection status Click the Test connection link to test whether the bucket connection with watsonx.data is successful or not. The system displays the status message.
  2. Click Next.

The IBM-managed bucket is a default 10 GB bucket. It is meant for an exploratory purpose and cannot be used to store production or sensitive data. The watsonx.data instance administrators can disable this bucket for compliance reasons.

When you register your own bucket, ensure to provide the correct details for bucket configuration. The quick start wizard does not validate the bucket configuration details and you cannot modify them later.

Configure a catalog

Your watsonx.data needs metadata catalogs to manage your table schemas. Creating the support services for the metadata catalog adds 3 RUs/Hr to your instance run rate when you complete the quickstart process.

In the Configure catalog page, complete the following steps:

  1. Select the table format for managing your data. Apache Hive and Apache Iceberg catalogs are selected by default.

  2. Click Next.

Configure an engine

Your watsonx.data needs a query engine to work with your data.

In the Configure engine page, complete the following steps:

  1. Select the engine to run and process the data that you attached.

  2. Select the size of the engine based on the requirements of your workload.

    Table 2. Engine size
    Size Description
    Starter/Lite (IBM) (2 RUs/hour) Includes 1 coordinator node and 1 worker node. All nodes are Starter.
    Starter (AWS) (5.6 RUs/hour) Includes 1 coordinator node and 1 worker node. All nodes are cache-optimized.
    Small (11.2 RUs/hour) Includes 1 coordinator node and 3 worker nodes. All nodes are cache-optimized.
    Medium (19.6 RUs/hour) Includes 1 coordinator node and 6 worker nodes. All nodes are cache-optimized.
    Large (36.4 RUs/hour) Includes 1 coordinator node and 12 worker nodes. All nodes are cache-optimized.
  3. Click Next.

Configure query monitoring

You can enable, or disable query monitoring feature (For more information about query monitoring, see Query monitoring) for your instance. If you enable the feature, you must specify the storage that is required to store QHMM related data. You have the provison to use the default storage (that the system provision for you) or you can bring your own bucket (BYOB).

  1. Use the toggle switch to enable (or disable) the query monitoring feature.

  2. If you enable the QHMM feature, you need to configure the storage details for storing QHMM data. Else, you can navigate to the next step using the Next button.

  3. You can view the following storage details that is available in the system by default to store the QHMM data.

    • The Bucket name field displays the default bucket (that the system provision) to which the query history is stored.
    • The Catalog type is by default Apache hive. QHMM supports only Apache hive.
    • The Catalog name is by default wxd_system_data.
  4. You can continue using the default storage details or you can change the default bucket and configure the details of the bucket that you bring in (BYOB) to store the QHMM data. To do that:

    a. Use the Back button to navigate backwards to the Configure bucket page.

    b. Select Register my own from the How would you like to proceed? field.

    c. Configure the details of your bucket. For more information, see Configure a bucket.

    d. Click Next.

    e. From the Configure catalog page, select the catalog Type as Apache hive. QHMM supports only Apache hive.

    f. Use the Next button to navigate to the Query monitoring page.

    g. In the Query monitoring page, from the Bucket name field, select the bucket that you registered.

The storage (default or BYOB) can be changed at later point from the watsonx.data console page. See Query monitoring.

  1. Click Next.

Review the configuration details

In the Summary page, complete the following steps:

  1. Review the configurations before you finish setting up your watsonx.data.

  2. Click Finish and go.

When the setup is complete, the watsonx.data home page appears. Resource Unit consumption begins soon after creating the support services by using the quick start wizard. You can view the run rate that is submitted for billing from the billing and usage tab. For more information, see Billing and usage.

Next steps

You are all set to use the watsonx.data or you can configure it further.