Before you begin

• watsonx.data instance with Native Spark engine provisioned.
• Download and install IBM cpdctl. For information, see Installing IBM cpdctl.
• Configure the watsonx.data environment in IBM cpdctl. For information, see Configure IBM cpdctl.

Table maintenance

You can use the resources available in the tablemaint utility to perform the following table maintenance activities.

• Snapshot management

  • rollback_to_snapshot - Roll back a table to a specific snapshot ID.
  • rollback_to_timestamp - Roll back the table to a snapshot at a specific day and time.
  • set_current_snapshot - Sets the current snapshot ID for a table.
  • cherrypick_snapshot - Cherry-picks changes from a snapshot into the current table state.

• Metadata management

  • expire_snapshots - Remove older snapshots and their files that are no longer needed.
  • remove_orphan_files - Used to remove files that are not referenced in any metadata files of an Iceberg table.
  • rewrite_data_files - Combines small files into larger files to reduce metadata overhead and runtime file open cost.
  • rewrite_manifests - Rewrite manifests for a table to optimize scan planning.

• Table Migration

  • register_table - Creates a catalog entry for a metadata.json file that exists but does not have a corresponding catalog identifier.

For information, see the How to use wx-data command --help (-h) section.