Ingesting data from watsonx.data

Before you begin

In the examples, the publicly available New York taxi trip record data for yellow taxis in January 2022 is used. To follow this example, make sure that the data is in an accessible S3 bucket and the table was loaded into watsonx.data into an Apache Iceberg table in the Hive Metastore server (HMS).

1. Connect to NPSaaS database.

MYLAKE.TAXIDATA(ADMIN)=> \c localdb

You are now connected to localdb database.

2. Run a CTAS query with a cross database select on the data lake database.schema.table.

Example:

LOCALDB.ADMIN(ADMIN)=> CREATE TABLE YELLOW_TAXI_JANUARY_2022_LOADED AS SELECT * FROM MYLAKE.TAXIDATA.YELLOW_TAXI_JANUARY_2022;
INSERT 0 2463931