Adding Milvus service

Milvus is a vector database that stores, indexes, and manages massive embedding vectors that are developed by deep neural networks and other machine learning (ML) models. It is developed to empower embedding similarity search and AI applications. Milvus makes unstructured data search more accessible and consistent across various environments.

The version 2.4.0 of pymilvus is recommended for Milvus 2.4.x. Uninstall the earlier version and install the latest version of pymilvus.

Complete the following steps to add Milvus as a service in IBM® watsonx.data.

1. Log in to the watsonx.data console.

2. From the navigation menu, select Infrastructure Manager.

3. To define and connect to a service, click Add component and select Add service.

4. In the Add service window, select Milvus from the Type list.

   Table 1. Adding Milvus service

   Field	Description
   Display name	Enter the Milvus service name to be displayed on the screen.
   Size	Select the suitable size.
   	Starter: Recommended for 1 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
   	Small: Recommended for 10 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
   	Medium: Recommended for 50 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
   	Large: Recommended for 100 million vectors, 64 index parameters, 1024 segment size, and 384 dimensions.
   Add storage bucket	Associate an external bucket for the Small, Medium, or Large sizes. For Starter size, you can also select an IBM-managed bucket. To associate an external bucket, you must have the bucket configured.
   Path	For external buckets, specify the path where you want to store vectorized data files.

   For more information about adding external buckets, see Adding a storage-catalog pair.

   If the schema of the collection changes (an increase in the number of fields in a collection or increase in the size of the varchar field beyond 256 characters, or if multiple vector fields are added into the collection), the number of records might decrease.

   Milvus service can connect to a storage without a catalog. You can perform the actions on Milvus even after disabling the storage.

   You must provide the endpoint for buckets used by Milvus with the region for region-specific buckets like S3 and without trailing slashes. For example: https://s3.<REGION>.amazonaws.com.

5. Click Provision.