Overview
Utilize data from your enterprise to achieve productivity gains in activities related to question/answer conversations, content search, summarization and generation. RAG can be deployed in multiple configurations and is applicable to various industry use cases and solutions.
This deployable architecture provides a comprehensive foundation for trust, observability, security, and regulatory compliance by configuring and deploying various services and a sample application for a RAG pattern, including:
- Configuring IBM Cloud Account with best practices from IBM Cloud Framework for Financial Services
- Deploying key and secrets management services for storage and management of encryption keys and secrets
- Deploying controls for continuous compliance
- Deploying observability services for application and platform logging and monitoring
- Deploying a suite of watsonx services to provide generative AI RAG capabilities
- Deploying content databases for storing vector embeddings of the documents and content search/retrieval
- Deploying a sample application in a variety of run times including CI/CD/CC pipelines for secure application lifecycle management
The above configured and deployed services enable a secure and trustworthy deployment of generative AI applications on IBM Cloud.
The configurations are flexible and be changed to meet the needs for several types of RAG patterns depending on the chosen combination of technologies and services.
The generative AI RAG pattern services include:
- watsonx.ai
- watsonx.data (with Milvus)
- watsonx.governance
- watsonx Assistant
- watsonx Orchestrate
- Watson Discovery
- Elasticsearch Enterprise and Platinum edition
The supporting services include:
- Secrets Manager
- Key Protect
- Security and Compliance Center
- Event Notifications
- Logs
- Monitoring
- Object Storage
- Continuous Delivery toolchains
- Container Registry
A sample RAG application is deployed to Code Engine or Red Hat OpenShift cluster.
By leveraging this architecture, you can accelerate your deployment and tailor it to meet your unique business needs and enterprise goals.
Features and capabilities
RAG Pattern
Deploy a RAG pattern with supporting IBM Cloud and watsonx services, and a sample application to Code Engine or Red Hat OpenShift using Continuous Delivery.
Implement Security
The architecture ensures security by deploying Key Protect and Secrets Manager.
Achieve Regulatory Compliance
Ensures regulatory compliance by implementing CI/CD/CC pipelines, along with Security and Compliance Center Workload Protection for continuous compliance.
Ensure Observability
Provides observability by deploying services such as Logs and Monitoring for log analysis and tracking activity.
Establish Trust
Ensures trust by configuring the IBM Cloud account to align with compliance settings as defined in the Financial Services framework.
