IBM Connected Trade Gateway

The IBM Connected Trade Gateway is a hybrid integration platform that is built on industry leading, automated, secure, and scalable capabilities. By using a comprehensive set of integration tools within a single, unified experience you can quickly connect applications and data across any cloud or on-premises environment.

By using the Connected Trade Gateway reference architecture, you can expect:

  • Scalable API management that prioritizes creating, socializing, managing, and monetizing APIs across cloud providers.
  • The ability to author and host environments for creating, testing, sharing, and deploying workflows that can be used to connect applications and data, assisted by AI, without having to write code.
  • Enterprise grade messaging and event streaming through IBM MQ, Apache Kafka, and Rabbit MQ.
  • High speed data transfer for files and data sets of any size that is reliably and securely performed.
  • The ability to add security, control, integrations, and optimized access to your workload.
  • A document classification and content extractions service for handling trade finance documents such as bill of lading, commercial invoice, etc ...

Architecture diagrams

In the following sections, you will learn more about the architectural aspects of the Connected Trade Gateway.

Logical architecture

To learn more about how the the IBM Connected Trade Gateway architecture and how it integrates with other solution components.

Architecture
Architecture

  • IBM Application Integration offers a single solution which ISVs and banks can use to create multi-style integrations, create APIs and act on events. It lets you quickly build and test integration flows with authoring tools for both integration experts and business technologists. The platform lets you secrely connect with hundreds of applications on cloud and on-premise with pre-built smart connectors and templates. The platform offers the fastest performing engine that virtually supports any-to-any data format and it offers AI-infused, smart tooling for non-specialists to quickly create integrations by using natural language. The platform also gives you the ability to deploy integrations with visibility into flow health and performance across hybrid environments.

  • Persona centric tooling IBM App Connect Enterprise Toolkit and Designer are complementary integration authoring tools that allow those who are newer to integrations the ability to collaborate with experts to build organization-wide integrations. Designer provides no-code development and AI-powered tooling for business users, while Toolkit provides feature rich message modeling with built-in nodes encapsulating transports, technologies and applications for integration experts. The two tools offer fully blended capabilities with the ability to reuse connectors, call shared assets and intermingle functions.

  • API Management is provided by the following three sub components:

    • API Manager: Enables providers of APIs to create or upload a definition of an API that they would like to make available to others by allowing them to determine who should be able to discover it, define the policies that will protect it, and outline the process for approving its use.

    • API Developer Portal: Enables potential consumers of the APIs to search the portal catalog for APIs that might be related to the data that they need and only view APIs that the provider has made accessible to their role. They can then request immediate access to the APIs and are given a set of credentials to use that are unique to their application so that their usage can be tracked. This portal can be used by all potential consumers of the API, whether within or beyond the enterprise boundary.

    • API Gateway: API consumers call the APIs via the API Gateway. It enforces the policies that are defined by the providers. These include confirming the identity of the consuming application, and a selection of policies such as rate limiting, which outlines the number of requests per second. These policies may be general across all APIs or specific to a particular consumer. For example, there might be different "plans" available that a consumer is able to subscribe to, each offering differing policies.

  • Management console: Centralizes the control and management plane with its own platform UI. All of the integration components mentioned above are available as standalone containerized software that can be installed and managed via the platform UI.

Reference architecture

IBM Cloud accounts can be used for isolation of all cloud resources, administration, and billing, which allows for a flexible deployment model that is flexible and can be tailored to the customer's needs. For example, if you wanted to consume this trade gateway purely as SaaS then the underlying deployment complexity can be abstracted out and managed by IBM. On the other hand, if you want more visibility and control over the deployment and corresponding billing and administration then IBM can provision the necessary resources within the customer's cloud account. The second option gives the customer the ability to pick and choose which components of the gateway solution they want to deploy. These containerized components are depicted by the OpenShift CTG workers in following high-level reference deployment architecture.

High Level Deployment Architecture
High Level Deployment Architecture

The following figure represents a more detailed deployment architecture for the Connected Trade Gateway and surrounding solution components. The diagram represents a single region with multiple availability zones view. The platform can be easily scaled to multiple regions.

Deployment Architecture
Deployment Architecture

This is a reference architecture that follows industry best practices and is pre-validated for regulated industries such as financial services. The architecture can be tailored to fit the customer's requirements.

A VPC gives an enterprise the ability to define and control a virtual network that is logically isolated from all other public cloud tenants, creating a private, secure place on the public cloud.

  • Management VPC: Provides compute, storage, and network services to enable application provider administrators to monitor, operate, and maintain the environment. The intent is to completely isolate management operations from the VPC that is running is consumer workloads. It is distributed across three zones in one multizone region (MZR). Each zone contains two subnets that are protected by different ACLs.

  • Subnets for management tools: The top subnet in each zone is part of the default security group for the VPC. And, each of those subnets contain an arbitrary number of virtual server instances and or RedHat OpenShift workers that use Block Storage for VPC. These instances are where your management tools run. The lower subnets in the image relate to inbound connectivity, which is covered in subsequent sections.

  • Connectivity inbound to VPC: Connectivity from your application provider's enterprise environment to the management VPC is accomplished by using Direct Link or Virtual Private Network (VPN) for VPC.

    Direct Link is the most secure way to enable connectivity from the application provider's on-premises environment to the management VPC. The speed and reliability of Direct Link extends to your organization's data center's network and offers more consistent, higher-throughput connectivity, keeping traffic within the IBM Cloud network.

    When using Direct Link, a private Application Load Balancer for VPC (ALB) is used to distribute traffic among multiple server instances within the same region of your VPC. An IBM Cloud account requires a single Direct Link instance. In the image, there are two Direct Link icons only to make the diagram more readable.

    An alternative connectivity pattern requires use of the VPN for VPC service to securely connect from your private network to the management VPC. VPN for VPX can be used as a static, route-based VPN or a policy-based VPN to set up an IPsec site-to-site tunnel between your VPC and your on-premises private network or another VPC. When using VPN for VPC, you must place the gateway in a subnet, which is shown in the diagram.

    • Bastion host: Regardless of whether you are using Direct Link or VPN for VPC to connect to the management VPC, you need to help ensure that all traffic is routed through a bastion host with session recording. The bastion host solution is depicted in the two rightmost lower subnets in the diagram.
  • Connectivity between VPCs: The management VPC needs to connect to the workload VPC to deploy, configure, and operate the components and workloads that are found in the workload VPC. Transit Gateway is designed specifically for this purpose, and is the means for connecting your management VPC to your workload VPC.

  • Workload VPC: The workload VPC provides compute, storage, and network services to support hosted applications and operations that deliver services to the consumer. Take a closer look at the following components within the VPC.

    • Regions and zones: Just like the management VPC, the workload VPC is spread across three zones. The workload VPC should be created in the same MZR as the management VPC.

    • Connectivity to workload VPC: If the consumer is in the same organization as the application provider, then just like for the management VPC, Direct Link can provide access to the workload VPC. Alternatively, VPN for VPC can be used for site-to-site VPN connectivity.

  • Storage and encryption:

    • Block Storage for VPC: Block Storage for VPC is automatically created for the primary book volume when you create a virtual server. You can also create more data volumes by using Block Storage for VPC within any subnet. By default, all boot and data volumes are encrypted at rest with IBM-managed encryption. There is no additional cost for this service. IBM-managed encryption uses the following industry standard protocols:

      • AES-256 encryption
      • Keys are managed in-house with Key Management Interoperability Protocol (KMIP)

      For all sensitive and consumer-owned data, the application provider should use customer-managed encryption. With this encryption method, you can bring your own customer root key (CRK) to the cloud or have a key management service (KMS) generate a key for you. For IBM Cloud for Financial Services, the supported key management service is Hyper Protect Crypto Services (HPCS). Root keys encrypt volume and custom image passphrases with envelope encryption, a process that encrypts a key with another key.

    • Object Storage: Object Storage is an alternative storage option that is useful for certain use cases, including backup and recovery, data archiving, cloud-native application building, and AI and big data analytics. Object Storage stores encrypted and dispersed data across multiple geographic locations.

    By default, all objects that are stored in Object Storage are encrypted by using randomly generated keys and an all-or-nothing-transform (AONT). While this default encryption model provides at-rest security, financial service workloads need full control over the data encryption keys used. Again, Hyper Protect Crypto Services should be used for this purpose.

Using IBM Cloud services outside of a VPC

With IBM Cloud Virtual Private Endpoint (VPE) for VPC, you can connect to supported IBM Cloud services from your VPC network by using the IP addresses of your choosing, which is allocated from a subnet within your VPC. In the reference architecture diagram, VPEs appear in the middle subnets of the workload VPC.

VPE is an evolution of the private connectivity to IBM Cloud services. VPEs are virtual IP interfaces that are bound to an endpoint gateway created on a per service, or service instance, basis (depending on the service operation model). The endpoint gateway is a virtualized function that scales horizontally, is redundant and highly available, and spans all availability zones of your VPC. Endpoint gateways enable communications from virtual server instances within your VPC and IBM Cloud service on the private backbone. VPE for VPC gives you the experience of controlling all the private addressing within your cloud.

Variation with edge and transit VPC for public internet access

You might want to allow consumers to access your service through the public internet. This base architecture can be adapted to securely enable this type of access via a new edge VPC. The request from the consumer gets routed through a global load balancer, through a web application firewall in the edge VPC, and then to the public application load balancer within the workload VPC.

Design concepts

The Architecture Design Framework provides a consistent approach to design cloud solutions by addressing requirements across a set of "aspects" and "domains", which are technology-agnostic architectural areas that need to be considered for any enterprise solution. See Introduction to the Architecture Design Framework for more details.

Enter image alt text here.
Connected Trade Gateway design requirements

Requirements

The following table outlines the requirements that are addressed in this architecture.

Requirements
Aspect Requirements
Compute
  • Provide properly isolated compute resources with adequate compute capacity for the applications.
Storage
  • Provide storage that meets the application and database performance requirements.
Networking
  • Deploy workloads in an isolated environment and enforce information flow policies.
  • Provide secure, encrypted connectivity to the cloud’s private network for management purposes.
  • Distribute incoming application requests across available compute resources.
  • Support failover of application to an alternative site in the event of planned or unplanned outages.
  • Provide public and private DNS resolution to support the use of hostnames instead of IP addresses.
Security
  • Ensure that all operator actions are executed securely through a bastion host.
  • Protect the boundaries of the application against denial-of-service and application-layer attacks.
  • Encrypt all application data in transit and at rest to protect it from unauthorized disclosure.
  • Encrypt all backup data to protect it from unauthorized disclosure.
  • Encrypt all security data (operational and audit logs) to protect from unauthorized disclosure.
  • Encrypt all data by using customer-managed keys to meet regulatory compliance requirements for additional security and customer control.
  • Protect secrets through their entire lifecycle and secure them using access control measures.
Resiliency
  • Support application availability targets and business continuity policies.
  • Ensure availability of the application in the event of planned and unplanned outages.
  • Provide highly available compute, storage, network, and other cloud services to handle application load and performance requirements.
  • Backup application data to enable recovery in the event of unplanned outages.
  • Provide highly available storage for security data (logs) and backup data.
  • Automate recovery tasks to minimize downtime
Service Management
  • Monitor system and application health metrics and logs to detect issues that might impact the availability of the application.
  • Generate alerts/notifications about issues that might impact the availability of applications to trigger appropriate responses to minimize downtime.
  • Monitor audit logs to track changes and detect potential security problems.
  • Provide a mechanism to identify and send notifications about issues that are found in audit logs.
  • Day-0 automation for consistent and secure infrastructure provisioning and Day-2 operations automation for ease of management

Components

The following table outlines the products or services that are used in the architecture for each aspect.

Components
Aspects Architecture components How the component is used
Compute VPC VSIs Bastion hosts and Redhat Openshift worker nodes are deployed on VSIs
Containers Red Hat Openshift Red Hat OpenShift on IBM Cloud is a managed Kubernetes service to create your own cluster of compute hosts where you can deploy and manage containerized apps on IBM Cloud. Its used to host Connected Trade Gateway software components and ISV apps
Storage VPC Block Storage Block Storage for VPC VSI
Cloud Object Storage Cloud Object Storage Buckets with Object Lock enabled
Networking VPC Virtual Private Network (VPN) Remote access to manage resources in a private network
Transit Gateway Connects across VPCs and source and recovery environments
Virtual Private Gateway & Virtual Private Endpoint (VPE) For private network access to Cloud Services, for example, Key Protect, Cloud Object Storage, and so on.
Public Gateway For resource access to the internet
Security IAM IBM Cloud Identity & Access Management
BYO Bastion Host on VPC VSI Remote access with Privileged Access Management
VPCs, Subnets, Security Groups and ACLS Network isolation and Virtual Air-Gap
Key protect or HPCS Hardware security module (HSM) and Key Management Service
Secrets Manager Certificate and Secrets Management
Context Based Restrictions Enforce access restrictions for service instances based on a rule's criteria
Document Digitization Watsonx Orchestrate Classifies and extracts information from your business documents more quickly, easily and accurately
Resiliency Cloud Object Storage Data archived in Cloud Object Storage cross-region buckets
Backup policy for VPC Use IBM Cloud® Backup for VPC to automatically create backups and manually restore Block Storage for VPC volumes and File Storage for VPC shares from backup snapshots
Portworx Enterprise with Disaster Recovery Disaster Recovery Supports HA across Availability Zones, RPO-zero failover across data centers in a metropolitan area and continuous incremental backups across global data centers.
PX-Backup for Kubernetes Portworx Enterprise is the most widely-used and reliable cloud-native storage solution for production workloads and provides high-availability, data protection, and security for containerized applications
Service Management IBM Cloud Monitoring Apps and operational monitoring
IBM Cloud Logs Apps and operational logs
Activity Tracker Event Routing Audit logs
Schematics Automated deployment that uses Deployable Architecture and Ansible actions