Edge environments for AI, IoT, and machine learning
Create a Satellite location with Red Hat OpenShift clusters at the edge near your IoT devices to access IBM Cloud AI and machine learning services wherever your data lives.
Solving common edge workload challenges with IBM Cloud
Address edge workload challenges like model training and inferencing by using IBM Cloud services where your edge workloads run.
- Training a machine learning model
- Training your machine learning model typically involves significant compute resources for memory, graphics processing unit (GPU), and storage. Instead of installing and managing training model software onto your compute infrastructure, you can add the compute infrastructure to a Satellite location. Then, you can access IBM Cloud Pak® for Data, which includes tools such as Watson Studio and IBM Watson® Machine Learning for data analysis and model training. By accessing these tools as cloud services, you simplify the installation and management of the software. You also can use these same cloud services across all your edge infrastructure, no matter the underlying infrastructure provider.
- Model inferencing
- Model inferencing is the task of using a trained model to make predictions, detect anomalies, and categorize data from your edge environment. Because of memory, storage, and latency requirements, model inferencing is most effectively run as near to your IoT sensors and other data sources as possible. You can create a Satellite location with managed Red Hat OpenShift clusters where your data is located in your edge environments. Then, you can set up a serverless programming model such as Red Hat™ OpenShift™ Serverless™ to provide a simplified programming model with a Representational State Transfer (REST) interface to query your trained model to produce a prediction.
Setting up your edge solution with Satellite
Use Satellite to provide a consistent, scalable experience across your edge environments.
- Set up machine learning and model training for your data.
- Deploy Satellite with a serverless component to your edge environment.
- Run model inferencing at the edge.
Step 1: Set up machine learning and model training for your data
Prepare edge data with Watson Studio and Machine Learning in IBM Cloud or IBM Cloud Pak for Data before deploying your model.
- Upload the training data to IBM Cloud Object Storage.
- Use Watson Studio and Machine Learning to pull the training data from IBM Cloud Object Storage, analyze the data, and train a model with TensorFlow, Keras, SciKit-Learn, or another popular machine learning algorithm.
The trained model is saved back to IBM Cloud Object Storage, so that the data does not take up storage space in your edge environment.
Step 2: Deploy Satellite with a serverless component to your edge environment
As the edge environment system administrator, you enable a serverless tool to simplify model inferencing at the edge.
- Create a Satellite location on your edge computing infrastructure.
- Create a managed Red Hat OpenShift cluster in the Satellite location.
- Access the Red Hat OpenShift web console.
- Using the OperatorHub, install the Red Hat OpenShift Serverless operator.
- Install the Knative Serving Operator.
You deployed Satellite with a serverless component.
Step 3: Run model inferencing at the edge
As the AI developer, run model inferencing on your edge data by using the serverless processing that the edge administrator set up.
- Download the trained model from IBM Cloud Object Storage to your local development environment.
- Create a Knative-compliant container image.
- Deploy the image to your Red Hat OpenShift Serverless processor that
runs in your Satellite cluster. You can use the Red Hat OpenShift web console in the developer perspective, or use the
kncommand line tool for Satellite Serverless.
Now, you have a managed Satellite location that runs on your edge environment and performs on demand model inferencing for your edge data through your AI-trained model and Red Hat OpenShift Serverless.