NetApp ONTAP-SAN
Set up NetApp ONTAP-SAN storage for IBM Cloud Satellite® clusters. You can use Satellite storage templates to create storage configurations. When you assign a storage configuration to your clusters, the storage drivers of the selected storage provider are installed in your cluster.
Before you can create storage configurations by using the NetApp NAS template, you must deploy the NetApp Trident template, which installs the required operator.
Before you can deploy storage templates to clusters in your location, make sure you set up Satellite Config by selecting the Enable cluster admin access for Satellite Config option in the console or including the --enable-config-admin
option when you create your cluster.
You cannot scope Satellite storage service to resource groups. However, if you are scoping other resources such as location and cluster to resource groups, you need to add Satellite reader and link administrator role for all resources in the account.
Prerequisites for NetApp ONTAP-SAN storage
Review the following prerequisites before you deploy the NetApp ONTAP-SAN drivers to your Satellite clusters.
-
You must configure your backend ONTAP cluster as a Trident backend.
-
You must have a dedicated Storage Virtual Machine (SVM) for Trident. Volumes and LUNs that are created by Trident are created in this SVM.
-
You must have one or more aggregates assigned to the SVM. You can add aggregates by running the
netapp1::> vserver modify -vs <svm_name> -aggr-list <aggregate(s)_to_be_added>
command. -
You must have one or more
dataLIFs
for the SVM. -
You must have iSCSI services enabled on the SVM.
-
You must set up a snapshot policy on the SVM.
-
- Make sure that you select the Enable cluster admin access for Satellite Config option when you create the cluster. If you don't enable Administrator (admin) access for Satellite Config when creating your cluster, you must re-create your cluster and enable admin access before you can deploy storage.
- Your cluster must meet the requirements for ONTAP-SAN. For more information, see the NetApp documentation.
- Your hosts must meet the Satellite host requirements in addition to the requirements for ONTAP-SAN.
Creating and assigning a configuration in the console
-
Review the parameter reference.
-
From the Locations console, select the location where you want to create a storage configuration.
-
Select Storage > Create storage configuration
-
Enter a name for your configuration.
-
Select the Storage type.
-
Select the Version and click Next
-
If the Storage type that you selected accepts custom parameters, enter them on the Parameters tab.
-
If the Storage type that you selected requires secrets, enter them on the Secrets tab.
-
On the Storage classes tab, review the storage classes that are deployed by the configuration or create a custom storage class.
-
On the Assign to service tab, select the service that you want to assign your configuration to.
-
Click Complete to assign your storage configuration.
Creating a configuration in the CLI
-
Review the parameter reference for the template version that you want to use.
-
Log in to the IBM Cloud CLI.
ibmcloud login
-
List your Satellite locations and note the
Managed from
column.ibmcloud sat location ls
-
Target the
Managed from
region of your Satellite location. For example, forwdc
targetus-east
. For more information, see Satellite regions.ibmcloud target -r us-east
-
If you use a resource group other than
default
, target it.ibmcloud target -g <resource-group>
-
Copy one of the following example command for the template version that you want to use. For more information about the command, see
ibmcloud sat storage config create
in the command reference.Example command to create a version 22.04 configuration.
ibmcloud sat storage config create --location LOCATION --name NAME --template-name netapp-ontap-san --template-version 22.04 --param "managementLIF=MANAGEMENTLIF" --param "dataLIF=DATALIF" --param "svm=SVM" --param "username=USERNAME" --param "password=PASSWORD" --param "limitVolumeSize=LIMITVOLUMESIZE" --param "limitAggregateUsage=LIMITAGGREGATEUSAGE"
Example command to create a version 22.10 configuration.
ibmcloud sat storage config create --location LOCATION --name NAME --template-name netapp-ontap-san --template-version 22.10 --param "managementLIF=MANAGEMENTLIF" --param "dataLIF=DATALIF" --param "svm=SVM" --param "username=USERNAME" --param "password=PASSWORD" --param "limitVolumeSize=LIMITVOLUMESIZE" --param "limitAggregateUsage=LIMITAGGREGATEUSAGE"
Example command to create a version 24.02 configuration.
ibmcloud sat storage config create --location LOCATION --name NAME --template-name netapp-ontap-san --template-version 24.02 --param "managementLIF=MANAGEMENTLIF" --param "dataLIF=DATALIF" --param "svm=SVM" --param "username=USERNAME" --param "password=PASSWORD" --param "limitVolumeSize=LIMITVOLUMESIZE" --param "limitAggregateUsage=LIMITAGGREGATEUSAGE"
-
Customize the command based on the settings that you want to use.
-
Run the command to create a configuration.
-
Verify your configuration was created.
ibmcloud sat storage config get --config CONFIG
Creating a configuration in the API
-
Generate an API key, then request a refresh token. For more information, see Generating an IBM Cloud IAM token by using an API key.
-
Review the parameter reference for the template version that you want to use.
-
Copy one of the following example requests and replace the variables that you want to use.
Example request to create a version 22.04 configuration.
curl -X POST "https://containers.cloud.ibm.com/global/v2/storage/satellite/createStorageConfigurationByController" -H "accept: application/json" -H "Authorization: TOKEN" -H "Content-Type: application/json" -d "{ \"config-name\": \"string\", \"controller\": \"string\", \"storage-class-parameters\": [ { \"additionalProp1\": \"string\", \"additionalProp2\": \"string\", \"additionalProp3\": \"string\" } ], \"storage-template-name\": \"netapp-ontap-san\", \"storage-template-version\": \"22.04\", \"update-assignments\": true, \"user-config-parameters\": { \"entry.name\": \"MANAGEMENTLIF\", { \"entry.name\": \"DATALIF\", { \"entry.name\": \"SVM\", { \"entry.name\": \"LIMITVOLUMESIZE\", { \"entry.name\": \"LIMITAGGREGATEUSAGE\",\"user-secret-parameters\": { \"entry.name\": \"USERNAME\",{ \"entry.name\": \"PASSWORD\",}
Example request to create a version 22.10 configuration.
curl -X POST "https://containers.cloud.ibm.com/global/v2/storage/satellite/createStorageConfigurationByController" -H "accept: application/json" -H "Authorization: TOKEN" -H "Content-Type: application/json" -d "{ \"config-name\": \"string\", \"controller\": \"string\", \"storage-class-parameters\": [ { \"additionalProp1\": \"string\", \"additionalProp2\": \"string\", \"additionalProp3\": \"string\" } ], \"storage-template-name\": \"netapp-ontap-san\", \"storage-template-version\": \"22.10\", \"update-assignments\": true, \"user-config-parameters\": { \"entry.name\": \"MANAGEMENTLIF\", { \"entry.name\": \"DATALIF\", { \"entry.name\": \"SVM\", { \"entry.name\": \"LIMITVOLUMESIZE\", { \"entry.name\": \"LIMITAGGREGATEUSAGE\",\"user-secret-parameters\": { \"entry.name\": \"USERNAME\",{ \"entry.name\": \"PASSWORD\",}
Example request to create a version 24.02 configuration.
curl -X POST "https://containers.cloud.ibm.com/global/v2/storage/satellite/createStorageConfigurationByController" -H "accept: application/json" -H "Authorization: TOKEN" -H "Content-Type: application/json" -d "{ \"config-name\": \"string\", \"controller\": \"string\", \"storage-class-parameters\": [ { \"additionalProp1\": \"string\", \"additionalProp2\": \"string\", \"additionalProp3\": \"string\" } ], \"storage-template-name\": \"netapp-ontap-san\", \"storage-template-version\": \"24.02\", \"update-assignments\": true, \"user-config-parameters\": { \"entry.name\": \"MANAGEMENTLIF\", { \"entry.name\": \"DATALIF\", { \"entry.name\": \"SVM\", { \"entry.name\": \"LIMITVOLUMESIZE\", { \"entry.name\": \"LIMITAGGREGATEUSAGE\",\"user-secret-parameters\": { \"entry.name\": \"USERNAME\",{ \"entry.name\": \"PASSWORD\",}
Creating an assignment in the CLI
-
List your storage configurations and make a note of the storage configuration that you want to assign to your clusters.
ibmcloud sat storage config ls
-
Get the ID of the cluster, cluster group, or service that you want to assign storage to.
To make sure that your cluster is registered with Satellite Config or to create groups, see Setting up clusters to use with Satellite Config.
Example command to list cluster groups.
ibmcloud sat group ls
Example command to list clusters.
ibmcloud oc cluster ls --provider satellite
Example command to list Satellite services.
ibmcloud sat service ls --location <location>
-
Assign your storage configuration to the cluster, group, or service that you retrieved earlier. For more information, see the
ibmcloud sat storage assignment create
command.Example command to assign a configuration to a cluster group.
ibmcloud sat storage assignment create --group GROUP --config CONFIG --name NAME
Example command to assign a configuration to a cluster.
ibmcloud sat storage assignment create --cluster CLUSTER --config CONFIG --name NAME
Example command to assign a configuration to a service cluster.
ibmcloud sat storage assignment create --service-cluster-id CLUSTER --config CONFIG --name NAME
-
Verify that your assignment is created.
ibmcloud sat storage assignment ls (--cluster CLUSTER | --config CONFIG | --location LOCATION | --service-cluster-id CLUSTER)
Creating a storage assignment in the API
-
Copy one of the following example requests.
Example request to assign a configuration to a cluster.
curl -X POST "https://containers.cloud.ibm.com/global/v2/storage/satellite/createAssignmentByCluster" -H "accept: application/json" -H "Authorization: Bearer TOKEN" -H "Content-Type: application/json" -d "{ \"channelName\": \"CONFIGURATION-NAME\", \"cluster\": \"CLUSTER-ID\", \"controller\": \"LOCATION-ID\", \"name\": \"ASSIGNMENT-NAME\"}"
Example request to assign configuration to a cluster group.
curl -X POST "https://containers.cloud.ibm.com/global/v2/storage/satellite/createAssignment" -H "accept: application/json" -H "Authorization: Bearer TOKEN" -H "Content-Type: application/json" -d "{ \"channelName\": \"CONFIGURATION-NAME\", \"cluster\": \"string\", \"groups\": [ \"CLUSTER-GROUP\" ], \"name\": \"ASSIGNMENT-NAME\"}"
-
Replace the variables with your details and run the request.
-
Verify the assignment was created by listing your assignments.
curl -X GET "https://containers.cloud.ibm.com/global/v2/storage/satellite/getAssignments" -H "accept: application/json" -H "Authorization: Bearer TOKEN"
Updating storage assignments in the console
You can use the Satellite console to apply the latest patch updates to your assignments.
-
From the Locations page in the Satellite console, select your location.
-
Click the Storage tab to view your configurations.
-
Click the configuration you want to update.
-
Click information Information (i) icon to apply the latest revision or patch.
-
Optional: Enable automatic patch updates for your storage assignment. Enabling automatic patch updates ensures that your assignment always has the latest security fixes.
If you enable automatic patch updates, you must still apply major updates manually.
Manually upgrading assignments in the CLI
Upgrade an assignment to use the latest storage template revision.
-
List your Satellite storage assignments, make a note of the Satellite assignment you want to upgrade.
ibmcloud sat storage assignment ls
-
List the Satellite storage templates to see the latest available versions.
ibmcloud sat storage template ls
-
Upgrade the Satellite assignment.
Example command to upgrade an assignment.
ibmcloud sat storage assignment upgrade --assignment ASSIGNMENT
Enabling automatic patch updates for configurations and assignments in the CLI
You can use the sat storage assignment autopatch enable
CLI to enable automatic patch updates for your assignments. Enabling automatic patch updates applies the latest storage template revisions (patches) automatically. You must
still apply major updates manually.
-
List your Satellite storage configurations. Make a note of the configuration ID.
ibmcloud sat storage assignment ls
-
Run one of the following example commands to enable automatic patch updates for your configuration and its associated assignments. Enter the configuration ID that you retrieved in the previous step.
Example command to enable automatic patch updates for an assignment.
ibmcloud sat storage assignment autopatch enable --config CONFIG (--all | --assignment ASSIGNMENT-ID [--assignment ASSIGNMENT-ID])
Example command to enable automatic patch updates for all storage assignments under a given configuration.
ibmcloud sat storage assignment autopatch enable --config CONFIG --all
Example command to disable automatic patch updates for all assignments under a specific configuration.
ibmcloud sat storage assignment autopatch disable --config CONFIG --all
Example command to disable automatic patch updates for an single assignment and a specific configuration.
ibmcloud sat storage assignment autopatch disable --config CONFIG --assignment ASSIGNMENT-ID
Example command to disable automatic patch updates for an multiple assignment and a specific configuration.
ibmcloud sat storage assignment autopatch disable --config CONFIG --assignment ASSIGNMENT-ID --assignment ASSIGNMENT-ID
Upgrading a configuration and assignments in the API
You can use the /v2/storage/satellite/updateAssignment
API to update your assignments with new clusters
or cluster groups. Set updateConfigVersion
to true
to apply the revision update.
-
Copy the following example request and replace the variables for the cluster groups and assignments that you want to update.
curl -X PATCH "https://containers.cloud.ibm.com/global/v2/storage/satellite/updateAssignment" -H "accept: application/json" -H "Authorization: Bearer TOKEN" -H "Content-Type: application/json" -d "{ \"groups\": [ \"CLUSTER-GROUPS\" ], \"name\": \"ASSIGNMENT-NAME\", \"updateConfigVersion\": true, \"uuid\": \"ASSIGNMENT-ID\"}"
-
Run the request.
-
Get the details of you assignment to verify the update.
curl -X GET "https://containers.cloud.ibm.com/global/v2/storage/satellite/getAssignment?uuid=ASSIGNMENT-ID" -H "accept: application/json" -H "Authorization: Bearer TOKEN"
Enabling automatic patch updates for assignments in the API
You can use the /v2/storage/satellite/setAssignmentAutoupgrade
API to enable automatic patch updates for your assignments. Enabling automatic patch updates applies the latest storage template revisions (patches) automatically. You
must still apply major updates manually.
-
Copy the following example request and replace the variables for the cluster groups and assignments that you want to update.
curl -X PATCH "https://containers.cloud.ibm.com/global/v2/storage/satellite/setAssignmentAutoupgrade" -H "accept: application/json" -H "Authorization: Bearer TOKEN" -H "Content-Type: application/json" -d { "config": "string", "controller": "string", "autopatch": boolean,"assignment" : { "all": boolean, "uuid": ["string", "string", ...], } }
-
Run the request.
-
Get the details of you assignment to verify the upgrade.
curl -X GET "https://containers.cloud.ibm.com/global/v2/storage/satellite/getAssignment?uuid=ASSIGNMENT-ID" -H "accept: application/json" -H "Authorization: Bearer TOKEN"
Parameter reference
22.04 parameter reference
Display name | CLI option | Type | Description | Required? | Default value |
---|---|---|---|---|---|
Management LIF | managementLIF |
Config | The IP address of the Management LIF. | true | N/A |
Data LIF | dataLIF |
Config | The IP address of the Data LIF. | true | N/A |
SVM | svm |
Config | The name of the SVM. | true | N/A |
User Name | username |
Secret | The username to connect to the storage device. | true | N/A |
User Password | password |
Secret | The password to connect to the storage device. | true | N/A |
Limit Volume Size | limitVolumeSize |
Config | The maximum volume size (in Gibibytes) that can be requested and the qtree parent volume size. | true | 50Gi |
Limit AggregateUsage | limitAggregateUsage |
Config | Provisioning fails if usage is greater than this percentage. | true | 80% |
22.10 parameter reference
Display name | CLI option | Type | Description | Required? | Default value |
---|---|---|---|---|---|
Management LIF | managementLIF |
Config | The IP address of the Management LIF. | true | N/A |
Data LIF | dataLIF |
Config | The IP address of the Data LIF. | true | N/A |
SVM | svm |
Config | The name of the SVM. | true | N/A |
User Name | username |
Secret | The username to connect to the storage device. | true | N/A |
User Password | password |
Secret | The password to connect to the storage device. | true | N/A |
Limit Volume Size | limitVolumeSize |
Config | The maximum volume size (in Gibibytes) that can be requested and the qtree parent volume size. | true | 50Gi |
Limit AggregateUsage | limitAggregateUsage |
Config | Provisioning fails if usage is greater than this percentage. | true | 80% |
24.02 parameter reference
Display name | CLI option | Type | Description | Required? | Default value |
---|---|---|---|---|---|
Management LIF | managementLIF |
Config | The IP address of the Management LIF. | true | N/A |
Data LIF | dataLIF |
Config | The IP address of the Data LIF. | true | N/A |
SVM | svm |
Config | The name of the SVM. | true | N/A |
User Name | username |
Secret | The username to connect to the storage device. | true | N/A |
User Password | password |
Secret | The password to connect to the storage device. | true | N/A |
Limit Volume Size | limitVolumeSize |
Config | The maximum volume size (in Gibibytes) that can be requested and the qtree parent volume size. | true | 50Gi |
Limit AggregateUsage | limitAggregateUsage |
Config | Provisioning fails if usage is greater than this percentage. | true | 80% |
Storage class reference for NetApp ONTAP-SAN
Before you deploy apps that use the sat-netapp
storage classes, review the following notes.
By default, the sat-netapp-file-gold
storage class doesn't include any QoS limits (unlimited IOPS).
To use the sat-netapp-file-silver
and sat-netapp-file-bronze
storage classes, you must create corresponding silver
and bronze
QoS policy groups on the storage controller and define the QoS
limits. To create a policy group on the storage system, log in to the system CLI and run the netapp1::> qos policy-group create -policy-group <policy_group_name> -vserver <svm_name> [-min-throughput <min_IOPS>] -max-throughput <max_IOPS>
command.
The min-throughput options is supported only on all-flash systems. For more information about creating and managing QoS Policy groups, see the ONTAP 9 Storage Management documentation.
To use an encrypted storage class, NetApp Volume Encryption (NVE) must be enabled on your storage system by using either the NetApp ONTAP onboard key manager or a supported (off-box) third-party key manager, such as IBM 's TKLM
key manager. To enable the onboard key manager, run the netapp1::> security key-manager onboard enable
command. For more information about configuring encryption, see the ONTAP 9 Security and Data Encryption documentation.
Review the Satellite storage classes for NetApp ONTAP-SAN. You can describe storage classes in the command line with the oc describe sc <storage-class-name>
command.
Storage class name | Type | File system | IOPs | Encryption | Reclaim policy |
---|---|---|---|---|---|
sat-netapp-block-gold Default |
ONTAP-SAN | ext4 | no QoS limits. | Encryption disabled. | Delete |
sat-netapp-block-gold-encrypted |
ONTAP-SAN | ext4 | no QoS limits. | Encryption enabled. | Delete |
sat-netapp-block-silver |
ONTAP-SAN | ext4 | User-defined QoS limit. | Encryption disabled. | Delete |
sat-netapp-block-silver-encrypted |
ONTAP-SAN | ext4 | User-defined QoS limit. | Encryption enabled. | Delete |
sat-netapp-block-bronze |
ONTAP-SAN | ext4 | User defined QoS limit. | Encryption disabled. | Delete |
sat-netapp-block-bronze-encrypted |
ONTAP-SAN | ext4 | User-defined QoS limit. | Encryption enabled. | Delete |
Getting help and support for NetApp ONTAP-SAN
If you run into an issue with NetApp Trident, you can visit the NetApp support page.