Why is my app pod stuck in Container creating when trying to mount File Storage for VPC?

When you try to deploy an app that uses File Storage for VPC you see one or more of the following error messages.

Example command to get the ibm-vpc-file-csi driver logs.

kubectl logs ibm-vpc-file-csi-node-xxx -n kube-system -c iks-vpc-file-node-driver

Example output with error message.

ibmcsidriver/node.go:94","msg":"CSINodeServer-NodePublishVolume..."
ibmcsidriver/node.go:160","msg":"CSINodeServer-NodeUnpublishVolume..."

Example describe pod command.

kubectl describe pod ibm-vpc-file-csi-node-xxx -n kube-system -c iks-vpc-file-node-driver

Example output with error message.

Warning FailedMount 68s kubelet MountVolume.SetUp failed for volume "pvc-c37fe511-ec6d-44c1-8c55-1b5e2c21ec5b" : rpc error: code = DeadlineExceeded desc = context deadline exceeded
Warning FailedMount 65s kubelet Unable to attach or mount volumes: unmounted volumes=[test-persistent-storage], unattached volumes=[], failed to process volumes=[]: timed out waiting for the condition

Example command to get the pipelineruns logs.

kubectl logs cat -n pipelineruns

Example output with error message.

Error from server (BadRequest): container "cat" in pod "cat" is waiting to start: ContainerCreating

A temporary network outage might cause file shares to be unreachable and unmountable.

Complete the following steps to resolve the issue.

1. Restart the ibm-vpc-file-csi-node daemonset.

   kubectl rolloutrestart daemonset ibm-vpc-file-csi-node
   

2. Wait a few minutes for the daemonset to restart.

3. Retry your app deployment.

4. Reboot the worker node.

   ibmcloud oc worker reboot -c CLUSTER -w WORKER
   

5. If the issue persists, contact support. Open a support case. In the case details, be sure to include any relevant log files, error messages, or command outputs.