Point-in-time recovery
IBM Cloud® Databases for PostgreSQL supports point-in-time recovery (PITR) to an available recovery point within the last 7 days. PITR restores a backup into a new deployment and replays retained transaction logs to the requested time.
Point-in-time recovery (PITR) for changes made after an in-place major version upgrade (IPMVU) requires a successful backup of the upgraded deployment and the corresponding transaction logs. The service automatically queues the backup to run after the upgrade task completes. Before you rely on PITR for the upgraded deployment, verify that the backup completed successfully. PITR cannot replay transactions across a major version upgrade. For more information, see Backups and recovery for IPMVU.
The Backups and restore tab of your deployment's UI keeps all your PITR information under Point-in-time recovery.
If the requested restore time is later than the last available transaction, the restore operation fails with the message recovery ended before configured recovery target is reached. If your restore fails for this reason, select Restore to last available point or choose an earlier date/time for Restore to a specific point in the last 7 days.
Included information is the earliest time for a PITR. To discover the earliest recovery point through the CLI, use the cdb postgresql earliest-pitr-timestamp command.
ibmcloud cdb postgresql earliest-pitr-timestamp <INSTANCE_NAME_OR_CRN>
To discover the earliest recovery point through the API, use the /deployments/{id}/point_in_time_recovery_data endpoint to find the earliest PITR time.
{
"point_in_time_recovery_data": {
"earliest_point_in_time_recovery_time": "2019-09-09T23:16:00Z"
}
}
Recovery
Backups are restored to a new deployment. After the new deployment finishes provisioning, your data in the backup file is restored into the new deployment. Backups are also restorable across accounts, but only by using the API and only if the user that is running the restore has access to both the source and destination accounts.
By default the new deployment is auto-sized to the same disk and memory allocation as the source deployment at the time of the backup that you are restoring from. Especially in the case of PITR that might not be the current size of your deployment. If you need to adjust the resources that are allocated to the new deployment, use the optional fields in the UI, CLI, or API to resize the new deployment. Be sure to allocate enough for your data and workload, if the deployment is not given enough resources the restore fails.
While storage and memory are restored to the same as the source deployment, specific instance configurations are not automatically set for the new instance. In this case, rerunning the configuration after a restore might be needed. Note any
instance modifications before running the restore (parameters, such as shared_buffers, max_connections, deadlock_timeout, archive_timeout, and others) to ensure accurate setting for the instance
after the restore is complete.
It is important that you do not delete the source deployment while the backup is restoring. You must wait until the new deployment is provisioned and the backup is restored before deleting the old deployment. Deleting a deployment also deletes its backups so not only does the restore fail, you might not be able to recover the backup either.
Recovery in the UI
To initiate a PITR, enter the time that you want to restore back to in Coordinated Universal Time. If you want to restore to the most recent available time, select that option. Clicking the Restore button brings up the new provisioning UI in a tab with the options for your recovery. Enter the service details, allocate resources, and set the database version, encryption and endpoint for your new deployment. Click Point in time recovery to start the process.
If you use Key Protect and have a key, you must use the CLI to recover, and a command is provided for your convenience.
Recovery in the CLI
The Resource controller supports provisioning of database deployments, and provisioning and restoring are the responsibility of the Resource controller CLI. Use the resource service-instance-create command.
For PITR, use the point_in_time_recovery_time and point_in_time_recovery_deployment_id parameters. The point_in_time_recovery_deployment_id is the source deployment's ID and point_in_time_recovery_time is the timestamp in Coordinated Universal Time you want to restore to. To restore to the latest available point-in-time, use "point_in_time_recovery_time":" ".
ibmcloud resource service-instance-create <databases-for-postgresql> <INSTANCE_NAME> <REGION> -p '{"point_in_time_recovery_deployment_id":"DEPLOYMENT_ID", "point_in_time_recovery_time":"TIMESTAMP", "version":" "}'
A pre-formatted command for a specific backup or PITR is available in detailed view of the backup.
When restoring through the CLI, optional parameters are available. Use them to customize resources or use a Key Protect key for BYOK encryption on the new deployment.
ibmcloud resource service-instance-create <databases-for-postgresql> <INSTANCE_NAME> standard <REGION> <--service-endpoints SERVICE_ENDPOINTS_TYPE> -p
'{"point_in_time_recovery_deployment_id":"DEPLOYMENT_ID", "point_in_time_recovery_time":"TIMESTAMP","key_protect_key":"KEY_PROTECT_KEY_CRN", "members_disk_allocation_mb":"DESIRED_DISK_IN_MB", "members_memory_allocation_mb":"DESIRED_MEMORY_IN_MB", "members_cpu_allocation_count":"NUMBER_OF_CORES", "version":" "}'
Recovery in the API
The Resource Controller supports provisioning of database deployments, and provisioning and restoring are the responsibility of the Resource Controller API. You need to complete the necessary steps to use the resource controller API before you can use it to restore from a backup.
Once you have all the information, the create request is a POST to the /resource_instances endpoint.
curl -X POST \
https://resource-controller.cloud.ibm.com/v2/resource_instances \
-H 'Authorization: Bearer <>' \
-H 'Content-Type: application/json' \
-d '{
"name": "<INSTANCE_NAME_OR_CRN>",
"target": "<REGION>",
"resource_group": "<RESOURCE_GROUP>",
"resource_plan_id": "<SERVICE_ID>"
"point_in_time_recovery_time":"<TIMESTAMP>",
"point_in_time_recovery_deployment_id":"<DEPLOYMENT_ID>"
}'
The parameters name, target, resource_group, and resource_plan_id are all required. The target is the region where you want the new deployment to be located, which can be a different
region from the source deployment. Cross region restores are supported, except for restoring a eu-de backup to another region.
For PITR, use the point_in_time_recovery_time and point_in_time_recovery_deployment_id parameters. The point_in_time_recovery_deployment_id is the source deployment's ID and point_in_time_recovery_time is the timestamp in Coordinated Universal Time you want to restore to. To restore to the latest available point-in-time use "point_in_time_recovery_time":" ".
To customize resource allocations or use a Key Protect key, include the applicable parameters and their values in the request body: key_protect_key, members_disk_allocation_mb, members_memory_allocation_mb,
and members_cpu_allocation_count.
Verifying PITR
To verify the correct recovery time, check the database logs. Checking the database logs requires the Logging integration to be set up on your deployment.
When you perform a recovery, your data is restored from the most recent incremental backup. Any outstanding transactions from the WAL log are used to restore your database up to the time you recovered to. After the recovery is finished, and the transactions are run, the logs display a message. You can check that your logs have the message with the following command:
LOG: last completed transaction was at log time 2019-09-03 19:40:48.997696+00
There are two scenarios where recovery does not show up in the logs.
- Your deployment has a recent full backup and there is no activity after the backup was taken that needs to be replayed.
- If you entered a time to recover to that is after the current time or is past latest available point-in-time recovery point.
In both cases the recovery is usually still successful, but there won't be an entry in the logs to check the exact time that the database was restored to.