Issue
- Under certain circumstances, a new deployment fails with a timeout message around the 30 minute mark:
- The error always includes the
backupservice failing to deploy:
Deployment timed out for
backup liferaycloud/backup:4.2.1
- Other services may or may not also have a failed deployment state, but
backupis always one of them.
Environment
- Liferay Cloud
- Liferay PaaS
Resolution
- The reason for a deployment timeout that includes the
backupservice may be related to a currently running backup operation (backup creation or backup upload). - You can check if there's a backup operation currently running by checking the logs of the
backupservice:
Jul 12 13:13:00.816 build-1418 [backup-7df55665b7-gxwlf] [INFO] 16.89 GiB uploaded for mnglojjnwbzxslmsxc/volume/dxpcloud-mnglojjnwbzxslmsxc-202207121558.tgz
- During this operation, the previous
backupinstance will refuse to termine until the upload is complete. New instances will fail to start up because the old instance is still running, and the deployment will time out. - The solution for this is issue is either:
- Wait for the running backup operation to complete, and then deploy the new services:
Jul 12 13:18:00.817 build-1418 [backup-7df55665b7-gxwlf] [INFO] 24.96 GiB uploaded for mnglojjnwbzxslmsxc/volume/dxpcloud-mnglojjnwbzxslmsxc-202207121558.tgz
Jul 12 13:18:29.324 build-1418 [backup-7df55665b7-gxwlf] [INFO] Volume backup succeeded: mnglojjnwbzxslmsxc/volume/dxpcloud-mnglojjnwbzxslmsxc-202207121558.tgz
Jul 12 13:18:29.324 build-1418 [backup-7df55665b7-gxwlf] [INFO] Backup completed: dxpcloud-mnglojjnwbzxslmsxc-202207121558
<From this point on you can deploy new services>
-
- Create and deploy a new build that doesn't include a deployment for the
backupservice.
- Create and deploy a new build that doesn't include a deployment for the
Additional Information