Ubuntu Docker Upgrade Stuck on DB Migration - 1.8.13 to 2.3.10

To be completed by the original poster:

CMS Version

Upgrading from 1.8.13 to 2.3.10

Installation Method

Docker

Operating System

Ubuntu 20.04.2

Issue

Upgraded following instructions at: https://xibo.org.uk/docs/setup/upgrade-xibo-for-docker-install
Command line portion completed without error, but web interface stuck at: “The CMS is temporarily off-line as an upgrade is in progress. Please check with your system administrator for updates or refresh your page in a few minutes.” - and stuck there overnight.

Output from logs:
ecotspm@tracker:/opt/Xibo/xibo-docker$ docker-compose -f cms_custom-ports.yml logs cms-web
Attaching to xibo-docker_cms-web_1
cms-web_1 | Waiting for MySQL to start - max 300 seconds
cms-web_1 | MySQL started
cms-web_1 | Updating settings.php
cms-web_1 | settingId
cms-web_1 | 1
cms-web_1 | Existing Database, checking if we need to upgrade it
cms-web_1 | Phinx by CakePHP - https://phinx.org. 0.9.2
cms-web_1 |
cms-web_1 | using config file .varwwwcmsphinx.php
cms-web_1 | using config parser php
cms-web_1 | using migration paths
cms-web_1 | - /var/www/cms/db/migrations
cms-web_1 | warning no environment specified, defaulting to: production
cms-web_1 | ordering by creation time
cms-web_1 |
cms-web_1 | Status [Migration ID] Started Finished Migration Name
cms-web_1 | ----------------------------------------------------------------------------------
cms-web_1 | up 20180130073838 2021-04-21 17:41:33 2021-04-21 17:41:33 InstallMigration
cms-web_1 | up 20180131113100 2021-04-21 17:41:33 2021-04-21 17:41:33 OldUpgradeStep85Migration
cms-web_1 | up 20180131113853 2021-04-21 17:41:33 2021-04-21 17:41:33 OldUpgradeStep86Migration
cms-web_1 | up 20180131113941 2021-04-21 17:41:33 2021-04-21 17:41:33 OldUpgradeStep87Migration
cms-web_1 | up 20180131113948 2021-04-21 17:41:33 2021-04-21 17:41:33 OldUpgradeStep88Migration
cms-web_1 | up 20180131113952 2021-04-21 17:41:33 2021-04-21 17:41:33 OldUpgradeStep92Migration
cms-web_1 | up 20180131113957 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep120Migration
cms-web_1 | up 20180131114002 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep121Migration
cms-web_1 | up 20180131114007 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep122Migration
cms-web_1 | up 20180131114013 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep123Migration
cms-web_1 | up 20180131114017 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep124Migration
cms-web_1 | up 20180131114021 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep125Migration
cms-web_1 | up 20180131114025 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep126Migration
cms-web_1 | up 20180131114030 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep127Migration
cms-web_1 | up 20180131114050 2021-04-21 17:41:34 2021-04-21 17:41:34 OldUpgradeStep128Migration
cms-web_1 | up 20180131114058 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep129Migration
cms-web_1 | up 20180131114103 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep130Migration
cms-web_1 | up 20180131114107 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep131Migration
cms-web_1 | up 20180131114110 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep132Migration
cms-web_1 | up 20180131114114 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep133Migration
cms-web_1 | up 20180131114118 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep134Migration
cms-web_1 | up 20180131114123 2021-04-21 17:41:35 2021-04-21 17:41:35 OldUpgradeStep135Migration
cms-web_1 | down 20180131122645 OneRegionPerPlaylistMigration
cms-web_1 | down 20180131123038 PlaylistTagsMigration
cms-web_1 | down 20180131123248 WidgetFromToDtMigration
cms-web_1 | down 20180212143336 DaypartSystemEntriesAsRecords
cms-web_1 | down 20180213173846 MailFromNameSettingMigration
cms-web_1 | down 20180219141257 DisplayGroupClosureIndexToNonUnique
cms-web_1 | down 20180223180534 DataSetColumnFilterAndSortOptionsMigration
cms-web_1 | down 20180302182421 WidgetCreatedAndModifiedDtMigration
cms-web_1 | down 20180313085749 MediaTableEditedIdIndexMigration
cms-web_1 | down 20180320154652 PlaylistAddDynamicFilterMigration
cms-web_1 | down 20180327153325 RemoveUserLoggedInMigration
cms-web_1 | down 20180514114415 FixCaseOnHelpTextFieldMigration
cms-web_1 | down 20180515123835 LayoutPublishDraftMigration
cms-web_1 | down 20180529065816 DataSetTruncateFixMigration
cms-web_1 | down 20180529073531 DisplayAsVncLinkMigration
cms-web_1 | down 20180621134013 AddWidgetSyncTaskMigration
cms-web_1 | down 20180621134250 EventLayoutPermissionSettingMigration
cms-web_1 | down 20180906115552 AddForeignKeysToTagsMigration
cms-web_1 | down 20180906115606 AddForeignKeysToPermissionsMigration
cms-web_1 | down 20180906115712 AddForeignKeysToWidgetMediaMigration
cms-web_1 | down 20180906131643 ForgottenPasswordReminderMigration
cms-web_1 | down 20180906131716 DataSetRssMigration
cms-web_1 | down 20181011160130 SimpleSettingsMigration
cms-web_1 | down 20181113173310 RemoveFinanceModuleMigration
cms-web_1 | down 20181113180337 SplitTickerModuleMigration
cms-web_1 | down 20181126113231 Release1812Migration
cms-web_1 | down 20181210092443 RemoveImageUriModuleMigration
cms-web_1 | down 20181212114400 CreatePlayerVersionsTableMigration
cms-web_1 | down 20181217135044 EventSyncMigration
cms-web_1 | down 20190121092556 PlayerUpgradeAndOverrideConfigMigration
cms-web_1 | down 20190125170130 PlayerSoftwareVersionFieldMigration
cms-web_1 | down 20190129103831 AddLinuxDisplayProfileMigration
cms-web_1 | down 20190212112534 AddProofOfPlayStatsDurationAndCountMigration
cms-web_1 | down 20190212115432 AddDefaultTransitionDurationSettingMigration
cms-web_1 | down 20190213160914 AddGlobalStatSettingMigration
cms-web_1 | down 20190213162212 AddHorizontalMenuSettingMigration
cms-web_1 | down 20190214102508 AddLayoutEnableStat
cms-web_1 | down 20190214102516 AddMediaEnableStat
cms-web_1 | down 20190220165703 AddScheduleRecurrenceMonthlyRepeatsOnMigration
cms-web_1 | down 20190227101705 MakeDisplayLicenseColumnUniqueMigration
cms-web_1 | down 20190228120603 AddDynamicCriteriaTagsMigration
cms-web_1 | down 20190301115046 AdjustGenericfileValidExtensionsMigration
cms-web_1 | down 20190315134628 AddBandwidthLimitColumnToDisplaygroupMigration
cms-web_1 | down 20190322162052 AddPublishedDateColumnMigration
cms-web_1 | down 20190326163016 CreateLayoutHistoryTableMigration
cms-web_1 | down 20190328111718 AddCampaignStatMigration
cms-web_1 | down 20190401150256 AddScheduleNowPageMigration
cms-web_1 | down 20190509101525 CreateReportScheduleTableMigration
cms-web_1 | down 20190509102648 CreateSavedReportTableMigration
cms-web_1 | down 20190509113001 AddReportPageMigration
cms-web_1 | down 20190510140126 TwoFactorAuthMigration
cms-web_1 | down 20190514134430 NullableTextFieldsMigration
cms-web_1 | down 20190515094133 AddHtmlDatatypeMigration
cms-web_1 | down 20190515105624 InstallAdditionalStandardModulesMigration
cms-web_1 | down 20190517080033 AddForeignKeysToLktagTablesMigration
cms-web_1 | down 20190521092700 AddReportScheduleTaskMigration
cms-web_1 | down 20190521092930 AddPreviousRunDateReportScheduleMigration
cms-web_1 | down 20190521102635 PlaylistDurationUpdateAtTimestamp
cms-web_1 | down 20190603083836 ChangeStatTableStartEndColumnMigration
cms-web_1 | down 20190610150331 TagsWithValuesMigration
cms-web_1 | down 20190611145607 RemoveOldVersionTableMigration
cms-web_1 | down 20190612140955 DisplayTableDatabaseSchemaAdjustmentsMigration
cms-web_1 | down 20190620112611 MoveTidyStatsToStatsArchiveTaskMigration
cms-web_1 | down 20190620142655 AddPlaylistEnableStatMigration
cms-web_1 | down 20190626091331 WidgetHistoryMigration
cms-web_1 | down 20190626110359 CreateStatTableMigration
cms-web_1 | down 20190628083649 AddStatsMigrationTaskMigration
cms-web_1 | down 20190710213414 AddIsActiveReportScheduleMigration
cms-web_1 | down 20190717101342 NullableCommandValidationStringMigration
cms-web_1 | down 20190719074601 MissingDefaultValueMigration
cms-web_1 | down 20190725115532 AddScheduleReminderTaskMigration
cms-web_1 | down 20190801102042 DisplayProfileCommandLinkFixMigration
cms-web_1 | down 20190801141737 DatasetAddCustomHeadersColumnMigration
cms-web_1 | down 20190801142302 AddDoohUserTypeMigration
cms-web_1 | down 20190802145636 CreateScheduleReminderTableMigration
cms-web_1 | down 20190806144729 AddShowContentFromMigration
cms-web_1 | down 20190823081448 AddImageProcessingTaskMigration
cms-web_1 | down 20190828123735 AddDefaultSettingResizeLimitResizeThresholdMigration
cms-web_1 | down 20190903083314 AddGlobalSettingForCascadePermissionsMigration
cms-web_1 | down 20190905084201 AddSettingForDefaultTransitionTypeMigration
cms-web_1 | down 20190905084642 AddSettingForAutoLayoutPublishMigration
cms-web_1 | down 20190910132520 DisplayMoveCmsMigration
cms-web_1 | down 20190917093141 InterruptLayoutMigration
cms-web_1 | down 20190918090608 AddDefaultSettingQuickChartMigration
cms-web_1 | down 20190919154513 AddNotificationAttachmentFilenameNonUsersMigration
cms-web_1 | down 20190926135518 AddSettingForTransitionAutoApplyToLayoutMigration
cms-web_1 | down 20190926140809 InstallSavedReportsAndSpacerModulesMigration
cms-web_1 | down 20191001092651 AddNotificationOriginalFilenameMigration
cms-web_1 | down 20191022101141 AddCommandEntityToPermissionEntityMigration
cms-web_1 | down 20191024152519 AddScheduleExclusionsTableMigration
cms-web_1 | down 20191122114104 FixDuplicateModuleFilesMigration
cms-web_1 | down 20191126103120 GeoScheduleMigration
cms-web_1 | down 20191126141140 RemoteDataSetCsvSourceMigration
cms-web_1 | down 20191205180116 AddPlaylistDashboardPageUserMigration
cms-web_1 | down 20200107082625 DisplayAddResolutionMigration
cms-web_1 | down 20200115115935 AddReportScheduleMessageMigration
cms-web_1 | down 20200122143630 AddReleasedRequiredFileMigration
cms-web_1 | down 20200122191232 AddCommercialLicenceColumnMigration
cms-web_1 | down 20200129104944 AddEngagementsStatsMigration
cms-web_1 | down 20200130165443 CountdownModuleAddMigration
cms-web_1 |
cms-web_1 | We will upgrade it, take a backup
cms-web_1 | mysqldump: Error: ‘Access denied; you need (at least one of) the PROCESS privilege(s) for this operation’ when trying to dump tablespaces
cms-web_1 | Running database migrations
cms-web_1 | Phinx by CakePHP - https://phinx.org. 0.9.2
cms-web_1 |
cms-web_1 | using config file .varwwwcmsphinx.php
cms-web_1 | using config parser php
cms-web_1 | using migration paths
cms-web_1 | - /var/www/cms/db/migrations
cms-web_1 | warning no environment specified, defaulting to: production
cms-web_1 | using adapter mysql
cms-web_1 | using database cms
cms-web_1 |
cms-web_1 | == 20180131122645 OneRegionPerPlaylistMigration: migrating
cms-web_1 |
cms-web_1 | In PdoAdapter.php line 134:
cms-web_1 |
cms-web_1 | SQLSTATE[42S21]: Column already exists: 1060 Duplicate column name ‘regionI
cms-web_1 | d’
cms-web_1 |
cms-web_1 |
cms-web_1 | migrate [-c|–configuration CONFIGURATION] [-p|–parser PARSER] [-e|–environment ENVIRONMENT] [-t|–target TARGET] [-d|–date DATE] [-x|–dry-run]
cms-web_1 |
cms-web_1 | Importing ca-certs
cms-web_1 | cp: can’t stat ‘/var/www/cms/ca-certs/.pem’: No such file or directory
cms-web_1 | cp: can’t stat '/var/www/cms/ca-certs/
.crt’: No such file or directory
cms-web_1 | WARNING: ca-certificates.crt does not contain exactly one certificate or CRL: skipping
cms-web_1 | Setting up Quickchart
cms-web_1 | Configuring Maintenance
cms-web_1 | Removing web/install/index.php from production container
cms-web_1 | Starting cron
cms-web_1 | Starting webserver
cms-web_1 | AH00558: httpd: Could not reliably determine the server’s fully qualified domain name, using 172.18.0.5. Set the ‘ServerName’ directive globally to suppress this message


Please advise on how I can complete the migration to 2.3.10.

Thanks,
-Eric

Hi !
i have the same issue (except my OS is Ubuntu 16.04) any idea to fix it ?

I have not yet found a solution - I’m hoping I don’t just need to start fresh. Any replies/pointers would be appreciated if anyone can help!

Solved ! After 9 upgrade steps and snapshots (my CMS is on a Proxmox, that’s pretty cool :wink: i thinks upgrade 1.8.7 to 2.3.10 is a too largest jump. So i have processed like that (backup xibo-docker directory before each upgrade):
v:1.8.7
v:1.8.10 (useless)
v:1.8.13 (useless)
v:2.0.2
v:2.1.0
exit code 137 issue : solved with increase RAM + docker container prune -f + upgrade to 2.2.0
v:2.2.0
v:2.3.0
v:2.3.10
mysql:5.6 to 5.7 migration issue : https://blog.xibo.org.uk/2-3-10-released/
see Alex’s reply (bottom)

So, i thinks that’s useless to upgrade like that, you can jump somes versions (tagged useless)

Now CMS 2.3.10 work fine !

Upgrade step:
docker-compose down
cp -rp [path-to-xibo-docker] [path-to-your-directory-backup]-xibo-docker-[version]-backup
download new version :
wget -O xibo-docker.tar.gz https://github.com/xibosignage/xibo-cms/releases/download/[version-release-that-you-need]/xibo-docker.tar.gz
tar --strip-components=1 -zxvf xibo-docker.tar.gz
docker-compose up -d (in your case, do with cms_custom-ports.yml)

Thanks, blop, for the pointer to that issue. I was finally able to circle back around to this project this morning, and was able to work my way through the upgrades. They key detail seems to be doing the linked mysql --skip-grant-tables step BEFORE applying the 2.3.10 upgrade.

This topic was automatically closed 91 days after the last reply. New replies are no longer allowed.