Upgrading from 2.3.7 to 3.0.4 - Access denied and SQLSTATE[42S21]: Column already exists: 1060 Duplicate column name 'ownerId

Hello all,
my goal is to migrate an existing installation running 2.3.7 to Version 3.0.4. I am working with a new hosting machine to keep my production system unchanged until it works.
My new installation is running Docker Desktop 4.3.0 on Windows 10 21H2.
I was able to “copy” the existing installation to the new machine without any problems. Now I have tried the upgrade to 3.0.4, but it looks like there is an issue with migrating the database.

Here is the mysql log:
cms-web_1 | Waiting for MySQL to start - max 300 seconds
cms-web_1 | MySQL started
cms-web_1 | Updating settings.php
cms-web_1 | settingId
cms-web_1 | 1
cms-web_1 | Existing Database, checking if we need to upgrade it
cms-web_1 | Phinx by CakePHP - https://phinx.org. 0.9.2
cms-web_1 |
cms-web_1 | using config file .varwwwcmsphinx.php
cms-web_1 | using config parser php
cms-web_1 | using migration paths
cms-web_1 | - /var/www/cms/db/migrations
cms-web_1 | warning no environment specified, defaulting to: production
cms-web_1 | ordering by creation time
cms-web_1 |
cms-web_1 | Status [Migration ID] Started Finished Migration Name
cms-web_1 | ----------------------------------------------------------------------------------
cms-web_1 | up 20180130073838 2019-05-17 12:21:35 2019-05-17 12:22:05 InstallMigration
cms-web_1 | up 20180131113100 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep85Migration
cms-web_1 | up 20180131113853 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep86Migration
cms-web_1 | up 20180131113941 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep87Migration
cms-web_1 | up 20180131113948 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep88Migration
cms-web_1 | up 20180131113952 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep92Migration
cms-web_1 | up 20180131113957 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep120Migration
cms-web_1 | up 20180131114002 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep121Migration
cms-web_1 | up 20180131114007 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep122Migration
cms-web_1 | up 20180131114013 2019-05-17 12:22:05 2019-05-17 12:22:05 OldUpgradeStep123Migration
cms-web_1 | up 20180131114017 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep124Migration
cms-web_1 | up 20180131114021 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep125Migration
cms-web_1 | up 20180131114025 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep126Migration
cms-web_1 | up 20180131114030 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep127Migration
cms-web_1 | up 20180131114050 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep128Migration
cms-web_1 | up 20180131114058 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep129Migration
cms-web_1 | up 20180131114103 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep130Migration
cms-web_1 | up 20180131114107 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep131Migration
cms-web_1 | up 20180131114110 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep132Migration
cms-web_1 | up 20180131114114 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep133Migration
cms-web_1 | up 20180131114118 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep134Migration
cms-web_1 | up 20180131114123 2019-05-17 12:22:06 2019-05-17 12:22:06 OldUpgradeStep135Migration
cms-web_1 | up 20180131122645 2019-05-17 12:22:06 2019-05-17 12:22:10 OneRegionPerPlaylistMigration
cms-web_1 | up 20180131123038 2019-05-17 12:22:10 2019-05-17 12:22:10 PlaylistTagsMigration
cms-web_1 | up 20180131123248 2019-05-17 12:22:10 2019-05-17 12:22:12 WidgetFromToDtMigration
cms-web_1 | up 20180212143336 2019-05-17 12:22:12 2019-05-17 12:22:14 DaypartSystemEntriesAsRecords
cms-web_1 | up 20180213173846 2019-05-17 12:22:14 2019-05-17 12:22:14 MailFromNameSettingMigration
cms-web_1 | up 20180219141257 2019-05-17 12:22:14 2019-05-17 12:22:15 DisplayGroupClosureIndexToNonUnique
cms-web_1 | up 20180223180534 2019-05-17 12:22:15 2019-05-17 12:22:16 DataSetColumnFilterAndSortOptionsMigration
cms-web_1 | up 20180302182421 2019-05-17 12:22:16 2019-05-17 12:22:18 WidgetCreatedAndModifiedDtMigration
cms-web_1 | up 20180313085749 2019-05-17 12:22:18 2019-05-17 12:22:18 MediaTableEditedIdIndexMigration
cms-web_1 | up 20180320154652 2019-05-17 12:22:18 2019-05-17 12:22:20 PlaylistAddDynamicFilterMigration
cms-web_1 | up 20180327153325 2019-05-17 12:22:20 2019-05-17 12:22:21 RemoveUserLoggedInMigration
cms-web_1 | up 20180514114415 2019-05-17 12:22:21 2019-05-17 12:22:21 FixCaseOnHelpTextFieldMigration
cms-web_1 | up 20180515123835 2019-05-17 12:22:21 2019-05-17 12:22:23 LayoutPublishDraftMigration
cms-web_1 | up 20180529065816 2019-05-17 12:22:23 2019-05-17 12:22:25 DataSetTruncateFixMigration
cms-web_1 | up 20180529073531 2019-05-17 12:22:25 2019-05-17 12:22:25 DisplayAsVncLinkMigration
cms-web_1 | up 20180621134013 2019-05-17 12:22:25 2019-05-17 12:22:25 AddWidgetSyncTaskMigration
cms-web_1 | up 20180621134250 2019-05-17 12:22:25 2019-05-17 12:22:25 EventLayoutPermissionSettingMigration
cms-web_1 | up 20180906115552 2019-05-17 12:22:25 2019-05-17 12:22:25 AddForeignKeysToTagsMigration
cms-web_1 | up 20180906115606 2019-05-17 12:22:25 2019-05-17 12:22:27 AddForeignKeysToPermissionsMigration
cms-web_1 | up 20180906115712 2019-05-17 12:22:27 2019-05-17 12:22:27 AddForeignKeysToWidgetMediaMigration
cms-web_1 | up 20180906131643 2019-05-17 12:22:27 2019-05-17 12:22:27 ForgottenPasswordReminderMigration
cms-web_1 | up 20180906131716 2019-05-17 12:22:27 2019-05-17 12:22:28 DataSetRssMigration
cms-web_1 | up 20181011160130 2019-05-17 12:22:28 2019-05-17 12:22:32 SimpleSettingsMigration
cms-web_1 | up 20181113173310 2019-05-17 12:22:32 2019-05-17 12:22:32 RemoveFinanceModuleMigration
cms-web_1 | up 20181113180337 2019-05-17 12:22:32 2019-05-17 12:22:32 SplitTickerModuleMigration
cms-web_1 | up 20181126113231 2019-05-17 12:22:32 2019-05-17 12:22:32 Release1812Migration
cms-web_1 | up 20181210092443 2019-05-17 12:22:32 2019-05-17 12:22:33 RemoveImageUriModuleMigration
cms-web_1 | up 20181212114400 2019-05-17 12:22:33 2019-05-17 12:22:33 CreatePlayerVersionsTableMigration
cms-web_1 | up 20181217135044 2019-05-17 12:22:33 2019-05-17 12:22:34 EventSyncMigration
cms-web_1 | up 20190121092556 2019-05-17 12:22:34 2019-05-17 12:22:35 PlayerUpgradeAndOverrideConfigMigration
cms-web_1 | up 20190125170130 2019-05-17 12:22:35 2019-05-17 12:22:36 PlayerSoftwareVersionFieldMigration
cms-web_1 | up 20190129103831 2019-05-17 12:22:36 2019-05-17 12:22:36 AddLinuxDisplayProfileMigration
cms-web_1 | up 20190212112534 2019-10-14 12:38:55 2019-10-14 12:38:55 AddProofOfPlayStatsDurationAndCountMigration
cms-web_1 | up 20190212115432 2019-05-17 12:22:36 2019-05-17 12:22:36 AddDefaultTransitionDurationSettingMigration
cms-web_1 | up 20190213160914 2019-10-14 12:38:55 2019-10-14 12:38:55 AddGlobalStatSettingMigration
cms-web_1 | up 20190213162212 2019-05-17 12:22:36 2019-05-17 12:22:36 AddHorizontalMenuSettingMigration
cms-web_1 | up 20190214102508 2019-10-14 12:38:55 2019-10-14 12:38:56 AddLayoutEnableStat
cms-web_1 | up 20190214102516 2019-10-14 12:38:56 2019-10-14 12:38:57 AddMediaEnableStat
cms-web_1 | up 20190220165703 2019-05-17 12:22:36 2019-05-17 12:22:37 AddScheduleRecurrenceMonthlyRepeatsOnMigration
cms-web_1 | up 20190227101705 2019-05-17 12:22:37 2019-05-17 12:22:37 MakeDisplayLicenseColumnUniqueMigration
cms-web_1 | up 20190228120603 2019-05-17 12:22:37 2019-05-17 12:22:37 AddDynamicCriteriaTagsMigration
cms-web_1 | up 20190301115046 2019-05-17 12:22:37 2019-05-17 12:22:38 AdjustGenericfileValidExtensionsMigration
cms-web_1 | up 20190315134628 2019-10-14 12:38:57 2019-10-14 12:38:58 AddBandwidthLimitColumnToDisplaygroupMigration
cms-web_1 | up 20190322162052 2019-10-14 12:38:58 2019-10-14 12:38:59 AddPublishedDateColumnMigration
cms-web_1 | up 20190326163016 2019-10-14 12:38:59 2019-10-14 12:39:00 CreateLayoutHistoryTableMigration
cms-web_1 | up 20190328111718 2019-10-14 12:39:00 2019-10-14 12:39:00 AddCampaignStatMigration
cms-web_1 | up 20190401150256 2019-10-14 12:39:00 2019-10-14 12:39:00 AddScheduleNowPageMigration
cms-web_1 | up 20190509101525 2019-10-14 12:39:00 2019-10-14 12:39:00 CreateReportScheduleTableMigration
cms-web_1 | up 20190509102648 2019-10-14 12:39:00 2019-10-14 12:39:01 CreateSavedReportTableMigration
cms-web_1 | up 20190509113001 2019-10-14 12:39:01 2019-10-14 12:39:01 AddReportPageMigration
cms-web_1 | up 20190510140126 2019-10-14 12:39:01 2019-10-14 12:39:03 TwoFactorAuthMigration
cms-web_1 | up 20190514134430 2019-10-14 12:39:03 2019-10-14 12:39:05 NullableTextFieldsMigration
cms-web_1 | up 20190515094133 2019-10-14 12:39:05 2019-10-14 12:39:05 AddHtmlDatatypeMigration
cms-web_1 | up 20190515105624 2019-10-14 12:39:05 2019-10-14 12:39:05 InstallAdditionalStandardModulesMigration
cms-web_1 | up 20190517080033 2019-10-14 12:39:32 2019-10-14 12:39:33 AddForeignKeysToLktagTablesMigration
cms-web_1 | up 20190521092700 2019-10-14 12:39:33 2019-10-14 12:39:33 AddReportScheduleTaskMigration
cms-web_1 | up 20190521092930 2019-10-14 12:39:33 2019-10-14 12:39:34 AddPreviousRunDateReportScheduleMigration
cms-web_1 | up 20190521102635 2019-10-14 12:39:34 2019-10-14 12:39:35 PlaylistDurationUpdateAtTimestamp
cms-web_1 | up 20190603083836 2019-10-14 12:39:35 2019-10-14 12:39:36 ChangeStatTableStartEndColumnMigration
cms-web_1 | up 20190610150331 2019-10-14 12:39:36 2019-10-14 12:39:41 TagsWithValuesMigration
cms-web_1 | up 20190611145607 2019-10-14 12:39:41 2019-10-14 12:39:41 RemoveOldVersionTableMigration
cms-web_1 | up 20190612140955 2019-10-14 12:39:41 2019-10-14 12:39:48 DisplayTableDatabaseSchemaAdjustmentsMigration
cms-web_1 | up 20190620112611 2019-10-14 12:39:48 2019-10-14 12:39:48 MoveTidyStatsToStatsArchiveTaskMigration
cms-web_1 | up 20190620142655 2019-10-14 12:39:48 2019-10-14 12:39:49 AddPlaylistEnableStatMigration
cms-web_1 | up 20190626091331 2019-10-14 12:39:49 2019-10-14 12:39:49 WidgetHistoryMigration
cms-web_1 | up 20190626110359 2019-10-14 12:39:49 2019-10-14 12:39:50 CreateStatTableMigration
cms-web_1 | up 20190628083649 2019-10-14 12:39:50 2019-10-14 12:39:50 AddStatsMigrationTaskMigration
cms-web_1 | up 20190710213414 2019-10-14 12:39:50 2019-10-14 12:39:50 AddIsActiveReportScheduleMigration
cms-web_1 | up 20190717101342 2019-10-14 12:39:50 2019-10-14 12:39:51 NullableCommandValidationStringMigration
cms-web_1 | up 20190719074601 2019-10-14 12:39:51 2019-10-14 12:39:52 MissingDefaultValueMigration
cms-web_1 | up 20190725115532 2020-02-18 09:36:09 2020-02-18 09:36:09 AddScheduleReminderTaskMigration
cms-web_1 | up 20190801102042 2019-10-14 12:39:52 2019-10-14 12:39:52 DisplayProfileCommandLinkFixMigration
cms-web_1 | up 20190801141737 2020-02-18 09:36:09 2020-02-18 09:36:09 DatasetAddCustomHeadersColumnMigration
cms-web_1 | up 20190801142302 2020-02-18 09:36:09 2020-02-18 09:36:09 AddDoohUserTypeMigration
cms-web_1 | up 20190802145636 2020-02-18 09:36:09 2020-02-18 09:36:09 CreateScheduleReminderTableMigration
cms-web_1 | up 20190806144729 2020-02-18 09:36:09 2020-02-18 09:36:09 AddShowContentFromMigration
cms-web_1 | up 20190823081448 2020-02-18 09:36:09 2020-02-18 09:36:09 AddImageProcessingTaskMigration
cms-web_1 | up 20190828123735 2020-02-18 09:36:09 2020-02-18 09:36:09 AddDefaultSettingResizeLimitResizeThresholdMigration
cms-web_1 | up 20190903083314 2020-02-18 09:36:09 2020-02-18 09:36:09 AddGlobalSettingForCascadePermissionsMigration
cms-web_1 | up 20190905084201 2020-02-18 09:36:09 2020-02-18 09:36:09 AddSettingForDefaultTransitionTypeMigration
cms-web_1 | up 20190905084642 2020-02-18 09:36:09 2020-02-18 09:36:09 AddSettingForAutoLayoutPublishMigration
cms-web_1 | up 20190910132520 2020-02-18 09:36:09 2020-02-18 09:36:09 DisplayMoveCmsMigration
cms-web_1 | up 20190917093141 2020-02-18 09:36:09 2020-02-18 09:36:09 InterruptLayoutMigration
cms-web_1 | up 20190918090608 2020-02-18 09:36:09 2020-02-18 09:36:09 AddDefaultSettingQuickChartMigration
cms-web_1 | up 20190919154513 2020-02-18 09:36:09 2020-02-18 09:36:09 AddNotificationAttachmentFilenameNonUsersMigration
cms-web_1 | up 20190926135518 2020-02-18 09:36:09 2020-02-18 09:36:10 AddSettingForTransitionAutoApplyToLayoutMigration
cms-web_1 | up 20190926140809 2020-02-18 09:36:10 2020-02-18 09:36:10 InstallSavedReportsAndSpacerModulesMigration
cms-web_1 | up 20191001092651 2020-02-18 09:36:10 2020-02-18 09:36:10 AddNotificationOriginalFilenameMigration
cms-web_1 | up 20191022101141 2020-10-20 10:30:01 2020-10-20 10:30:01 AddCommandEntityToPermissionEntityMigration
cms-web_1 | up 20191024152519 2020-10-20 10:30:01 2020-10-20 10:30:01 AddScheduleExclusionsTableMigration
cms-web_1 | up 20191122114104 2020-02-18 09:36:10 2020-02-18 09:36:10 FixDuplicateModuleFilesMigration
cms-web_1 | up 20191126103120 2020-10-20 10:30:01 2020-10-20 10:30:01 GeoScheduleMigration
cms-web_1 | up 20191126141140 2020-10-20 10:30:01 2020-10-20 10:30:01 RemoteDataSetCsvSourceMigration
cms-web_1 | up 20191205180116 2020-10-20 10:30:01 2020-10-20 10:30:01 AddPlaylistDashboardPageUserMigration
cms-web_1 | up 20200107082625 2020-10-20 10:30:01 2020-10-20 10:30:02 DisplayAddResolutionMigration
cms-web_1 | up 20200115115935 2020-10-20 10:30:02 2020-10-20 10:30:02 AddReportScheduleMessageMigration
cms-web_1 | up 20200122143630 2020-10-20 10:30:02 2020-10-20 10:30:02 AddReleasedRequiredFileMigration
cms-web_1 | up 20200122191232 2020-10-20 10:30:02 2020-10-20 10:30:02 AddCommercialLicenceColumnMigration
cms-web_1 | up 20200129104944 2020-10-20 10:30:02 2020-10-20 10:30:02 AddEngagementsStatsMigration
cms-web_1 | up 20200130165443 2020-10-20 10:30:02 2020-10-20 10:30:02 CountdownModuleAddMigration
cms-web_1 | up 20200311110512 2021-12-13 08:46:54 2021-12-13 08:46:54 AddIsDrawerColumnMigration
cms-web_1 | down 20200311110535 CreateActionTableMigration
cms-web_1 | down 20200319093235 ChangeInterruptLayoutMigration
cms-web_1 | down 20200401121544 AddSystemUserSettingMigration
cms-web_1 | down 20200407143200 AddCodeColumnToLayoutMigration
cms-web_1 | down 20200422101006 AddDataSetRowLimitMigration
cms-web_1 | down 20200427085958 AddReportScheduleStartEndMigration
cms-web_1 | down 20200530103029 DisplayRemoteLinksMigration
cms-web_1 | down 20200604103141 CommandImprovementsMigration
cms-web_1 | down 20200612141755 OauthUpgradeMigration
cms-web_1 | down 20200720092246 AddSavedReportSchemaVersionMigration
cms-web_1 | down 20200916134817 RemoveOldScreenshotsMigration
cms-web_1 | down 20200917140227 DisplayGroupCreatedModifiedDates
cms-web_1 | down 20201007080829 AddFoldersMigration
cms-web_1 | down 20201007093511 FeaturesMigration
cms-web_1 | down 20201025153753 RemoveOldPermissionSettingsMigration
cms-web_1 | down 20210105105646 AddMcaasScopeAndRouteMigration
cms-web_1 | down 20210113134628 EnableUserSharingFeatureOnUsersGroupMigration
cms-web_1 | down 20210201150259 UserOnboardingMigration
cms-web_1 | down 20210305131937 FixDuplicateTagsMigration
cms-web_1 | down 20210407111756 RemoveReportNameColumnFromSavedReportMigration
cms-web_1 | down 20210601104441 AddUserAgentToDataSetMigration
cms-web_1 |
cms-web_1 | We will upgrade it, take a backup
cms-web_1 | mysqldump: Error: ‘Access denied; you need (at least one of) the PROCESS privilege(s) for this operation’ when trying to dump tablespaces
cms-web_1 | Running database migrations
cms-web_1 | Phinx by CakePHP - https://phinx.org. 0.9.2
cms-web_1 |
cms-web_1 | using config file .varwwwcmsphinx.php
cms-web_1 | using config parser php
cms-web_1 | using migration paths
cms-web_1 | - /var/www/cms/db/migrations
cms-web_1 | warning no environment specified, defaulting to: production
cms-web_1 | using adapter mysql
cms-web_1 | using database cms
cms-web_1 |
cms-web_1 | == 20200311110535 CreateActionTableMigration: migrating
cms-web_1 |
cms-web_1 | In PdoAdapter.php line 134:
cms-web_1 |
cms-web_1 | SQLSTATE[42S21]: Column already exists: 1060 Duplicate column name 'ownerId
cms-web_1 | ’
cms-web_1 |
cms-web_1 |
cms-web_1 | migrate [-c|–configuration CONFIGURATION] [-p|–parser PARSER] [-e|–environment ENVIRONMENT] [-t|–target TARGET] [-d|–date DATE] [-x|–dry-run]
cms-web_1 |
cms-web_1 | Importing ca-certs
cms-web_1 | cp: can’t stat ‘/var/www/cms/ca-certs/.pem’: No such file or directory
cms-web_1 | cp: can’t stat '/var/www/cms/ca-certs/
.crt’: No such file or directory
cms-web_1 | WARNING: ca-certificates.crt does not contain exactly one certificate or CRL: skipping
cms-web_1 | Setting up Quickchart
cms-web_1 | Configuring Maintenance
cms-web_1 | Removing web/install/index.php from production container
cms-web_1 | Starting cron
cms-web_1 | Starting webserver
cms-web_1 | AH00558: httpd: Could not reliably determine the server’s fully qualified domain name, using 172.23.0.6. Set the ‘ServerName’ directive globally to suppress this message

The main errors seem to be:
a) mysqldump: Error: ‘Access denied; you need (at least one of) the PROCESS privilege(s) for this operation’ when trying to dump tablespaces
b) SQLSTATE[42S21]: Column already exists: 1060 Duplicate column name 'ownerId

I also tried upgrading from 2.3.7 to 3.0.0, but resulting in the same errors.
I also have already added this commandline to my custom-ports.yml file:

command: mysqld
–sql_mode=“ONLY_FULL_GROUP_BY,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION”

Can someone please advise me how to proceed further and what is causing this errors?

Thanks in advance

Is there really no one out there being able to help?

This topic was automatically closed 91 days after the last reply. New replies are no longer allowed.