[17.0] Update UCX to version 1.21.0 by fwyzard · Pull Request #10689 · cms-sw/cmsdist

fwyzard · 2026-06-30T21:30:27Z

Enable multi-microarchitecture support in UCX.
Download the UCX sources via git, with support for git submodules.

Backport of #10663, #10671, #10673 and #10682 to 17.0.x for Run-3 studies.

cmsbuild · 2026-06-30T21:30:51Z

A new Pull Request was created by @fwyzard for branch IB/CMSSW_17_0_X/master.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

Backported from Update UCX to version 1.21.0 #10682

cmsbuild · 2026-06-30T21:30:52Z

cms-bot internal usage

fwyzard · 2026-06-30T21:31:38Z

backport #10682

fwyzard · 2026-06-30T21:31:46Z

type ngt

fwyzard · 2026-06-30T21:32:38Z

please test

cmsbuild · 2026-06-30T21:36:19Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c611e0/54425/summary.html
COMMIT: c7d83cd
CMSSW: CMSSW_17_0_X_2026-06-30-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54425/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation warning when building: See details on the summary page.

Get the sources from git to support submodules.

fwyzard · 2026-06-30T22:04:56Z

please test

cmsbuild · 2026-06-30T22:05:00Z

Pull request #10689 was updated.

cmsbuild · 2026-07-01T10:49:28Z

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c611e0/54427/summary.html
COMMIT: 08db9e8
CMSSW: CMSSW_17_0_X_2026-06-30-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 1 errors in the following unit tests:

---> test testPhase2PixelNtuple had ERRORS

Failed RelVals

34434.911

----- Begin Fatal Exception 01-Jul-2026 12:30:24 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step2_DIGI_L1TrackTrigger_L1_L1P2GT_DIGI2RAW_HLT.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/omtf_config/hwToLogicLayer_0x0210.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/external/el8_amd64_gcc13/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02948/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_X_2026-06-30-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02948/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_X_2026-06-30-1100/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/34434.911_TTbar_14TeV+Run4D121_DD4hep


At:
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Types.py(1050): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Mixins.py(402): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Mixins.py(537): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Modules.py(160): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Config.py(1120): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Config.py(1331): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

34434.0

----- Begin Fatal Exception 01-Jul-2026 12:25:05 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step2_DIGI_L1TrackTrigger_L1_L1P2GT_DIGI2RAW_HLT.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/omtf_config/hwToLogicLayer_0x0210.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/external/el8_amd64_gcc13/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02948/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_X_2026-06-30-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02948/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_X_2026-06-30-1100/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/34434.0_TTbar_14TeV+Run4D121


At:
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Types.py(1050): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Mixins.py(402): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Mixins.py(537): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Modules.py(160): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Config.py(1120): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Config.py(1331): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

34434.75

----- Begin Fatal Exception 01-Jul-2026 12:25:30 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named step2_DIGI_L1TrackTrigger_L1_L1P2GT_DIGI2RAW_HLT_VALIDATION.py
Exception Message:
 unknown python problem occurred.
RuntimeError: An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/omtf_config/hwToLogicLayer_0x0210.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/poison:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src:/cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/external/el8_amd64_gcc13/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02948/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_X_2026-06-30-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02948/el8_amd64_gcc13/cms/cmssw-patch/CMSSW_17_0_X_2026-06-30-1100/src
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/34434.75_TTbar_14TeV+Run4D121_HLT75e33Timing


At:
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Types.py(1050): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Mixins.py(402): insertContentsInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Mixins.py(537): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Modules.py(160): insertInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Config.py(1120): _insertManyInto
  /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54427/CMSSW_17_0_X_2026-06-30-1100/src/FWCore/ParameterSet/python/Config.py(1331): fillProcessDesc
  <string>(2): <module>

----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

smuzaffar · 2026-07-01T11:07:34Z

please test with #10694

cmsbuild · 2026-07-01T16:08:08Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c611e0/54445/summary.html
COMMIT: 08db9e8
CMSSW: CMSSW_17_0_X_2026-07-01-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10689/54445/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

There are some workflows for which there are errors in the baseline:
34434.0 step 2
34434.75 step 2
34434.911 step 2
34496.0 step 2
34500.0 step 2
34634.999 step 3
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

You potentially added 234 lines to the logs
Reco comparison results: 8 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3566491
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3566465
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 217 log files, 187 edm output root files, 48 DQM output files
TriggerResults: no differences found

smuzaffar · 2026-07-01T19:02:41Z

+externals

cmsbuild · 2026-07-01T19:03:04Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_17_0_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @ftenchini, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild added tests-pending externals-pending pending-signatures orp-pending labels Jun 30, 2026

cmsbuild added backport ngt labels Jun 30, 2026

cmsbuild added tests-started and removed tests-pending labels Jun 30, 2026

fwyzard changed the title ~~Update UCX to version 1.21.0~~ [17.0] Update UCX to version 1.21.0 Jun 30, 2026

cmsbuild added tests-rejected and removed tests-started labels Jun 30, 2026

smuzaffar and others added 5 commits July 1, 2026 00:04

Add default package name definition for vectorization

8234219

Update cmsdist_packages.py

cecea65

added override_microarch_name for vectorized packages

03f1371

UCX version 1.20.1; enabled multi-vectorization

3f8909a

Update UCX to version 1.21.0

08db9e8

Get the sources from git to support submodules.

fwyzard force-pushed the IB/CMSSW_17_0_X/master_UCX_v1.21.0 branch from c7d83cd to 08db9e8 Compare June 30, 2026 22:04

cmsbuild added tests-pending and removed tests-rejected labels Jun 30, 2026

cmsbuild added tests-started and removed tests-pending backport labels Jun 30, 2026

cmsbuild added the backport-ok label Jul 1, 2026

cmsbuild added tests-rejected and removed tests-started labels Jul 1, 2026

cmsbuild added requires-external tests-started and removed tests-rejected labels Jul 1, 2026

cmsbuild added tests-approved and removed tests-started labels Jul 1, 2026

smuzaffar merged commit 55238f6 into cms-sw:IB/CMSSW_17_0_X/master Jul 1, 2026
8 checks passed

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Jul 1, 2026

Uh oh!

Conversation

fwyzard commented Jun 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Jun 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Jun 30, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

fwyzard commented Jun 30, 2026

Uh oh!

fwyzard commented Jun 30, 2026

Uh oh!

fwyzard commented Jun 30, 2026

Uh oh!

cmsbuild commented Jun 30, 2026

Failed External Build

Uh oh!

fwyzard commented Jun 30, 2026

Uh oh!

cmsbuild commented Jun 30, 2026

Uh oh!

cmsbuild commented Jul 1, 2026

Failed Unit Tests

Failed RelVals

Uh oh!

smuzaffar commented Jul 1, 2026

Uh oh!

cmsbuild commented Jul 1, 2026

Comparison Summary

Uh oh!

smuzaffar commented Jul 1, 2026

Uh oh!

Uh oh!

cmsbuild commented Jul 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

fwyzard commented Jun 30, 2026 •

edited

Loading

cmsbuild commented Jun 30, 2026 •

edited

Loading

cmsbuild commented Jun 30, 2026 •

edited

Loading