Update hwloc to v2.14.0 by fwyzard · Pull Request #10608 · cms-sw/cmsdist

fwyzard · 2026-06-08T12:52:23Z

See https://raw.githubusercontent.com/open-mpi/hwloc/v2.14/NEWS for the changes since v2.12.2.

fwyzard · 2026-06-08T12:52:36Z

enable gpu

fwyzard · 2026-06-08T12:52:40Z

please test

cmsbuild · 2026-06-08T12:52:46Z

A new Pull Request was created by @fwyzard for branch IB/CMSSW_17_0_X/master.

@akritkbehera, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2026-06-08T12:52:47Z

cms-bot internal usage

cmsbuild · 2026-06-09T00:11:04Z

-1

Failed Tests: UnitTests RelVals-AMD_MI300X
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53730/summary.html
COMMIT: dcf00ae
CMSSW: CMSSW_17_0_X_2026-06-08-1100/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10608/53730/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 11 errors in the following unit tests:

---> test testMPIAutosplitter had ERRORS
---> test testMPIComplexTransfer had ERRORS
---> test testMPIFilters had ERRORS
and more ...

Failed RelVals-AMD_MI300X

34634.40334634.403_TTbar_14TeV+Run4D121PU_Patatrack_PixelOnlyAlpaka_Validation/step2_TTbar_14TeV+Run4D121PU_Patatrack_PixelOnlyAlpaka_Validation.log
34634.75134634.751_TTbar_14TeV+Run4D121PU_HLT75e33TimingAlpaka/step2_TTbar_14TeV+Run4D121PU_HLT75e33TimingAlpaka.log

Comparison Summary

Summary:

You potentially added 9 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 10 differences found in the comparisons
DQMHistoTests: Total files compared: 54
DQMHistoTests: Total histograms compared: 4316359
DQMHistoTests: Total failures: 36
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 4316303
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 53 files compared)
Checked 232 log files, 203 edm output root files, 54 DQM output files
TriggerResults: no differences found

AMD_W7900 Comparison Summary

There are some workflows for which there are errors in the baseline:
34634.751 step 2
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

You potentially added 61 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 407 differences found in the comparisons
DQMHistoTests: Total files compared: 12
DQMHistoTests: Total histograms compared: 185396
DQMHistoTests: Total failures: 22303
DQMHistoTests: Total nulls: 16
DQMHistoTests: Total successes: 163077
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 11 files compared)
Checked 48 log files, 50 edm output root files, 12 DQM output files
TriggerResults: found differences in 1 / 11 workflows

NVIDIA_H100 Comparison Summary

Summary:

You potentially added 9 lines to the logs
Reco comparison results: 401 differences found in the comparisons
DQMHistoTests: Total files compared: 13
DQMHistoTests: Total histograms compared: 218945
DQMHistoTests: Total failures: 31619
DQMHistoTests: Total nulls: 33
DQMHistoTests: Total successes: 187293
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 12 files compared)
Checked 49 log files, 50 edm output root files, 13 DQM output files
TriggerResults: found differences in 5 / 12 workflows

NVIDIA_L40S Comparison Summary

Summary:

You potentially added 16 lines to the logs
Reco comparison results: 390 differences found in the comparisons
DQMHistoTests: Total files compared: 13
DQMHistoTests: Total histograms compared: 218945
DQMHistoTests: Total failures: 26655
DQMHistoTests: Total nulls: 34
DQMHistoTests: Total successes: 192256
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 12 files compared)
Checked 49 log files, 50 edm output root files, 13 DQM output files
TriggerResults: found differences in 1 / 12 workflows

NVIDIA_T4 Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 400 differences found in the comparisons
DQMHistoTests: Total files compared: 13
DQMHistoTests: Total histograms compared: 218945
DQMHistoTests: Total failures: 31908
DQMHistoTests: Total nulls: 27
DQMHistoTests: Total successes: 187010
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 12 files compared)
Checked 49 log files, 50 edm output root files, 13 DQM output files
TriggerResults: no differences found

Max Memory Comparisons exceeding threshold NVIDIA_T4

@cms-sw/core-l2 , I found 1 workflow step(s) with memory usage exceeding the error threshold:

Expand to see workflows ...

Error: Workflow 34634.712_TTbar_14TeV+Run4D121PU_lstOnGPUIters01TrackingOnly step3 max memory diff 72.0 exceeds +/- 30.0 MiB

fwyzard · 2026-06-09T08:21:53Z

please test

smuzaffar · 2026-06-09T15:40:45Z

please test

cmsbuild · 2026-06-10T02:59:13Z

-1

Failed Tests: UnitTests RelVals-AMD_MI300X
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53782/summary.html
COMMIT: dcf00ae
CMSSW: CMSSW_20_1_X_2026-06-09-1100/el9_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10608/53782/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed Unit Tests

I found 10 errors in the following unit tests:

---> test testMPIAutosplitter had ERRORS
---> test testMPIComplexTransfer had ERRORS
---> test testMPIEventId had ERRORS
and more ...

Failed RelVals-AMD_MI300X

34434.40234434.402_TTbar_14TeV+Run4D121_Patatrack_PixelOnlyAlpaka/step2_TTbar_14TeV+Run4D121_Patatrack_PixelOnlyAlpaka.log

Comparison Summary

Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 44
DQMHistoTests: Total histograms compared: 3248390
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3248372
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
Checked 191 log files, 159 edm output root files, 44 DQM output files

AMD_W7900 Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 141 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 14864
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 148342
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_H100 Comparison Summary

Summary:

You potentially removed 2 lines from the logs
Reco comparison results: 167 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 22664
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 140543
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_L40S Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 124 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 15849
DQMHistoTests: Total nulls: 2
DQMHistoTests: Total successes: 147356
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_T4 Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 75 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 13088
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 150118
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

Max Memory Comparisons exceeding threshold NVIDIA_L40S

@cms-sw/core-l2 , I found 1 workflow step(s) with memory usage exceeding the error threshold:

Expand to see workflows ...

Error: Workflow 34434.7503_TTbar_14TeV+Run4D121_HLTHeterogeneousValid step2 max memory diff -265.0 exceeds +/- 30.0 MiB

fwyzard · 2026-06-10T07:38:23Z

please test

fwyzard · 2026-06-10T07:38:55Z

please test for el9_amd64_gcc13

fwyzard · 2026-06-10T07:39:30Z

please test for el8_amd64_gcc13

cmsbuild · 2026-06-10T13:10:06Z

-1

Failed Tests: UnitTests RelVals-AMD_W7900
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53812/summary.html
COMMIT: dcf00ae
CMSSW: CMSSW_20_1_X_2026-06-09-2300/el9_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10608/53812/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@fwyzard ONNXRuntime: update to version 1.26.0 #10615

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53812/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53812/git-merge-result

Failed Unit Tests

I found 10 errors in the following unit tests:

---> test testMPIAutosplitter had ERRORS
---> test testMPIComplexTransfer had ERRORS
---> test testMPIEventId had ERRORS
and more ...

Failed RelVals-AMD_W7900

34434.40434434.404_TTbar_14TeV+Run4D121_Patatrack_PixelOnlyAlpaka_Profiling/step2_TTbar_14TeV+Run4D121_Patatrack_PixelOnlyAlpaka_Profiling.log

Comparison Summary

Summary:

You potentially added 1 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 44
DQMHistoTests: Total histograms compared: 3248390
DQMHistoTests: Total failures: 21
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3248351
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
Checked 191 log files, 159 edm output root files, 44 DQM output files

AMD_MI300X Comparison Summary

Summary:

You potentially removed 2 lines from the logs
Reco comparison results: 98 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 14901
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 148306
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_H100 Comparison Summary

Summary:

You potentially removed 2 lines from the logs
Reco comparison results: 109 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 17110
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 146097
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_L40S Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 150 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 21860
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 141347
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_T4 Comparison Summary

Summary:

You potentially removed 2 lines from the logs
Reco comparison results: 173 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 163207
DQMHistoTests: Total failures: 21946
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 141260
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

cmsbuild · 2026-06-10T17:05:05Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53813/summary.html
COMMIT: dcf00ae
CMSSW: CMSSW_20_1_X_2026-06-09-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10608/53813/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@fwyzard ONNXRuntime: update to version 1.26.0 #10615

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53813/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53813/git-merge-result

Failed Unit Tests

I found 11 errors in the following unit tests:

---> test testMPIMultiEventId had ERRORS
---> test testMPIComplexTransfer had ERRORS
---> test TestHeterogeneousCoreMPIServices had ERRORS
and more ...

Comparison Summary

Summary:

You potentially added 190 lines to the logs
Reco comparison results: 60297 differences found in the comparisons
DQMHistoTests: Total files compared: 44
DQMHistoTests: Total histograms compared: 3248390
DQMHistoTests: Total failures: 335536
DQMHistoTests: Total nulls: 222
DQMHistoTests: Total successes: 2912614
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
DQMHistoSizes: changed ( 2023.0020001 ): -0.012 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 2024.0030001 ): 0.004 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 2025.0000002 ): 0.008 KiB JetMET/SUSYDQM
Checked 191 log files, 159 edm output root files, 44 DQM output files
TriggerResults: found differences in 10 / 43 workflows

cmsbuild · 2026-06-10T17:05:06Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53813/summary.html
COMMIT: dcf00ae
CMSSW: CMSSW_20_1_X_2026-06-09-2300/el8_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/10608/53813/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@fwyzard ONNXRuntime: update to version 1.26.0 #10615

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53813/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53813/git-merge-result

Failed Unit Tests

I found 11 errors in the following unit tests:

---> test testMPIMultiEventId had ERRORS
---> test testMPIComplexTransfer had ERRORS
---> test TestHeterogeneousCoreMPIServices had ERRORS
and more ...

Comparison Summary

Summary:

You potentially added 190 lines to the logs
Reco comparison results: 60297 differences found in the comparisons
DQMHistoTests: Total files compared: 44
DQMHistoTests: Total histograms compared: 3248390
DQMHistoTests: Total failures: 335536
DQMHistoTests: Total nulls: 222
DQMHistoTests: Total successes: 2912614
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
DQMHistoSizes: changed ( 2023.0020001 ): -0.012 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 2024.0030001 ): 0.004 KiB JetMET/SUSYDQM
DQMHistoSizes: changed ( 2025.0000002 ): 0.008 KiB JetMET/SUSYDQM
Checked 191 log files, 159 edm output root files, 44 DQM output files
TriggerResults: found differences in 10 / 43 workflows

smuzaffar · 2026-06-16T11:40:48Z

please test

cmsbuild · 2026-06-16T23:05:16Z

-1

Failed Tests: UnitTests RelVals-AMD_MI300X amd_mi300xUnitTests amd_w7900UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53978/summary.html
COMMIT: dcf00ae
CMSSW: CMSSW_20_1_X_2026-06-15-2300/el9_amd64_gcc13
Additional Tests: GPU,AMD_MI300X,AMD_W7900,NVIDIA_H100,NVIDIA_L40S,NVIDIA_T4
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/10608/53978/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@fwyzard Update ROCm to version 7.2.4 #10633

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53978/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3595a2/53978/git-merge-result

Failed Unit Tests

I found 11 errors in the following unit tests:

---> test testMPIComplexTransfer had ERRORS
---> test testMPIAutosplitter had ERRORS
---> test testMPIEventId had ERRORS
and more ...

Failed RelVals-AMD_MI300X

34434.40434434.404_TTbar_14TeV+Run4D121_Patatrack_PixelOnlyAlpaka_Profiling/step2_TTbar_14TeV+Run4D121_Patatrack_PixelOnlyAlpaka_Profiling.log

Comparison Summary

Summary:

You potentially added 6 lines to the logs
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 45
DQMHistoTests: Total histograms compared: 3414477
DQMHistoTests: Total failures: 3
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3414456
DQMHistoTests: Total skipped: 18
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 44 files compared)
Checked 195 log files, 163 edm output root files, 45 DQM output files

AMD_W7900 Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 123 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 167007
DQMHistoTests: Total failures: 13452
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 153554
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_H100 Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 109 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 167007
DQMHistoTests: Total failures: 19033
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 147973
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_L40S Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 81 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 167007
DQMHistoTests: Total failures: 15465
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 151542
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

NVIDIA_T4 Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 126 differences found in the comparisons
DQMHistoTests: Total files compared: 7
DQMHistoTests: Total histograms compared: 167007
DQMHistoTests: Total failures: 21487
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 145519
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 6 files compared)
Checked 25 log files, 20 edm output root files, 7 DQM output files

fwyzard · 2026-06-17T04:32:30Z

The AMD GPU failures are known.

The MPI failures are not, and they look like a problem with the memory allocation code.

fwyzard · 2026-06-17T04:32:40Z

assign heterogeneous

cmsbuild · 2026-06-17T04:32:51Z

New categories assigned: heterogeneous

@fwyzard,@makortel you have been requested to review this Pull request/Issue and eventually sign? Thanks

Update hwloc to v2.14.0

dcf00ae

See https://raw.githubusercontent.com/open-mpi/hwloc/v2.14/NEWS for the changes since v2.12.2.

cmsbuild added externals-pending pending-signatures tests-started orp-pending labels Jun 8, 2026

cmsbuild added tests-rejected and removed tests-started labels Jun 9, 2026

fwyzard changed the base branch from IB/CMSSW_17_0_X/master to IB/CMSSW_20_1_X/master June 9, 2026 08:21

cmsbuild added tests-started tests-rejected and removed tests-rejected tests-started labels Jun 9, 2026

cmsbuild added tests-started and removed tests-rejected labels Jun 9, 2026

cmsbuild added tests-rejected and removed tests-started labels Jun 10, 2026

cmsbuild added tests-started and removed tests-rejected labels Jun 10, 2026

cmsbuild added tests-rejected and removed tests-started labels Jun 10, 2026

cmsbuild added tests-started and removed tests-rejected labels Jun 16, 2026

cmsbuild added tests-rejected and removed tests-started labels Jun 16, 2026

cmsbuild added the heterogeneous-pending label Jun 17, 2026

Uh oh!

Conversation

fwyzard commented Jun 8, 2026

Uh oh!

fwyzard commented Jun 8, 2026

Uh oh!

fwyzard commented Jun 8, 2026

Uh oh!

cmsbuild commented Jun 8, 2026

Uh oh!

cmsbuild commented Jun 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cmsbuild commented Jun 9, 2026

Failed Unit Tests

Failed RelVals-AMD_MI300X

Comparison Summary

AMD_W7900 Comparison Summary

NVIDIA_H100 Comparison Summary

NVIDIA_L40S Comparison Summary

NVIDIA_T4 Comparison Summary

Max Memory Comparisons exceeding threshold NVIDIA_T4

Uh oh!

fwyzard commented Jun 9, 2026

Uh oh!

smuzaffar commented Jun 9, 2026

Uh oh!

cmsbuild commented Jun 10, 2026

Failed Unit Tests

Failed RelVals-AMD_MI300X

Comparison Summary

AMD_W7900 Comparison Summary

NVIDIA_H100 Comparison Summary

NVIDIA_L40S Comparison Summary

NVIDIA_T4 Comparison Summary

Max Memory Comparisons exceeding threshold NVIDIA_L40S

Uh oh!

fwyzard commented Jun 10, 2026

Uh oh!

fwyzard commented Jun 10, 2026

Uh oh!

fwyzard commented Jun 10, 2026

Uh oh!

cmsbuild commented Jun 10, 2026

Failed Unit Tests

Failed RelVals-AMD_W7900

Comparison Summary

AMD_MI300X Comparison Summary

NVIDIA_H100 Comparison Summary

NVIDIA_L40S Comparison Summary

NVIDIA_T4 Comparison Summary

Uh oh!

cmsbuild commented Jun 10, 2026

Failed Unit Tests

Comparison Summary

Uh oh!

cmsbuild commented Jun 10, 2026

Failed Unit Tests

Comparison Summary

Uh oh!

smuzaffar commented Jun 16, 2026

Uh oh!

cmsbuild commented Jun 16, 2026

Failed Unit Tests

Failed RelVals-AMD_MI300X

Comparison Summary

AMD_W7900 Comparison Summary

NVIDIA_H100 Comparison Summary

NVIDIA_L40S Comparison Summary

NVIDIA_T4 Comparison Summary

Uh oh!

fwyzard commented Jun 17, 2026

Uh oh!

fwyzard commented Jun 17, 2026

Uh oh!

cmsbuild commented Jun 17, 2026

Uh oh!

Reviewers

Assignees

Labels

cmsbuild commented Jun 8, 2026 •

edited

Loading