GH-46691: [CI][Packaging] Update platform tag on generated wheel name to match newest auditwheel naming #46705

raulcd · 2025-06-04T07:30:06Z

Rationale for this change

The new version of auditwheel has added improvements to detect libc / platform on the wheels:

feat: detect architecture/libc from wheel pypa/auditwheel#548

This has updated the ordering of the platform tags for some of the generated wheels. For the case of our manylinux_2014 and libc 2.17 but only for Python 3.13 amd64 and 3.13t arm64. The rest are using the old order.

What changes are included in this PR?

Force the newest version and update to new order of platform tags.

Are these changes tested?

Via archery.

Are there any user-facing changes?

No

GitHub Issue: [CI][Packaging] Manylinux tags mismatch between generated artifact and validation on wheel-manylinux-2014-cp313 #46691

…ame generated from latest auditwheel version

github-actions · 2025-06-04T07:30:32Z

⚠️ GitHub issue #46691 has been automatically assigned in GitHub to PR creator.

raulcd · 2025-06-04T07:30:43Z

@github-actions crossbow submit wheel-manylinux-2014-cp313-cp313-*

raulcd · 2025-06-04T08:08:44Z

@github-actions crossbow submit wheel-manylinux-2014-*

github-actions · 2025-06-04T08:11:09Z

Revision: afdf276

Submitted crossbow builds: ursacomputing/crossbow @ actions-5a36b43cc0

Task	Status
wheel-manylinux-2014-cp310-cp310-amd64
wheel-manylinux-2014-cp310-cp310-arm64
wheel-manylinux-2014-cp311-cp311-amd64
wheel-manylinux-2014-cp311-cp311-arm64
wheel-manylinux-2014-cp312-cp312-amd64
wheel-manylinux-2014-cp312-cp312-arm64
wheel-manylinux-2014-cp313-cp313-amd64
wheel-manylinux-2014-cp313-cp313-arm64
wheel-manylinux-2014-cp313-cp313t-amd64
wheel-manylinux-2014-cp313-cp313t-arm64
wheel-manylinux-2014-cp39-cp39-amd64
wheel-manylinux-2014-cp39-cp39-arm64

raulcd · 2025-06-04T08:57:34Z

@github-actions crossbow submit wheel-manylinux-2014-cp310-cp310-amd64

raulcd · 2025-06-04T09:17:12Z

@github-actions crossbow submit wheel-manylinux-2014-cp310-cp310-amd64

raulcd · 2025-06-04T11:18:48Z

@github-actions crossbow submit wheel-manylinux-2014-cp310-cp310-amd64

github-actions · 2025-06-04T11:21:06Z

Revision: 4caab32

Submitted crossbow builds: ursacomputing/crossbow @ actions-351a7828b5

Task	Status
wheel-manylinux-2014-cp310-cp310-amd64

raulcd · 2025-06-04T11:46:43Z

@github-actions crossbow submit wheel-manylinux-2014-*

github-actions · 2025-06-04T11:49:15Z

Revision: 4caab32

Submitted crossbow builds: ursacomputing/crossbow @ actions-3fe8019705

Task	Status
wheel-manylinux-2014-cp310-cp310-amd64
wheel-manylinux-2014-cp310-cp310-arm64
wheel-manylinux-2014-cp311-cp311-amd64
wheel-manylinux-2014-cp311-cp311-arm64
wheel-manylinux-2014-cp312-cp312-amd64
wheel-manylinux-2014-cp312-cp312-arm64
wheel-manylinux-2014-cp313-cp313-amd64
wheel-manylinux-2014-cp313-cp313-arm64
wheel-manylinux-2014-cp313-cp313t-amd64
wheel-manylinux-2014-cp313-cp313t-arm64
wheel-manylinux-2014-cp39-cp39-amd64
wheel-manylinux-2014-cp39-cp39-arm64

kou

Hmm. If we run dev/release/verify-release-candidate.sh with Python 3.13 without TEST_WHEEL_PLATFORM_TAGS on local for the next release vote, it'll be failed because manylinux2014_${arch}.manylinux_2_17_${arch} not manylinux_2_17_${arch}.manylinux2014_${arch} is used, right?

Do we have more stable(?) approach? (Should we improve auditwheel?)

kou · 2025-06-04T20:54:27Z

dev/release/verify-release-candidate.sh

        continue
      fi
-      pip install pyarrow-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-${platform}.whl
+      find . -name pyarrow-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-*.whl | grep -E "${platform}" | \


Suggested change

find . -name pyarrow-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-*.whl | grep -E "${platform}" | \

ls pyarrow-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-*.whl | grep -E "${platform}" | \

…on newer auditwheel

raulcd · 2025-06-05T07:16:51Z

@github-actions crossbow submit wheel-manylinux-2014-cp310-cp310-amd64 wheel-manylinux-2014-cp313-cp313-amd64

github-actions · 2025-06-05T07:19:04Z

Revision: cc7facb

Submitted crossbow builds: ursacomputing/crossbow @ actions-f191869fad

Task	Status
wheel-manylinux-2014-cp310-cp310-amd64
wheel-manylinux-2014-cp313-cp313-amd64

raulcd · 2025-06-05T07:40:58Z

@github-actions crossbow submit wheel-manylinux-2014-*

github-actions · 2025-06-05T07:43:21Z

Revision: cc7facb

Submitted crossbow builds: ursacomputing/crossbow @ actions-e546bc5ba4

Task	Status
wheel-manylinux-2014-cp310-cp310-amd64
wheel-manylinux-2014-cp310-cp310-arm64
wheel-manylinux-2014-cp311-cp311-amd64
wheel-manylinux-2014-cp311-cp311-arm64
wheel-manylinux-2014-cp312-cp312-amd64
wheel-manylinux-2014-cp312-cp312-arm64
wheel-manylinux-2014-cp313-cp313-amd64
wheel-manylinux-2014-cp313-cp313-arm64
wheel-manylinux-2014-cp313-cp313t-amd64
wheel-manylinux-2014-cp313-cp313t-arm64
wheel-manylinux-2014-cp39-cp39-amd64
wheel-manylinux-2014-cp39-cp39-arm64

raulcd · 2025-06-05T08:08:25Z

Do we have more stable(?) approach? (Should we improve auditwheel?)

It seems forcing the jobs to use the latest version of auditwheel is stable with the new ordering. Let's wait for CI to finish but that seems better than the regex.

kou

+1

conbench-apache-arrow · 2025-06-05T17:52:50Z

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 3d4e8bc.

There were 68 benchmark results with an error:

Commit Run on arm64-t4g-2xlarge-linux at 2025-06-05 12:16:00Z
- tpch (R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-07, scale_factor=1
- tpch (R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-09, scale_factor=1
and 66 more (see the report linked below)

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 5 possible false positives for unstable benchmarks that are known to sometimes produce them.

…l name to match newest auditwheel naming (apache#46705) ### Rationale for this change The new version of auditwheel has added improvements to detect libc / platform on the wheels: - pypa/auditwheel#548 This has updated the ordering of the platform tags for some of the generated wheels. For the case of our manylinux_2014 and libc 2.17 but only for Python 3.13 amd64 and 3.13t arm64. The rest are using the old order. ### What changes are included in this PR? Force the newest version and update to new order of platform tags. ### Are these changes tested? Via archery. ### Are there any user-facing changes? No * GitHub Issue: apache#46691 Authored-by: Raúl Cumplido <[email protected]> Signed-off-by: Sutou Kouhei <[email protected]>

apacheGH-46691: [CI][Packaging] Reorder platform tag to match wheel n…

bf382f7

…ame generated from latest auditwheel version

github-actions bot added the awaiting committer review Awaiting committer review label Jun 4, 2025

This comment was marked as outdated.

Sign in to view

Use regex to match other cases

afdf276

raulcd changed the title ~~GH-46691: [CI][Packaging] Reorder platform tag to match wheel name generated from latest auditwheel version~~ GH-46691: [CI][Packaging] Make order of platform tag on generated wheel name not relevant for uploaded artifact validation Jun 4, 2025

Try something

5e50734

This comment was marked as outdated.

Sign in to view

Fix typo

0f8d840

This comment was marked as outdated.

Sign in to view

Fix verification script for validating wheels

4caab32

raulcd marked this pull request as ready for review June 4, 2025 13:03

raulcd requested review from assignUser, jonkeane and kou as code owners June 4, 2025 13:03

kou reviewed Jun 4, 2025

View reviewed changes

github-actions bot added awaiting changes Awaiting changes and removed awaiting committer review Awaiting committer review labels Jun 4, 2025

Try force upgrading to validate if platform tags order is maintained …

cc7facb

…on newer auditwheel

github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Jun 5, 2025

raulcd changed the title ~~GH-46691: [CI][Packaging] Make order of platform tag on generated wheel name not relevant for uploaded artifact validation~~ GH-46691: [CI][Packaging] Update platform tag on generated wheel name to match newest auditwheel naming Jun 5, 2025

raulcd requested a review from kou June 5, 2025 09:03

kou approved these changes Jun 5, 2025

View reviewed changes

kou merged commit 3d4e8bc into apache:main Jun 5, 2025
38 of 43 checks passed

kou removed the awaiting change review Awaiting change review label Jun 5, 2025

kou mentioned this pull request Jun 5, 2025

[CI][Packaging] Manylinux tags mismatch between generated artifact and validation on wheel-manylinux-2014-cp313 #46691

Closed

github-actions bot added the awaiting merge Awaiting merge label Jun 5, 2025

	find . -name pyarrow-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-*.whl \| grep -E "${platform}" \| \
	ls pyarrow-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-*.whl \| grep -E "${platform}" \| \

GH-46691: [CI][Packaging] Update platform tag on generated wheel name to match newest auditwheel naming #46705

GH-46691: [CI][Packaging] Update platform tag on generated wheel name to match newest auditwheel naming #46705

Uh oh!

Conversation

raulcd commented Jun 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

github-actions bot commented Jun 4, 2025

Uh oh!

raulcd commented Jun 4, 2025

Uh oh!

This comment was marked as outdated.

raulcd commented Jun 4, 2025

Uh oh!

github-actions bot commented Jun 4, 2025

Uh oh!

raulcd commented Jun 4, 2025

Uh oh!

This comment was marked as outdated.

raulcd commented Jun 4, 2025

Uh oh!

This comment was marked as outdated.

raulcd commented Jun 4, 2025

Uh oh!

github-actions bot commented Jun 4, 2025

Uh oh!

raulcd commented Jun 4, 2025

Uh oh!

github-actions bot commented Jun 4, 2025

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

kou Jun 4, 2025

Choose a reason for hiding this comment

Uh oh!

raulcd commented Jun 5, 2025

Uh oh!

github-actions bot commented Jun 5, 2025

Uh oh!

raulcd commented Jun 5, 2025

Uh oh!

github-actions bot commented Jun 5, 2025

Uh oh!

raulcd commented Jun 5, 2025

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

conbench-apache-arrow bot commented Jun 5, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

raulcd commented Jun 4, 2025 •

edited

Loading