Skip to content

[TEST] Skip the flaky shared DAG hash scaling test - #857

Merged
tqchen merged 1 commit into
apache:mainfrom
cyx-6:2026-10-19/robust-dag-hash-scaling-test
Oct 19, 2026
Merged

tqchen merged 1 commit into
apache:mainfrom
cyx-6:2026-10-19/robust-dag-hash-scaling-test

Conversation

@cyx-6

@cyx-6 cyx-6 commented Oct 18, 2026 •

Copy link
Copy Markdown
Contributor

Why

test_shared_dag_hash_scaling_not_exponential compares the mean time of hashing depth-18 and depth-19 shared DAGs against a 10x ratio. Each hash takes a few microseconds, so a single scheduling stall pushes the ratio past the threshold. It failed the aarch64 wheel job of the Publish wheel runs for v0.1.13, v0.1.14-post1 (twice) and v0.1.15 (d18=0.000006s d19=0.000155s), and mainline-only CI on cp315. Every failure holds the whole PyPI upload until the job is re-run. #612 and #702 already relaxed its threshold.

What changed

Skip the test with @pytest.mark.skip, giving the reason.

Validation

  • tests/python/test_dataclass_hash.py: 152 passed, 1 skipped; the skip reason is reported.
  • ruff check and ruff format --check pass. check version consistency currently fails on every PR because main still has patch 15 after the v0.1.15 tag; chore(release): Version bump after release v0.1.15 #856 fixes that.

@cyx-6
cyx-6 force-pushed the 2026-10-19/robust-dag-hash-scaling-test branch from da227f6 to fe42c90 Compare October 18, 2026 16:37
@cyx-6 cyx-6 changed the title [TEST] Make the shared DAG hash scaling test robust and sensitive [TEST] Check shared DAG hash memoization by counting visits Oct 18, 2026
test_shared_dag_hash_scaling_not_exponential compares the mean time of
hashing depth-18 and depth-19 shared DAGs against a 10x ratio. Each hash
takes a few microseconds, so a single scheduling stall pushes the ratio
past the threshold: it failed the aarch64 wheel job of the v0.1.13,
v0.1.14-post1 and v0.1.15 Publish wheel runs, and mainline-only CI.
Every failure holds the whole PyPI upload until the job is re-run.

Skip it until it can be made robust.
@cyx-6
cyx-6 force-pushed the 2026-10-19/robust-dag-hash-scaling-test branch from fe42c90 to 893f411 Compare October 19, 2026 09:08
@cyx-6 cyx-6 changed the title [TEST] Check shared DAG hash memoization by counting visits [TEST] Skip the flaky shared DAG hash scaling test Oct 19, 2026
@tqchen
tqchen merged commit 2562bf4 into apache:main Oct 19, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants