Skip to content

Re-enable 3 stale-excluded Playground tests (345, 346, 533).#1693

Merged
bkaradzic-microsoft merged 1 commit into
BabylonJS:masterfrom
bkaradzic-microsoft:reenable-stale-exclusions
May 12, 2026
Merged

Re-enable 3 stale-excluded Playground tests (345, 346, 533).#1693
bkaradzic-microsoft merged 1 commit into
BabylonJS:masterfrom
bkaradzic-microsoft:reenable-stale-exclusions

Conversation

@bkaradzic-microsoft
Copy link
Copy Markdown
Contributor

@bkaradzic-microsoft bkaradzic-microsoft commented May 11, 2026

Re-enables three tests in Apps/Playground/Scripts/config.json whose excludeFromAutomaticTesting reasons no longer match observed behavior.

Tests re-enabled

idx title Stale reason (removed) Observed behavior today
345 Load GUI snippet with unicode "Test crashes or hangs on Babylon Native" Validates at ~2k px diff (sub-threshold)
346 Parse GUI json with unicode "Test crashes or hangs on Babylon Native" Validates at ~2k px diff (sub-threshold)
533 OpenPBR Analytic Lights Anisotropy "Test fails locally on Win32 D3D11 sweep; disabled until BabylonNative fixes are made." Validates at ~1.3k px diff (sub-threshold)

Verification

On Win32 V8 D3D11 Debug build, with the modified config.json:

  • Each test run in isolation (5 repeated runs each): exit 0, [Log] validated with stable pixel-diff counts.
  • All 3 run as one in-process batch: ran=3 passed=3 failed=0.

None of the listed failure modes (crash, hang, sweep-only fail) reproduce. CI on this PR will exercise them in the full automatic sweep, which is the authoritative validation.

Notes

  • One cold-run anomaly was observed for idx 345 (one run showed 10.8k px diff vs. the stable 2k on every other run). Looked like first-time network/JIT/font-cache warmup. If CI surfaces flake here, the next step is to bump errorRatio slightly on that entry or pin its playground snippet version (currently unpinned).

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot was unable to run its full agentic suite in this review.

Re-enables three previously excluded Playground automatic tests by removing stale excludeFromAutomaticTesting entries whose recorded failure reasons no longer reproduce.

Changes:

  • Removed excludeFromAutomaticTesting + reason from tests 345 and 346 (unicode GUI).
  • Removed excludeFromAutomaticTesting + reason from test 533 (OpenPBR analytic lights anisotropy).

Comment thread Apps/Playground/Scripts/config.json Outdated
Comment thread Apps/Playground/Scripts/config.json Outdated
Re-enables three tests in Apps/Playground/Scripts/config.json whose
`excludeFromAutomaticTesting` reasons no longer match observed behavior:

- idx 345 - Load GUI snippet with unicode (was: "Test crashes or hangs on
  Babylon Native"). Renders and validates at ~2k pixel diff sub-threshold
  in repeated isolation runs.
- idx 346 - Parse GUI json with unicode (was: "Test crashes or hangs on
  Babylon Native"). Same behavior as 345.
- idx 533 - OpenPBR Analytic Lights Anisotropy (was: "Test fails locally
  on Win32 D3D11 sweep; disabled until BabylonNative fixes are made.").
  Renders and validates at ~1.3k pixel diff sub-threshold.

Also pins the unicode tests' playground IDs to `#YS93KY#0` / `#ERVGT5#0`
so the test inputs cannot silently drift if a future revision is
published, matching the pinned style of nearby entries (e.g. test 533's
`#GRQHVV#61`). Today both snippets only have version 0, so this is a
no-op for current behavior; it is a guard against future drift.

Verified on Win32 V8 D3D11 Debug: each test exits 0 with `[Log] validated`
both in isolation (5 runs each) and in a 3-test in-process batch. CI will
exercise them in the full sweep on this PR.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@bkaradzic-microsoft bkaradzic-microsoft force-pushed the reenable-stale-exclusions branch from d5c76da to 0719107 Compare May 11, 2026 20:41
@bkaradzic-microsoft bkaradzic-microsoft enabled auto-merge (squash) May 11, 2026 21:17
@bkaradzic-microsoft bkaradzic-microsoft merged commit 05f0ccc into BabylonJS:master May 12, 2026
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants