Skip to content

[ci] skip the array filter check on non-PR builds - #512

Open
elliot-barn wants to merge 1 commit into
mainfrom
elliot-barn/array-test-non-pr
Open

elliot-barn wants to merge 1 commit into
mainfrom
elliot-barn/array-test-non-pr

Conversation

@elliot-barn

Copy link
Copy Markdown
Collaborator

Why

Array linux-2, Array windows-1, Array windows-2 and Array macos-2 fail on every main build (every one back to #2446 in June, through #2481 for v0.51.0), so main is always red.

The array expansion test checks that only the variants something depends on get pulled in: Final validation (tagged always) → Depends check only → array-step(os=linux, os=macos, variant=1). The other four variants exit 1 if they run. That only holds on a filtered PR build. On a non-PR build, needRunAllTags selects every tag, so all six variants run and four fail by design.

What

array-step exits 0 before the filter check when BUILDKITE_PULL_REQUEST is false (or unset). BUILDKITE_PULL_REQUEST is already passed into job containers (buildkiteEnvs in raycicmd/bk_pipeline.go). It is escaped as $${...} so it is read at runtime, like the other steps in this repo.

PR builds keep the check: a variant that runs on a PR still fails.

Testing

Rendered the pipeline locally with the rayci pipeline config:

  • BUILDKITE_PULL_REQUEST=false: all 6 variants emitted (as on main today), and the command exits 0.
  • BUILDKITE_PULL_REQUEST=4242: the windows-2 command still exits 1.
  • BUILDKITE_PULL_REQUEST unset: exits 0.

🤖 Generated with Claude Code

Non-PR builds run all tags, so every array-step variant runs on main and
the four variants the check rejects fail on every main build. The check
only means something on a filtered PR build, so exit 0 when
BUILDKITE_PULL_REQUEST is false.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Elliot Barnwell <elliot.barnwell@anyscale.com>

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the Buildkite configuration in .buildkite/array-test.rayci.yaml to skip the OS filtering check for non-pull request builds by checking the BUILDKITE_PULL_REQUEST environment variable. There are no review comments, so I have no feedback to provide.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant