Skip to content

Add release build output canaries #2400

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
msarahan wants to merge 8 commits into
base: main
Choose a base branch
from
Draft

Add release build output canaries #2400

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
bdeac96
ci: add release build output canaries
msarahan Aug 3, 2026
f0015ac
ci: exercise release build output in PRs
msarahan Aug 4, 2026
2ed7e02
ci: use automatic release build outputs
msarahan Aug 6, 2026
c2fe709
ci: trigger automatic manifest canary
msarahan Aug 6, 2026
fa5f57e
ci: recheck container-safe manifest dispatch
msarahan Aug 7, 2026
3f735ae
ci: retry allowed manifest dispatch
msarahan Aug 7, 2026
7fdbdde
ci: verify action-path manifest dispatch
msarahan Aug 7, 2026
02b98d6
ci: verify exact manifest dispatch revision
msarahan Aug 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 19 additions & 7 deletions .github/workflows/build.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@codex/release-build-output-manifests
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -68,7 +68,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@codex/release-build-output-manifests
strategy:
fail-fast: false
matrix: ${{ fromJSON(needs.rocky8-clib-standalone-build-matrix.outputs.matrix) }}
Expand All @@ -82,7 +82,14 @@ jobs:
requires_license_builder: true
script: "ci/build_standalone_c.sh"
artifact-name: "libcuvs_c_${{ matrix.CUDA_VER }}_${{ matrix.ARCH }}.tar.gz"
file_to_upload: "libcuvs_c.tar.gz"
file_to_upload: |
libcuvs_c.tar.gz
libcuvs_c.release-package.json
release-build-output: true
release-output-directory: .
release-unit: archive:libcuvs-c
release-package-file: libcuvs_c.release-package.json
release-artifacts: '[{"path":"libcuvs_c.tar.gz"}]'
sha: ${{ inputs.sha }}
rust-build-matrix:
needs: cpp-build
Expand Down Expand Up @@ -168,7 +175,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@codex/release-build-output-manifests
# Artifacts are not published from these jobs, so it's safe to run for multiple CUDA versions.
# If these jobs start producing artifacts, the names will have to differentiate between CUDA versions.
strategy:
Expand All @@ -183,6 +190,11 @@ jobs:
script: "ci/build_java.sh"
artifact-name: "cuvs-java-cuda${{ matrix.CUDA_VER }}"
file_to_upload: "java/cuvs-java/target/"
release-build-output: true
release-output-directory: java/cuvs-java/target
release-unit: maven:cuvs-java
release-package-file: cuvs-java.release-package.json
release-artifacts: '[{"path":"cuvs-java-*-x86_64-cuda*.jar"}]'
sha: ${{ inputs.sha }}
python-build:
needs: [cpp-build]
Expand All @@ -193,7 +205,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@codex/release-build-output-manifests
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand Down Expand Up @@ -254,7 +266,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@codex/release-build-output-manifests
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand Down Expand Up @@ -295,7 +307,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@codex/release-build-output-manifests
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand Down
26 changes: 19 additions & 7 deletions .github/workflows/pr.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -399,7 +399,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@codex/release-build-output-manifests
with:
build_type: pull-request
node_type: cpu16
Expand Down Expand Up @@ -440,7 +440,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@codex/release-build-output-manifests
with:
build_type: pull-request
script: ci/build_python.sh
Expand Down Expand Up @@ -477,7 +477,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@codex/release-build-output-manifests
strategy:
fail-fast: false
matrix: ${{ fromJSON(needs.rocky8-clib-standalone-build-matrix.outputs.matrix) }}
Expand All @@ -490,7 +490,14 @@ jobs:
requires_license_builder: true
script: "ci/build_standalone_c.sh --build-tests"
artifact-name: "libcuvs_c_${{ matrix.CUDA_VER }}_${{ matrix.ARCH }}.tar.gz"
file_to_upload: "libcuvs_c.tar.gz"
file_to_upload: |
libcuvs_c.tar.gz
libcuvs_c.release-package.json
release-build-output: true
release-output-directory: .
release-unit: archive:libcuvs-c
release-package-file: libcuvs_c.release-package.json
release-artifacts: '[{"path":"libcuvs_c.tar.gz"}]'
sha: ${{ inputs.sha }}
rocky8-clib-tests-matrix:
needs: [rocky8-clib-standalone-build, changed-files]
Expand Down Expand Up @@ -541,7 +548,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@codex/release-build-output-manifests
# Artifacts are not published from these jobs, so it's safe to run for multiple CUDA versions.
# If these jobs start producing artifacts, the names will have to differentiate between CUDA versions.
strategy:
Expand All @@ -555,6 +562,11 @@ jobs:
script: "ci/test_java.sh"
artifact-name: "cuvs-java-cuda${{ matrix.CUDA_VER }}"
file_to_upload: "java/cuvs-java/target/"
release-build-output: true
release-output-directory: java/cuvs-java/target
release-unit: maven:cuvs-java
release-package-file: cuvs-java.release-package.json
release-artifacts: '[{"path":"cuvs-java-*-x86_64-cuda*.jar"}]'
rust-build-matrix:
needs: [conda-cpp-build, changed-files]
permissions:
Expand Down Expand Up @@ -641,7 +653,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@codex/release-build-output-manifests
with:
build_type: pull-request
node_type: cpu16
Expand All @@ -659,7 +671,7 @@ jobs:
packages: read
pull-requests: read
secrets: inherit # zizmor: ignore[secrets-inherit]
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@main
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@codex/release-build-output-manifests
with:
build_type: pull-request
node_type: cpu8
Expand Down
10 changes: 9 additions & 1 deletion ci/build_java.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/bin/bash
# SPDX-FileCopyrightText: Copyright (c) 2025-2026, NVIDIA CORPORATION.
# SPDX-FileCopyrightText: Copyright (c) 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0

set -euo pipefail
Expand Down Expand Up @@ -58,6 +58,14 @@ export RAPIDS_CUDA_MAJOR

bash ./build.sh java "${EXTRA_BUILD_ARGS[@]}"

if [[ "${EXITCODE}" -eq 0 ]]; then
JAVA_PACKAGE_VERSION="$(sed -n 's/.*<version>\([^<]*\)<\/version>.*/\1/p' java/cuvs-java/pom.xml | head -n 1)"
jq -n \
--arg version "${JAVA_PACKAGE_VERSION}" \
'{ecosystem: "maven", name: "com.nvidia.cuvs:cuvs-java", version: $version}' \
>java/cuvs-java/target/cuvs-java.release-package.json
fi

sccache --show-adv-stats
sccache --stop-server >/dev/null 2>&1 || true

Expand Down
6 changes: 5 additions & 1 deletion ci/build_standalone_c.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/bin/bash
# SPDX-FileCopyrightText: Copyright (c) 2025-2026, NVIDIA CORPORATION.
# SPDX-FileCopyrightText: Copyright (c) 2025-2026, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0

set -euo pipefail
Expand Down Expand Up @@ -99,3 +99,7 @@ license-builder . --output-json c/build/install/licenses.json --output-txt c/bui
rapids-logger "Begin c tarball creation"
tar czf libcuvs_c.tar.gz -C c/build/install/ .
ls -lh libcuvs_c.tar.gz
jq -n \
--arg version "${RAPIDS_PACKAGE_VERSION}" \
'{ecosystem: "archive", name: "libcuvs-c", version: $version}' \
>libcuvs_c.release-package.json
Loading