Skip to content

grid_submit: pre-stage extra input files and fix --wait - #2512

Open
sawenzel wants to merge 2 commits into
AliceO2Group:masterfrom
sawenzel:grid-submit-wait-subjobs
Open

sawenzel wants to merge 2 commits into
AliceO2Group:masterfrom
sawenzel:grid-submit-wait-subjobs

Conversation

@sawenzel

Copy link
Copy Markdown
Contributor

Two changes to GRID/utils/grid_submit.sh:

  • A repeatable --inputfile <lfn> adds files to the JDL InputFile list, so AliEn stages them before the job starts. Unlike an alien.py cp inside the job, this is not charged to the job's CPU time.
  • --wait no longer returns early. AliEn can briefly report a masterjob as DONE while a subjob in ERROR_A is put back to WAITING, and --wait read only the masterjob status. Both --wait and --wait-any now finish only when no subjob is still active.

The second problem was seen on a real job: --wait returned after one minute, while AliEn resubmitted the job and it kept running.

Without --inputfile, the JDL is unchanged apart from InputFile being written as a list.

Assisted by Claude Code.

sawenzel and others added 2 commits October 19, 2026 18:55
This fixes a problem in the --wait and --wait-any modes of grid_submit.sh.

- AliEn can briefly report a masterjob as DONE while one of its subjobs in ERROR_A is put back to WAITING.
- --wait read only the masterjob status and returned at that moment, although the job was then retried.
- Both modes now finish only when no subjob is still active, with ERROR_A counted as active.
- A failed or empty status query also counts as active.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown

REQUEST FOR PRODUCTION RELEASES:
To request your PR to be included in production software, please add the corresponding labels called "async-" to your PR. Add the labels directly (if you have the permissions) or add a comment of the form (note that labels are separated by a ",")

+async-label <label1>, <label2>, !<label3> ...

This will add <label1> and <label2> and removes <label3>.

The following labels are available
async-2023-pbpb-apass4
async-2023-pp-apass4
async-2024-pp-apass1
async-2022-pp-apass7
async-2024-pp-cpass0
async-2024-PbPb-apass1
async-2024-ppRef-apass1
async-2024-PbPb-apass2
async-2023-PbPb-apass5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant