Skip to content

feat: Allow multiple jobs per job launcher#1328

Open
eikek wants to merge 19 commits into
mainfrom
eikek/multiple-jobs-per-launcher
Open

feat: Allow multiple jobs per job launcher#1328
eikek wants to merge 19 commits into
mainfrom
eikek/multiple-jobs-per-launcher

Conversation

@eikek

@eikek eikek commented May 22, 2026

Copy link
Copy Markdown
Member

/deploy extra-values=dataService.imageBuilders.enabled=true,dataService.imageBuilders.strategyName=renku-buildpacks-v3,dataService.imageBuilders.outputImagePrefix=harbor.dev.renku.ch/renku-build/,dataService.imageBuilders.nodeSelector.renku.io/node-purpose=user,dataService.imageBuilders.tolerations[0].effect=NoSchedule,dataService.imageBuilders.tolerations[0].key=renku.io/dedicated,dataService.imageBuilders.tolerations[0].operator=Equal,dataService.imageBuilders.tolerations[0].value=user amalthea-sessions=main

@RenkuBot

Copy link
Copy Markdown
Contributor

You can access the deployment of this PR at https://renku-ci-ds-1328.dev.renku.ch

@eikek eikek force-pushed the eikek/multiple-jobs-per-launcher branch from 970d871 to ae9e285 Compare May 22, 2026 07:13
@coveralls

coveralls commented May 22, 2026

Copy link
Copy Markdown

Coverage Report for CI Build 27264253109

Coverage decreased (-0.1%) to 86.285%

Details

  • Coverage decreased (-0.1%) from the base build.
  • Patch coverage: 43 uncovered changes across 8 files (113 of 156 lines covered, 72.44%).
  • 22 coverage regressions across 11 files.

Uncovered Changes

File Changed Covered %
components/renku_data_services/notebooks/models.py 28 14 50.0%
components/renku_data_services/notebooks/core_sessions.py 17 9 52.94%
components/renku_data_services/session/core.py 30 22 73.33%
components/renku_data_services/notebooks/cr_amalthea_session.py 12 8 66.67%
components/renku_data_services/session/db.py 22 19 86.36%
components/renku_data_services/notebooks/blueprints.py 6 4 66.67%
components/renku_data_services/notebooks/crs.py 10 8 80.0%
components/renku_data_services/notebooks/util/kubernetes_.py 7 5 71.43%
Total (12 files) 156 113 72.44%

Coverage Regressions

22 previously-covered lines in 11 files lost coverage.

Top 10 Files by Coverage Loss Lines Losing Coverage Coverage
components/renku_data_services/notifications/core.py 9 30.95%
components/renku_data_services/k8s/watcher/core.py 2 78.75%
components/renku_data_services/crc/blueprints.py 2 96.64%
components/renku_data_services/notebooks/crs.py 2 88.97%
components/renku_data_services/base_api/error_handler.py 1 91.75%
components/renku_data_services/users/db.py 1 90.36%
components/renku_data_services/crc/core.py 1 79.29%
components/renku_data_services/base_api/pagination.py 1 88.16%
components/renku_data_services/notebooks/api/classes/k8s_client.py 1 66.67%
components/renku_data_services/session/models.py 1 94.69%

Coverage Stats

Coverage Status
Relevant Lines: 31337
Covered Lines: 27039
Line Coverage: 86.28%
Coverage Strength: 1.5 hits per line

💛 - Coveralls

@eikek eikek force-pushed the eikek/multiple-jobs-per-launcher branch 4 times, most recently from 4916193 to 02c78a5 Compare May 28, 2026 15:28

@olevski olevski left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few minor changes Eike. Everything else look good.

Comment thread components/renku_data_services/notebooks/api.spec.yaml Outdated
Comment thread components/renku_data_services/notebooks/util/kubernetes_.py Outdated
Comment thread components/renku_data_services/notebooks/core_sessions.py
Comment thread components/renku_data_services/session/apispec_base.py Outdated
@eikek eikek requested a review from olevski May 29, 2026 13:26
@eikek eikek marked this pull request as ready for review May 29, 2026 13:38
@eikek eikek requested review from a team, SalimKayal and sgaist as code owners May 29, 2026 13:38
Comment thread components/renku_data_services/notebooks/core_sessions.py
Comment thread components/renku_data_services/notebooks/models.py
prefix = f"{prefix}{safe_username}"
if submission_id:
prefix = f"{prefix}_{submission_id}"
prefix = f"j-{prefix}-{submission_id}"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we really need the j- prefix? This eats out 2 characters out of the 12 available.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh right, i overlooked that the caller only takes the first 12 characters of the result of that function. As I understood, the j- is for ui purposes for admins, right? So perhaps we can remove it to save two characters. I don't have a strong opinion, though, slightly in favor of not using j-.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See the other comment. It is so that all jobs show up together when you list them. If we dont add this, the jobs show up interspersed with all the renku services and renku sessions. And it is hard to see what is what. It is also hard to see at a glance what is a job and what is not when looking at pods. So it just for admins. And I think is worth it. I have gotten similar requests even for session from admins.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would this be better served by using k8s labels?

@eikek eikek force-pushed the eikek/multiple-jobs-per-launcher branch from d02c450 to 0feb343 Compare May 29, 2026 15:30
@eikek eikek requested review from leafty and sgaist May 29, 2026 15:31
leafty
leafty previously approved these changes May 29, 2026
olevski
olevski previously approved these changes Jun 1, 2026
@eikek eikek dismissed stale reviews from olevski and leafty via 19176c7 June 3, 2026 06:18
@eikek eikek force-pushed the eikek/multiple-jobs-per-launcher branch from 0feb343 to 19176c7 Compare June 3, 2026 06:18
Comment thread components/renku_data_services/notebooks/core_sessions.py
@eikek eikek force-pushed the eikek/multiple-jobs-per-launcher branch from 1313956 to fa1a651 Compare June 10, 2026 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants