Skip to content

[template] create templates for use in generating actions#1282

Draft
cjac wants to merge 131 commits intoGoogleCloudDataproc:mainfrom
LLC-Technologies-Collier:template-gpu-20241219
Draft

[template] create templates for use in generating actions#1282
cjac wants to merge 131 commits intoGoogleCloudDataproc:mainfrom
LLC-Technologies-Collier:template-gpu-20241219

Conversation

@cjac
Copy link
Contributor

@cjac cjac commented Dec 20, 2024

This PR should resolve #1276 and is an attempt at better solving the problem space of #1030

I believe that #1259 could be implemented easier using this change, but its dependency on rebooting is antithetical to Dataproc in many ways and has not been included. I will meet with NVIDIA and the Dataproc engineering team to troubleshoot the problem.

This PR includes code refactored out of GPU-acceleration-related and dask-related actions and into files under the templates/ directory of the repository. There are a set of PRs which rebase to this branch:

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[initialization-actions] The repository has manually-generated, re-used code which gets out of sync

4 participants