Will gpu-operator support Rocky linux in the furture?

[carlwang87]

Will gpu-operator support Rocky linux in the furture?

[hotspoons]

@carlwang87 I was able to make the GPU operator work on a Rocky 8 Kubernetes cluster by rebuilding the driver container image and modifying the nvidia-driver script to pull and install kernel RPMs from Rocky's RPM repo over top of the RHEL UBI container image, and use that to build and install the driver on the host. A little hacky but it works! And - it should also work for AlmaLinux and Oracle Linux too provided you update RPM_BASE_URL when building the image to point to the respective RPM repo for each distro, but I haven't tested.

[mmmarceleza]

@carlwang87 I was able to make the GPU operator work on a Rocky 8 Kubernetes cluster by rebuilding the driver container image and modifying the nvidia-driver script to pull and install kernel RPMs from Rocky's RPM repo over top of the RHEL UBI container image, and use that to build and install the driver on the host. A little hacky but it works! And - it should also work for AlmaLinux and Oracle Linux too provided you update RPM_BASE_URL when building the image to point to the respective RPM repo for each distro, but I haven't tested.

I have the same problem and need to install Nvidia operator in a cluster with Oracle Linux. I will try your solution.

[hotspoons]

@carlwang87 I was able to make the GPU operator work on a Rocky 8 Kubernetes cluster by rebuilding the driver container image and modifying the nvidia-driver script to pull and install kernel RPMs from Rocky's RPM repo over top of the RHEL UBI container image, and use that to build and install the driver on the host. A little hacky but it works! And - it should also work for AlmaLinux and Oracle Linux too provided you update RPM_BASE_URL when building the image to point to the respective RPM repo for each distro, but I haven't tested.

I have the same problem and need to install Nvidia operator in a cluster with Oracle Linux. I will try your solution.

One thing to note is I switched to the "vault" URL for rocky, where they archive old versions of packages. If oracle Linux has something similar, I suggest using that because otherwise you will run into a situation where you are chasing mismatched packages from the latest security updates for the UBI image and the EL clone's newest available versions.

I also suggest locking the base image to a specific digest for the container instead of what ever tag I used in my repo, because otherwise you will be fighting a moving target. Godspeed.

[mmmarceleza]

Hi @hotspoons, thank you for your advice, I could make it work with Rocky Linux 8.10.

I created a PoC on GCP to validate with freedom. There, I needed to use Rocky Linux, since It is not possible to choose Oracle Linux.

Now, I am fighting with Rocky Linux 9.5, since my real environmental has this version. The problem I am facing now is the absence of base RHEL images in version 9.5. I am trying to use version 9.3 to make it work.

[pikomen]

Hi @hotspoons, thank you for your advice, I could make it work with Rocky Linux 8.10.

I created a PoC on GCP to validate with freedom. There, I needed to use Rocky Linux, since It is not possible to choose Oracle Linux.

Now, I am fighting with Rocky Linux 9.5, since my real environmental has this version. The problem I am facing now is the absence of base RHEL images in version 9.5. I am trying to use version 9.3 to make it work.

Waiting for your update

[d-a-n-k-a]

also AMD's approach, based on Kernel Module Management Operator looks way more elegant - they don't bother to build images for every possible distro (well, neither does Nvidia :-D ), but AMD makes it possible to run their stack on any distro instead <3

[github-actions]

This issue is stale because it has been open 90 days with no activity. This issue will be closed in 30 days unless new comments are made or the stale label is removed. To skip these checks, apply the "lifecycle/frozen" label.

[francisguillier]

Hi,
I’ve added the request to our backlog, and we’ll prioritize it as we see increased demand.

[rahulait]

Merged PRs:
#2044
NVIDIA/gpu-driver-container#595