In reply to @vid:matrix.org
Hi all, I am running nixos 23.11. I have an intel 12700k igpu for display, and an nvidia 3090 I want to use for cuda. That is basically working, displays work as does nvidia-smi. However, I need to use this with docker, which apparently needs libnvidia-ml.so.1, which I cannot install. Is there an answer, or a better place to ask? thanks!

In reply to @vid:matrix.org
I can't find how it should be installed.

In reply to @ss:someonex.net
Can't say much about the state of 2311 rn, but unstable offers a CDI module

I switched over to unstable, but am still going in circles. I feel like I'm one statement away from success, but it still seems infinitely far away. here's my cuda-specific config at the moment (it's included from configuration.nix):

{ config, pkgs, ... }:

{
  boot.extraModulePackages = [ pkgs.linuxPackages.nvidia_x11 ];
  hardware.opengl.enable = true; # needed for docker
  systemd.enableUnifiedCgroupHierarchy = false; # otherwise nvidia-docker fails
  
  hardware.nvidia = {
    modesetting.enable = true;
    nvidiaSettings = true;
    package = config.boot.kernelPackages.nvidia_x11;
    powerManagement.finegrained = false;
    powerManagement.enable = true;
    open = false;
  };
  
  environment.systemPackages = with pkgs; [
    btop
    cudatoolkit
#    nvidia-container-toolkit
    linuxPackages.nvidia_x11
  ];
  nixpkgs.config.allowUnfree = true;
  
  nixpkgs.config.cudaSupport = true;

  boot.blacklistedKernelModules = [ "nouveau"];
#  services.xserver.videoDrivers = ["nvidia"];

  hardware.nvidia-container-toolkit.enable = true;
  virtualisation = {
    containers = {
      enable = true;
      cdi.dynamic.nvidia.enable = true;
    };
    docker = {
#     rootless = {
#        setSocketVariable = false;
#      };
      enable = true;
      # CDI is feature-gated and only available from Docker 25 and onwards
     package = pkgs.docker_25;
     daemon.settings.features.cdi = true;
    };
 #   oci-containers.backend = "docker";
  };
  
}

In reply to @vid:matrix.org
one notable thing is I don't have services.xserver.videoDrivers defined at all. "intel" didn't work for some reason (12700k).