In reply to @vid:matrix.org
Hi all, I am running nixos 23.11. I have an intel 12700k igpu for display, and an nvidia 3090 I want to use for cuda. That is basically working, displays work as does nvidia-smi. However, I need to use this with docker, which apparently needs libnvidia-ml.so.1, which I cannot install. Is there an answer, or a better place to ask? thanks!

In reply to @vid:matrix.org
I can't find how it should be installed.

In reply to @ss:someonex.net
Can't say much about the state of 2311 rn, but unstable offers a CDI module

I switched over to unstable, but am still going in circles. I feel like I'm one statement away from success, but it still seems infinitely far away. here's my cuda-specific config at the moment (it's included from configuration.nix):

{ config, pkgs, ... }:

{
  boot.extraModulePackages = [ pkgs.linuxPackages.nvidia_x11 ];
  hardware.opengl.enable = true; # needed for docker
  systemd.enableUnifiedCgroupHierarchy = false; # otherwise nvidia-docker fails
  
  hardware.nvidia = {
    modesetting.enable = true;
    nvidiaSettings = true;
    package = config.boot.kernelPackages.nvidia_x11;
    powerManagement.finegrained = false;
    powerManagement.enable = true;
    open = false;
  };
  
  environment.systemPackages = with pkgs; [
    btop
    cudatoolkit
#    nvidia-container-toolkit
    linuxPackages.nvidia_x11
  ];
  nixpkgs.config.allowUnfree = true;
  
  nixpkgs.config.cudaSupport = true;

  boot.blacklistedKernelModules = [ "nouveau"];
#  services.xserver.videoDrivers = ["nvidia"];

  hardware.nvidia-container-toolkit.enable = true;
  virtualisation = {
    containers = {
      enable = true;
      cdi.dynamic.nvidia.enable = true;
    };
    docker = {
#     rootless = {
#        setSocketVariable = false;
#      };
      enable = true;
      # CDI is feature-gated and only available from Docker 25 and onwards
     package = pkgs.docker_25;
     daemon.settings.features.cdi = true;
    };
 #   oci-containers.backend = "docker";
  };
  
}

In reply to @vid:matrix.org
one notable thing is I don't have services.xserver.videoDrivers defined at all. "intel" didn't work for some reason (12700k).

I found that doing docker run --gpus=all results in

docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

Whereas docker run --device nvidia.com/gpu=all will detect my GPU. vid

My minimal settings are documented in this issue. https://github.com/NixOS/nixpkgs/issues/305312

Has anyone managed to get TensorFlow and PyTorch in the same Python environment on a recent nixos-unstable? This has seemed to have broken at some point in the last few months.

$ nix-shell -I nixpkgs=channel:nixos-unstable -p 'python3.withPackages (ps: with ps; [ torch tensorflow ])'

this derivation will be built:
  /nix/store/p7hnwqgxp8hm52qkw787r9i9akb1y9fd-python3-3.11.9-env.drv
building '/nix/store/p7hnwqgxp8hm52qkw787r9i9akb1y9fd-python3-3.11.9-env.drv'...
error: collision between `/nix/store/k0hpynrpwp0ihh86r1walxv0dcvij9ba-python3.11-grpcio-1.62.1/lib/python3.11/site-packages/grpc/__pycache__/__init__.cpython-311.opt-1.pyc' and `/nix/store/n67kryc5dcblnvb17h04fx7ivbbjjlk6-python3.11-grpcio-1.62.1/lib/python3.11/site-packages/grpc/__pycache__/__init__.cpython-311.opt-1.pyc'
error: builder for '/nix/store/p7hnwqgxp8hm52qkw787r9i9akb1y9fd-python3-3.11.9-env.drv' failed with exit code 255;
       last 1 log lines:
       > error: collision between `/nix/store/k0hpynrpwp0ihh86r1walxv0dcvij9ba-python3.11-grpcio-1.62.1/lib/python3.11/site-packages/grpc/__pycache__/__init__.cpython-311.opt-1.pyc' and `/nix/store/n67kryc5dcblnvb17h04fx7ivbbjjlk6-python3.11-grpcio-1.62.1/lib/python3.11/site-packages/grpc/__pycache__/__init__.cpython-311.opt-1.pyc'
       For full logs, run 'nix log /nix/store/p7hnwqgxp8hm52qkw787r9i9akb1y9fd-python3-3.11.9-env.drv'.