Hi! If you have some time I have a couple PRs waiting review/merge:

• Allow to provide CSV files for Nvidia-ctk (fixes jetson devices): https://github.com/NixOS/nixpkgs/pull/401840
• Fix nvidia-ctk for the Nvidia docker runtime (deprecated): https://github.com/NixOS/nixpkgs/pull/407290

Thanks :)

Hello, this was a long time ago, but I'm finally back to trying to run ollama :D

saxpy doesn't work. I used this flake:

{
  description = "CUDA saxpy test";
  inputs.nixpkgs.url = "nixpkgs";
  outputs =
    { self, nixpkgs }:
    {
      devShell.x86_64-linux =
        let
          pkgs = import nixpkgs {
            system = "x86_64-linux";
            config.allowUnfree = true; # Required for CUDA
          };
        in
        pkgs.mkShell {
          name = "cuda-saxpy-shell";
          buildInputs = [
            pkgs.cudaPackages.saxpy
            pkgs.cudaPackages.cudatoolkit
          ];
          shellHook = ''
            export CUDA_PATH=${pkgs.cudatoolkit}
            export EXTRA_LDFLAGS="-L/lib -L${pkgs.linuxPackages.nvidia_x11}/lib"
            export EXTRA_CCFLAGS="-I/usr/include"
            # Should I set this?
            # export LD_LIBRARY_PATH=${pkgs.cudaPackages.cudatoolkit.lib}/lib:$LD_LIBRARY_PATH
          '';
        };
    };
}

I'm running in the same(?) initialization error I think (see the log file attached) for LD_DEBUG=libs saxpy.

The output of nvidia-smi:

{
  description = "CUDA saxpy test";
  inputs.nixpkgs.url = "nixpkgs";
  outputs =
    { self, nixpkgs }:
    {
      devShell.x86_64-linux =
        let
          pkgs = import nixpkgs {
            system = "x86_64-linux";
            config.allowUnfree = true; # Required for CUDA
          };
        in
        pkgs.mkShell {
          name = "cuda-saxpy-shell";
          buildInputs = [
            pkgs.cudaPackages.saxpy
            pkgs.cudaPackages.cudatoolkit
          ];
          shellHook = ''
            export CUDA_PATH=${pkgs.cudatoolkit}
            export EXTRA_LDFLAGS="-L/lib -L${pkgs.linuxPackages.nvidia_x11}/lib"
            export EXTRA_CCFLAGS="-I/usr/include"
            # Should I set this?
            # export LD_LIBRARY_PATH=${pkgs.cudaPackages.cudatoolkit.lib}/lib:$LD_LIBRARY_PATH
          '';
        };
    };
}

Hello, this was a long time ago, but I'm finally back to trying to run ollama :D

saxpy doesn't work. I used this flake:

{
  description = "CUDA saxpy test";
  inputs.nixpkgs.url = "nixpkgs";
  outputs =
    { self, nixpkgs }:
    {
      devShell.x86_64-linux =
        let
          pkgs = import nixpkgs {
            system = "x86_64-linux";
            config.allowUnfree = true; # Required for CUDA
          };
        in
        pkgs.mkShell {
          name = "cuda-saxpy-shell";
          buildInputs = [
            pkgs.cudaPackages.saxpy
            pkgs.cudaPackages.cudatoolkit
          ];
          shellHook = ''
            export CUDA_PATH=${pkgs.cudatoolkit}
            export EXTRA_LDFLAGS="-L/lib -L${pkgs.linuxPackages.nvidia_x11}/lib"
            export EXTRA_CCFLAGS="-I/usr/include"
            # Should I set this?
            # export LD_LIBRARY_PATH=${pkgs.cudaPackages.cudatoolkit.lib}/lib:$LD_LIBRARY_PATH
          '';
        };
    };
}

I'm running in the same(?) initialization error I think (see the log file attached) for LD_DEBUG=libs saxpy.

The output of nvidia-smi:

[little-dude@system76-laptop:~/cuda-tests]$ nvidia-smi 
Sat May 24 11:08:06 2025       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 570.144                Driver Version: 570.144        CUDA Version: 12.8     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4060 ...    Off |   00000000:01:00.0 Off |                  N/A |
| N/A   46C    P0            590W /  115W |      12MiB /   8188MiB |     13%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A            3706      G   ...me-shell-48.1/bin/gnome-shell          2MiB |
+-----------------------------------------------------------------------------------------+