!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

211 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda42 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
16 Jul 2024
@ss:someonex.netSomeoneSerge (utc+3)* To be clear: the intention is that on nixos the user should never have to manually list all packages in the driver's closure. If you find that you need to that's either a bug or an edge case I failed to handle20:20:27
@ss:someonex.netSomeoneSerge (utc+3)
In reply to @mkiefel:matrix.org
Man, I got it. Somehow the wrong libEGL_nvidia.so got picked up. With the right one it works. This kept me busy this afternoon. :) In any case, thanks so much for the great work on the cuda packages! I really appreciate all the work that you folks put into this.
Thanks. Could you still tell us which libegl was the wrong one and which one is the right?
20:21:58
@mkiefel:matrix.orgmkiefel
In reply to@ss:someonex.net
Thanks. Could you still tell us which libegl was the wrong one and which one is the right?
Sure. It went for /nix/store/cg66ia01r8226nr478rv2b7fffvrl4gg-xgcc-12.3.0-libgcc/lib/libEGL_nvidia.so.0 but should have picked the one in /usr/lib/aarch64-linux-gnu/tegra-egl/libEGL_nvidia.so.0. I think I need to do something like nixGL and set these libraries up when calling the executable. I am still a bit confused why setting export __EGL_VENDOR_LIBRARY_FILENAMES=/usr/lib/aarch64-linux-gnu/tegra-egl/nvidia.json didn't do the trick.
20:31:42
@alex3829:matrix.org@alex3829:matrix.org left the room.23:17:07
17 Jul 2024
@ironbound:hackerspace.pl@ironbound:hackerspace.pl changed their display name from ironbound to Professor Bin Dong.18:22:01
@ironbound:hackerspace.pl@ironbound:hackerspace.pl removed their profile picture.18:22:09
@ironbound:hackerspace.pl@ironbound:hackerspace.pl set a profile picture.18:23:57
@philiptaron:matrix.orgPhilip Taron (UTC-8) joined the room.19:07:33
18 Jul 2024
@jiashuaixu:matrix.orgJesse joined the room.09:51:27
@ironbound:hackerspace.pl@ironbound:hackerspace.pl changed their display name from Professor Bin Dong to Professor.22:49:10
@ironbound:hackerspace.pl@ironbound:hackerspace.pl changed their display name from Professor to P_Big.22:49:51
19 Jul 2024
@shapr:cofree.coffeeshapr joined the room.19:25:24
@fishball02:matrix.org@fishball02:matrix.org left the room.21:30:09
21 Jul 2024
@hexa:lossy.networkhexa (UTC+1)can anyone here test a hardening change for ollama with rocm?18:33:12
@hexa:lossy.networkhexa (UTC+1)https://github.com/NixOS/nixpkgs/pull/32871318:33:17
@hexa:lossy.networkhexa (UTC+1)they want at least a vega 56, but not the rx 5000 series18:33:44
@hexa:lossy.networkhexa (UTC+1)
services.ollama = {
  enable = true;
  acceleration = "rocm";
};
18:34:17
@hexa:lossy.networkhexa (UTC+1) then run ollama pull gemma 18:35:26
@hexa:lossy.networkhexa (UTC+1)and18:36:00
@hexa:lossy.networkhexa (UTC+1)
curl http://localhost:11434/api/generate -d '{
  "model": "gemma",
  "prompt":"Why is the sky blue?"
}'
18:36:09
@hexa:lossy.networkhexa (UTC+1) *
services.ollama = {
  enable = true;
  acceleration = "rocm";
};

systemd.services.ollama.serviceConfig = {
  DeviecPolicy = "closed";
  DeviceAllow = [
    "/dev/dri/renderD128"
    "/dev/dri/renderD129"
    "/dev/dri/renderD130"
    "/dev/dri/renderD131"
    /dev/kfd"
  };
};
18:39:42
@hexa:lossy.networkhexa (UTC+1) *
services.ollama = {
  enable = true;
  acceleration = "rocm";
};

systemd.services.ollama.serviceConfig = {
  DeviecPolicy = "closed";
  DeviceAllow = [
    "/dev/dri/renderD128"
    "/dev/dri/renderD129"
    "/dev/dri/renderD130"
    "/dev/dri/renderD131"
    "/dev/kfd"
  };
};
18:39:49

Show newer messages


Back to Room ListRoom Version: 9