16 Jul 2024 |
SomeoneSerge (utc+3) | In reply to @mkiefel:matrix.org Man, I got it. Somehow the wrong libEGL_nvidia.so got picked up. With the right one it works. This kept me busy this afternoon. :) In any case, thanks so much for the great work on the cuda packages! I really appreciate all the work that you folks put into this. Thanks. Could you still tell us which libegl was the wrong one and which one is the right? | 20:21:58 |
mkiefel | In reply to@ss:someonex.net Thanks. Could you still tell us which libegl was the wrong one and which one is the right? Sure. It went for /nix/store/cg66ia01r8226nr478rv2b7fffvrl4gg-xgcc-12.3.0-libgcc/lib/libEGL_nvidia.so.0 but should have picked the one in /usr/lib/aarch64-linux-gnu/tegra-egl/libEGL_nvidia.so.0 . I think I need to do something like nixGL and set these libraries up when calling the executable. I am still a bit confused why setting export __EGL_VENDOR_LIBRARY_FILENAMES=/usr/lib/aarch64-linux-gnu/tegra-egl/nvidia.json didn't do the trick. | 20:31:42 |
| @alex3829:matrix.org left the room. | 23:17:07 |
17 Jul 2024 |
| @ironbound:hackerspace.pl changed their display name from ironbound to Professor Bin Dong. | 18:22:01 |
| @ironbound:hackerspace.pl removed their profile picture. | 18:22:09 |
| @ironbound:hackerspace.pl set a profile picture. | 18:23:57 |
| Philip Taron (UTC-8) joined the room. | 19:07:33 |
18 Jul 2024 |
| Jesse joined the room. | 09:51:27 |
| @ironbound:hackerspace.pl changed their display name from Professor Bin Dong to Professor. | 22:49:10 |
| @ironbound:hackerspace.pl changed their display name from Professor to P_Big. | 22:49:51 |
19 Jul 2024 |
| shapr joined the room. | 19:25:24 |
| @fishball02:matrix.org left the room. | 21:30:09 |
21 Jul 2024 |
hexa (UTC+1) | can anyone here test a hardening change for ollama with rocm? | 18:33:12 |
hexa (UTC+1) | https://github.com/NixOS/nixpkgs/pull/328713 | 18:33:17 |
hexa (UTC+1) | they want at least a vega 56, but not the rx 5000 series | 18:33:44 |
hexa (UTC+1) | services.ollama = {
enable = true;
acceleration = "rocm";
};
| 18:34:17 |
hexa (UTC+1) | then run ollama pull gemma | 18:35:26 |
hexa (UTC+1) | and | 18:36:00 |
hexa (UTC+1) | curl http://localhost:11434/api/generate -d '{
"model": "gemma",
"prompt":"Why is the sky blue?"
}'
| 18:36:09 |
hexa (UTC+1) | * services.ollama = {
enable = true;
acceleration = "rocm";
};
systemd.services.ollama.serviceConfig = {
DeviecPolicy = "closed";
DeviceAllow = [
"/dev/dri/renderD128"
"/dev/dri/renderD129"
"/dev/dri/renderD130"
"/dev/dri/renderD131"
/dev/kfd"
};
};
| 18:39:42 |
hexa (UTC+1) | * services.ollama = {
enable = true;
acceleration = "rocm";
};
systemd.services.ollama.serviceConfig = {
DeviecPolicy = "closed";
DeviceAllow = [
"/dev/dri/renderD128"
"/dev/dri/renderD129"
"/dev/dri/renderD130"
"/dev/dri/renderD131"
"/dev/kfd"
};
};
| 18:39:49 |
| mindstorms6 joined the room. | 18:43:32 |