| 31 Dec 2024 |
 connor (he/him) | Looks like the authors of Flash Attention are looking at support for fp8 (which comes with v3, currently only available for Hopper) for Ada series per their rebuttals on their paper: https://openreview.net/forum?id=tVConYid20&referrer=%5Bthe+profile+of+Tri+Dao%5D%28%2Fprofile%3Fid%3D~Tri_Dao1%29 | 16:53:06 |
|  kaya 𖤐 changed their profile picture. | 21:48:16 |
| 1 Jan 2025 |
| connor (he/him) | pushed the changes I had locally for nix-cuda-test (https://github.com/ConnorBaker/nix-cuda-test), if anyone wants to play with transformer engine or flash attention. I'll probably work on upstreaming those at some indeterminate point in time, but I don't know if they'll work with what's in-tree right now | 03:59:10 |
| connor (he/him) | * pushed the changes I had locally for nix-cuda-test (https://github.com/ConnorBaker/nix-cuda-test), if anyone wants to play with transformer engine or flash attention (both for PyTorch). I'll probably work on upstreaming those at some indeterminate point in time, but I don't know if they'll work with what's in-tree right now | 03:59:24 |
| connor (he/him) | SomeoneSerge (utc+3): are you aware of a clean, cross-platform way to handle patching the path to libcuda.so (as needed in https://github.com/NixOS/nixpkgs/pull/369495#issuecomment-2566002172)? Is it fair to assume that on non-NixOS systems, whatever wrapper people use (like nixGL or nixglhost) will add libcuda.so to LD_LIBRARY_PATH? | 04:00:43 |
| connor (he/him) | A new hope? https://www.phoronix.com/news/ZLUDA-v4-Released | 11:14:50 |
| connor (he/him) | https://github.com/NixOS/nixpkgs/pull/369956 | 13:22:40 |
|  NixOS Moderation Botchanged room power levels. | 14:26:32 |
| connor (he/him) | Thanks for the feedback Serge :) | 20:37:37 |
| 5 Jan 2025 |
|  @techyporcupine:matrix.org set a profile picture. | 20:36:11 |
| 7 Jan 2025 |
|  ruro joined the room. | 03:39:47 |
 SomeoneSerge (back on matrix) | Hi, sorry if I missed anything, my homeserver was offline for a week | 21:58:59 |
| Jitsi widget removed by SomeoneSerge (back on matrix) | 21:59:20 |
|  tomberek joined the room. | 22:40:13 |
| 9 Jan 2025 |
 hexa | connor (he/him) (UTC-7): can we get your result of https://github.com/microsoft/onnxruntime/issues/22855 ported into nixpkgs as well? | 02:08:59 |
| hexa | https://github.com/NixOS/nixpkgs/pull/364362 is still stuck on that issue | 02:09:12 |
| hexa | oh, I see your're in the LA area | 02:12:06 |
| hexa | take care! | 02:12:08 |
| connor (he/him) | Check out how I packaged https://github.com/ConnorBaker/cuda-packages/tree/main/cuda-packages/common/cudnn-frontend and https://github.com/ConnorBaker/cuda-packages/blob/main/cuda-packages/common/onnxruntime/package.nix | 05:56:56 |
| connor (he/him) | In reply to @hexa:lossy.network
oh, I see your're in the LA area I’m about an hour south so I’m fine apart from poor air quality | 15:01:45 |
| hexa | torch and tensorboard on python3.13 https://github.com/NixOS/nixpkgs/pull/372406 | 15:33:12 |
 Gaétan Lepage | Thanks for handling that ! | 15:37:46 |
| 11 Jan 2025 |
|  oak 🏳️🌈♥️ removed their profile picture. | 16:46:07 |
| hexa | can I get some guidance on cudaPackages? | 02:24:33 |
| oak 🏳️🌈♥️ set a profile picture. | 16:47:04 |
| hexa | https://github.com/NixOS/nixpkgs/pull/364362 | 02:24:37 |
| hexa |
error: evaluation aborted with the following error message: 'lib.customisation.callPackageWith: Function called without required argument "cuda_cccl" at /nix/store/sj06sl54sc0rxlj0g52pd3pq3glyvpak-source/pkgs/development/cuda-modules/cudnn-frontend/default.nix:5'
| 02:24:46 |
| hexa | ok, guess I need to pick them out of cudaPackages | 02:33:01 |
| SomeoneSerge (back on matrix) | Odd, I thought we nuked old cuda releases that didn't have cuda_cccl? | 11:47:40 |
| hexa | oh yeah, that would explain why I could build it just fine, but eval would fail 🙂 | 16:09:02 |
