| 4 Nov 2025 |
 Robbie Buxton | * And from what git tag? | 22:24:59 |
 Ari Lotter | v2, from tag v2.8.2 | 22:29:50 |
| Robbie Buxton | I think there is currently a pr open in nixpkgs to add this, is that the one you’re building? | 22:30:41 |
| Ari Lotter | oh neat, no | 22:31:37 |
| Ari Lotter | let me compare my derivation with that one | 22:31:40 |
| Ari Lotter | ok yeah, decently similar. difference is i'm building against cutlass 4.0 instead of 4.1, and.. somehow my deps list is wayy simpler, yet the build works (on previous versions of my derivation, pre updating CUDA)? very strange.. | 22:35:13 |
| Ari Lotter | but yeah i just smash into
> build/lib.linux-x86_64-cpython-312/flash_attn_2_cuda.cpython-312-x86_64-linux-gnu.so: PC-relative offset overflow in PLT entry for `_ZNK3c1010TensorImpl4sizeEl'
``` 🤷
| 22:35:28 |
| Ari Lotter | i'm so tired of CUDA nightmares 😭 im so close to giving up and building dockerized devenvs, i just really don't want to give in..... :( | 22:37:57 |
 Gaétan Lepage | (It's a secret, but you might want to add https://cache.nixos-cuda.org as a substituter, it is slowly getting more and more artifacts)
Public key: cache.nixos-cuda.org:74DUi4Ye579gUqzH4ziL9IyiJBlDpMRn9MBN8oNan9M= | 22:44:02 |
| Gaétan Lepage | connor (burnt/out) (UTC-8), Serge and I got #457803 ready.
We are waiting for nixpkgs's CI to get fixed (https://github.com/NixOS/nixpkgs/pull/458647).
Let's merge ASAP | 23:38:07 |
| Robbie Buxton | For flash attention you should use the version of cutlass in the repo | 23:54:57 |
| Robbie Buxton | They have a hash | 23:55:06 |
