| 5 Nov 2025 |
 apyh | should be fine | 03:28:56 |
 connor (burnt/out) (UTC-8) | Flash attention doesn’t support anything older than Ampere I thought | 03:29:07 |
 Robbie Buxton | V2 does | 03:29:19 |
| Robbie Buxton | V3 is hopper only | 03:29:24 |
| apyh | ya its only v3 iirc | 03:29:26 |
| Robbie Buxton | V4 (cute) is Blackwell | 03:29:33 |
| Robbie Buxton | But that’s a wip | 03:29:38 |
| apyh | and yeah fair enough I could drop fa for older gpus, ig i can provide cuda capabilities different per package | 03:30:06 |
| Robbie Buxton | Requires cutlass-dsl | 03:30:07 |
| connor (burnt/out) (UTC-8) | V2 doesn’t support older than Ampere per their readme, unless they forgot to update it | 03:30:25 |
| apyh | In reply to @connorbaker:matrix.org
V2 doesn’t support older than Ampere per their readme, unless they forgot to update it yeah makes sense then maybe I'll just drop and see if anyone complains lol | 03:30:43 |
| Robbie Buxton | In reply to @connorbaker:matrix.org
V2 doesn’t support older than Ampere per their readme, unless they forgot to update it It’s not optimized but it runs | 03:30:46 |
| Robbie Buxton | V3 is busted | 03:30:54 |
| connor (burnt/out) (UTC-8) | So long as you have PTX it should be fine | 03:30:55 |
| connor (burnt/out) (UTC-8) | cries in Ada | 03:31:14 |
| connor (burnt/out) (UTC-8) | Robbie have you been following PyTorch Helion? Seems interesting (but boooooo Bazel build) | 03:32:07 |
| Robbie Buxton | Yeah seems cool, morach too! | 03:32:37 |
| Robbie Buxton | * Yeah seems cool, monarch too! | 03:32:47 |
| apyh | monarch looks sweeet | 03:32:52 |
| apyh | were any of you at pytorch conference? | 03:33:02 |
| apyh | shoulda asked when i was there lol | 03:33:08 |
| Robbie Buxton | Nah | 03:33:33 |
| Robbie Buxton | Was it any good!? | 03:33:41 |
| apyh | nah | 03:33:44 |
| apyh | lol | 03:33:45 |
| apyh | couple neat talks but nothing revolutionary | 03:33:57 |
| Robbie Buxton | I will say tho @apyh for packaging I often disable high capacities until after I’ve got it working to make it quicker to interate. | 03:38:39 |
| Robbie Buxton | I’ve yet to hit a capability specific build issue touch wood | 03:38:54 |
| connor (burnt/out) (UTC-8) | Merged https://github.com/NixOS/nixpkgs/pull/458835
hexa (UTC+1) that should fix the Firefox breakage due to CUDA leaking into the default | 15:33:50 |
 hexa (UTC+1) | thannks | 15:36:24 |
