| 21 Dec 2024 |
matthewcroughan | trying to use rocm | 18:54:55 |
matthewcroughan | rocmlir-rock-5.7.1 | 18:55:09 |
matthewcroughan | https://github.com/NixOS/nixpkgs/issues/197885#issuecomment-2416994704 | 19:00:58 |
matthewcroughan | ah does torch-bin only work for cuda? | 19:17:31 |
matthewcroughan | https://github.com/ROCm/rocMLIR/releases/tag/rocm-6.3.1 | 19:40:29 |
matthewcroughan | looks like it got an update to 6.3.1 yesterday | 19:40:43 |
matthewcroughan | 6.3.1 compiles fine just by overriding to use this new source | 20:42:05 |
matthewcroughan | but then I need magma in rocmPackages 6, which doesn't seem to build either | 20:42:28 |
matthewcroughan | rocm in nixpkgs is close to working, but not quite there | 20:42:37 |
| 22 Dec 2024 |
SomeoneSerge (back on matrix) | 👍️ cuda and rocm in pytorch are mutually exclusive, so I guess there must be a separate wheel | 00:19:20 |
matthewcroughan | https://hydra.nixos.org/job/nixpkgs/trunk/zluda.x86_64-linux | 10:51:11 |
matthewcroughan | when is the last time this even built | 10:51:18 |
matthewcroughan | it seems like literally never? | 10:51:30 |
matthewcroughan | how was this merged if it never built? | 10:51:34 |
SomeoneSerge (back on matrix) | Back when rocmPackages weren't broken | 11:28:26 |
SomeoneSerge (back on matrix) | * Back when rocmPackages weren't broken exceeding the hydra quotas | 11:28:39 |
matthewcroughan | SomeoneSerge (utc+3): I would love to try out zluda, but do not want to wait over 7 hours for the build, or whatever it takes | 12:21:49 |
matthewcroughan | got a cache? | 12:21:52 |
SomeoneSerge (back on matrix) | No, sorry. I haven't got any amd hardware at home unfortunately | 12:37:10 |
matthewcroughan | Yeah I think there's a lack of investment in the AMD community. | 12:37:30 |
matthewcroughan | In a fairer world, we would be given the hardware to support this, but we don't have such a thing. And given that nobody is willing to give, then they won't get. | 12:37:49 |
matthewcroughan | The state of things, I think reflects a lack of support from the people who need to give it. | 12:38:27 |
matthewcroughan | And I don't see many people complaining either, so maybe there aren't very many users anyway? | 12:38:54 |
SomeoneSerge (back on matrix) | I still think the clusters are the main user, and these people currently aren't sold on "this kind of reproducibility" | 13:22:51 |
| @stablejoy:matrix.org left the room. | 13:24:59 |
matthewcroughan | What I mean is that I could sit here and build stuff, and with some hard drives given to me host a cache for almost free on a gigabit connection | 13:30:52 |
matthewcroughan | But there's no incentive for me to do so, because I would starve trying | 13:31:01 |
SomeoneSerge (back on matrix) | Nooooo you have to build a profitable business that justifies building stuff, embrace the grind | 14:15:23 |
matthewcroughan | I think what I'm saying is that there seems to be exactly no way to justify building for AMD, and that this goes beyond NixOS and upstream | 14:20:45 |
| allrealmsoflife joined the room. | 15:55:31 |