| 10 Dec 2025 |
SomeoneSerge (back on matrix) | Gaetan has been on it | 23:32:00 |
apyh | yeah, seems like there's a clear path to patch / upstream a fix to llama cpp python to make it lazy | 23:33:22 |
apyh | btw i posted logs about that torch nvrtc thing | 23:33:36 |
| 11 Dec 2025 |
GaƩtan Lepage | Yes, but it's not as straightforward as they initialize some top-level constants at module import time with the content of the loaded library...
I still think that it would be the best solution to this issue. | 09:19:45 |
| youthlic changed their profile picture. | 14:36:35 |