Sender | Message | Time |
---|---|---|
30 Dec 2023 | ||
raitobezarius changed their display name from raitobezarius (DECT 2128) to raitobezarius. | 19:53:16 | |
31 Dec 2023 | ||
benoitdr | Redacted or Malformed Event | 08:30:54 |
trexd | In reply to @benoitdr:matrix.orgYeah protip, if you're looking for AI packages, use github search and do language:Nix PACKAGE_NAME buildPythonPackage and there's a good chance someone has already packaged it. That saves me so much time :D | 17:04:35 |
2 Jan 2024 | ||
benoitdr | In reply to @trexd:matrix.orgGreat, thanks ! | 08:35:38 |
@1h0:matrix.org joined the room. | 11:33:37 | |
3 Jan 2024 | ||
benoitdr | Still a question : I have successfully packaged ctransformers based on the information above, but it cannot see my GPU. If I would pip install it, I would use the cuda option (pip install ctransfomers[cuda]). Is there a way to pass the same option to buildPythonPackage ? | 13:01:55 |
benoitdr | In reply to @benoitdr:matrix.org (partially) answering to myslef, looking at setup.py, I can see that the cuda option corresponds to 2 extra packages :
| 14:18:44 |
Someone S | (casual reminder that these are poetry2nix-generated wrappers for the pypi wheels, expect them to break) | 14:33:54 |
Someone S | In reply to @benoitdr:matrix.orgPass the respective flags to cmake | 14:34:10 |
Someone S | * (casual reminder that these are poetry2nix-generated wrappers for the pypi wheels, expect them to break) EDIT: aj this is from setup.py, nvm | 14:34:33 |
benoitdr | Need more info ... indeed these 2 pkgs from setup.py are nvidia proprietary and only distributed as wheels on pypi. So what is the way out (if any) ? I have already tried to include python310Packages.pycuda, cudaPackages.libcublas, cudaPackages.cuda_cudart, cudaPackages.cudatoolkit , also passing allowUnfree = true; cudaSupport = true; to nixpkgs config, without success. I'm feeling a bit stuck here ... | 14:43:55 |
Someone S | You need to pass this flag during the ctransformers build: https://github.com/marella/ctransformers/blob/ed02cf4b9322435972ff3566fd4832806338ca3d/CMakeLists.txt#L6 | 14:45:55 |
Someone S |
You can remove this one | 14:46:22 |
Someone S |
I don't see pycuda in ctrasnformers' dependencies? | 14:47:01 |
Someone S | In reply to @ss:someonex.netTheir setup.py introduces an ad hoc environment variable for that: https://github.com/marella/ctransformers/blob/ed02cf4b9322435972ff3566fd4832806338ca3d/setup.py#L10C41-L10C42 | 14:50:11 |
Someone S | It would've been better if they weren't wrapping/hiding cmake from the user but at least there's a variable | 14:50:37 |
Someone S | So you can set something like env.CT_CUBLAS = "ON" | 14:51:22 |
benoitdr | Yep, env.CT_CUBLAS = "ON"; was the trick. Still I need cudatoolkit in propagatedBuildInputs, nothing more. Thanks a lot ! | 15:58:26 |
4 Jan 2024 | ||
Someone S |
| 04:47:57 |
Someone S | Also there's no need to propagate it | 04:48:08 |
thetootler joined the room. | 06:25:27 | |
benoitdr | Strange ... It doesn't work without it on my side | 19:56:48 |
5 Jan 2024 | ||
@palo:xaos.space joined the room. | 08:38:35 | |
palo joined the room. | 08:54:18 | |
@ava:milliways.info joined the room. | 10:16:35 | |
@ava:milliways.info left the room. | 10:16:48 | |
Hmpffff joined the room. | 13:17:55 | |
Someone S | In reply to @benoitdr:matrix.orgCould you elaborate? What are the errors | 17:31:24 |
6 Jan 2024 | ||
benoitdr | Here is my shell.nix file :
Without cudatoolkit, at compile time, ctransformers complaints that cublas is not found, and at runtime, ctransformers cannot use the GPU. | 10:29:05 |
benoitdr | BTW, the same thing happens if I set cudaSupport to true like this :
cudatoolkit is still needed | 10:43:54 |