| 16 Apr 2024 |
 SomeoneSerge (matrix works sometimes) | In reply to @search-sense:matrix.org
establishing a base line I don't know what it means Have you tried building diff_gaussian_rasterization entirely without using pip or venv? Just normal buildPythonPackage extending python3Packages | 16:21:10 |
| SomeoneSerge (matrix works sometimes) | * Have you tried building diff_gaussian_rasterization entirely without using pip or venv? Just a normal buildPythonPackage extending python3Packages | 16:21:15 |
 search-sense | pip show torch
Name: torch
Version: 2.2.2+cu121
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /nix/store/lmi9p1iwv9v0acr8bjf8gwrhai0l2zr7-python3.11-torch-2.2.2/lib/python3.11/site-packages
Requires: filelock, fsspec, jinja2, networkx, nvidia-cublas-cu12, nvidia-cuda-cupti-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-runtime-cu12, nvidia-cudnn-cu12, nvidia-cufft-cu12, nvidia-curand-cu12, nvidia-cusolver-cu12, nvidia-cusparse-cu12, nvidia-nccl-cu12, nvidia-nvtx-cu12, sympy, triton, typing-extensions
Required-by:
pip show torch
Name: torch
Version: 2.2.2
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /nix/store/0x5vlhjmw4sx7snhy68kqm50dql4nlvg-python3.11-torch-2.2.2/lib/python3.11/site-packages
Requires: filelock, fsspec, jinja2, networkx, sympy, typing-extensions
Required-by: accelerate, basicsr, clean-fid, clip-anytorch, clip-interrogator, clipseg, compel, controlnet_aux, dctorch, facexlib, gfpgan, invisible-watermark, k-diffusion, kornia, lpips, open_clip_torch, pytorch-lightning, pytorch_msssim, realesrgan, rotary-embedding-torch, simple-lama-inpainting, stanza, taming-transformers-rom1504, thop, timm, torch_fidelity, torchdiffeq, torchmetrics, torchsde, torchtyping, torchvision, ultralytics, xformers
| 16:22:29 |
| search-sense | * torch-bin it does work:
pip show torch
Name: torch
Version: 2.2.2+cu121
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /nix/store/lmi9p1iwv9v0acr8bjf8gwrhai0l2zr7-python3.11-torch-2.2.2/lib/python3.11/site-packages
Requires: filelock, fsspec, jinja2, networkx, nvidia-cublas-cu12, nvidia-cuda-cupti-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-runtime-cu12, nvidia-cudnn-cu12, nvidia-cufft-cu12, nvidia-curand-cu12, nvidia-cusolver-cu12, nvidia-cusparse-cu12, nvidia-nccl-cu12, nvidia-nvtx-cu12, sympy, triton, typing-extensions
Required-by:
torch - it doesn't work
pip show torch
Name: torch
Version: 2.2.2
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email: packages@pytorch.org
License: BSD-3
Location: /nix/store/0x5vlhjmw4sx7snhy68kqm50dql4nlvg-python3.11-torch-2.2.2/lib/python3.11/site-packages
Requires: filelock, fsspec, jinja2, networkx, sympy, typing-extensions
Required-by: accelerate, basicsr, clean-fid, clip-anytorch, clip-interrogator, clipseg, compel, controlnet_aux, dctorch, facexlib, gfpgan, invisible-watermark, k-diffusion, kornia, lpips, open_clip_torch, pytorch-lightning, pytorch_msssim, realesrgan, rotary-embedding-torch, simple-lama-inpainting, stanza, taming-transformers-rom1504, thop, timm, torch_fidelity, torchdiffeq, torchmetrics, torchsde, torchtyping, torchvision, ultralytics, xformers
| 16:23:21 |
| search-sense | In reply to @ss:someonex.net
Have you tried building diff_gaussian_rasterization entirely without using pip or venv? Just a normal buildPythonPackage extending python3Packages yes, it gives errors:
diff-gaussian-rasterization> Creating a wheel...
diff-gaussian-rasterization> ERROR Source /build/source/build does not appear to be a Python project: no pyproject.toml or setup.py
error: builder for '/nix/store/4v4cff3qc19ls630lwzll36ycx16fbqh-diff-gaussian-rasterization-0.0.0.drv' failed with exit code 1;
last 10 log lines:
> PYTHON_SITE_PACKAGES
>
>
> -- Build files have been written to: /build/source/build
> cmake: enabled parallel building
> cmake: enabled parallel installing
> Running phase: buildPhase
> Executing pypaBuildPhase
> Creating a wheel...
> ERROR Source /build/source/build does not appear to be a Python project: no pyproject.toml or setup.py
| 16:24:30 |
| SomeoneSerge (matrix works sometimes) | In reply to @search-sense:matrix.org
yes, it gives errors:
diff-gaussian-rasterization> Creating a wheel...
diff-gaussian-rasterization> ERROR Source /build/source/build does not appear to be a Python project: no pyproject.toml or setup.py
error: builder for '/nix/store/4v4cff3qc19ls630lwzll36ycx16fbqh-diff-gaussian-rasterization-0.0.0.drv' failed with exit code 1;
last 10 log lines:
> PYTHON_SITE_PACKAGES
>
>
> -- Build files have been written to: /build/source/build
> cmake: enabled parallel building
> cmake: enabled parallel installing
> Running phase: buildPhase
> Executing pypaBuildPhase
> Creating a wheel...
> ERROR Source /build/source/build does not appear to be a Python project: no pyproject.toml or setup.py
Is there an open PR or a gist somewhere demonstrating your current expression? | 16:25:14 |
| search-sense | In reply to @ss:someonex.net
Is there an open PR or a gist somewhere demonstrating your current expression? https://github.com/ksenia-portu/flake/blob/master/packages/diff-gaussian-rasterization/default.nix | 16:25:57 |
| SomeoneSerge (matrix works sometimes) |
ERROR Source /build/source/build does not appear
This already looks like cmakeConfigurePhase hijacking pypaBuildPhase (the extra build/) | 16:26:21 |
| SomeoneSerge (matrix works sometimes) | You could start with dontUseCmakeConfigure = true; | 16:27:09 |
| search-sense | In reply to @ss:someonex.net
You could start with dontUseCmakeConfigure = true; diff-gaussian-rasterization> File "/nix/store/0x5vlhjmw4sx7snhy68kqm50dql4nlvg-python3.11-torch-2.2.2/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1976, in _get_cuda_arch_flags
diff-gaussian-rasterization> arch_list[-1] += '+PTX'
diff-gaussian-rasterization> ~~~~~~~~~^^^^
diff-gaussian-rasterization> IndexError: list index out of range
diff-gaussian-rasterization> ERROR Backend subprocess exited when trying to invoke build_wheel
error: builder for '/nix/store/ivph1bp8ba63qhji2j0lbj0xka4qslc3-diff-gaussian-rasterization-0.0.0.drv' failed with exit code 1;
last 10 log lines:
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/nix/store/0x5vlhjmw4sx7snhy68kqm50dql4nlvg-python3.11-torch-2.2.2/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 574, in unix_cuda_flags
> cflags + _get_cuda_arch_flags(cflags))
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/nix/store/0x5vlhjmw4sx7snhy68kqm50dql4nlvg-python3.11-torch-2.2.2/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1976, in _get_cuda_arch_flags
> arch_list[-1] += '+PTX'
> ~~~~~~~~~^^^^
> IndexError: list index out of range
>
> ERROR Backend subprocess exited when trying to invoke build_wheel
| 16:33:04 |
| SomeoneSerge (matrix works sometimes) | Reuse the TORCH_CUDA_ARCH_LIST from the pytorch expression | 16:34:57 |
| SomeoneSerge (matrix works sometimes) | What is the name of the attribute to build from that flake? | 16:35:12 |
| search-sense | In reply to @ss:someonex.net
What is the name of the attribute to build from that flake? I am sorry, I don't know what kind of attribute do you mean | 16:45:04 |
| search-sense | diff-gaussian-rasterization> Running phase: buildPhase
diff-gaussian-rasterization> Executing pypaBuildPhase
diff-gaussian-rasterization> /nix/store/v5lsd029lz5lfhamivbgqyp3zdv94ah2-stdenv-linux/setup: line 115: 5.0: command not found
diff-gaussian-rasterization> /nix/store/v5lsd029lz5lfhamivbgqyp3zdv94ah2-stdenv-linux/setup: line 131: pop_var_context: head of shell_variables not a function context
error: builder for '/nix/store/xwq84xgh5wa1l5zwabq1b705da7niixk-diff-gaussian-rasterization-0.0.0.drv' failed with exit code 127;
last 10 log lines:
> setting SOURCE_DATE_EPOCH to timestamp 315619200 of file source/third_party/stbi_image_write.h
> Running phase: patchPhase
> Running phase: updateAutotoolsGnuConfigScriptsPhase
> Running phase: configurePhase
> Executing setupCUDAToolkitCompilers
> no configure script, doing nothing
> Running phase: buildPhase
> Executing pypaBuildPhase
> /nix/store/v5lsd029lz5lfhamivbgqyp3zdv94ah2-stdenv-linux/setup: line 115: 5.0: command not found
> /nix/store/v5lsd029lz5lfhamivbgqyp3zdv94ah2-stdenv-linux/setup: line 131: pop_var_context: head of shell_variables not a function context
For full logs, run 'nix log /nix/store/xwq84xgh5wa1l5zwabq1b705da7niixk-diff-gaussian-rasterization-0.0.0.drv'.
| 16:45:44 |
| SomeoneSerge (matrix works sometimes) | https://github.com/ksenia-portu/flake/pull/1 | 17:11:26 |
| SomeoneSerge (matrix works sometimes) | * Can you tell me if https://github.com/ksenia-portu/flake/pull/1 works | 17:13:32 |
| search-sense | In reply to @ss:someonex.net
Can you tell me if https://github.com/ksenia-portu/flake/pull/1 works it works | 17:36:12 |
| 17 Apr 2024 |
|  @alex3829:matrix.org changed their display name from alex3829 to real_z22. | 04:36:23 |
| @alex3829:matrix.org changed their display name from real_z22 to real_z2. | 05:33:53 |
| SomeoneSerge (matrix works sometimes) | connor (he/him) (UTC-5) Samuel Ainsworth I don't think we have any critical PRs that absolutely must make it into the release? Other than https://github.com/NixOS/nixpkgs/pull/290979 | 09:45:04 |
 connor (burnt/out) (UTC-8) | Any chance we could also get https://github.com/NixOS/nixpkgs/pull/301416 merged? Since it has a number of fixes | 13:02:25 |
| connor (burnt/out) (UTC-8) | one of my desktops keeps restarting suddenly, guess I need to try downclocking it some more >.> | 13:30:27 |
| SomeoneSerge (matrix works sometimes) | In reply to @connorbaker:matrix.org
Any chance we could also get https://github.com/NixOS/nixpkgs/pull/301416 merged? Since it has a number of fixes We should merge but I don't see it as a "blocker" since it doesn't change interfaces | 14:10:55 |
| 18 Apr 2024 |
|  @nscnt:matrix.org joined the room. | 13:21:30 |
| connor (burnt/out) (UTC-8) | I think I addressed your comments on https://github.com/NixOS/nixpkgs/pull/301416, SomeoneSerge (void) . Would you mind taking another look? I'm running nixpkgs-review again just to make sure it's still all good. | 15:55:48 |
| 19 Apr 2024 |
| connor (burnt/out) (UTC-8) | Okay, pretty much done with the rewrite for the scripts I was using previously to parse the NVIDIA manifests and detect the features each redistributable provides: https://github.com/ConnorBaker/cuda-redist-find-features/tree/feat/recursive-nar-hash-for-FOD
The actual JSON we would check in to Nixpkgs is the stage4 file. It's much more compact than what we already have in tree, so hopefully we have a net reduction in the number of lines.
There are also modules to parse it, as well as some utility functions, which should be helpful in integrating it with the existing build infra we have in Nixpkgs. | 01:33:10 |
 trexd | Is there anything I need to do besides enable virtualisation.containers.cdi.dynamic.nvidia.enable = true; to get docker containers to see my GPU? | 13:13:05 |
| trexd | I'm also using docker 25 | 13:13:38 |
| SomeoneSerge (matrix works sometimes) | With podmand and with docker>=25 this, together with the host configuration, should be enough. Disclaimer: the option will be renamed before the release after all.... | 13:16:01 |
| SomeoneSerge (matrix works sometimes) | * With podman and with docker>=25 this, together with the host configuration, should be enough. Disclaimer: the option will be renamed before the release after all.... | 13:16:06 |
