| 16 Oct 2024 |
 hexa (UTC+1) | tensordict> test/smoke_test.py . [ 0%]
tensordict> test/test_compile.py ...........................................ssss.... [ 0%]
tensordict> ............................ssss.... [ 0%]
tensordict> test/test_distributed.py s.............................................. [ 0%]
tensordict> .......... [ 0%]
tensordict> test/test_functorch.py ................................................. [ 0%]
tensordict> ............................................... [ 0%]
tensordict> test/test_fx.py ... [ 0%]
tensordict> test/test_h5.py ... [ 0%]
tensordict> test/test_memmap.py .................................................... [ 0%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 2%]
tensordict> ........................................................................ [ 2%]
tensordict> ........................................................................ [ 2%]
tensordict> . [ 2%]
tensordict> test/test_nn.py ........................................................ [ 2%]
tensordict> ........................................................................ [ 3%]
tensordict> ........................................................................ [ 3%]
tensordict> ........................................................................ [ 3%]
tensordict> ........................................................................ [ 3%]
tensordict> .................................. [ 3%]
tensordict> test/test_tensorclass.py .........................s..................... [ 3%]
tensordict> .............s........................... [ 4%]
tensordict> test/test_tensordict.py .......................................s........ [ 4%]
tensordict> s....................................................................... [ 4%]
tensordict> ..s..........s...................................s...................... [ 4%]
tensordict> ........................................................................ [ 4%]
tensordict> .....................s...............s.................................. [ 5%]
tensordict> ........................................................................ [ 5%]
tensordict> ........................................................................ [ 5%]
tensordict> ........................................................................ [ 5%]
tensordict> ........................................................................ [ 6%]
tensordict> ................ssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 6%]
tensordict> ssssssss................................................................ [ 6%]
tensordict> ................................................................ssssssss [ 6%]
tensordict> ssssssss................................................................ [ 7%]
tensordict> ........................................................................ [ 7%]
tensordict> ........................................................................ [ 7%]
tensordict> .............................s...............s...............s.......... [ 7%]
tensordict> .....s.................................................................. [ 7%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 9%]
tensordict> ........................................................................ [ 9%]
tensordict> ........................................................................ [ 9%]
tensordict> ........................................................................ [ 9%]
tensordict> .......................................................s.s.............. [ 10%]
tensordict> ........................................................................ [ 10%]
tensordict> ........................................................................ [ 10%]
tensordict> ........................................................................ [ 10%]
tensordict> ......................................................................ss [ 10%]
tensordict> s....ss.......sss....ss................................................. [ 11%]
tensordict> ........................s............................................... [ 11%]
tensordict> ........................................................................ [ 11%]
tensordict> ........................................................................ [ 11%]
tensordict> ........................................................................ [ 12%]
tensordict> ........................................................................ [ 12%]
tensordict> ........................................................................ [ 12%]
tensordict> ................................................................ssssssss [ 12%]
tensordict> ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 13%]
tensordict> ssssssssssssssss........................................................ [ 13%]
tensordict> ........................................................................ [ 13%]
tensordict> ........................................................................ [ 13%]
tensordict> ..............................................................ss........ [ 13%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 17%]
tensordict> ........................................................................ [ 17%]
tensordict> ........................................................................ [ 17%]
tensordict> ........................................................................ [ 17%]
tensordict> ................s....................................................... [ 18%]
tensordict> .......................................................s.s.............. [ 18%]
tensordict> ........................................................................ [ 18%]
tensordict> ................................................................ssssssss [ 18%]
tensordict> ........................................................................ [ 19%]
tensordict> ...........................s............................................ [ 19%]
tensordict> ........................................................................ [ 19%]
tensordict> ........................................................................ [ 19%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ...................................................sss.................. [ 21%]
tensordict> ........................................................................ [ 21%]
tensordict> ........................................................................ [ 21%]
tensordict> ........................................................................ [ 21%]
tensordict> ........................................................................ [ 22%]
tensordict> ..........ss.....s..ssssssssssssssssssssssssssss........................ [ 22%]
| 17:30:45 |
| hexa (UTC+1) | :: (nixbld10) → /nix/store/svw8b4655f6w413xz23jjg6yn4b1d9p0-python3.12-tensordict-0.5.0
UID PID PPID STIME TIME COMMAND
30010 432250 432213 17:17 00:00:00 bash -e /nix/store/v6x3cs394jgqfbi0a42pam708flxaphh-default-builder.sh
30010 433687 432250 17:17 00:02:07 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 434047 433687 17:18 00:00:03 [pt_main_thread] <defunct>
30010 464302 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464342 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464382 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464422 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464462 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464502 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464542 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464582 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464622 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464662 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464702 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464742 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464766 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464822 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464862 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464903 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464945 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464986 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465029 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465071 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465076 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465157 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465192 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465244 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465286 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465328 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465370 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465413 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465455 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465499 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465541 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465583 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465614 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465669 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465712 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465755 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465797 433687 17:20 00:00:00 [pt_main_thread] <defunct>
| 17:30:54 |
| hexa (UTC+1) | this is the current situation I'm seeing | 17:30:59 |
| hexa (UTC+1) | I'm heading out for dinner, maybe it will complete in the next 2h | 17:31:37 |
| hexa (UTC+1) |
┃ ⏵ python3.12-tensordict-0.5.0 (pytestCheckPhase) ⏱ 2h35m4s
| 19:52:24 |
| hexa (UTC+1) | hasn't moved one bit since | 19:52:27 |
 SomeoneSerge (matrix works sometimes) | In reply to @hexa:lossy.network
:: (nixbld10) → /nix/store/svw8b4655f6w413xz23jjg6yn4b1d9p0-python3.12-tensordict-0.5.0
UID PID PPID STIME TIME COMMAND
30010 432250 432213 17:17 00:00:00 bash -e /nix/store/v6x3cs394jgqfbi0a42pam708flxaphh-default-builder.sh
30010 433687 432250 17:17 00:02:07 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 434047 433687 17:18 00:00:03 [pt_main_thread] <defunct>
30010 464302 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464342 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464382 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464422 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464462 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464502 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464542 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464582 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464622 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464662 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464702 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464742 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464766 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464822 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464862 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464903 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464945 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464986 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465029 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465071 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465076 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465157 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465192 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465244 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465286 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465328 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465370 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465413 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465455 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465499 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465541 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465583 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465614 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465669 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465712 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465755 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465797 433687 17:20 00:00:00 [pt_main_thread] <defunct>
Shall we make it pytest -n1 | 20:06:34 |
| hexa (UTC+1) | not sure yet 🙂 | 20:29:41 |
| hexa (UTC+1) | feel free to try | 20:29:46 |
| 17 Oct 2024 |
| hexa (UTC+1) | In reply to @ss:someonex.net
Shall we make it pytest -n1 doesn't use xdist | 00:43:31 |
| hexa (UTC+1) | builds fine on my 8th gen intel machine | 00:44:03 |
| hexa (UTC+1) | reliably crashes and gets stuck on 6th gen intel | 00:44:36 |
| SomeoneSerge (matrix works sometimes) | In reply to @hexa:lossy.network
doesn't use xdist Oh. So "pt_main_thread" must be the only thread it's mentioned there just because I guess | 00:45:24 |
| hexa (UTC+1) | both are effectively skylake machines (x86_64 v3) | 00:46:18 |
| hexa (UTC+1) | and since they go [defunct] and not crash I also get no coredump | 00:46:50 |
 connor (burnt/out) (UTC-8) | Pretty proud of how performant this is, after much stats scrutinizing and reading primop implementations: https://github.com/ConnorBaker/cuda-packages/blob/23f199365343e3355469332acb5cf501c8c5fc68/upstreamable-lib/attrsets.nix#L38
Credit for the flattenDrvTree function goes to Adam Joseph though, basically took that stuff from https://github.com/NixOS/nixpkgs/blob/3a5940b539fdd56ace90d5e79a926e5e2694ba45/pkgs/top-level/release-attrpaths-superset.nix#L38 | 03:55:43 |
| SomeoneSerge (matrix works sometimes) | In reply to @connorbaker:matrix.org
Pretty proud of how performant this is, after much stats scrutinizing and reading primop implementations: https://github.com/ConnorBaker/cuda-packages/blob/23f199365343e3355469332acb5cf501c8c5fc68/upstreamable-lib/attrsets.nix#L38
Credit for the flattenDrvTree function goes to Adam Joseph though, basically took that stuff from https://github.com/NixOS/nixpkgs/blob/3a5940b539fdd56ace90d5e79a926e5e2694ba45/pkgs/top-level/release-attrpaths-superset.nix#L38 That for a release file or? | 08:56:25 |
| connor (burnt/out) (UTC-8) | Yeah, the idea being that if you’re using CI that isn’t hydra or wanted to build a whole package set, you could use that function | 14:22:16 |
