| 15 Oct 2024 |
 Gaétan Lepage | This looks smart indeed ! | 16:55:13 |
| 16 Oct 2024 |
| Gaétan Lepage | As the onnx failure was blocking me elsewhere, I went and fixed it myself.
Any review is welcome :)
https://github.com/NixOS/nixpkgs/pull/348985 | 09:07:07 |
 hexa | :: (nixbld1) → /nix/store/svw8b4655f6w413xz23jjg6yn4b1d9p0-python3.12-tensordict-0.5.0
UID PID PPID STIME TIME COMMAND
30001 4207 4170 15:14 00:00:00 bash -e /nix/store/v6x3cs394jgqfbi0a42pam708flxaphh-default-builder.sh
30001 4737 4207 15:15 00:02:09 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 4781 4737 15:15 00:00:03 [pt_main_thread] <defunct>
30001 28942 4737 15:17 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 28943 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 28984 4737 15:17 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 29021 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29073 4737 15:17 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 29098 4737 15:17 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 29144 4737 15:17 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 29184 4737 15:17 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30001 29246 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29264 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29304 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29344 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29384 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29463 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29464 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29512 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29540 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29590 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29631 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29664 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29736 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29750 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29821 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29824 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29901 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29905 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29986 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 29989 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30044 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30069 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30110 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30150 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30214 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30231 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30273 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30311 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30390 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30398 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30460 4737 15:17 00:00:00 [pt_main_thread] <defunct>
30001 30471 4737 15:17 00:00:00 [pt_main_thread] <defunct>
| 17:06:17 |
| hexa | tensordict has been a pain in the last python-updates cycle | 17:06:26 |
| hexa | and still is | 17:06:30 |
| Gaétan Lepage | Ah really ? Lately I had no issues on master to build it. It takes some time but it always succeed.
Have you bumped its version ?
Do you want me to have a look ? | 17:21:59 |
| hexa | no failing tests | 17:30:12 |
| hexa | but they're slowing to a crawl | 17:30:17 |
| hexa | I have not touched it at all | 17:30:25 |
| hexa | tensordict> test/smoke_test.py . [ 0%]
tensordict> test/test_compile.py ...........................................ssss.... [ 0%]
tensordict> ............................ssss.... [ 0%]
tensordict> test/test_distributed.py s.............................................. [ 0%]
tensordict> .......... [ 0%]
tensordict> test/test_functorch.py ................................................. [ 0%]
tensordict> ............................................... [ 0%]
tensordict> test/test_fx.py ... [ 0%]
tensordict> test/test_h5.py ... [ 0%]
tensordict> test/test_memmap.py .................................................... [ 0%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 1%]
tensordict> ........................................................................ [ 2%]
tensordict> ........................................................................ [ 2%]
tensordict> ........................................................................ [ 2%]
tensordict> . [ 2%]
tensordict> test/test_nn.py ........................................................ [ 2%]
tensordict> ........................................................................ [ 3%]
tensordict> ........................................................................ [ 3%]
tensordict> ........................................................................ [ 3%]
tensordict> ........................................................................ [ 3%]
tensordict> .................................. [ 3%]
tensordict> test/test_tensorclass.py .........................s..................... [ 3%]
tensordict> .............s........................... [ 4%]
tensordict> test/test_tensordict.py .......................................s........ [ 4%]
tensordict> s....................................................................... [ 4%]
tensordict> ..s..........s...................................s...................... [ 4%]
tensordict> ........................................................................ [ 4%]
tensordict> .....................s...............s.................................. [ 5%]
tensordict> ........................................................................ [ 5%]
tensordict> ........................................................................ [ 5%]
tensordict> ........................................................................ [ 5%]
tensordict> ........................................................................ [ 6%]
tensordict> ................ssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 6%]
tensordict> ssssssss................................................................ [ 6%]
tensordict> ................................................................ssssssss [ 6%]
tensordict> ssssssss................................................................ [ 7%]
tensordict> ........................................................................ [ 7%]
tensordict> ........................................................................ [ 7%]
tensordict> .............................s...............s...............s.......... [ 7%]
tensordict> .....s.................................................................. [ 7%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 8%]
tensordict> ........................................................................ [ 9%]
tensordict> ........................................................................ [ 9%]
tensordict> ........................................................................ [ 9%]
tensordict> ........................................................................ [ 9%]
tensordict> .......................................................s.s.............. [ 10%]
tensordict> ........................................................................ [ 10%]
tensordict> ........................................................................ [ 10%]
tensordict> ........................................................................ [ 10%]
tensordict> ......................................................................ss [ 10%]
tensordict> s....ss.......sss....ss................................................. [ 11%]
tensordict> ........................s............................................... [ 11%]
tensordict> ........................................................................ [ 11%]
tensordict> ........................................................................ [ 11%]
tensordict> ........................................................................ [ 12%]
tensordict> ........................................................................ [ 12%]
tensordict> ........................................................................ [ 12%]
tensordict> ................................................................ssssssss [ 12%]
tensordict> ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 13%]
tensordict> ssssssssssssssss........................................................ [ 13%]
tensordict> ........................................................................ [ 13%]
tensordict> ........................................................................ [ 13%]
tensordict> ..............................................................ss........ [ 13%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 14%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 15%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 16%]
tensordict> ........................................................................ [ 17%]
tensordict> ........................................................................ [ 17%]
tensordict> ........................................................................ [ 17%]
tensordict> ........................................................................ [ 17%]
tensordict> ................s....................................................... [ 18%]
tensordict> .......................................................s.s.............. [ 18%]
tensordict> ........................................................................ [ 18%]
tensordict> ................................................................ssssssss [ 18%]
tensordict> ........................................................................ [ 19%]
tensordict> ...........................s............................................ [ 19%]
tensordict> ........................................................................ [ 19%]
tensordict> ........................................................................ [ 19%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ........................................................................ [ 20%]
tensordict> ...................................................sss.................. [ 21%]
tensordict> ........................................................................ [ 21%]
tensordict> ........................................................................ [ 21%]
tensordict> ........................................................................ [ 21%]
tensordict> ........................................................................ [ 22%]
tensordict> ..........ss.....s..ssssssssssssssssssssssssssss........................ [ 22%]
| 17:30:45 |
| hexa | :: (nixbld10) → /nix/store/svw8b4655f6w413xz23jjg6yn4b1d9p0-python3.12-tensordict-0.5.0
UID PID PPID STIME TIME COMMAND
30010 432250 432213 17:17 00:00:00 bash -e /nix/store/v6x3cs394jgqfbi0a42pam708flxaphh-default-builder.sh
30010 433687 432250 17:17 00:02:07 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 434047 433687 17:18 00:00:03 [pt_main_thread] <defunct>
30010 464302 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464342 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464382 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464422 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464462 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464502 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464542 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464582 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464622 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464662 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464702 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464742 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464766 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464822 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464862 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464903 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464945 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464986 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465029 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465071 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465076 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465157 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465192 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465244 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465286 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465328 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465370 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465413 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465455 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465499 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465541 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465583 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465614 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465669 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465712 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465755 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465797 433687 17:20 00:00:00 [pt_main_thread] <defunct>
| 17:30:54 |
| hexa | this is the current situation I'm seeing | 17:30:59 |
| hexa | I'm heading out for dinner, maybe it will complete in the next 2h | 17:31:37 |
| hexa |
┃ ⏵ python3.12-tensordict-0.5.0 (pytestCheckPhase) ⏱ 2h35m4s
| 19:52:24 |
| hexa | hasn't moved one bit since | 19:52:27 |
 SomeoneSerge (matrix works sometimes) | In reply to @hexa:lossy.network
:: (nixbld10) → /nix/store/svw8b4655f6w413xz23jjg6yn4b1d9p0-python3.12-tensordict-0.5.0
UID PID PPID STIME TIME COMMAND
30010 432250 432213 17:17 00:00:00 bash -e /nix/store/v6x3cs394jgqfbi0a42pam708flxaphh-default-builder.sh
30010 433687 432250 17:17 00:02:07 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 434047 433687 17:18 00:00:03 [pt_main_thread] <defunct>
30010 464302 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464342 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464382 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464422 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464462 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464502 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464542 433687 17:20 00:00:00 /nix/store/wfbjq35kxs6x83c3ncpfxdyl5gbhdx4h-python3-3.12.6/bin/python3.12 -m pytest -k not test_copy_onto and not test_mp and not test_functional and not test_linear and not test_seq and not test_seq_lmbda
30010 464582 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464622 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464662 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464702 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464742 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464766 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464822 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464862 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464903 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464945 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 464986 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465029 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465071 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465076 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465157 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465192 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465244 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465286 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465328 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465370 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465413 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465455 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465499 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465541 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465583 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465614 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465669 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465712 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465755 433687 17:20 00:00:00 [pt_main_thread] <defunct>
30010 465797 433687 17:20 00:00:00 [pt_main_thread] <defunct>
Shall we make it pytest -n1 | 20:06:34 |
| hexa | not sure yet 🙂 | 20:29:41 |
| hexa | feel free to try | 20:29:46 |
| 17 Oct 2024 |
| hexa | In reply to @ss:someonex.net
Shall we make it pytest -n1 doesn't use xdist | 00:43:31 |
| hexa | builds fine on my 8th gen intel machine | 00:44:03 |
| hexa | reliably crashes and gets stuck on 6th gen intel | 00:44:36 |
