| 24 Jun 2026 |
hexa | Redacted or Malformed Event | 13:35:40 |
hexa | Redacted or Malformed Event | 13:35:44 |
hexa | libgomp is the primariy thing causing load | 13:36:41 |
hexa | so probably something not respecting -j2 | 13:36:46 |
Vladimír Čunát | What do you mean by "minimal system load"? | 13:38:15 |
hexa | not much time in kernel space | 13:38:58 |
hexa | so the scheduling cost is not that great | 13:39:45 |
Vladimír Čunát | When you run 10x+ more threads than you can schedule, you'll be prone to issues, as tests will run 10x+ longer on average, etc. | 13:40:21 |
hexa | right, but in this case I think we need to find the build going haywire | 13:41:12 |
Vladimír Čunát | I see several different builds using many cores. | 13:45:37 |
Vladimír Čunát | All python packages. | 13:46:58 |
Vladimír Čunát | pytest I suspect | 13:47:58 |
hexa | scikit-bio is my guess | 13:48:16 |
Vladimír Čunát | I mean, all the culprits seem to be running pytest tests right now. | 13:48:37 |
Vladimír Čunát | So perhaps it's what pytest does in usual setups? | 13:49:07 |
hexa | yeah, but some are doing openmp | 13:49:11 |
hexa | pytest-xdist in nixpkgs respects NIX_BUILD_CORES | 13:49:27 |
hexa | also, how is this anything new? | 13:49:44 |
hexa | we still schedule the same max number to elated-minsky as before | 13:49:51 |
K900 | I don't think it is | 13:49:55 |
hexa | but now we stop after cpu some exceeds 70% :) | 13:49:59 |
K900 | We're just seeing more occupancy than before | 13:50:01 |
K900 | So we hit that more often | 13:50:07 |
hexa | I think we need to fix some packages in response | 13:50:14 |
hexa | find out how to limit libgomp parallelism during tests | 13:50:27 |
hexa | 53.40% libgomp.so.1.0.0 [.] gomp_team_barrier_wait_end
42.08% libgomp.so.1.0.0 [.] gomp_barrier_wait_end
3.01% libopenblas.so.0.3 [.] inner_thread
0.28% libopenblas.so.0.3 [.] inner_thread
0.19% libopenblas.so.0.3 [.] inner_thread
0.14% .perf-wrapped [.] queue_event
0.03% .perf-wrapped [.] perf_sample__init
0.03% libc.so.6 [.] _int_malloc
0.02% .perf-wrapped [.] hist_entry__cmp_impl.constprop.2
0.02% .perf-wrapped [.] evlist__event2evsel
0.02% libopenblas.so.0.3 [.] inner_thread
| 13:51:03 |
Vladimír Čunát | I agree it does not look related to the new queue-runner. | 13:51:19 |
hexa | something OMP_NUM_THREADS | 13:51:33 |
hexa | also I noticed that nodejs is not marked big-parallel | 13:52:26 |
hexa | I'm retry to repro scikit-bio now | 13:52:58 |