| 27 Jun 2026 |
 Grimmauld (any/all) | i don't, i think. I have a github account with committer access, and community builder access. That's about it. What would i need to do to get a grafana account? | 08:17:35 |
 hexa (signing key rotation when) | I think we have open registration? | 08:17:54 |
| hexa (signing key rotation when) | you just need write permissions after that | 08:19:12 |
| Grimmauld (any/all) | looks like there is a signup, does someone have to approve that or how does that work? | 08:19:44 |
| hexa (signing key rotation when) | no, just do | 08:22:34 |
| hexa (signing key rotation when) | sure can | 08:24:32 |
| Grimmauld (any/all) | alright, profile done. And sorry, i lost internet connectivity for a bit and your message appeared after mine despite sending order being the other way round | 08:26:51 |
| Grimmauld (any/all) | 
Download image.png | 08:26:51 |
| Grimmauld (any/all) | * alright, account done. And sorry, i lost internet connectivity for a bit and your message appeared after mine despite sending order being the other way round | 08:27:11 |
| hexa (signing key rotation when) | already granted editor | 08:27:27 |
| Grimmauld (any/all) | https://grafana.nixos.org/d/mel9fqb/very-simple-combined-occupancy
yep that worked | 09:00:26 |
| Grimmauld (any/all) | I'll also see whether i can correlate load with occupancy, if we have metrics for that. Might be interesting too. | 09:07:34 |
| hexa (signing key rotation when) | yeah, the database doesn't look outrageous in total | 09:23:27 |
| hexa (signing key rotation when) | I think missing runnables is really in the queue-runner | 09:23:35 |
| hexa (signing key rotation when) | especially with so many steps it has ingested | 09:26:36 |
|  Defelo joined the room. | 10:46:59 |
 Mic92 | hexa (signing key rotation when): https://github.com/NixOS/infra/pull/1099 My recommendation is to first deploy this on staging, eval nixos unstable small and if logs are clear, we can promote this to prod. I have rebased it now | 11:14:29 |
| Mic92 | Once this is in I can run perf again and see what the new bottleneck is. | 11:14:49 |
| hexa (signing key rotation when) | applying to staging-hydra | 11:15:35 |
| Mic92 | I don't think the current bottlenecks will be very visible in prometheus. But they are very obvious if you open htop | 11:16:50 |
| Grimmauld (any/all) | Can't really open htop without being infra team though. And prometheus does show some info worth looking at imo, even if it doesn't show the reasons behind metrics. | 11:18:16 |
| Mic92 | I was aware of the performance bottleneck when I switched to this code but there were more pressing issues like fixing nix gc and other bugs. | 11:20:10 |
| Mic92 | long-term it would be nice to make the evaluation deamon-less but there is some handover between queue-runner and hydra-eval-job set that needs to happen. Because they run as different user. | 11:21:18 |
| Mic92 | * long-term it would be nice to make the evaluation nix-deamon-less but there is some handover between queue-runner and hydra-eval-job set that needs to happen. Because they run as different user. | 11:21:30 |
| hexa (signing key rotation when) | eval is running https://staging-hydra.nixos.org/jobset/nixos/unstable-small | 11:29:00 |
 eyJhb | @[hexa (signing key rotation when)] how big of a hassle would it be to change the signing keys? | 11:30:42 |
| hexa (signing key rotation when) | not super big | 11:31:04 |
| hexa (signing key rotation when) | requires some testing | 11:31:11 |
| hexa (signing key rotation when) | rolling a new key | 11:31:14 |
| hexa (signing key rotation when) | ideally the new key is pq safe | 11:31:25 |
