!sBfrWMVsLoSyFTCkNv:nixos.org

OfBorg

180 Members
Number of builds and evals in queue: <TBD>63 Servers

Load older messages


SenderMessageTime
4 May 2023
@raitobezarius:matrix.orgraitobezarius
In reply to @raitobezarius:matrix.org
also I don't think we store the name of modules anywhere anyway
(I can derive it via string ops on filenames)
22:11:39
@cole-h:matrix.orgcole-h Having to evaluate NixOS seems like it would add a lot of overheard to the evaluation times. Maybe you could look at how it would change that before going too far.
ofborg/src/nixstats.rs and ofborg/src/outpathdiff.rs might have some hints on how that information is generated.
22:12:11
@raitobezarius:matrix.orgraitobezariusevaluating NixOS with an empty module set I believe is extremely fast?22:12:44
@raitobezarius:matrix.orgraitobezarius * evaluating NixOS with an empty configuration I believe is extremely fast?22:12:51
@cole-h:matrix.orgcole-hI'd be happier with empirical evidence :P22:13:05
@raitobezarius:matrix.orgraitobezarius
❯ hyperfine "nix-instantiate --eval '<nixpkgs/nixos>' --arg configuration '{}' -A config.meta.maintainers --strict --json" 
Benchmark 1: nix-instantiate --eval '<nixpkgs/nixos>' --arg configuration '{}' -A config.meta.maintainers --strict --json
  Time (mean ± σ):     621.8 ms ±  22.6 ms    [User: 524.8 ms, System: 91.2 ms]
  Range (min … max):   597.3 ms … 663.9 ms    10 runs
22:13:59
@raitobezarius:matrix.orgraitobezarius
{
  "cpuTime": 0.49957001209259033,
  "envs": {
    "bytes": 12506824,
    "elements": 609381,
    "number": 476986
  },
  "gc": {
    "heapSize": 402915328,
    "totalBytes": 87726480
  },
  "list": {
    "bytes": 1933232,
    "concats": 13049,
    "elements": 241654
  },
  "nrAvoided": 488806,
  "nrFunctionCalls": 412021,
  "nrLookups": 240540,
  "nrOpUpdateValuesCopied": 1193821,
  "nrOpUpdates": 12482,
  "nrPrimOpCalls": 244606,
  "nrThunks": 691079,
  "sets": {
    "bytes": 29699424,
    "elements": 1702651,
    "number": 153563
  },
  "sizes": {
    "Attr": 16,
    "Bindings": 16,
    "Env": 16,
    "Value": 24
  },
  "symbols": {
    "bytes": 531386,
    "number": 45882
  },
  "values": {
    "bytes": 27441768,
    "number": 1143407
  }
}
22:14:20
@raitobezarius:matrix.orgraitobezariusfor the nix show stats22:14:23
@cole-h:matrix.orgcole-hCool22:14:35
@raitobezarius:matrix.orgraitobezariusI mean I'm not aware of the performance constraints of ofborg, but I believe it's probably negligible?22:15:03
@cole-h:matrix.orgcole-hNot necessarily constraints, but when you start evaluating every PR on all of Nixpkgs, slowdowns can be noticeable22:16:00
@raitobezarius:matrix.orgraitobezariusOf course22:16:10
@cole-h:matrix.orgcole-hI'll take a closer look tomorrow, but it doesn't look immediately flawed, as long as performance doesn't massively regress :P22:18:35
@raitobezarius:matrix.orgraitobezarius:)22:18:52
@raitobezarius:matrix.orgraitobezariuslet me know22:18:55
@raitobezarius:matrix.orgraitobezariusI wished we could just run performance testing without setting the whole broker/worker stuff :D22:19:13
5 May 2023
@raitobezarius:matrix.orgraitobezariushttps://github.com/NixOS/ofborg/pull/562/files interesting PR to revive20:40:39
6 May 2023
@lily:lily.flowersLily Foster

Ofborg's ofborg-eval-package-list-no-aliases check is still missing a lot of alias usage (see https://github.com/NixOS/nixpkgs/pull/230188#pullrequestreview-1415772214)

I notice that adding --drv-path to the command here https://github.com/NixOS/ofborg/blob/0f34038feb9b0ae9959c865608700c91d57b2590/ofborg/src/tasks/eval/nixpkgs.rs#L455 lets it catch those, but obviously that makes it a more expensive eval (since it has to actually evaluate the entire drvs)

Is there a better way we can detect alias usage instead of having it pass PRs that fail with allowAliases = false?

14:13:15
@lily:lily.flowersLily Foster (I am also happy to open a PR to add --drv-path to that check, and just discuss it there. I just don't know much ofborg and idk how reasonable that solution is) 14:17:17
@vcunat:matrix.orgVladimír ČunátThe most expensive checks that I'm aware of running anywhere need around 36G RAM: https://github.com/NixOS/nixpkgs/issues/22794514:53:11
@vcunat:matrix.orgVladimír Čunát * The most expensive eval checks that I'm aware of running anywhere need around 36G RAM: https://github.com/NixOS/nixpkgs/issues/22794514:53:30
@lily:lily.flowersLily FosterI suppose I could try to do some local comparisons later to see what the performance impact would be. Because at least I'm pretty sure it's nowhere near that. It still runs in only a few seconds on my laptop without too extreme memory requirements14:55:24
9 May 2023
@hexa:lossy.networkhexaofborg goes 📈19:28:43
@wegank:matrix.orgWeijia joined the room.20:19:42
10 May 2023
@elvishjerricco:matrix.orgElvishJerricco joined the room.20:01:38
11 May 2023
@me:linj.techlinj joined the room.12:16:32
@me:linj.techlinjAny ideas why "@ofborg eval" has no effect? https://github.com/NixOS/nixpkgs/pull/230997#issuecomment-154388880812:18:00
@wegank:matrix.orgWeijia left the room.13:26:20
@hexa:lossy.networkhexalikely because github stopped sending out webhooks14:01:01
@hexa:lossy.networkhexahttps://www.githubstatus.com/14:01:15

Show newer messages


Back to Room ListRoom Version: 6