| 6 Jun 2021 |
| Valodim joined the room. | 11:01:00 |
Valodim | https://hydra.nixos.org/search?query=aaaa it seems that just about any search term that isn't very short will run into query timeouts. also, "aaaa" finds results with four as anywhere in the Job name. is the hydra search doing an unoptimized fuzzy search? | 11:13:30 |
das_j | In reply to @Valodim:stratum0.org https://hydra.nixos.org/search?query=aaaa it seems that just about any search term that isn't very short will run into query timeouts. also, "aaaa" finds results with four as anywhere in the Job name. is the hydra search doing an unoptimized fuzzy search? https://github.com/NixOS/hydra/blob/master/src/lib/Hydra/Controller/Root.pm#L431 | 11:19:11 |
Valodim | ah, there's actually "aaaa" in those results elsewhere. so it's really just an ILIKE "%query%" that consistently times out | 11:24:38 |
@grahamc:nixos.org | in this PR I included some potential improvements to the search behavior: https://github.com/NixOS/hydra/pull/853 | 14:45:47 |
Valodim | queries that aren't left-anchored don't profit from btree indexes. are you currently using a trigram gin, or any other sort of specialized index for this operation? | 17:35:49 |
Valodim | with a bit of luck, your woes might be gone with just CREATE INDEX expIndexBuildOutputsPathGin ON BuildOutputs USING GIN (path gin_trgm_ops); | 17:38:44 |
Valodim | alternatively, maybe just don't allow fully fuzzy LIKEs but use a more specialized matching? I imagine searches by path will all look more or less alike, i.e. for a path /nix/store/hash-name-version the user will likely search either by that full string, or hash-name-version, or hash, or name-version | 17:50:55 |
Valodim | I have next to no perl experience so probably won't have the time to encode that idea into a PR :\ | 17:51:42 |
Valodim | Has anyone looked more closely into optimizing those queries yet? If not, I could probably do some experiments and see what works. | 17:56:05 |
| 7 Jun 2021 |
| David Arnold (blaggacao) joined the room. | 03:57:47 |
| manveru joined the room. | 08:09:39 |
@grahamc:nixos.org | https://github.com/SysPete/Catalyst-Plugin-PrometheusTiny/pull/2 | 16:37:13 |
Mic92 (Old) | grahamc (he/him): what is your personal roadmap for hydra? | 16:58:17 |
Mic92 (Old) | We don't have enough roadmaps in the nix community. | 16:58:35 |
@grahamc:nixos.org | +1 | 17:00:59 |
@grahamc:nixos.org | my driving goals:
- Make it easier to work on (tests, docs)
- Make it faster (database, observability)
- Make it more reliable (obvervability, tests, ???)
this is of course hard to pull off in free time, and sometimes I have clients that want to pay me to do various work along these lines
| 17:03:12 |
@grahamc:nixos.org | I don't know if that is enough to call it a roadmap | 17:05:25 |
@grahamc:nixos.org | but it is hard to come up with a roadmap when there isn't a way to easily manifest that roadmap | 17:05:52 |
David Arnold (blaggacao) | In reply to @grahamc:nixos.org I don't know if that is enough to call it a roadmap Often times roadmaps result being self-fulfilling prophecies 😁 | 17:16:11 |
David Arnold (blaggacao) | In reply to @grahamc:nixos.org but it is hard to come up with a roadmap when there isn't a way to easily manifest that roadmap Would be a ROADMAP.md inapropriate? | 17:17:01 |
@grahamc:nixos.org | well, maybe -- it depends. Right now, hydra is "unreleased software" and exists, essentially, to support nixos.org. This isn't true in practice, though. It might be a bit early, though, as afaik there isn't a lot to go on w.r.t. roadmap. | 17:20:38 |
David Arnold (blaggacao) | Communicating some vision was almost always at the start of something. Though I acknowledge I can't really speak with proriety w.r.t hydra. | 17:23:45 |
David Arnold (blaggacao) | * Communicating some vision was almost always at the start of something. Though I acknowledge I can't really speak with propriety w.r.t hydra. | 17:23:59 |
tomberek | I’ve keep using Hydra as a data transformation engine. Each time there is a major development I see how that use-case is impacted. I’d put something in a roadmap about that. | 20:04:21 |
| 8 Jun 2021 |
| Rick (Mindavi) joined the room. | 18:44:07 |
| rosariopulella joined the room. | 23:05:31 |
| 11 Jun 2021 |
@grahamc:nixos.org | https://github.com/NixOS/hydra/pull/972 | 00:15:58 |
@grahamc:nixos.org | RFR? :) | 00:16:09 |
@grahamc:nixos.org | is this way too many metrics / too high cardinality? | 00:16:19 |