| 11 Dec 2025 |
|  suua joined the room. | 16:11:27 |
| 13 Dec 2025 |
 l0b0 | How do I disable the NixOS "Tour" popup when starting GNOME for the first time? I had a look at nixpkgs/nixos/tests/gnome.nix, but it's not obvious what they do (or even whether they dismiss or disable the popup). | 13:01:52 |
| l0b0 | * How do I disable the NixOS "Tour" popup when starting GNOME for the first time? I had a look at nixpkgs/nixos/tests/gnome.nix, but it's not obvious what they do (or even whether they dismiss or disable the popup). Update: nodes.machine.environment.gnome.excludePackages = [ pkgs.gnome-tour ]; seems to have taken care of it. | 13:04:54 |
| l0b0 | How do I send the Super key to GNOME in a test? send_key doesn't seem to support it. | 13:39:15 |
| l0b0 | * How do I send the Super key to GNOME in a test? send_key doesn't seem to support it. Update: It doesn't seem to be documented anywhere, but an old forum post had the answer: meta_l or meta_r. | 13:41:58 |
| l0b0 | Why does machine.wait_for_text(r"some regex", 10) never seem to finish? It prints "machine: waiting for some regex to appear on screen", then continues to print system logs, and never exits. This is the last line of code in the test, so it should exit after 10 seconds. | 13:48:24 |
| l0b0 | * Why does machine.wait_for_text(r"some regex", 10) never seem to time out? It prints "machine: waiting for some regex to appear on screen", then continues to print system logs, and never exits. This is the last line of code in the test, so it should exit after 10 seconds. | 14:11:01 |
| l0b0 | How do I view screenshot(filename) results locally? My test prints making screenshot /nix/store/yibqm6bh97j7842d8mz5n9zi7ff213ac-vm-test-run-purge-missing-pictures-service/notifications.png, but that path is not available locally, even while the test is still running. | 15:24:56 |
| 27 Oct 2022 |
|  Winter (she/her) joined the room. | 14:32:17 |
 @davidak:matrix.org | i guess everything. improve quality with any method
i established the term "package tests" in the manual, i do manual tests before release, i test prs like the gui installer, i test pantheon as part of it's maintainer team, i review prs, i create automated test, i improve and extend the manual, i try to establish a vision for nixpkgs, ..... | 14:36:31 |
| @davidak:matrix.org | i professionally work in QA and our team does manual tests for release und automate testing where possible. i think that belongs in one team, to have a common goal. there can still be people that only work in one area and maybe separate chat rooms if it helps decluttering, but we should coordinate the efforts more | 14:42:14 |
|  chreekat joined the room. | 14:46:13 |
|  Wanja Hentze joined the room. | 14:48:09 |
| @davidak:matrix.org | i just do my own thing and have my own standards for quality (often too perfectionistic). i would like to have a consensus on what level of quality we work towards and a combined effort on that. maybe even policies or recommendations. it's often unclear to me what and to i do things. so i try to learn how it is done or propose something and hope the reviewers are satisfied. i got a lot of such into the manual, like "how to deprecate packages" | 14:49:16 |
| Wanja Hentze | I think VM-based NixOS tests are seriously cool | 14:50:08 |
| Wanja Hentze | We have a few at work but almost nobody knows how to properly write them | 14:50:26 |
| Wanja Hentze | the ones who do learned by looking at random nixpgks code | 14:51:00 |
| @davidak:matrix.org | * i just do my own thing and have my own standards for quality (often too perfectionistic). i would like to have a consensus on what level of quality we work towards and a combined effort on that. maybe even policies or recommendations. it's often unclear to me what and how to do things. so i try to learn how it is done or propose something and hope the reviewers are satisfied. i got a lot of such into the manual, like "how to deprecate packages" | 14:52:23 |
| Wanja Hentze | also, maybe a NixOS Containers based variant could make sense. for when you're testing rather high-level things and test performance is more important than precise control over kernel version | 14:54:58 |
|  nbp joined the room. | 14:57:41 |
| Wanja Hentze | has anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense? | 14:58:29 |
| @davidak:matrix.org | maybe i should bring up the idea of a QA team in the forum? | 14:59:28 |
| nbp | Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra. | 15:01:20 |
| Wanja Hentze | In reply to @davidak:matrix.org
maybe i should bring up the idea of a QA team in the forum? would that be QA-for-nixpkgs or using-nix-for-QA? (or both) | 15:01:29 |
| @davidak:matrix.org | In reply to @whentze:matrix.org
has anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense? i don't know of any container based tests. using testing frameworks make sense. we use language based test tools like pytest | 15:01:41 |
| @davidak:matrix.org | there is one gui test using that x11 framebuffer tool. j want to document that | 15:02:28 |
| Wanja Hentze | I have at some point made a nixos test that would start a single VM with a bunch of nixos containers in it. that also cut down the test runtime a bunch | 15:02:34 |
 Robert Hensing (roberth) | In reply to @nbp:mozilla.org
Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra. there's a github action CI that runs nix-build --arg pkgs import ./. {} ./lib/tests/release.nix. I don't think there's a hydra job for it, but that doesn't seem necessary. | 15:03:51 |
| @davidak:matrix.org | In reply to @whentze:matrix.org
would that be QA-for-nixpkgs or using-nix-for-QA? (or both) a qa team for our project, nixos, nixpkgs etc | 15:04:01 |
| @davidak:matrix.org | * there is one gui test using that x11 framebuffer tool. i want to document that | 15:04:50 |
