27 Oct 2022 |
Wanja Hentze | has anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense? | 14:58:29 |
@davidak:matrix.org | maybe i should bring up the idea of a QA team in the forum? | 14:59:28 |
nbp — PTO | Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra. | 15:01:20 |
Wanja Hentze | In reply to @davidak:matrix.org maybe i should bring up the idea of a QA team in the forum? would that be QA-for-nixpkgs or using-nix-for-QA? (or both) | 15:01:29 |
@davidak:matrix.org | In reply to @whentze:matrix.org has anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense? i don't know of any container based tests. using testing frameworks make sense. we use language based test tools like pytest | 15:01:41 |
@davidak:matrix.org | there is one gui test using that x11 framebuffer tool. j want to document that | 15:02:28 |
Wanja Hentze | I have at some point made a nixos test that would start a single VM with a bunch of nixos containers in it. that also cut down the test runtime a bunch | 15:02:34 |
Robert Hensing (roberth) | In reply to @nbp:mozilla.org Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra. there's a github action CI that runs nix-build --arg pkgs import ./. {} ./lib/tests/release.nix . I don't think there's a hydra job for it, but that doesn't seem necessary. | 15:03:51 |
@davidak:matrix.org | In reply to @whentze:matrix.org would that be QA-for-nixpkgs or using-nix-for-QA? (or both) a qa team for our project, nixos, nixpkgs etc | 15:04:01 |