| 27 Oct 2022 |
|  @grahamc:nixos.org invited  NixOS Moderation Bot. | 13:54:29 |
| @grahamc:nixos.orgchanged room power levels. | 13:54:32 |
| Room Avatar Renderer. | 13:54:34 |
| NixOS Moderation Bot joined the room. | 13:55:12 |
|  jonge joined the room. | 13:56:40 |
|  tomberek joined the room. | 14:07:10 |
|  lewo joined the room. | 14:08:40 |
|  raitobezarius joined the room. | 14:10:48 |
|  FRidh joined the room. | 14:14:56 |
|  @davidak:matrix.org joined the room. | 14:23:08 |
 Robert Hensing (roberth) | awesome! Great to see y'all this soon after announcing the room. Let's get this going!
What do you think deserves attention wrt testing?
Do you have any questions about testing? | 14:23:19 |
| @davidak:matrix.org | what is the scope of this? package and module tests, manual testing, ...? i would like to have a QA team and contribute there. is this similar? | 14:25:39 |
| @davidak:matrix.org | i do a lot of QA work, but at times it can feel as if i'm the only one. so i would like better coordination and community (but can't organize it myself) | 14:27:52 |
| Robert Hensing (roberth) | For this room I had mostly automated testing in mind. I think a team that performs manual testing would be a slightly different audience(?) | 14:31:33 |
| Robert Hensing (roberth) | what sort of QA work is it that you refer to? | 14:31:56 |
|  Winter (she/her) joined the room. | 14:32:17 |
| @davidak:matrix.org | i guess everything. improve quality with any method
i established the term "package tests" in the manual, i do manual tests before release, i test prs like the gui installer, i test pantheon as part of it's maintainer team, i review prs, i create automated test, i improve and extend the manual, i try to establish a vision for nixpkgs, ..... | 14:36:31 |
| @davidak:matrix.org | i professionally work in QA and our team does manual tests for release und automate testing where possible. i think that belongs in one team, to have a common goal. there can still be people that only work in one area and maybe separate chat rooms if it helps decluttering, but we should coordinate the efforts more | 14:42:14 |
|  chreekat joined the room. | 14:46:13 |
|  Wanja Hentze joined the room. | 14:48:09 |
| @davidak:matrix.org | i just do my own thing and have my own standards for quality (often too perfectionistic). i would like to have a consensus on what level of quality we work towards and a combined effort on that. maybe even policies or recommendations. it's often unclear to me what and to i do things. so i try to learn how it is done or propose something and hope the reviewers are satisfied. i got a lot of such into the manual, like "how to deprecate packages" | 14:49:16 |
| Wanja Hentze | I think VM-based NixOS tests are seriously cool | 14:50:08 |
| Wanja Hentze | We have a few at work but almost nobody knows how to properly write them | 14:50:26 |
| Wanja Hentze | the ones who do learned by looking at random nixpgks code | 14:51:00 |
| @davidak:matrix.org | * i just do my own thing and have my own standards for quality (often too perfectionistic). i would like to have a consensus on what level of quality we work towards and a combined effort on that. maybe even policies or recommendations. it's often unclear to me what and how to do things. so i try to learn how it is done or propose something and hope the reviewers are satisfied. i got a lot of such into the manual, like "how to deprecate packages" | 14:52:23 |
| Wanja Hentze | also, maybe a NixOS Containers based variant could make sense. for when you're testing rather high-level things and test performance is more important than precise control over kernel version | 14:54:58 |
|  nbp joined the room. | 14:57:41 |
| Wanja Hentze | has anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense? | 14:58:29 |
| @davidak:matrix.org | maybe i should bring up the idea of a QA team in the forum? | 14:59:28 |
| nbp | Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra. | 15:01:20 |
