!jtzdZrQSXtEpeGtzAn:nixos.org

Testing with Nix

105 Members
26 Servers

Load older messages


SenderMessageTime
24 Jan 2026
@kdk12:matrix.orgKDK12 set a profile picture.22:12:56
28 Jan 2026
@er10:matrix.org@er10:matrix.org

Hello :

One question here about yggdrasil settings ; how to best set-it-up on top of mullvad-vpn ?

13:30:14
@er10:matrix.org@er10:matrix.orgAlso, could anyone help package this : https://discourse.imfreedom.org/t/barev-xmpp-flavoured-p2p-protocol/348/213:31:35
@er10:matrix.org@er10:matrix.orgwhere should I ask otherwise ? -- Thank you for any indication however. -- 13:31:46
@er10:matrix.org@er10:matrix.org

last question, freenet-related : how to overcome this ?

You are running Freenet without the wrapper. This is not recommended. Freenet will not be able to restart itself, so auto-updating won't work, and if Java crashes, it won't get restarted either. Also Freenet can't generate stack dumps in some places so debugging will be marginally harder.

13:32:04
@sigmasquadron:matrix.orgSigmaSquadron @er10:matrix.org This channel is about automated systems testing. For user support, please use #users:nixos.org 23:56:28
27 Oct 2022
@winterqt:nixos.devWinter (she/her) joined the room.14:32:17
@davidak:matrix.org@davidak:matrix.orgi guess everything. improve quality with any method i established the term "package tests" in the manual, i do manual tests before release, i test prs like the gui installer, i test pantheon as part of it's maintainer team, i review prs, i create automated test, i improve and extend the manual, i try to establish a vision for nixpkgs, .....14:36:31
@davidak:matrix.org@davidak:matrix.orgi professionally work in QA and our team does manual tests for release und automate testing where possible. i think that belongs in one team, to have a common goal. there can still be people that only work in one area and maybe separate chat rooms if it helps decluttering, but we should coordinate the efforts more14:42:14
@b:chreekat.netchreekat joined the room.14:46:13
@whentze:matrix.orgWanja Hentze joined the room.14:48:09
@davidak:matrix.org@davidak:matrix.orgi just do my own thing and have my own standards for quality (often too perfectionistic). i would like to have a consensus on what level of quality we work towards and a combined effort on that. maybe even policies or recommendations. it's often unclear to me what and to i do things. so i try to learn how it is done or propose something and hope the reviewers are satisfied. i got a lot of such into the manual, like "how to deprecate packages"14:49:16
@whentze:matrix.orgWanja HentzeI think VM-based NixOS tests are seriously cool14:50:08
@whentze:matrix.orgWanja HentzeWe have a few at work but almost nobody knows how to properly write them14:50:26
@whentze:matrix.orgWanja Hentzethe ones who do learned by looking at random nixpgks code14:51:00
@davidak:matrix.org@davidak:matrix.org* i just do my own thing and have my own standards for quality (often too perfectionistic). i would like to have a consensus on what level of quality we work towards and a combined effort on that. maybe even policies or recommendations. it's often unclear to me what and how to do things. so i try to learn how it is done or propose something and hope the reviewers are satisfied. i got a lot of such into the manual, like "how to deprecate packages"14:52:23
@whentze:matrix.orgWanja Hentzealso, maybe a NixOS Containers based variant could make sense. for when you're testing rather high-level things and test performance is more important than precise control over kernel version14:54:58
@nbp:mozilla.orgnbp joined the room.14:57:41
@whentze:matrix.orgWanja Hentzehas anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense?14:58:29
@davidak:matrix.org@davidak:matrix.orgmaybe i should bring up the idea of a QA team in the forum?14:59:28
@nbp:mozilla.orgnbp Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra. 15:01:20
@whentze:matrix.orgWanja Hentze
In reply to @davidak:matrix.org
maybe i should bring up the idea of a QA team in the forum?
would that be QA-for-nixpkgs or using-nix-for-QA? (or both)
15:01:29
@davidak:matrix.org@davidak:matrix.org
In reply to @whentze:matrix.org
has anybody tried integrating GUI test automation like appium or robot framework into these? would it make sense?
i don't know of any container based tests. using testing frameworks make sense. we use language based test tools like pytest
15:01:41
@davidak:matrix.org@davidak:matrix.orgthere is one gui test using that x11 framebuffer tool. j want to document that15:02:28
@whentze:matrix.orgWanja HentzeI have at some point made a nixos test that would start a single VM with a bunch of nixos containers in it. that also cut down the test runtime a bunch15:02:34
@roberthensing:matrix.orgRobert Hensing (roberth)
In reply to @nbp:mozilla.org
Robert Hensing (roberth): I had one question about testing, which is: Are nixpkgs/lib tests ever executed? When I was working on modules I added them to the release.nix files of Nixpkgs, but never saw it being reported on Hydra.
there's a github action CI that runs nix-build --arg pkgs import ./. {} ./lib/tests/release.nix. I don't think there's a hydra job for it, but that doesn't seem necessary.
15:03:51
@davidak:matrix.org@davidak:matrix.org
In reply to @whentze:matrix.org
would that be QA-for-nixpkgs or using-nix-for-QA? (or both)
a qa team for our project, nixos, nixpkgs etc
15:04:01
@davidak:matrix.org@davidak:matrix.org* there is one gui test using that x11 framebuffer tool. i want to document that15:04:50
@whentze:matrix.orgWanja Hentzedoes nixpkgs (the repo) implement the "no rocket science" rule btw?15:04:51
@whentze:matrix.orgWanja Hentzethe one that says CI on main must always be green, no exceptions, and this should be automatically enforced15:05:25

Show newer messages


Back to Room ListRoom Version: 9