!CJXQiUGqNPcFonEdME:nixos.org

NixOS Foundation

479 Members
Public room for chatting with the NixOS Foundation Board122 Servers

Load older messages


SenderMessageTime
19 Apr 2024
@alejandrosame:matrix.org@alejandrosame:matrix.org
In reply to @delroth:delroth.net
do you think nlnet is properly aware of what they're getting out of SoN?
No clue tbh
20:42:28
@janik0:matrix.orgJanik (they/them)

First of all to be fully transparent: I'm one of the facilitator for this year and thus have a financial tie to this project.

  • In the end this is an NLnet project, not a NixOS foundation project, so their own pressure on setting their own objectives has to be taken into account.

that's not entirely true, since it's a project in colab with the nixos foundation and all the financial stuff and contracts are handled through the foundation.

20:44:07
@delroth:delroth.netdelrothalso, even if nlnet strictly set the goals (which I don't believe they do - it's probably fairly loosely defined, as it should be), there would still be significant leeway in how to achieve those goals, and that's the space I think would be worth exploring because I don't believe the SoN methods are being effective20:45:39
@alejandrosame:matrix.org@alejandrosame:matrix.org
In reply to @delroth:delroth.net
also, low efficiency isn't really debatable when you take groups of 5 participants and they end up having lower output (even after months of being in the program) than I'd expect a single nixpkgs committer would have in the same unit of time
My comment of being debatable is more on the point of under which constraints are we talking about. Aka, I'm willing to talk specifics in detail to understand myself whenever I ran projects like this, but also I'm not a person with any decision making impact in any of this.
20:46:10
@alejandrosame:matrix.org@alejandrosame:matrix.org
In reply to @janik0:matrix.org

First of all to be fully transparent: I'm one of the facilitator for this year and thus have a financial tie to this project.

  • In the end this is an NLnet project, not a NixOS foundation project, so their own pressure on setting their own objectives has to be taken into account.

that's not entirely true, since it's a project in colab with the nixos foundation and all the financial stuff and contracts are handled through the foundation.

So then why ngipkgs exists to begin with?
20:47:04
@janik0:matrix.orgJanik (they/them)
In reply to @alejandrosame:matrix.org
So then why ngipkgs exists to begin with?
I have asked the same but did not get a satisfactory answer.
20:47:37
@delroth:delroth.netdelroth
In reply to @alejandrosame:matrix.org
My comment of being debatable is more on the point of under which constraints are we talking about. Aka, I'm willing to talk specifics in detail to understand myself whenever I ran projects like this, but also I'm not a person with any decision making impact in any of this.
makes perfect sense, and I'll clarify that low productivity/throughput on its own is not really a red flag either - if for example it came with tangible benefits in terms of ramping up contributors long term to the project. But right now we can't even honestly have this discussion because all I see in SoN reports is organizers claiming everything is amazing, including productivity
20:48:27
@janik0:matrix.orgJanik (they/them)btw, most builds of ngipkgs just straight up fail and don't seem to be maintained while lots of the packages would not be mergeable to nixpkgs because of a low quality and in general things that would be catched in a nixpkgs review https://hydra.ngi0.nixos.org/jobset/ngipkgs/main none of the packages has a vmtest or module from what I could tell in the ngipkgs repo which is also quiet sad, since vmtests are what (imho) differentiates good from very nix packages. 20:52:40
@janik0:matrix.orgJanik (they/them) * btw, most builds of ngipkgs just straight up fail and don't seem to be maintained while lots of the packages would not be mergeable to nixpkgs because of a low quality and in general things that would be catched in a nixpkgs review https://hydra.ngi0.nixos.org/jobset/ngipkgs/main none of the packages has a vmtest or module from what I could tell in the ngipkgs repo which is also quiet sad, since vmtests are what (imho) differentiates good from very good nix packages. 20:53:14
@janik0:matrix.orgJanik (they/them)
In reply to @alejandrosame:matrix.org
So then why ngipkgs exists to begin with?
fwiw there is a reasoning paragraph in the repo https://github.com/ngi-nix/ngipkgs/?tab=readme-ov-file#reasoning-for-creation-of-the-ngipkgs-monorepo
20:55:28
@nerves:bark.lgbt@nerves:bark.lgbt joined the room.23:26:51
20 Apr 2024
@aynish:sealight.xyzaynish

Full disclosure: I was a SoN 2023 participant.

i think its pertinent to remember SoN is primarily about facilitating students. Low productivity, and low follow up aren't necessarily red flags even together imo. Lots of the packages in ngipkgs havent been packaged for nixpkgs precisely because of the difficulty in packaging them in nix, and that they landed in ngipkgs at all (flaws and all) by students speaks highly of the capabilities of mob programming.

07:04:31
@aynish:sealight.xyzaynish
In reply to @janik0:matrix.org
btw, most builds of ngipkgs just straight up fail and don't seem to be maintained while lots of the packages would not be mergeable to nixpkgs because of a low quality and in general things that would be catched in a nixpkgs review https://hydra.ngi0.nixos.org/jobset/ngipkgs/main

none of the packages has a vmtest or module from what I could tell in the ngipkgs repo which is also quiet sad, since vmtests are what (imho) differentiates good from very nix packages.
thats not true. ngipkgs dors have vmware tests, ive used them
07:14:09
@aynish:sealight.xyzaynish * thats not true. ngipkgs does have vmware tests, ive used them 07:14:17
@aynish:sealight.xyzaynish as for why ngipkgs exists, there's lots of restrictions and unstable apis not yet merged in nixpkgs that are nonetheless useful for building packages. IFD and fetchPnpmDeps being perfect examples of each. I used both of these too package applications for ngipkgs, that haven't yet landed in nixpkgs. In the ideal case we upstream to nixpkgs (which my mob did), but even if we cant meet that bar, having the pkg in ngipkgs still produces value to the community, and in particular nlnet. 07:18:52
@aynish:sealight.xyzaynish * as for why ngipkgs exists, there's lots of restrictions and unstable apis not yet merged in nixpkgs that are nonetheless useful for building packages. IFD and fetchPnpmDeps being perfect examples of each. I used both of these too package applications for ngipkgs, that haven't yet landed in nixpkgs. In the ideal case we upstream to nixpkgs (which my mob did), but even if we cant meet that bar, having the pkg in ngipkgs still produces value to the community, and in particular, to nlnet. 07:19:19
@vcunat:matrix.orgvcunatIFD is too problematic to ever get used in nixpkgs, IMHO.07:20:50
@aynish:sealight.xyzaynishExactly, and understandably so, but that shouldnt stop nlnet and achieving its goal of packaging software funded through it with nix07:21:20
@vcunat:matrix.orgvcunatMaybe some weaker variant, like recursive nix (or how it's called).07:21:31
@fricklerhandwerk:matrix.orgfricklerhandwerk joined the room.07:36:33
@jackleightcap:matrix.org@jackleightcap:matrix.org

to be transparent, i participated as a group member in SON 2023 and also now a facilitator in 2024 and thus have a financial tie to the project.

i'd like to make two points from my perspective, both related to communication between NGI and nixpkgs efforts:

  1. NGI funding packaging with nix is not funding of nixpkgs, but when they do there should be mutual expectations about finalizing that work
  2. i think with those mutual expectations clarified, i fully agree probing how well the mob format performs is worth discussion.
07:52:14
@jackleightcap:matrix.org@jackleightcap:matrix.org

first, i'd like to clarify some of the differences in scope between ngipkgs and nixpkgs: the packages under consideration, via the selection of NGI funding, are often not subject to the general OSS popularity marketplace and are often research-quality software.
(i'm a research engineer, this is not meant to be derogatory, there are simply different motivations involved in research efforts.)
while nixpkgs was encouraged as the end home for packages when possible, upstreaming required some level of indefinite commitment which can be a hard ask when members have no lasting personal vested interest in the NGI projects for themselves.
my 2023 SON group decided to collectively maintain our librecast work that currently exists upstreamed into nixpkgs, because we ended up finding it useful, for example.
some of the packages under ngipkgs's scope are not mature and ready for broad adoption in a high-quality well-maintained package set, however, that shouldn't be just some person's decision on a case-by-case basis, closing the conversation, which i think is kind of the problem here!

as an example of what i mean on the extreme research side, take this NGI project PR: https://github.com/ngi-nix/ngipkgs/pull/168
Libre-SOC is a large project in the libre hardware world, it requires many of its own bespoke tools to compile an ASIC.
the result/ is a (reproducible, cached, lengthy) build with an artifact not standard for packages or services distributed in nixpkgs (that I'm aware of.)
this involves tools based on python 2 (electrical engineers broadly do not care about supply chain security), lots of patching, and generally lack the polish of software intended for distribution.
in this case, the project had an initial pass of packaging by a SON 2021 participant and had since bitrotted, however from that starting work, it took me a relatively quick pass to revive that work to the current release and enable all of the verification suites.
that is to say, ending up in nixpkgs is not the be-all and end-all of the packaging work being funded; it is absolutely worth having as an independent repository with its own standards of inclusion (not unlike the NUR, i figure.)

07:52:29
@jackleightcap:matrix.org@jackleightcap:matrix.org second, i agree with the skepticism about the program's group structure: fwiw, i found the mob format to be an extremely blunt and basic tool, where i was reminded of the formats used in my first university CS classes.
but, the expectations of the program should be clarified before addressing this.
being a summer program targeting students and newcomers, the experience felt like consistent but slow work, mostly bottlenecked by the least proficient or engaged member.
it was difficult to determine the total difficulty and time investment of a package without simply seeing it through, requiring slow and methodical debugging stabs in the dark.
we learned more about the pain of shitty PHP build systems than we did about nix, in the case of one project.
overcoming friction like this highlights that an introductory group cannot be expected to take side-quests into ecosystem-level problems, and instead requires scavenging through available stale and in-progress PRs to meet completion.
while it is frankly important to develop tolerance when using Nix, and these are much more general problems, i mention them to demonstrate that when collaborating and teaching in these conditions, expectations must be very clear before the management of the group can be addressed.
because of this miscommunication, the $/package metric meaningless, as the format is obviously outmoded if aiming entirely for pure efficiency.
the program is currently branded as educational/mentoring, so i do not think this metric is correct to optimize for, nor do i think 'progression into nixpkgs maintainer' is the sole metric of having successfully taught nix to students.
07:52:43
@jackleightcap:matrix.org@jackleightcap:matrix.orgall that said, apologies for the novel. now leading my own group, i'd like to aid however i can in opening up better coordination here.07:53:10
@jackleightcap:matrix.org@jackleightcap:matrix.org *

to be transparent, i participated as a group member in SON 2023 and also now a facilitator in 2024 and thus have a financial tie to the project.

i'd like to make two points from my perspective, both related to communication between NGI and nixpkgs efforts:

  1. NGI funding packaging with nix is not funding of nixpkgs, but when incentives align there should be mutual expectations about finalizing that work
  2. i think with those mutual expectations clarified, i fully agree probing how well the mob format performs is worth discussion.
07:54:14
@piegames:matrix.orgpiegamesShort interjection: goals and success metrics are subjective, and Ngi and the Foundation may not necessarily align in these. If Ngi decides that their money is well spent on this, this does not contradict with questioning the Foundation's involvement in it.08:02:14
@fricklerhandwerk:matrix.orgfricklerhandwerk

delroth I‘m confused about all this. Why don’t you ask me directly if you see issues? I’m online and responsive essentially every day. This can happen in public if you feel like it. There are no secrets around what’s happening, sometimes merely lack of communication.

It’s a bit much to unpack right now, and I’ll reply in detail when I’m back at a keyboard. But I reject the claim that I ever said anything even close to “everything is amazing”. Getting this stuff right is hard, I’m very critical about the outcomes, and I highly appreciate any feedback and tips on how to do it better.

Procedural note: Maybe we can find a better venue for such a discussion? This already completely occupies the channel and prevents other subjects from getting attention.

08:02:41
@fricklerhandwerk:matrix.orgfricklerhandwerk Janik (they/them) I’m confused just as well about your reaction. You asked me about the merits of NGIpkgs the other day. I replied, but you did not signal that why I wrote was unsatisfactory, so I concluded that topic is closed. I’m open for anyone voicing concerns just as much as for constructive feedback, but please do that and don’t leave me in the dark if you have the impression there’s something seriously going wrong. I’ll re-do my answer for public consumption in my detailed reply to this conversation, feel free to pick up in that on record. 08:09:52
@fricklerhandwerk:matrix.orgfricklerhandwerk * Janik (they/them) I’m confused just as well about your reaction. You asked me about the merits of NGIpkgs the other day. I replied, but you did not signal that why I wrote was unsatisfactory, so I concluded that topic is closed. I’m open for anyone voicing concerns just as much as for constructive feedback, but please do that and don’t leave me in the dark if you have the impression there’s something seriously going wrong. I’ll re-do my answer for public consumption in my detailed reply to this conversation, feel free to pick up on that on record. 08:10:01
@fricklerhandwerk:matrix.orgfricklerhandwerk * Janik (they/them) I’m confused just as well about your reaction. You asked me about the merits of NGIpkgs the other day. I replied, but you did not signal that what I wrote was unsatisfactory, so I concluded that topic is closed. I’m open for anyone voicing concerns just as much as for constructive feedback, but please do that and don’t leave me in the dark if you have the impression there’s something seriously going wrong. I’ll re-do my answer for public consumption in my detailed reply to this conversation, feel free to pick up on that on record. 08:10:19

Show newer messages


Back to Room ListRoom Version: 10