!CJXQiUGqNPcFonEdME:nixos.org

NixOS Foundation

455 Members
Public room for chatting with the NixOS Foundation Board115 Servers

Load older messages


SenderMessageTime
20 Apr 2024
@aynish:sealight.xyzaynish

Full disclosure: I was a SoN 2023 participant.

i think its pertinent to remember SoN is primarily about facilitating students. Low productivity, and low follow up aren't necessarily red flags even together imo. Lots of the packages in ngipkgs havent been packaged for nixpkgs precisely because of the difficulty in packaging them in nix, and that they landed in ngipkgs at all (flaws and all) by students speaks highly of the capabilities of mob programming.

07:04:31
@aynish:sealight.xyzaynish
In reply to @janik0:matrix.org
btw, most builds of ngipkgs just straight up fail and don't seem to be maintained while lots of the packages would not be mergeable to nixpkgs because of a low quality and in general things that would be catched in a nixpkgs review https://hydra.ngi0.nixos.org/jobset/ngipkgs/main

none of the packages has a vmtest or module from what I could tell in the ngipkgs repo which is also quiet sad, since vmtests are what (imho) differentiates good from very nix packages.
thats not true. ngipkgs dors have vmware tests, ive used them
07:14:09
@aynish:sealight.xyzaynish * thats not true. ngipkgs does have vmware tests, ive used them 07:14:17
@aynish:sealight.xyzaynish as for why ngipkgs exists, there's lots of restrictions and unstable apis not yet merged in nixpkgs that are nonetheless useful for building packages. IFD and fetchPnpmDeps being perfect examples of each. I used both of these too package applications for ngipkgs, that haven't yet landed in nixpkgs. In the ideal case we upstream to nixpkgs (which my mob did), but even if we cant meet that bar, having the pkg in ngipkgs still produces value to the community, and in particular nlnet. 07:18:52
@aynish:sealight.xyzaynish * as for why ngipkgs exists, there's lots of restrictions and unstable apis not yet merged in nixpkgs that are nonetheless useful for building packages. IFD and fetchPnpmDeps being perfect examples of each. I used both of these too package applications for ngipkgs, that haven't yet landed in nixpkgs. In the ideal case we upstream to nixpkgs (which my mob did), but even if we cant meet that bar, having the pkg in ngipkgs still produces value to the community, and in particular, to nlnet. 07:19:19
@vcunat:matrix.orgvcunatIFD is too problematic to ever get used in nixpkgs, IMHO.07:20:50
@aynish:sealight.xyzaynishExactly, and understandably so, but that shouldnt stop nlnet and achieving its goal of packaging software funded through it with nix07:21:20
@vcunat:matrix.orgvcunatMaybe some weaker variant, like recursive nix (or how it's called).07:21:31
@fricklerhandwerk:matrix.orgfricklerhandwerk joined the room.07:36:33
@jackleightcap:matrix.org@jackleightcap:matrix.org

to be transparent, i participated as a group member in SON 2023 and also now a facilitator in 2024 and thus have a financial tie to the project.

i'd like to make two points from my perspective, both related to communication between NGI and nixpkgs efforts:

  1. NGI funding packaging with nix is not funding of nixpkgs, but when they do there should be mutual expectations about finalizing that work
  2. i think with those mutual expectations clarified, i fully agree probing how well the mob format performs is worth discussion.
07:52:14
@jackleightcap:matrix.org@jackleightcap:matrix.org

first, i'd like to clarify some of the differences in scope between ngipkgs and nixpkgs: the packages under consideration, via the selection of NGI funding, are often not subject to the general OSS popularity marketplace and are often research-quality software.
(i'm a research engineer, this is not meant to be derogatory, there are simply different motivations involved in research efforts.)
while nixpkgs was encouraged as the end home for packages when possible, upstreaming required some level of indefinite commitment which can be a hard ask when members have no lasting personal vested interest in the NGI projects for themselves.
my 2023 SON group decided to collectively maintain our librecast work that currently exists upstreamed into nixpkgs, because we ended up finding it useful, for example.
some of the packages under ngipkgs's scope are not mature and ready for broad adoption in a high-quality well-maintained package set, however, that shouldn't be just some person's decision on a case-by-case basis, closing the conversation, which i think is kind of the problem here!

as an example of what i mean on the extreme research side, take this NGI project PR: https://github.com/ngi-nix/ngipkgs/pull/168
Libre-SOC is a large project in the libre hardware world, it requires many of its own bespoke tools to compile an ASIC.
the result/ is a (reproducible, cached, lengthy) build with an artifact not standard for packages or services distributed in nixpkgs (that I'm aware of.)
this involves tools based on python 2 (electrical engineers broadly do not care about supply chain security), lots of patching, and generally lack the polish of software intended for distribution.
in this case, the project had an initial pass of packaging by a SON 2021 participant and had since bitrotted, however from that starting work, it took me a relatively quick pass to revive that work to the current release and enable all of the verification suites.
that is to say, ending up in nixpkgs is not the be-all and end-all of the packaging work being funded; it is absolutely worth having as an independent repository with its own standards of inclusion (not unlike the NUR, i figure.)

07:52:29
@jackleightcap:matrix.org@jackleightcap:matrix.org second, i agree with the skepticism about the program's group structure: fwiw, i found the mob format to be an extremely blunt and basic tool, where i was reminded of the formats used in my first university CS classes.
but, the expectations of the program should be clarified before addressing this.
being a summer program targeting students and newcomers, the experience felt like consistent but slow work, mostly bottlenecked by the least proficient or engaged member.
it was difficult to determine the total difficulty and time investment of a package without simply seeing it through, requiring slow and methodical debugging stabs in the dark.
we learned more about the pain of shitty PHP build systems than we did about nix, in the case of one project.
overcoming friction like this highlights that an introductory group cannot be expected to take side-quests into ecosystem-level problems, and instead requires scavenging through available stale and in-progress PRs to meet completion.
while it is frankly important to develop tolerance when using Nix, and these are much more general problems, i mention them to demonstrate that when collaborating and teaching in these conditions, expectations must be very clear before the management of the group can be addressed.
because of this miscommunication, the $/package metric meaningless, as the format is obviously outmoded if aiming entirely for pure efficiency.
the program is currently branded as educational/mentoring, so i do not think this metric is correct to optimize for, nor do i think 'progression into nixpkgs maintainer' is the sole metric of having successfully taught nix to students.
07:52:43
@jackleightcap:matrix.org@jackleightcap:matrix.orgall that said, apologies for the novel. now leading my own group, i'd like to aid however i can in opening up better coordination here.07:53:10
@jackleightcap:matrix.org@jackleightcap:matrix.org *

to be transparent, i participated as a group member in SON 2023 and also now a facilitator in 2024 and thus have a financial tie to the project.

i'd like to make two points from my perspective, both related to communication between NGI and nixpkgs efforts:

  1. NGI funding packaging with nix is not funding of nixpkgs, but when incentives align there should be mutual expectations about finalizing that work
  2. i think with those mutual expectations clarified, i fully agree probing how well the mob format performs is worth discussion.
07:54:14
@piegames:matrix.org@piegames:matrix.orgShort interjection: goals and success metrics are subjective, and Ngi and the Foundation may not necessarily align in these. If Ngi decides that their money is well spent on this, this does not contradict with questioning the Foundation's involvement in it.08:02:14
@fricklerhandwerk:matrix.orgfricklerhandwerk

delroth I‘m confused about all this. Why don’t you ask me directly if you see issues? I’m online and responsive essentially every day. This can happen in public if you feel like it. There are no secrets around what’s happening, sometimes merely lack of communication.

It’s a bit much to unpack right now, and I’ll reply in detail when I’m back at a keyboard. But I reject the claim that I ever said anything even close to “everything is amazing”. Getting this stuff right is hard, I’m very critical about the outcomes, and I highly appreciate any feedback and tips on how to do it better.

Procedural note: Maybe we can find a better venue for such a discussion? This already completely occupies the channel and prevents other subjects from getting attention.

08:02:41
@fricklerhandwerk:matrix.orgfricklerhandwerk Janik (they/them) I’m confused just as well about your reaction. You asked me about the merits of NGIpkgs the other day. I replied, but you did not signal that why I wrote was unsatisfactory, so I concluded that topic is closed. I’m open for anyone voicing concerns just as much as for constructive feedback, but please do that and don’t leave me in the dark if you have the impression there’s something seriously going wrong. I’ll re-do my answer for public consumption in my detailed reply to this conversation, feel free to pick up in that on record. 08:09:52
@fricklerhandwerk:matrix.orgfricklerhandwerk * Janik (they/them) I’m confused just as well about your reaction. You asked me about the merits of NGIpkgs the other day. I replied, but you did not signal that why I wrote was unsatisfactory, so I concluded that topic is closed. I’m open for anyone voicing concerns just as much as for constructive feedback, but please do that and don’t leave me in the dark if you have the impression there’s something seriously going wrong. I’ll re-do my answer for public consumption in my detailed reply to this conversation, feel free to pick up on that on record. 08:10:01
@fricklerhandwerk:matrix.orgfricklerhandwerk * Janik (they/them) I’m confused just as well about your reaction. You asked me about the merits of NGIpkgs the other day. I replied, but you did not signal that what I wrote was unsatisfactory, so I concluded that topic is closed. I’m open for anyone voicing concerns just as much as for constructive feedback, but please do that and don’t leave me in the dark if you have the impression there’s something seriously going wrong. I’ll re-do my answer for public consumption in my detailed reply to this conversation, feel free to pick up on that on record. 08:10:19
@vcunat:matrix.orgvcunat

Procedural note: Maybe we can find a better venue for such a discussion?

A discourse thread?

08:16:49
@julienmalka:matrix.orgJulien Arriving after the battle here (I feel you ronef), but as I've said here, I also don't believe the mob programming principle is really beneficial for this kind of program. That being said, fricklerhandwerk kindly accepted to allow me to handle my team the way I wish, that is I'll mentor my participants both individually and in group to help them learn Nix and the tools and knowledge to contribute to nixpkgs and the Nix ecosystem. My objective is that the expressions produced should be of enough quality that they are upstreamable to nixpkgs. My vision of this program is that it's a success if we create new regular nixpkgs contributors, so I will clearly focus my energy on that point and will report to the community. I think the fact that we have both mob programing and mentoring this year is interesting because it will allow us to have a point of comparison and an honest discussion on how to run things for the next years. 09:28:26
@julienmalka:matrix.orgJulien * Arriving after the battle here (I feel you ronef), but as I've said here, I also don't believe the mob programming principle is really beneficial for this kind of program. That being said, fricklerhandwerk kindly accepted to allow me to handle my team the way I wish, that is I'll mentor my participants both individually and in group to help them learn Nix and the tools and knowledge to contribute to nixpkgs and the Nix ecosystem. My objective is that the expressions produced should be of enough quality that they are upstreamable to nixpkgs. My vision of this program is that it's a success if we create new regular nixpkgs contributors, so I will clearly focus my energy on that point (and a large criterion for the recruitment of my team is the will to contribute to OSS) and will report to the community. I think the fact that we have both mob programing and mentoring this year is interesting because it will allow us to have a point of comparison and an honest discussion on how to run things for the next years. 09:29:43
@julienmalka:matrix.orgJulien * Arriving after the battle here (I feel you ronef), but as I've said here, I also don't believe the mob programming principle is really beneficial for this kind of program. That being said, fricklerhandwerk kindly accepted to allow me to handle my team the way I wish, that is I'll mentor my participants both individually and in group to help them learn Nix and the tools and knowledge to contribute to nixpkgs and the Nix ecosystem. My objective is that the expressions produced should be of enough quality that they are upstreamable to nixpkgs. My vision of this program is that it's a success if we create new regular nixpkgs contributors, so I will clearly focus my energy on that point (and a large criterion for the recruitment of my team is the will to contribute to OSS) and will report to the community. I think the fact that we have both mob programing and mentoring this year is interesting because it will allow us to have a point of comparison and an honest discussion on how to run things for the next years. I pledge to report extensively and honestly on the failures and successes of my team so that we have tangible points to discuss. 09:30:39
@fricklerhandwerk:matrix.orgfricklerhandwerk

To be clear, especially to people at the fringe of the community reading this, or people watching Summer or Nix from the sidelines, who may not be aware of the differences between in-person verbal and public written communication: this is definitely not a battle, not even a heated debate. This is how we clarify uncertainty, and the length of text and style of argument says little about relative importance or tone of voice one may say this in if we were talking to each other in a room.

Jack Leightcap Janik (they/them) alejandrosame Julien aynish many others and I all have working relationships and talk or exchange messages more or less regularly, we know how the other speaks, what certain ways of phrasing mean, and a bit of each other’s way of thinking. Many others I have met in person or talked with remotely at least once.

Read me here as being rather casual but serious – not agitated.

09:47:17
@fricklerhandwerk:matrix.orgfricklerhandwerk(I read Julien’s bit as a joke on the side, but this may not be evident without context, and, to be honest, I may even be wrong.)09:48:41
@fricklerhandwerk:matrix.orgfricklerhandwerk* (I read Julien’s “battle” as a joke on the side, but this may not be evident without context, and, to be honest, I may even be wrong.)09:48:51
@julienmalka:matrix.orgJulienYeah no sorry "arriving after the battle" is the literal translation of a french expression meaning "arriving after the fact"09:49:15
@julienmalka:matrix.orgJulienbecause it felt that the heart of this conversation was yesterday 09:50:06
@julienmalka:matrix.orgJulienbut don't mind me09:50:11
@nscnt:matrix.org@nscnt:matrix.org left the room.13:40:49

Show newer messages


Back to Room ListRoom Version: 10