!aGqRytqbCECitOFhbt:nixos.org

Release Management

341 Members
25.11 "Xantusia" | https://nixos.github.io/release-wiki/Home.html91 Servers

Load older messages


SenderMessageTime
9 Nov 2023
@reckenrode:matrix.orgRandy Eckenrode joined the room.15:03:42
@reckenrode:matrix.orgRandy Eckenrode

I was directed here from the Staging channel. I’ve got question about how LLVM update for Darwin fits into the release process. I know Darwin isn’t a tier 1 platform, but I don’t know what amount of breakage is expected or tolerated.

  • Is there a point at which it should be reverted to reduce the breakage on staging-next; or
  • Is there a threshold (such as less than X dependents) where stuff can be allowed through broken on Darwin (perhaps marked en masse on the release branch) and fixed with backports?
15:14:15
@raitobezarius:matrix.orgraitobezarius(a shame we didn't get a Darwin release manager :>)15:32:23
@raitobezarius:matrix.orgraitobezarius

Personally, I have no idea and no real opinion, I don't know what is the type of software people tend to use on Darwin with Nix, if I had to say anything:

  • someone who cares about Darwin has to make the call for the reverts on staging-next based on their time, expected folks who will help on Darwin fixes, etc.
  • the threshold thing seems weird to me, I would pursue a set of leaf packages that you always want to work in general (or is required for channel bump for example).
  • I'd generally move any large scale changes to after the release otherwise chances are that you will slip and it will be hard to fix things with all the backports you need
15:36:13
@raitobezarius:matrix.orgraitobezariusMore generally, there's enough work with ZHF in normal times, I am not sure extra difficulty should be added15:36:30
@raitobezarius:matrix.orgraitobezariusAlso, I know you are probably among the folks that does a lot of Darwin work and I don't know how much "colleagues" do you have to help in that endeavor, I would be mindful of your energy15:37:24
@raitobezarius:matrix.orgraitobezarius(also be mindful of Hydra being in meh state, etc.)15:39:52
@vcunat:matrix.orgVladimír ČunátHydra is probably back in normal now.15:40:37
@raitobezarius:matrix.orgraitobezariusYep, I just meant this as: Hydra is not a highly available platform and we should all be mindful of its capabilities to build a lot of stuff15:41:12
@raitobezarius:matrix.orgraitobezarius(I mean, for the work it's doing, it's a very good platform)15:41:22
@reckenrode:matrix.orgRandy Eckenrode
In reply to @raitobezarius:matrix.org

Personally, I have no idea and no real opinion, I don't know what is the type of software people tend to use on Darwin with Nix, if I had to say anything:

  • someone who cares about Darwin has to make the call for the reverts on staging-next based on their time, expected folks who will help on Darwin fixes, etc.
  • the threshold thing seems weird to me, I would pursue a set of leaf packages that you always want to work in general (or is required for channel bump for example).
  • I'd generally move any large scale changes to after the release otherwise chances are that you will slip and it will be hard to fix things with all the backports you need

From a Darwin perspective, reverting would be non-ideal. Aside from pushing back the work on the SDK stuff, it risks breaking things using older versions of clang due to incompatibility with clang 16. I’m thinking nodejs and some other stuff that is pinned to clang 15. libc++16 is backward compatible, but libc++ 11 may not be forward compatible enough. There’s also the issue of things that already are not compatible with the clang 11 toolchain (for various reasons).

The threshold was proposed as an attempt at an objective-ish cutoff. I’ll look at what’s in the Darwin channel bump requirements to see if any of those packages need fixed. If they’re all okay, I think it’d be reasonable to tolerate the breakage in the short term provided that fixes are backported. The rebuilds should all be low, so everything would be able to go into master directly.

The only large change currently targeting the release is a fix requested by Haskell maintainers to address the libc++abi issue for Haskell in their generic-builder.nix rather than just in the breaking packages (due to end users using the Haskell infrastructure to build code outside of nixpkgs that may be impacted by the issue). It was indicated they preferred rebuilds to having end-users with broken code (see https://github.com/NixOS/nixpkgs/pull/266172).

There are a few others such as the CF change (because mixing CF and CoreFoundation results in crashes, and CF is just such a maintenance burden) and Darwin cross-compilation, but I wasn’t planning to have those in the release unless something really needed them. Currently aws-sdk-cpp, arrow-cpp, and python3Packages.cherrypy are known not to be buildable on x86_64-darwin running macOS 14. The first two have made it through Hydra, but the last one is getting unlucky with the builder it gets. If it gets lucky, I think that’s okay. Rebuilding all of Darwin (and it would be a completely full rebuild due to touching the first stage of the Darwin bootstrap) should be avoided at this point.

16:00:23
@raitobezarius:matrix.orgraitobezariusI think you have a pretty good view of the situation16:00:57
@raitobezarius:matrix.orgraitobezariusI wished you became Darwin release manager for this release and made those decisions unblocked16:01:15
@reckenrode:matrix.orgRandy Eckenrode
In reply to @raitobezarius:matrix.org
Also, I know you are probably among the folks that does a lot of Darwin work and I don't know how much "colleagues" do you have to help in that endeavor, I would be mindful of your energy
Thanks, and yeah. There are some others contributing fixes as well. No one should risk burning themselves out over this.
16:01:51
10 Nov 2023
@hexa:lossy.networkhexaapparently we're currently aarch64-linux builder starved00:45:31
@hexa:lossy.networkhexabecause the spot market is a cruel place00:45:44
@hexa:lossy.networkhexaI feel like this falls on your shoulders https://github.com/NixOS/nixpkgs/pull/266270#issuecomment-180613247717:32:35
@hexa:lossy.networkhexa

Anyways, I'll be gone for two weeks now, so the call on what to do has to make someone else anyways.

17:32:49
@hexa:lossy.networkhexa figsoda, raitobezarius 17:33:02
@raitobezarius:matrix.orgraitobezarius
In reply to @hexa:lossy.network
I feel like this falls on your shoulders https://github.com/NixOS/nixpkgs/pull/266270#issuecomment-1806132477
Yep I received a private message about it
17:33:19
@raitobezarius:matrix.orgraitobezariusThis is a matter I am monitoring17:33:24
@lennart:0520.chlennart
In reply to @hexa:lossy.network

FoundationDB now defaults to major version 7.

haha, I guess we could drop it
18:43:54
@raitobezarius:matrix.orgraitobezariusI answered on it here19:10:57
@raitobezarius:matrix.orgraitobezarius figsoda: I would like your stamp on https://github.com/NixOS/nixpkgs/pull/266270#issuecomment-1806294172 19:11:04
@raitobezarius:matrix.orgraitobezariusor your "aaaaaaaah no"19:11:09
@raitobezarius:matrix.orgraitobezariusIf anyone feels concerned by convergence logic and PostgreSQL ones, please chime in19:11:29
@raitobezarius:matrix.orgraitobezariusMy perspective is obviously biased as a maintainer of that subsystem and someone who hates when all the work is pushed on a poor overworked maintainer whom we ask to make it up for absence of investment in an ecosystem to avoid this situation19:12:07
@julienmalka:matrix.org@julienmalka:matrix.orgI we reverted the default postgresql version to 14, the impacted users would be everyone that run nixos-unstable right ? 19:16:58
@julienmalka:matrix.org@julienmalka:matrix.orgWhat if we remove the default value for postgresql, forcing users to be mindful about the versions they use ? Migrated users could then use version 15 and new users version 14. We would have to also have an assert that ensure* is used only with version 14. 19:22:42
@julienmalka:matrix.org@julienmalka:matrix.orgCurrently if we remove the ensure* options a lot of nixos modules are going to be broken no ?19:23:47

Show newer messages


Back to Room ListRoom Version: 6