| 21 Mar 2025 |
Arian | I'm trying to build the Amazon linux 2023 kernel in Nixpkgs (for some firecracker testing) but it seems the tags that Amazon linux use don't belong to any branch. So fetchFromGtHub doesn't work | 11:05:27 |
Arian | E.g. https://github.com/amazonlinux/linux/tree/microvm-kernel-6.1.128-3.201.amzn2023 | 11:06:11 |
Arian | It says "doesn't belong to any branch or repo" | 11:06:19 |
Arian | Anybody got an idea why the repo is in such a weird state? | 11:06:38 |
adamcstephens | I think it’s because GitHub considers that repo a fork | 11:41:38 |
adamcstephens | Can you fetch that branch or commit with git directly? | 11:41:54 |
adamcstephens | * Can you fetch that tag or commit with git directly? | 11:42:11 |
Arian | Nope. I can't :/ | 15:12:46 |
Arian | Unable to checkout refs/tags/microvm-kernel-6.1.8..... | 15:13:09 |
Arian | Oh I made a typo | 15:13:34 |
Arian | Okay trying with fetchgit now. Just very slow | 15:14:36 |
Arian | Yep worked. Thanks | 15:15:22 |
| 27 Mar 2025 |
Arian | @commiterate:matrix.org: do you remember why you added zstd as a buildInput to fluent-bit?
Fluent-bit started vendoring libzstd-1.5.7 in their tree but because we add zstd to buildInputs and nixos has a different version it somehow ends up dynamically linking to libzstd-1.5.6 but with the wrong headers. This causes fluent-bit to segfault | 22:34:54 |
Arian | I hate fluent-bit | 22:35:05 |
| 28 Mar 2025 |
Arian | Okay... Fluent-bit just segfaults even without this stuff.. argh | 00:24:45 |
Arian | It's due to libsystemd dlopening libzstd | 00:25:04 |
Ilan Joselevich (Kranzes) | In reply to @arianvp:matrix.org Okay... Fluent-bit just segfaults even without this stuff.. argh Go sleep, we going surfing tomorrow morning | 00:28:54 |
commiterate | It's needed by rdkafka. Otherwise build complains that the library isn't available.
https://github.com/NixOS/nixpkgs/blob/698214a32beb4f4c8e3942372c694f40848b360d/pkgs/by-name/fl/fluent-bit/package.nix#L86-L87
| 03:52:31 |
commiterate | The way Fluent Bit does things is extremely cursed. | 03:52:54 |
commiterate | It was a pretty terrible time getting the package to work properly. | 03:53:24 |
commiterate | * It's needed by rdkafka. Otherwise build complained that the library isn't available.
https://github.com/NixOS/nixpkgs/blob/698214a32beb4f4c8e3942372c694f40848b360d/pkgs/by-name/fl/fluent-bit/package.nix#L86-L87
| 03:55:10 |
commiterate | I didn't think it would be this brittle though. | 03:56:12 |
commiterate | I feel like at some point they're just going to vendor their entire dependency graph and continue having 0 instructions on what's needed to build it, so the only working build setup will be theirs and people can only consume their pre-built binaries. | 03:59:10 |
Arian | So the problem even occurs when I use all their vendores libraries | 08:17:00 |
Arian | Problem is that libsystemd dlopens an incompatible libzstd into memory | 08:17:21 |
Arian | And then all hell breaks loose | 08:17:27 |
Arian | 🔥 | 08:17:45 |
commiterate | Can't say I'm surprised with their lack of systemd tests in CI. Did this not fail the fluent-bit NixOS test? | 14:12:02 |
commiterate | * It feels like at some point they're just going to vendor their entire dependency graph and continue having 0 instructions on what's needed to build it, so the only working build setup will be theirs and people can only consume their pre-built binaries. | 14:12:27 |
geekodour | i am finding it hard to find teams using aws+nix if any of your teams are hiring remotely, pls let me know! much appreciate! | 14:12:59 |