!SgYlXivkogarTVcnZO:nixos.org

Nix Flakes

892 Members
179 Servers

Load older messages


SenderMessageTime
24 Oct 2023
@lorenzleutgeb:matrix.orgLorenz Leutgeb
In reply to @pederbs:pvv.ntnu.no
make an alias?
You mean a shell alias? An alias from what to what? I don't know an that gives me the output I want. I could call nix flake show right before/after I call nix build, but that's racy.
20:30:00
@pederbs:pvv.ntnu.nopbsdsYou use the resolved flake url in nix build20:53:01
@lorenzleutgeb:matrix.orgLorenz Leutgeb

One nice property of flakes is that I can address them as github:edolstra/hello, that's something I can remember as a human. This reference changes over time and is not reproducible. Whenever I call nix build github:edolstra/hello, Nix must inevitably somehow resolve this reference to a concrete revision. The concrete revision is a long hexadecimal string I cannot remember. Therefore I do see value in nix build to, when requested, just print the revision. Then, I can share its output (which now includes the resolved URL, which includes the hash) to my teammates, who can run the same build even if the revision that the default branch of github:edolstra/hello resolves to has changed in the meantime.

It's not a question of whether there is a possibility to somehow obtain a fully resolved flake URL, and that it can be provided as an argument to nix build, but a matter of convenience of the user experience with nix build.

20:58:37
@lorenzleutgeb:matrix.orgLorenz Leutgeb *

One nice property of flakes is that I can address them as github:edolstra/hello, that's something I can remember as a human. This reference changes over time and is not reproducible. Whenever I call nix build github:edolstra/hello, Nix must inevitably somehow resolve this reference to a concrete revision. The concrete revision contains a long hexadecimal string I cannot remember. Therefore I do see value in nix build to, when requested, just print the revision. Then, I can share its output (which now includes the resolved URL, which includes the hash) to my teammates, who can run the same build even if the revision that the default branch of github:edolstra/hello resolves to has changed in the meantime.

It's not a question of whether there is a possibility to somehow obtain a fully resolved flake URL, and that it can be provided as an argument to nix build, but a matter of convenience of the user experience with nix build.

20:58:59
@lorenzleutgeb:matrix.orgLorenz Leutgeb *

One nice property of flakes is that I can address them as github:edolstra/hello, that's something I can remember as a human. This reference changes over time and is not reproducible. Whenever I call nix build github:edolstra/hello, Nix must inevitably somehow resolve this reference to a concrete revision. The concrete revision contains a long hexadecimal string I cannot remember. Therefore I do see value in nix build to, when requested, just print the revision, i.e. the result of the resolution it must perform anyways. Then, I can share its output (which now includes the resolved URL, which includes the hash) to my teammates, who can run the same build even if the revision that the default branch of github:edolstra/hello resolves to has changed in the meantime.

It's not a question of whether there is a possibility to somehow obtain a fully resolved flake URL, and that it can be provided as an argument to nix build, but a matter of convenience of the user experience with nix build.

20:59:27
@lorenzleutgeb:matrix.orgLorenz Leutgeb nix flake show does this by the way (as I have mentioned above), but there's no way for me to guarantee that the reference does not change in between invocations of nix build and nix flake show. That's why I am asking for a solution that only involves nix build. Or a convincing explanation for a better solution... 21:03:38
@pederbs:pvv.ntnu.nopbsdshuh, you're right21:06:42
@pederbs:pvv.ntnu.nopbsds there is no utility to expand github:nixos/nixpkgs#hello to e.g. github:NixOS/nixpkgs/7e63eed145566cca98158613f3700515b4009ce3#hello 21:07:26
@lorenzleutgeb:matrix.orgLorenz Leutgeb At least I couldn't find one... And if there would be one, I'd still prefer nix build to give me the expansion of the very thing I am building to avoid races (colleague pushing to Git in parallel, who knows...). 21:08:24
@lorenzleutgeb:matrix.orgLorenz Leutgeb * At least I couldn't find one... And if there would be one, I'd still prefer nix build to give me the expansion of the very thing I am building to avoid races (colleague pushing to Git host in parallel, who knows...). 21:08:45
@lorenzleutgeb:matrix.orgLorenz Leutgeb Also note that nix flake show --json does not print the resolved URL (which nix flake show does). I just filed an issue: https://github.com/NixOS/nix/issues/9230 21:09:44
@lorenzleutgeb:matrix.orgLorenz Leutgeb If nix flake show --json would print the URL (analogously to nix flake show), then nix flake show --json FLAKE | jq -r 'keys[0]' would be the utility that resolves a flake to its precise URL. 21:11:15
@lorenzleutgeb:matrix.orgLorenz Leutgeb * If nix flake show --json would print the URL (analogously to nix flake show), then nix flake show --json FLAKE | jq -r 'keys' would be the utility that resolves a flake to its precise URL. 21:11:43
@lorenzleutgeb:matrix.orgLorenz Leutgeb * If nix flake show --json would print the URL (analogously to nix flake show), then nix flake show --json FLAKE | jq -r 'keys' would be the utility that resolves a flake to its precise URL. And then we would have to deal with the #hello part separately... 21:12:14
25 Oct 2023
@federicodschonborn:matrix.org@federicodschonborn:matrix.org changed their profile picture.00:12:36
26 Oct 2023
@lehmanator:gnulinux.club@lehmanator:gnulinux.club

What is the flakes way of going about installing packages from different nixpkgs branches?

I have been seeing stuff like this everywhere, but no equivalent method for flakes that doesn't break reproducibility:

unstable = import <nixos-unstable> {};
environment.systemPackages = [ unstable.myPackage ];

or

unstable = fetchTarball https://github.com/NixOS/nixpkgs/archive/nixos-unstable.tar.gz

I was thinking about making an overlay using flake-utils.lib.eachDefaultSystem to instantiate nixpkgs to be set as pkgs.unstable, but this feels wrong and I'm wondering if this will cause lots of cache misses & blow up my build times.

Is there a "best practices" way of going about this?

02:32:50
@petrichor:envs.net@petrichor:envs.net
In reply to @lehmanator:gnulinux.club

What is the flakes way of going about installing packages from different nixpkgs branches?

I have been seeing stuff like this everywhere, but no equivalent method for flakes that doesn't break reproducibility:

unstable = import <nixos-unstable> {};
environment.systemPackages = [ unstable.myPackage ];

or

unstable = fetchTarball https://github.com/NixOS/nixpkgs/archive/nixos-unstable.tar.gz

I was thinking about making an overlay using flake-utils.lib.eachDefaultSystem to instantiate nixpkgs to be set as pkgs.unstable, but this feels wrong and I'm wondering if this will cause lots of cache misses & blow up my build times.

Is there a "best practices" way of going about this?

you can include it as another input to your flake, like nixpkgs-unstable.url = "github:nixos/nixpkgs/nixos-unstable";
07:24:59
@lehmanator:gnulinux.club@lehmanator:gnulinux.club
In reply to @petrichor:envs.net
you can include it as another input to your flake, like nixpkgs-unstable.url = "github:nixos/nixpkgs/nixos-unstable";

Right, but how should I make its packages accessible by the system / home-manager?

I know I can do something like:

19:12:25
@lehmanator:gnulinux.club@lehmanator:gnulinux.club
In reply to @petrichor:envs.net
you can include it as another input to your flake, like nixpkgs-unstable.url = "github:nixos/nixpkgs/nixos-unstable";
*

Right, but how should I make its packages accessible by the system / home-manager?

I know I can do something like:

19:12:32
@lehmanator:gnulinux.club@lehmanator:gnulinux.club
In reply to @petrichor:envs.net
you can include it as another input to your flake, like nixpkgs-unstable.url = "github:nixos/nixpkgs/nixos-unstable";
*

Right, but how should I make its packages accessible by the system / home-manager?

I know I can do something like:

nixpkgs.overlays = [
  (final: prev: { pkgs.unstable = inputs.nixpkgs-unstable.legacyPackages.${prev.stdenv.system}; })
];

but I remember seeing one of the big maintainers saying that using a lot of overlays is discouraged and often causes slow builds, and suggested a better practice (which unfortunately I dont remember) for overriding / adding packages, but that was for one-off packages and not an entire instance of nixpkgs.

19:18:01
@lehmanator:gnulinux.club@lehmanator:gnulinux.clubThis was specifically when using flakes, as using the channels mechanism breaks reproducibility.19:21:22
27 Oct 2023
@federicodschonborn:matrix.org@federicodschonborn:matrix.org changed their profile picture.01:24:13
30 Oct 2023
@charles:computer.surgeryCharles
In reply to @lehmanator:gnulinux.club

What is the flakes way of going about installing packages from different nixpkgs branches?

I have been seeing stuff like this everywhere, but no equivalent method for flakes that doesn't break reproducibility:

unstable = import <nixos-unstable> {};
environment.systemPackages = [ unstable.myPackage ];

or

unstable = fetchTarball https://github.com/NixOS/nixpkgs/archive/nixos-unstable.tar.gz

I was thinking about making an overlay using flake-utils.lib.eachDefaultSystem to instantiate nixpkgs to be set as pkgs.unstable, but this feels wrong and I'm wondering if this will cause lots of cache misses & blow up my build times.

Is there a "best practices" way of going about this?

when you do outputs = { self, ... }@inputs: ...; in your flake.nix, pass inputs to specialArgs, then you can use the flake inputs and outputs (via self) in your nixos modules. maybe home manager has something like specialArgs too
04:13:21
@charles:computer.surgeryCharles
In reply to @lehmanator:gnulinux.club

What is the flakes way of going about installing packages from different nixpkgs branches?

I have been seeing stuff like this everywhere, but no equivalent method for flakes that doesn't break reproducibility:

unstable = import <nixos-unstable> {};
environment.systemPackages = [ unstable.myPackage ];

or

unstable = fetchTarball https://github.com/NixOS/nixpkgs/archive/nixos-unstable.tar.gz

I was thinking about making an overlay using flake-utils.lib.eachDefaultSystem to instantiate nixpkgs to be set as pkgs.unstable, but this feels wrong and I'm wondering if this will cause lots of cache misses & blow up my build times.

Is there a "best practices" way of going about this?

*

when you do outputs = { self, ... }@inputs: ...; in your flake.nix, pass inputs to specialArgs, then you can use the flake inputs and outputs (via self) in your nixos modules. maybe home manager has something like specialArgs too.

for example: https://or.computer.surgery/charles/servy-fleet/-/blob/3eae347d2cce33d1fed7371346b9d8b2aced891b/config/matrix-conduit/default.nix#L17

04:14:46
@virtu:matrix.im@virtu:matrix.im joined the room.14:16:51
31 Oct 2023
@virtu:matrix.im@virtu:matrix.im

Hey everyone. Flake novice here. I used a flake to create a reproducible development shell for one of my python applications. So far, so good.

Then I wanted to integrate my application into my configuration.nix and run it as a recurring service via systemd. To this end, (after browsing github for inspiration), in my nix config repo I created a pkgs/app/default.nix, which points to the github repo of my application, and a modules/app/default.nix, which defines settings and applies those appropriately. My configuration.nix imports the app's module and enables it. Although it took me a while cause I'm new to Nix, I got that setup working after a while.

Now I'd like to turn the second part (module, pkg definitions) into a flake, and have some questions about that. Because there's so many open questions, I'll just post them in the order that makes sense to me. Any help/pointers would be greatly appreciated:

  • When searching for flakes on github, I only found repos that turn other repos into flakes. Is there a reason to separate the flake part from the code part? Or is this mainly due to people turning other people's applications into flakes?
  • What if I want to turn code I maintain into a flake? Should I also use dedicated repos for the application and the flake? Since I already have a flake.nix file for the development shell in my application's repo, at first glance it doesn't make sense to me to have a dedicated repo for the module/pkg functionality because there's a chance the lock files are not in sync so you might be running different code/deps than you're using during development.
  • If it's therefore considered a best practice to put the functionality for the devshell and packaging into the same repo, is there some other set of best practices about the layout? On one hand, I don't want to stuff the code repo with nix-specific directories and files; on the other, putting everything into flake.nix might make the code cluttered.
  • Last but not least, how do I port the functionality from the {pkgs,module}/app/default.nix files so it can be used as a flake in my configuration.nix? If anyone has a (preferably simple) example repo on github, that would be great.
    Sorry for the lengthy list, but I felt putting all questions out there so people can immediately shoot down stupid questions and point me into the right direction. Thanks!
08:28:51
@mewp:nurupo.plmewpthe main difference between having a flake in the same repo vs a separate one is that if it's in the same repo, the whole repository ends up in the closure—which is fine most of the time, but sometimes you e.g. want to filter something out, because it isn't necessary for your builds08:53:53
@mewp:nurupo.plmewpI'd say that when possible, it makes sense to have the flake in the same repo08:54:09
@mewp:nurupo.plmewpI wouldn't want to have a devshell in a repository separate from the app—but I don't know if there is a general practice08:54:53
@mewp:nurupo.plmewpfor what it's worth, my encounters with flakes so far are mostly in repos that package themselves, in the same repo08:55:20

Show newer messages


Back to Room ListRoom Version: 6