In reply to @mattleon:matrix.org
This reddit thread has some performance notes for various models and Nvidia cards, but I don't see llama with 3b parameters: https://www.reddit.com/r/LocalLLaMA/comments/13j5cxf/how_many_tokens_per_second_do_you_guys_get_with/

error: function 'anonymous lambda' called with unexpected argument 'packageOverrides'

       at /nix/store/y6205wq8hxvpqvl8l9d1n9xah01kg0lq-source/pkgs/by-name/mu/music-assistant/package.nix:1:1:

            1| { lib
             | ^
            2| , python3

systemd.services.music-assistant.environment.NIX_SSL_CERT_FILE = "${pkgs.cacert.override { extraCertificateFiles [ ./foo.pem ] }}/etc/ssl/certs/ca-bundle.crt";

systemd.services.music-assistant.environment = {
  NIX_SSL_CERT_FILE = "${pkgs.cacert.override { extraCertificateFiles [ ./foo.pem ] }}/etc/ssl/certs/ca-bundle.crt";
};

 error: attempt to call something which is not a function but a list

       at /nix/store/y6205wq8hxvpqvl8l9d1n9xah01kg0lq-source/pkgs/by-name/mu/music-assis
tant/package.nix:20:52:

           19|   providerNames = lib.attrNames providerPackages;
           20|   providerDependencies = lib.concatMap (provider: (providerPackages.${provider} python.pkgs)) providers;
             |                                                    ^
           21|