!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

315 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda63 Servers

Load older messages


SenderMessageTime
20 May 2024
@ss:someonex.netSomeoneSerge (matrix works sometimes) Have you seen https://fzakaria.com/2023/09/11/quick-insights-using-sqlelf.html? 18:17:01
@glepage:matrix.orgGaétan Lepage
In reply to @tpw_rules:matrix.org
is there some reason we've got an out of date tensorflow build from source?
Because a >200 IQ is necessary to grasp this derivation 😅
18:19:34
@trexd:matrix.orgtrexd
In reply to @glepage:matrix.org
Because a >200 IQ is necessary to grasp this derivation 😅
What's the TLDR on why tensorflow is so difficult to package if you don't mind me asking? Maybe this is another example of "packaging is a hard problem" that I can add to my Nix pitch slides.
18:27:20
@glepage:matrix.orgGaétan Lepage Well, the [tensorflow derivation](https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/tensorflow/default.nix= is ~600 lines of hacking around the bazel build system, + doing a bunch of hacks to inject our own dependencies + CUDA stuff...
All of this requires a lot of expertise (that I personnaly lack).
It is surely one of the hardest packages that I am aware of in the python package set.
18:36:24
@glepage:matrix.orgGaétan Lepage * Well, the tensorflow derivation is ~600 lines of hacking around the bazel build system, + doing a bunch of hacks to inject our own dependencies + CUDA stuff...
All of this requires a lot of expertise (that I personnaly lack).
It is surely one of the hardest packages that I am aware of in the python package set.
18:36:30
@glepage:matrix.orgGaétan Lepage Now, if you want to take this challenge and update tensorflow, please go ahead.
For context, there is a stale PR for updating tensorflow to 2.14: https://github.com/NixOS/nixpkgs/pull/272838
18:38:02
@trexd:matrix.orgtrexd
In reply to @glepage:matrix.org
Now, if you want to take this challenge and update tensorflow, please go ahead.
For context, there is a stale PR for updating tensorflow to 2.14: https://github.com/NixOS/nixpkgs/pull/272838
I'm already full up with packaging hasktorch haha! Yeah I've had a look at the derivation before and it seems nuts.
18:49:58
@aidalgol:matrix.orgaidalgol
In reply to @connorbaker:matrix.org
Maybe it forced the driver to reload lol
I think that's what it is, yeah. This seems to break upon resuming the machine from suspend.
20:06:08
@connorbaker:matrix.orgconnor (he/him)
In reply to @ss:someonex.net
Have you seen https://fzakaria.com/2023/09/11/quick-insights-using-sqlelf.html?
I have! I saw Farid give a presentation on it at NixCon NA and that was neat; but it’s not packaged in Nixpkgs and I don’t want to do it :/
20:58:45
@tpw_rules:matrix.orgtpw_rulesdoes the tensorflow-bin have cuda support?21:41:29
@glepage:matrix.orgGaétan LepageHmm I guess so22:01:54
@glepage:matrix.orgGaétan LepageIt comes with its prebuilt CUDA binary I think22:02:11
@kamillaova:matrix.orgKamilla 'ova joined the room.23:23:10
21 May 2024
@glepage:matrix.orgGaétan Lepage connor (he/him) (UTC-5) where do you "develop" from on nixpkgs ?
Do you use the same machine for writting code and building things (i.e. doing eval) ?
08:04:04
@tpw_rules:matrix.orgtpw_rulesoh yes, it does, it was easy to set up. thanks all!21:08:52
22 May 2024
@connorbaker:matrix.orgconnor (he/him) I use my laptop to ssh into nixos-desktop where I do most of my work 12:53:43
@glepage:matrix.orgGaétan Lepage Ok, I do the same, and then, your nixos-desktop has a few remote builders configured 12:56:19
@glepage:matrix.orgGaétan LepageIs it your intel machine that you linked above ?12:56:30
@connorbaker:matrix.orgconnor (he/him)It is13:43:13
@connorbaker:matrix.orgconnor (he/him)Each of the three desktops has the other two as a remote builder so they effectively share the same store, as I understand13:43:49
@glepage:matrix.orgGaétan LepageOk, thanks so much for answering my questions and providing all those details !14:50:14
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.15:26:09
@mjolnir:nixos.orgNixOS Moderation Botchanged room power levels.15:28:22
@elonsroadster:matrix.orgcolonelpanic changed their display name from elonsroadster to colonelpanic.20:10:22
23 May 2024
@connorbaker:matrix.orgconnor (he/him) Ugh finally made some more progress on https://github.com/NixOS/nixpkgs/pull/306172
Hopefully moving now to the “fix other derivations” stage because I’m mostly satisfied with the core logic
02:36:49
@connorbaker:matrix.orgconnor (he/him) Updated https://gist.github.com/ConnorBaker/305b1aebd7ee74a258a616bbbd4dcd7b with a list of packages which use requireFile if that's helpful to anyone 13:36:53
@connorbaker:matrix.orgconnor (he/him)

Gaétan Lepage: if you get a chance, could you patch python312Packages.qgrid? It needs distutils when building with python3.12 or later:

python3.12-qgrid> ModuleNotFoundError: No module named 'distutils'
14:28:27
@glepage:matrix.orgGaétan Lepage
In reply to @connorbaker:matrix.org

Gaétan Lepage: if you get a chance, could you patch python312Packages.qgrid? It needs distutils when building with python3.12 or later:

python3.12-qgrid> ModuleNotFoundError: No module named 'distutils'
Sure ! Done: https://github.com/NixOS/nixpkgs/pull/314010
14:43:58
@connorbaker:matrix.orgconnor (he/him)

Would you mind also patching https://github.com/NixOS/nixpkgs/blob/master/pkgs/development/python-modules/svgelements/default.nix?

Maybe like the API for the tests changed (extra s)?

python3.12-svgelements> =================================== FAILURES ===================================
python3.12-svgelements> ___________ TestElementCubicBezierPoint.test_cubic_bounds_issue_220 ____________
python3.12-svgelements> [gw27] linux -- Python 3.12.3 /nix/store/c7ycrgwv039nqglbif98yggx211sdbcl-python3-3.12.3/bin/python3.12
python3.12-svgelements> self = <test.test_cubic_bezier.TestElementCubicBezierPoint testMethod=test_cubic_bounds_issue_220>
python3.12-svgelements>     def test_cubic_bounds_issue_220(self):
python3.12-svgelements>         p = Path(transform=Matrix(682.657124793113, 0.000000000003, -0.000000000003, 682.657124793113, 257913.248909660178, -507946.354527872754))
python3.12-svgelements>         p += CubicBezier(start=Point(-117.139521365,1480.99923469), control1=Point(-41.342266634,1505.62725567), control2=Point(40.3422666342,1505.62725567), end=Point(116.139521365,1480.99923469))
python3.12-svgelements>         bounds = p.bbox()
python3.12-svgelements> >       self.assertNotAlmostEquals(bounds[1], bounds[3], delta=100)
python3.12-svgelements> E       AttributeError: 'TestElementCubicBezierPoint' object has no attribute 'assertNotAlmostEquals'. Did you mean: 'assertNotAlmostEqual'?
python3.12-svgelements> test/test_cubic_bezier.py:82: AttributeError
python3.12-svgelements> ______________________ TestElementWrite.test_write_group _______________________
python3.12-svgelements> [gw20] linux -- Python 3.12.3 /nix/store/c7ycrgwv039nqglbif98yggx211sdbcl-python3-3.12.3/bin/python3.12
python3.12-svgelements> self = <test.test_write.TestElementWrite testMethod=test_write_group>
python3.12-svgelements>     def test_write_group(self):
python3.12-svgelements>         g = Group()
python3.12-svgelements> >       self.assertEquals(g.string_xml(), "<g />")
python3.12-svgelements> E       AttributeError: 'TestElementWrite' object has no attribute 'assertEquals'. Did you mean: 'assertEqual'?
python3.12-svgelements> test/test_write.py:27: AttributeError
14:49:59
@connorbaker:matrix.orgconnor (he/him)Oh there's a patch for it! https://github.com/meerk40t/svgelements/commit/23da98941a94cf1afed39c10750222ccfee73c9f14:50:30

Show newer messages


Back to Room ListRoom Version: 9