| 9 Nov 2023 |
 matthewcroughan | During the build log for tokenizers it says
python3.11-tokenizers> ⚠️ Warning: You're building a library without activating pyo3's `extension-module` feature. See https://pyo3.rs/v0.19.2/building_and_distribution.html#linking
python3.11-tokenizers> 🔗 Found pyo3 bindings
python3.11-tokenizers> 🐍 Found CPython 3.11 at /nix/store/ffll6glz3gwx342z0ch8wx30p5cnqz1z-python3-3.11.5/bin/python3
python3.11-tokenizers> Compiling autocfg v1.1.
| 23:14:26 |
 K900 | https://github.com/huggingface/tokenizers/blob/648b33a09ee8da40a5b4599054eb855a7a875ca5/bindings/python/py_src/tokenizers/models/__init__.py | 23:20:49 |
| K900 | No it's not | 23:20:51 |
| matthewcroughan | the transformers from nixpkgs can do this import, that is good | 23:22:11 |
| matthewcroughan | K900 ⚡️: I literally copy pasted the derivation form nixpkgs, and made an override like this transformers = super.pythonPackages.callPackage ./f.nix {}; | 23:32:45 |
| matthewcroughan | is that dumb, or a good debugging step? | 23:33:02 |
| K900 | Could work | 23:33:11 |
| K900 | Could also not work | 23:33:14 |
| matthewcroughan | because in this case, the transformers can't import tokenizers.models and the one from nixpkgs can | 23:33:23 |
| matthewcroughan | they seem in the logs to build the same | 23:33:45 |
| 10 Nov 2023 |
| matthewcroughan | K900 ⚡️: the reason is because the version of transformers in the poetry.lock of privateGPT is 0.14.1 | 01:00:02 |
| matthewcroughan | whereas the version that had the method is 0.14.0, not 0.14.1 | 01:00:04 |
| matthewcroughan | they removed the method it's looking for in 0.14.1 | 01:04:20 |
| matthewcroughan | semantic versioning fail | 01:04:21 |
 adisbladis | This is really cool if I say so myself https://github.com/adisbladis/pdm2nix/tree/master/tests/nested-poetry
| 03:31:10 |
| adisbladis | a is a PDM project
b is a Poetry project | 03:31:20 |
| adisbladis | https://github.com/adisbladis/pdm2nix/blob/master/lib/lock.nix#L314-L328 | 03:32:19 |
|  @connorbaker:matrix.org changed their display name from connor (he/him) (UTC-4) to connor (he/him) (UTC-5). | 12:33:39 |
 pareto-optimal-dev | matthewcroughan Your flake built for me just now, I thought you'd want to know. I don't do much python programming anymore though, so I'm not sure what to do at the python prompt it drops me into to further test PrivateGPT. I tried `import PrivateGPT` so that later I could do `dir(PrivateGPT)` and discover how to run it, but that didn't work. | 16:31:58 |
| matthewcroughan | pareto-optimal-dev: python -m private_gpt | 17:22:42 |
| matthewcroughan | python is not for the faint of heart, it's the hardest ecosystem and language ever devised | 17:23:09 |
| pareto-optimal-dev | In reply to @matthewcroughan:defenestrate.it
pareto-optimal-dev: python -m private_gpt Oh... I should use nix shell rather than nix run then | 21:49:38 |
| pareto-optimal-dev | $ nix shell --refresh github:MatthewCroughan/privateGPT -c "python -m mem_gpt"
error: unable to execute 'python -m mem_gpt': No such file or directory
Maybe I'm still in a bad state because I cloned it before you force pushed?
| 21:51:16 |
| pareto-optimal-dev | * $ nix shell --refresh github:MatthewCroughan/privateGPT -c bash -c "python -m mem_gpt"
/nix/store/zg2n0brrnziyb3cj37sqhlhikkvwn61h-python3-3.11.5-env/bin/python3.11: No module named mem_gpt
Maybe I'm still in a bad state because I cloned it before you force pushed?
| 21:52:00 |
| pareto-optimal-dev | oh I feel silly | 21:54:54 |
| pareto-optimal-dev | that's what I get for not copy pasting | 21:55:12 |
| pareto-optimal-dev | nix develop --refresh -c bash -c "python -m private_gpt"
seems working so far
| 21:55:26 |
| 11 Nov 2023 |
|  maxpowerextreme joined the room. | 06:06:56 |
| 12 Nov 2023 |
|  flomonster joined the room. | 14:23:46 |
| flomonster changed their display name from Florian Amsallem to flomonster. | 14:25:14 |
