| 11 Feb 2024 |
 SYMYƧ | In reply to @dooy:matrix.org
Is there any work towards creating an LLM bot that integrates Nix documentation for user support and generating specific documentation In my experience LLMs are really awful at Nix right now and hallucinate a lot. I think significant advancement would probably need to happen for this to be helpful rather than confusing, as a bot pulling from existing LLMs is very likely to hallucinate and provide incorrect documentation. Probably, an LLM would need to be trained specifically for the task, and yeah I feel like the best one could even hope for right now is for the LLM to provide links to relevant discussions as described above, or be able to tell you "this is new territory" with some level of confidence. | 18:42:12 |
| SYMYƧ | This also brings up the inevitable question of training ethics. Is there a means for indicating consent to train LLMs on, for example, code in nixpkgs? Is that up to the maintainer, or what? How does that work for discourse? | 18:46:07 |
| SYMYƧ | My bias on this is, I'm a defender of "ai" tech, but also, people are thinking it's way better and more accurate right now than it actually is due to a small number of impressive cases like Alpha Go, and also the ethics are in a spot where nobody knows quite what to do and it's very easy to piss people off | 18:47:50 |
| SYMYƧ | All that being said, docs are one place that LLMs should have some good use-cases, so I think it's good to keep exploring those. | 18:49:18 |
| SYMYƧ | Finding relevant discussions would be more of a classifier than a generator | 18:51:19 |
 @dooy:matrix.org | If it could encapsulate the function logic without merely skimming over the consent code, that would be ideal. However, my knowledge in this area is limited. ChatGPT has been immensely helpful to me over the past year as I've been getting up to speed with NixOS. For the first time in my life, after being a hobbyist for 15 years, I've started working on my first PR. It assists me in understanding the function logic and already possesses a substantial amount of knowledge about Nix too. The value it provides is immense, and I feel significantly less stressed than before. It feels like I'm moving quickly, which empowers me.
| 21:24:30 |
| 12 Feb 2024 |
 symys | Sounds like it's gotten a little better since the last time I tried it. | 01:41:47 |
| symys | But... You haven't run in to situations where it lies to you? 🤨 Cuz that's the thing that would make it dubious to use unsupervised in docs. | 01:43:34 |
| symys | Personally I encounter hallucinations nearly every time I use chatGPT. | 01:45:04 |
