| 11 Feb 2024 |
@fractivore:cyberia.club | My bias on this is, I'm a defender of "ai" tech, but also, people are thinking it's way better and more accurate right now than it actually is due to a small number of impressive cases like Alpha Go, and also the ethics are in a spot where nobody knows quite what to do and it's very easy to piss people off | 18:47:50 |
@fractivore:cyberia.club | All that being said, docs are one place that LLMs should have some good use-cases, so I think it's good to keep exploring those. | 18:49:18 |
@fractivore:cyberia.club | Finding relevant discussions would be more of a classifier than a generator | 18:51:19 |
@dooy:matrix.org | If it could encapsulate the function logic without merely skimming over the consent code, that would be ideal. However, my knowledge in this area is limited. ChatGPT has been immensely helpful to me over the past year as I've been getting up to speed with NixOS. For the first time in my life, after being a hobbyist for 15 years, I've started working on my first PR. It assists me in understanding the function logic and already possesses a substantial amount of knowledge about Nix too. The value it provides is immense, and I feel significantly less stressed than before. It feels like I'm moving quickly, which empowers me.
| 21:24:30 |
| 12 Feb 2024 |
symys | Sounds like it's gotten a little better since the last time I tried it. | 01:41:47 |
symys | But... You haven't run in to situations where it lies to you? 🤨 Cuz that's the thing that would make it dubious to use unsupervised in docs. | 01:43:34 |
symys | Personally I encounter hallucinations nearly every time I use chatGPT. | 01:45:04 |
symys | Could be clearly labeled with a warning tho, I spose | 02:02:09 |
symys | Personally I feel like a q&a support bot with warning labels would make more sense than a doc generator as such. | 02:05:21 |
symys | I've been on the other hand thinking about "deterministic" doc generation... Which has certain advantages over "AI" (namely accuracy) but also distinct issues (verbosity). | 02:11:58 |
symys | * I've been on the other hand thinking about "deterministic" doc generation... Which has certain advantages over "AI" (namely accuracy) but also distinct issues (verbosity and style). | 02:12:27 |
symys | * I've been on the other hand thinking about "deterministic" doc generation... Which has certain advantages over "AI" (namely accuracy) but also distinct issues (overly verbose, formulaic style, always low-level). | 02:16:31 |
symys | * I've been on the other hand thinking about "deterministic" doc generation... Which has certain advantages over "AI" (namely accuracy) but also distinct issues (overly verbose, formulaic style, unable to recontexutalize or "zoom out"). | 02:17:08 |
| 13 Feb 2024 |
@adam:robins.wtf | hallucinations aren't great, but humans can provide incorrect information too, and it seems the alternative is going to chat/forum and asking humans to help. granted, that would be in a public forum where other people could correct the bad information | 18:17:19 |
@jade_:matrix.org | https://tenforward.social/@noracodes/111926120933093851 | 21:15:01 |
@jade_:matrix.org | we should have a glossary of common top level Nix expression shapes | 21:15:21 |