!fXpAvneDgyJuYMZSwO:nixos.org

Nix Data Science

282 Members
61 Servers

Load older messages


SenderMessageTime
28 Aug 2023
@crtified:crtified.meCRTified sleep 1 suffices and is not that painful, so I'll keep that in it 20:30:40
30 Aug 2023
@maupind:matrix.orgmaupind joined the room.15:16:50
@maupind:matrix.orgmaupindDoes anyone here have good experience developing shiny apps?15:17:22
31 Aug 2023
@brodriguesco:matrix.orgBruno RodriguesI've built some, but am no expert 15:31:04
@brodriguesco:matrix.orgBruno Rodriguesbut ask away maybe I can help 15:31:18
1 Sep 2023
@maupind:matrix.orgmaupind
In reply to @brodriguesco:matrix.org
but ask away maybe I can help
Thanks Bruno! I've trained multiple XG models looking at assessors performance and outcomes. I've created a few SHAP graphs using the shapviz package and would like to create a shiny app that people can use to explore the information rather than emailing multiple graphs. Ideally, I'd have a UI element to choose an assessor, and another UI element to choose the type of graph. For the first graph (overall importance) this seems like it should be straightforward, using some ifelse statements to line up if assessor 1 is chosen display assessor 1 importance graph
08:59:12
@maupind:matrix.orgmaupindHowever, I'd also like to display dependence plots where you have to choose a variable to display, and I am not sure how to go about writing a function that would state if variable X is chosen, create the dependence plot using variable X09:00:18
@maupind:matrix.orgmaupindNot sure if this is important, but the shapviz packages first needs to create an object (calculates the shap values) and then this object is used to create plots. So Assessor A would have a shap object A and from this object you can create an importance plot and/or a dependence plot using some variable i09:01:42
@brodriguesco:matrix.orgBruno Rodriguesthis sounds like you need conditional UI rendering?10:29:56
@brodriguesco:matrix.orgBruno Rodrigueshttps://mastering-shiny.org/action-dynamic.html 10:29:57
@brodriguesco:matrix.orgBruno RodriguesSo you likely need to render the UI server side 10:30:19
@brodriguesco:matrix.orgBruno Rodriguesyou'll likely get more help in the posit Forums though https://community.rstudio.com/ 10:31:08
@brodriguesco:matrix.orgBruno Rodriguestry to post a minimal reproducible example of what you're looking for 10:33:44
@maupind:matrix.orgmaupind Bruno Rodrigues: awesome, thank you! This is definitely a good start and I'll explore this and before trying Posit 10:37:57
3 Sep 2023
@brodriguesco:matrix.orgBruno Rodriguesfriends, what do you use to build pipelines that integrate will with Nix? something that would let you build an environment and run a pipeline as simple as possible? me, coming from R I'm adding the command to run the pipeline in the shellHook of a shell (typically targets::tar_make)14:04:29
@brodriguesco:matrix.orgBruno Rodriguessou dropping in the shell starts the pipeline and then let's me explore the results 14:05:00
@brodriguesco:matrix.orgBruno RodriguesI would imagine que there's likely a way to use nix itself to do it 14:09:20
@crtified:crtified.meCRTified Maybe check out https://github.com/PapenfussLab/bionix - it appears to at least partially match your description (although I don't have any experience with it) 14:10:17
@brodriguesco:matrix.orgBruno Rodriguesyep I've taken a look at it already 😁14:11:22
@crtified:crtified.meCRTifiedCan't really help further than that, I'm still pondering whether I should migrate our hpc cluster to NixOS, but my contract ends soon and I likely won't have enough time14:13:14
@crtified:crtified.meCRTified* Can't really help further than that, I'm still only pondering whether I should migrate our hpc cluster to NixOS, but my contract ends soon and I likely won't have enough time14:13:27
@jb:vk3.wtfjbedoI use bionix pretty extensively, largest project currently involves processing ~90TiB of primary data21:43:06
@crtified:crtified.meCRTified
In reply to @jb:vk3.wtf
I use bionix pretty extensively, largest project currently involves processing ~90TiB of primary data
Does that dataset interact with the nix store in any way? Or is it kept separately? (Just asking, because I had some problems with putting just <30GB inside the store)
21:45:02
@crtified:crtified.meCRTifiedIt probably doesn't make sense to put it in the store, I guess 😄21:45:21
@jb:vk3.wtfjbedoIt does make sense and we do :)21:45:33
@crtified:crtified.meCRTifiedWow, that's surprising 😄21:46:15
@jb:vk3.wtfjbedoIt means we can cache some key intermediate products so we rarely need to revisit the primary inputs 21:46:26
@jb:vk3.wtfjbedoLarge store paths used to be an issue but mostly work pretty smoothly now as a lot of the memory bottlenecks have been removed21:49:18
@crtified:crtified.meCRTifiedThat makes sense. I really had the impression that large store entries still pose a lot of problems 🙂 Nice to know that this changed21:51:16
4 Sep 2023
@brodriguesco:matrix.orgBruno Rodriguesdoes that mean that you could retrieve intermediary outputs from the store to further Analyse in R?16:25:16

Show newer messages


Back to Room ListRoom Version: 6