!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

337 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda65 Servers

You have reached the beginning of time (for this room).


SenderMessageTime
20 Dec 2024
@matthewcroughan:defenestrate.itmatthewcroughanDo we have any existing VM Tests that test torch?13:09:05
@matthewcroughan:defenestrate.itmatthewcroughanlooks like we don't actually13:10:16
@matthewcroughan:defenestrate.itmatthewcroughanhttps://github.com/pytorch/pytorch/blob/main/torch/nn/modules/conv.py13:15:03
@matthewcroughan:defenestrate.itmatthewcroughanultimately it complains about this 13:15:07
@ss:someonex.netSomeoneSerge (matrix works sometimes) No VM tests, no 13:19:16
@matthewcroughan:defenestrate.itmatthewcroughanThis is the first one I'm trying to execute entirely on the CPU13:20:32
@matthewcroughan:defenestrate.itmatthewcroughanfor comfyui in particular13:20:39
@matthewcroughan:defenestrate.itmatthewcroughanimage.png
Download image.png
13:21:14
@matthewcroughan:defenestrate.itmatthewcroughanI have this cat that I can reproduce on the host cpu in 13 seconds only13:21:17
@matthewcroughan:defenestrate.itmatthewcroughan comfyui is launched with --cpu but maybe that is incomplete 13:21:31
@matthewcroughan:defenestrate.itmatthewcroughanMaybe it secretly still accesses the GPU and this vm test proves it13:21:41
@ss:someonex.netSomeoneSerge (matrix works sometimes)

Plausible, I suppose pytorch could ignore our flags and build something with vector extensions on (unless cc-wrapper filters those, I'm not sure), but what part of the logs suggested this conclusion?

Searching for "qemu avx" I see https://superuser.com/a/454814 suggesting -cpu sandyBridge,+avx,enforce

13:23:54
@ss:someonex.netSomeoneSerge (matrix works sometimes)oh i'm acting like an llm13:24:16
@matthewcroughan:defenestrate.itmatthewcroughan

Yeah I've done all of that, and lspcu inside the vm shows

Architecture:             x86_64
  CPU op-mode(s):         32-bit, 64-bit
  Address sizes:          48 bits physical, 48 bits virtual
  Byte Order:             Little Endian
CPU(s):                   8
  On-line CPU(s) list:    0-7
Vendor ID:                AuthenticAMD
  BIOS Vendor ID:         QEMU
  Model name:             AMD Ryzen 9 3900X 12-Core Processor
    BIOS Model name:      pc-i440fx-9.1  CPU @ 2.0GHz
    BIOS CPU family:      1
    CPU family:           23
    Model:                113
    Thread(s) per core:   1
    Core(s) per socket:   8
    Socket(s):            1
    Stepping:             0
    BogoMIPS:             7599.99
    Flags:                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge m
                          ca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall
                           nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cp
                          uid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma
                           cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_t
                          imer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_
                          legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefe
                          tch osvw perfctr_core ssbd ibpb stibp vmmcall fsgsbase
                           tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflus
                          hopt clwb sha_ni xsaveopt xsavec xgetbv1 clzero xsavee
                          rptr wbnoinvd arat npt lbrv nrip_save tsc_scale vmcb_c
                          lean flushbyasid pausefilter pfthreshold v_vmsave_vmlo
                          ad vgif umip rdpid overflow_recov succor arch_capabili
                          ties
Virtualization features:
13:24:36
@matthewcroughan:defenestrate.itmatthewcroughanso I supposedly have it13:24:44

Show newer messages


Back to Room ListRoom Version: 9