!eWOErHSaiddIbsUNsJ:nixos.org

NixOS CUDA

290 Members
CUDA packages maintenance and support in nixpkgs | https://github.com/orgs/NixOS/projects/27/ | https://nixos.org/manual/nixpkgs/unstable/#cuda57 Servers

Load older messages

SenderMessageTime
16 Dec 2024
@matthewcroughan:defenestrate.itmatthewcroughan Interestingly in the case of comfyui, I didn't need to add any rocm specific stuff 15:33:35
@matthewcroughan:defenestrate.itmatthewcroughan * Interestingly in the case of comfyui, I didn't need to add any rocm or cuda specific stuff 15:33:37
@matthewcroughan:defenestrate.itmatthewcroughanthat's all in the deps 15:33:40
@matthewcroughan:defenestrate.itmatthewcroughanSo for it, all I do is swap rocmSupport/cudaSupport in the nixpkgs instance, which isgreat15:34:35
@matthewcroughan:defenestrate.itmatthewcroughan * So for it, all I do is swap rocmSupport/cudaSupport in the nixpkgs instance, which is great15:34:37
17 Dec 2024
@connorbaker:matrix.orgconnor (he/him) just left some comments, looks good!
Since you're the first person I'm aware of other than myself to use my cuda-packages repo, I'd love any thoughts you had on the user experience... especially given I've not documented anything yet. 		07:34:41
@connorbaker:matrix.orgconnor (he/him) My understanding was that changes which introduce new functionality or information to ubiquitous components in Nixpkgs should/need to go through the RFC process because people can/do expect stability around those interfaces and so the review process helps find and fix issues with designs before they're implemented.
If there are actual guidelines for changes that would require an RFC (I've not searched hard for them) I'd like to see them so I'm at least aware of them lol 		07:37:58
@connorbaker:matrix.orgconnor (he/him)For awareness, I tagged this issue as CUDA related so it should be on our project board: https://github.com/NixOS/nixpkgs/issues/36526207:39:57
18 Dec 2024
@dmiskovic:matrix.org@dmiskovic:matrix.org joined the room.19:38:04
19 Dec 2024
@hexa:lossy.networkhexahttps://www.cnx-software.com/2024/12/18/249-nvidia-jetson-orin-nano-super-developer-kit-targets-generative-ai-applications-at-the-edge/17:22:18
@matthewcroughan:defenestrate.itmatthewcroughan Saw this, they have a 16G version available too 22:20:04
@hexa:lossy.networkhexamuch more interesting, agreed22:20:13
@matthewcroughan:defenestrate.itmatthewcroughanIs this a "unified memory architecture" too?22:20:28
@hexa:lossy.networkhexastill hinges on the firmware and mainline support22:20:31
@hexa:lossy.networkhexano idea22:20:33
@matthewcroughan:defenestrate.itmatthewcroughan16G for the OS and GPU and CPU22:20:40
@matthewcroughan:defenestrate.itmatthewcroughanWould have to get my hands on it to really know22:20:47
@matthewcroughan:defenestrate.itmatthewcroughanthe ML stuff I run needs at least 16G of memory, and if this is a GPU that only has access to 4G of that memory, then it's kinda useless :P22:21:05
@matthewcroughan:defenestrate.itmatthewcroughanI doubt it!22:21:13
@matthewcroughan:defenestrate.itmatthewcroughanBut that price point makes me wonder 22:21:18
@matthewcroughan:defenestrate.itmatthewcroughanI can't wait to roam around events with a stable diffusion hat running one of these things off battery 22:21:44
@ss:someonex.netSomeoneSerge (back on matrix) I thought they all are 22:57:55
20 Dec 2024
@matthewcroughan:defenestrate.itmatthewcroughan SomeoneSerge (utc+3): perhaps you know exactly what CPU is needed in QEMU to run Pytorch conv2d functions? 11:22:52
@matthewcroughan:defenestrate.itmatthewcroughan 
vm-test-run-comfyui> machine: waiting for file '/var/lib/comfyui/.local/share/output/ComfyUI_00001_.png'
vm-test-run-comfyui> machine # [   27.602723] comfyui[863]: model weight dtype torch.float32, manual cast: None
vm-test-run-comfyui> machine # [   27.609286] comfyui[863]: model_type EPS
vm-test-run-comfyui> machine # [   43.685242] comfyui[863]: Using split attention in VAE
vm-test-run-comfyui> machine # [   43.687474] comfyui[863]: Using split attention in VAE
vm-test-run-comfyui> machine # [   45.600677] comfyui[863]: Requested to load SD1ClipModel
vm-test-run-comfyui> machine # [   45.605643] comfyui[863]: loaded completely 9.5367431640625e+25 235.84423828125 True
vm-test-run-comfyui> machine # [   47.912296] comfyui[863]: Requested to load SD1ClipModel
vm-test-run-comfyui> machine # [   47.917707] comfyui[863]: loaded completely 9.5367431640625e+25 235.84423828125 True
vm-test-run-comfyui> machine # [   48.340050] comfyui[863]: Requested to load BaseModel
vm-test-run-comfyui> machine # [   62.654040] comfyui[863]: loaded completely 9.5367431640625e+25 3278.812271118164 True
vm-test-run-comfyui> machine # [   62.683342] comfyui[863]: ****** User settings have been changed to be stored on the server instead of browser storage. ******
vm-test-run-comfyui> machine # [   62.684273] comfyui[863]: ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
vm-test-run-comfyui> machine # [   62.784671] comfyui[863]:   0%|          | 0/1 [00:00<?, ?it/s]  0%|          | 0/1 [00:00<?, ?it/s]
vm-test-run-comfyui> machine # [   62.819300] comfyui[863]: !!! Exception during processing !!! could not create a primitive
vm-test-run-comfyui> machine # [   62.843048] comfyui[863]: Traceback (most recent call last):
vm-test-run-comfyui> machine # [   62.843458] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/execution.py", line 324, in execute
vm-test-run-comfyui> machine # [   62.844145] comfyui[863]:     output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
vm-test-run-comfyui> machine # [   62.844883] comfyui[863]:                                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.845825] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/execution.py", line 199, in get_output_data
vm-test-run-comfyui> machine # [   62.848276] comfyui[863]:     return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
vm-test-run-comfyui> machine # [   62.849088] comfyui[863]:                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.849899] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/execution.py", line 170, in _map_node_over_list
vm-test-run-comfyui> machine # [   62.850636] comfyui[863]:     process_inputs(input_dict, i)
vm-test-run-comfyui> machine # [   62.850940] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/execution.py", line 159, in process_inputs
vm-test-run-comfyui> machine # [   62.853090] comfyui[863]:     results.append(getattr(obj, func)(**inputs))
vm-test-run-comfyui> machine # [   62.853475] comfyui[863]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.853854] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/nodes.py", line 1467, in sample
vm-test-run-comfyui> machine # [   62.854553] comfyui[863]:     return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
vm-test-run-comfyui> machine # [   62.855238] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.855896] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/nodes.py", line 1434, in common_ksampler
vm-test-run-comfyui> machine # [   62.858089] comfyui[863]:     samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
vm-test-run-comfyui> machine # [   62.858741] comfyui[863]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.859383] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/sample.py", line 43, in sample
vm-test-run-comfyui> machine # [   62.860074] comfyui[863]:     samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)
vm-test-run-comfyui> machine # [   62.861295] comfyui[863]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.862509] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 1020, in sample
vm-test-run-comfyui> machine # [   62.865089] comfyui[863]:     return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)
vm-test-run-comfyui> machine # [   62.866157] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.867180] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 918, in sample
vm-test-run-comfyui> machine # [   62.867864] comfyui[863]:     return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
vm-test-run-comfyui> machine # [   62.868482] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.869097] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 904, in sample
vm-test-run-comfyui> machine # [   62.869788] comfyui[863]:     output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
vm-test-run-comfyui> machine # [   62.870438] comfyui[863]:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.872053] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/patcher_extension.py", line 110, in execute
vm-test-run-comfyui> machine # [   62.872786] comfyui[863]:     return self.original(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.873143] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.873475] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 873, in outer_sample
vm-test-run-comfyui> machine # [   62.874514] comfyui[863]:     output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
vm-test-run-comfyui> machine # [   62.875181] comfyui[863]:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.875816] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 857, in inner_sample
vm-test-run-comfyui> machine # [   62.876546] comfyui[863]:     samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
vm-test-run-comfyui> machine # [   62.877301] comfyui[863]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.879043] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/patcher_extension.py", line 110, in execute
vm-test-run-comfyui> machine # [   62.879777] comfyui[863]:     return self.original(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.882084] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.882435] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 714, in sample
vm-test-run-comfyui> machine # [   62.883144] comfyui[863]:     samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
vm-test-run-comfyui> machine # [   62.883868] comfyui[863]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.884639] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
vm-test-run-comfyui> machine # [   62.885444] comfyui[863]:     return func(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.885760] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.886097] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/k_diffusion/sampling.py", line 155, in sample_euler
vm-test-run-comfyui> machine # [   62.886862] comfyui[863]:     denoised = model(x, sigma_hat * s_in, **extra_args)
vm-test-run-comfyui> machine # [   62.887283] comfyui[863]:                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.887670] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 384, in __call__
vm-test-run-comfyui> machine # [   62.889079] comfyui[863]:     out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
vm-test-run-comfyui> machine # [   62.889563] comfyui[863]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.890045] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 839, in __call__
vm-test-run-comfyui> machine # [   62.890749] comfyui[863]:     return self.predict_noise(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.891359] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.891724] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 842, in predict_noise
vm-test-run-comfyui> machine # [   62.892453] comfyui[863]:     return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
vm-test-run-comfyui> machine # [   62.893452] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.895201] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 364, in sampling_function
vm-test-run-comfyui> machine # [   62.895917] comfyui[863]:     out = calc_cond_batch(model, conds, x, timestep, model_options)
vm-test-run-comfyui> machine # [   62.896610] comfyui[863]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.899035] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 200, in calc_cond_batch
vm-test-run-comfyui> machine # [   62.899769] comfyui[863]:     return executor.execute(model, conds, x_in, timestep, model_options)
vm-test-run-comfyui> machine # [   62.900254] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.900718] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/patcher_extension.py", line 110, in execute
vm-test-run-comfyui> machine # [   62.901463] comfyui[863]:     return self.original(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.901876] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.902246] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/samplers.py", line 313, in _calc_cond_batch
vm-test-run-comfyui> machine # [   62.902951] comfyui[863]:     output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
vm-test-run-comfyui> machine # [   62.904081] comfyui[863]:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.904502] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/model_base.py", line 128, in apply_model
vm-test-run-comfyui> machine # [   62.905247] comfyui[863]:     return comfy.patcher_extension.WrapperExecutor.new_class_executor(
vm-test-run-comfyui> machine # [   62.905703] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.906443] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/patcher_extension.py", line 110, in execute
vm-test-run-comfyui> machine # [   62.908075] comfyui[863]:     return self.original(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.908422] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.908758] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/model_base.py", line 157, in _apply_model
vm-test-run-comfyui> machine # [   62.910094] comfyui[863]:     model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
vm-test-run-comfyui> machine # [   62.910818] comfyui[863]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.912075] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl
vm-test-run-comfyui> machine # [   62.912876] comfyui[863]:     return self._call_impl(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.913252] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.913590] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl
vm-test-run-comfyui> machine # [   62.914387] comfyui[863]:     return forward_call(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.914723] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.915074] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 832, in forward
vm-test-run-comfyui> machine # [   62.915885] comfyui[863]:     return comfy.patcher_extension.WrapperExecutor.new_class_executor(
vm-test-run-comfyui> machine # [   62.917335] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.917788] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/patcher_extension.py", line 110, in execute
vm-test-run-comfyui> machine # [   62.918522] comfyui[863]:     return self.original(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.918858] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.919224] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 874, in _forward
vm-test-run-comfyui> machine # [   62.920038] comfyui[863]:     h = forward_timestep_embed(module, h, emb, context, transformer_options, time_context=time_context, num_video_frames=num_video_frames, image_only_indicator=image_only_indicator)
vm-test-run-comfyui> machine # [   62.920915] comfyui[863]:         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.921802] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 39, in forward_timestep_embed
vm-test-run-comfyui> machine # [   62.922685] comfyui[863]:     x = layer(x, emb)
vm-test-run-comfyui> machine # [   62.922950] comfyui[863]:         ^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.924086] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl
vm-test-run-comfyui> machine # [   62.924887] comfyui[863]:     return self._call_impl(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.925265] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.925616] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl
vm-test-run-comfyui> machine # [   62.926414] comfyui[863]:     return forward_call(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.926747] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.927094] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 240, in forward
vm-test-run-comfyui> machine # [   62.927899] comfyui[863]:     return checkpoint(
vm-test-run-comfyui> machine # [   62.928192] comfyui[863]:            ^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.928465] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ldm/modules/diffusionmodules/util.py", line 191, in checkpoint
vm-test-run-comfyui> machine # [   62.929270] comfyui[863]:     return func(*inputs)
vm-test-run-comfyui> machine # [   62.929541] comfyui[863]:            ^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.929834] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ldm/modules/diffusionmodules/openaimodel.py", line 253, in _forward
vm-test-run-comfyui> machine # [   62.931079] comfyui[863]:     h = self.in_layers(x)
vm-test-run-comfyui> machine # [   62.931382] comfyui[863]:         ^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.931662] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl
vm-test-run-comfyui> machine # [   62.932467] comfyui[863]:     return self._call_impl(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.932815] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.933185] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfh
q9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl
vm-test-run-comfyui> machine # [   62.933934] comfyui[863]:     return forward_call(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.935089] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.935433] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/container.py", line 250, in forward
vm-test-run-comfyui> machine # [   62.936215] comfyui[863]:     input = module(input)
vm-test-run-comfyui> machine # [   62.936490] comfyui[863]:             ^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.936769] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1736, in _wrapped_call_impl
vm-test-run-comfyui> machine # [   62.937574] comfyui[863]:     return self._call_impl(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.937915] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.938300] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1747, in _call_impl
vm-test-run-comfyui> machine # [   62.939066] comfyui[863]:     return forward_call(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.939416] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.939745] comfyui[863]:   File "/nix/store/css11jdci8dblbzwskpxi47ln5m8iw1x-comfyui-0.3.7/lib/python3.12/site-packages/comfy/ops.py", line 98, in forward
vm-test-run-comfyui> machine # [   62.940439] comfyui[863]:     return super().forward(*args, **kwargs)
vm-test-run-comfyui> machine # [   62.940788] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.941192] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/conv.py", line 554, in forward
vm-test-run-comfyui> machine # [   62.941923] comfyui[863]:     return self._conv_forward(input, self.weight, self.bias)
vm-test-run-comfyui> machine # [   62.943083] comfyui[863]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vm-test-run-comfyui> machine # [   62.943525] comfyui[863]:   File "/nix/store/minbaa1r1viqhnfhq9gna38fgmj5psxc-python3.12-torch-2.5.1/lib/python3.12/site-packages/torch/nn/modules/conv.py", line 549, in _conv_forward
vm-test-run-comfyui> machine # [   62.944329] comfyui[863]:     return F.conv2d(
11:23:08
@matthewcroughan:defenestrate.itmatthewcroughan Gets very far, and then fails on the CPU at conv2d(), works fine on the host outside of a VM in the same seutp 11:23:26
@matthewcroughan:defenestrate.itmatthewcroughanlooks like it might be avx stuff13:00:48
@matthewcroughan:defenestrate.itmatthewcroughanah no, I gave it avx and it still complains like this 13:08:35
@matthewcroughan:defenestrate.itmatthewcroughanhow odd13:08:36
@matthewcroughan:defenestrate.itmatthewcroughanDo we have any existing VM Tests that test torch?13:09:05
@matthewcroughan:defenestrate.itmatthewcroughanlooks like we don't actually13:10:16

Show newer messages

Back to Room ListRoom Version: 9