Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError: mat1 and mat2 shapes cannot be multiplied (8192x16 and 64x3072) #1200

Closed
gabrie opened this issue Sep 20, 2024 · 9 comments
Closed

Comments

@gabrie
Copy link

gabrie commented Sep 20, 2024

I was trying to use Scribble ControlNet, and also tried other ControlNet.

Below ones met same errors.
Scribble
LineArt
Soft Edge
Canny Edge

Previously all of them are fine to use.

@syl1130
Copy link

syl1130 commented Sep 20, 2024

@Acly
I have the same error
RuntimeError: mat1 and mat2 shapes cannot be multiplied (6912x16 and 64x3072)

@Acly
Copy link
Owner

Acly commented Sep 20, 2024

Seems to work fine for me. Need more information.

What base model? Which version (plugin/comfy)?

@marcoA152
Copy link

marcoA152 commented Sep 20, 2024

the error message appear with all SDXL models, running 1.24.0 plugin and related automatically installed comfyUI (local managed server) as @gabrie suggesting running ControNets
Scribble
LineArt
Soft Edge <<works ?
Canny Edge

Here a dump of client.log related to the error

2024-09-20 10:52:25,090 WARNING Error processing message, error=argument of type 'NoneType' is not iterable, msg={'type': 'executed', 'data': {'node': '6', 'display_node': '6', 'output': None, 'prompt_id': 'd041e126-29f3-4621-8405-0c7388cf0140'}}
2024-09-20 10:52:25,090 WARNING Error processing message, error=argument of type 'NoneType' is not iterable, msg={'type': 'executed', 'data': {'node': '6', 'display_node': '6', 'output': None, 'prompt_id': 'd041e126-29f3-4621-8405-0c7388cf0140'}}
2024-09-20 10:52:27,165 ERROR Job Job[local=d5d92281-f287-4cb0-9648-1d8564388743, remote=d041e126-29f3-4621-8405-0c7388cf0140] failed: mat1 and mat2 shapes cannot be multiplied (8192x16 and 64x3072)
[' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\execution.py", line 323, in execute\n output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\execution.py", line 198, in get_output_data\n return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\execution.py", line 169, in _map_node_over_list\n process_inputs(input_dict, i)\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\execution.py", line 158, in process_inputs\n results.append(getattr(obj, func)(**inputs))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy_extras\nodes_custom_sampler.py", line 612, in sample\n samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 716, in sample\n output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 695, in inner_sample\n samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 600, in sample\n samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\python\Lib\site-packages\torch\utils\contextlib.py", line 116, in decorate_context\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\k_diffusion\sampling.py", line 653, in sample_dpmpp_2m\n denoised = model(x, sigmas[i] * s_in, **extra_args)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 299, in call\n out = self.inner_model(x, sigma, model_options=model_options, seed=seed)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 682, in call\n return self.predict_noise(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 685, in predict_noise\n return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 279, in sampling_function\n out = calc_cond_batch(model, conds, x, timestep, model_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\samplers.py", line 202, in calc_cond_batch\n c['control'] = control.get_control(input_x, timestep, c, len(cond_or_uncond))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\controlnet.py", line 237, in get_control\n control = self.control_model(x=x_noisy.to(dtype), hint=self.cond_hint, timesteps=timestep.to(dtype), context=context.to(dtype), **extra)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\python\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\python\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\ldm\flux\controlnet.py", line 200, in forward\n return self.forward_orig(img, img_ids, hint, context, txt_ids, timesteps, y, guidance, control_type=kwargs.get("control_type", []))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\ldm\flux\controlnet.py", line 122, in forward_orig\n img = self.img_in(img)\n ^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\python\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl\n return self._call_impl(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\python\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl\n return forward_call(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\ComfyUI\comfy\ops.py", line 78, in forward\n return super().forward(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "C:\ComfyUI_windows_portable\krita2\python\Lib\site-packages\torch\nn\modules\linear.py", line 117, in forward\n return F.linear(input, self.weight, self.bias)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n']

@gabrie
Copy link
Author

gabrie commented Sep 20, 2024

Seems to work fine for me. Need more information.

What base model? Which version (plugin/comfy)?

Krita Ai Diffusion version: 1.24.0
Comfyui as server, updated to latest: ComfyUI v0.2.2 Release

I tried multiple SDXL models, all same issues. Ex: ZavyChromaXL 9.0

Thanks for checking, any further info needed, let me know.

@Acly
Copy link
Owner

Acly commented Sep 20, 2024

Can you check client.log for which models are used for those SDXL CN modes?

should be something like INFO Found ControlNet model scribble for SD XL: ...

If you're using the Flux variant of Mistoline CN, it's possible those are mixed up with the SDXL variant. Removing mistoline_flux.dev_v1.safetensors should work in that case (at least temporarily)

@marcoA152
Copy link

yes, found it:

INFO Found ControlNet model canny_edge for SD XL: mistoline_flux.dev_v1.safetensors

moving that file away and restarting server solves the error for controlnet loading

@Acly
Copy link
Owner

Acly commented Sep 21, 2024

Fixed in v1.25.0

@Acly Acly closed this as completed Sep 21, 2024
@gabrie
Copy link
Author

gabrie commented Sep 22, 2024

Can you check client.log for which models are used for those SDXL CN modes?

should be something like INFO Found ControlNet model scribble for SD XL: ...

If you're using the Flux variant of Mistoline CN, it's possible those are mixed up with the SDXL variant. Removing mistoline_flux.dev_v1.safetensors should work in that case (at least temporarily)

Thanks, I changed the name of flux CN, it's working again in krita now. Thanks a lot!

@KusaPinPon
Copy link

I"m on version 1.25.0 and I have the same issue

Loading 1 new model
Requested to load SDXL
Requested to load ControlNet
Loading 2 new models
  0%|                                                                                           | 0/11 [00:01<?, ?it/s]
!!! Exception during processing!!! mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)
Traceback (most recent call last):
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\execution.py", line 152, in recursive_execute
    output_data, output_ui = get_output_data(obj, input_data_all)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\execution.py", line 82, in get_output_data
    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\execution.py", line 75, in map_node_over_list
    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy_extras\nodes_custom_sampler.py", line 612, in sample
    samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 716, in sample
    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 695, in inner_sample
    samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 600, in sample
    samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\k_diffusion\sampling.py", line 600, in sample_dpmpp_2m
    denoised = model(x, sigmas[i] * s_in, **extra_args)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 299, in __call__
    out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 682, in __call__
    return self.predict_noise(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 685, in predict_noise
    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 279, in sampling_function
    out = calc_cond_batch(model, conds, x, timestep, model_options)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\samplers.py", line 202, in calc_cond_batch
    c['control'] = control.get_control(input_x, timestep_, c, len(cond_or_uncond))
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\controlnet.py", line 203, in get_control
    control = self.control_model(x=x_noisy.to(dtype), hint=self.cond_hint, timesteps=timestep.to(dtype), context=context.to(dtype), **extra)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1532, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1541, in _call_impl
    return forward_call(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\cldm\cldm.py", line 430, in forward
    h = module(h, emb, context)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1532, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1541, in _call_impl
    return forward_call(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\ldm\modules\diffusionmodules\openaimodel.py", line 60, in forward
    return forward_timestep_embed(self, *args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\ldm\modules\diffusionmodules\openaimodel.py", line 44, in forward_timestep_embed
    x = layer(x, context, transformer_options)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1532, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1541, in _call_impl
    return forward_call(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\ldm\modules\attention.py", line 694, in forward
    x = block(x, context=context[i], transformer_options=transformer_options)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1532, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1541, in _call_impl
    return forward_call(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\ldm\modules\attention.py", line 621, in forward
    n = self.attn2(n, context=context_attn2, value=value_attn2)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1532, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1541, in _call_impl
    return forward_call(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\ldm\modules\attention.py", line 467, in forward
    k = self.to_k(context)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1532, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\module.py", line 1541, in _call_impl
    return forward_call(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\ComfyUI\comfy\ops.py", line 65, in forward
    return super().forward(*args, **kwargs)
  File "G:\AI\ComfyUI\ComfyUI\python\lib\site-packages\torch\nn\modules\linear.py", line 116, in forward
    return F.linear(input, self.weight, self.bias)
RuntimeError: mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)

2024-09-29 09:27:05,026 INFO GGUF support: node is not installed.
2024-09-29 09:27:05,026 INFO SD 1.5: supported
2024-09-29 09:27:05,026 INFO SD XL: supported
2024-09-29 09:27:05,026 INFO SD 3: missing 3 models
2024-09-29 09:27:05,026 INFO Flux: missing 1 models
2024-09-29 09:59:15,186 ERROR Job Job[local=7a7b478c-a633-42bf-96fd-e59833baa199, remote=adc6d384-264e-4a8c-8d81-b2f65cc79a28] failed: mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)
['  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 152, in recursive_execute\n    output_data, output_ui = get_output_data(obj, input_data_all)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 82, in get_output_data\n    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 75, in map_node_over_list\n    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy_extras\\nodes_custom_sampler.py", line 612, in sample\n    samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 716, in sample\n    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 695, in inner_sample\n    samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 600, in sample\n    samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\utils\\_contextlib.py", line 115, in decorate_context\n    return func(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\k_diffusion\\sampling.py", line 600, in sample_dpmpp_2m\n    denoised = model(x, sigmas[i] * s_in, **extra_args)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 299, in __call__\n    out = self.inner_model(x, sigma, model_options=model_options, seed=seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 682, in __call__\n    return self.predict_noise(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 685, in predict_noise\n    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 279, in sampling_function\n    out = calc_cond_batch(model, conds, x, timestep, model_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 202, in calc_cond_batch\n    c[\'control\'] = control.get_control(input_x, timestep_, c, len(cond_or_uncond))\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\controlnet.py", line 203, in get_control\n    control = self.control_model(x=x_noisy.to(dtype), hint=self.cond_hint, timesteps=timestep.to(dtype), context=context.to(dtype), **extra)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\cldm\\cldm.py", line 430, in forward\n    h = module(h, emb, context)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\diffusionmodules\\openaimodel.py", line 60, in forward\n    return forward_timestep_embed(self, *args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\diffusionmodules\\openaimodel.py", line 44, in forward_timestep_embed\n    x = layer(x, context, transformer_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 694, in forward\n    x = block(x, context=context[i], transformer_options=transformer_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 621, in forward\n    n = self.attn2(n, context=context_attn2, value=value_attn2)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 467, in forward\n    k = self.to_k(context)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ops.py", line 65, in forward\n    return super().forward(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\linear.py", line 116, in forward\n    return F.linear(input, self.weight, self.bias)\n']
2024-09-29 09:59:50,562 ERROR Job Job[local=62f1e81b-8beb-41a2-94c0-cbd71f8596ee, remote=26fa76a0-2a01-4eb1-9f13-805c5dfd7f74] failed: mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)
['  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 152, in recursive_execute\n    output_data, output_ui = get_output_data(obj, input_data_all)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 82, in get_output_data\n    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 75, in map_node_over_list\n    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy_extras\\nodes_custom_sampler.py", line 612, in sample\n    samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 716, in sample\n    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 695, in inner_sample\n    samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 600, in sample\n    samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\utils\\_contextlib.py", line 115, in decorate_context\n    return func(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\k_diffusion\\sampling.py", line 600, in sample_dpmpp_2m\n    denoised = model(x, sigmas[i] * s_in, **extra_args)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 299, in __call__\n    out = self.inner_model(x, sigma, model_options=model_options, seed=seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 682, in __call__\n    return self.predict_noise(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 685, in predict_noise\n    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 279, in sampling_function\n    out = calc_cond_batch(model, conds, x, timestep, model_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 202, in calc_cond_batch\n    c[\'control\'] = control.get_control(input_x, timestep_, c, len(cond_or_uncond))\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\controlnet.py", line 203, in get_control\n    control = self.control_model(x=x_noisy.to(dtype), hint=self.cond_hint, timesteps=timestep.to(dtype), context=context.to(dtype), **extra)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\cldm\\cldm.py", line 430, in forward\n    h = module(h, emb, context)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\diffusionmodules\\openaimodel.py", line 60, in forward\n    return forward_timestep_embed(self, *args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\diffusionmodules\\openaimodel.py", line 44, in forward_timestep_embed\n    x = layer(x, context, transformer_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 694, in forward\n    x = block(x, context=context[i], transformer_options=transformer_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 621, in forward\n    n = self.attn2(n, context=context_attn2, value=value_attn2)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 467, in forward\n    k = self.to_k(context)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ops.py", line 65, in forward\n    return super().forward(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\linear.py", line 116, in forward\n    return F.linear(input, self.weight, self.bias)\n']
2024-09-29 10:00:20,622 WARNING Websocket connection closed: no close frame received or sent
2024-09-29 10:02:06,154 INFO GGUF support: node is not installed.
2024-09-29 10:02:07,025 INFO GGUF support: node is not installed.
2024-09-29 10:02:47,497 INFO Checking for latest plugin version at https://api.interstice.cloud
2024-09-29 10:02:48,308 INFO Plugin is up to date!
2024-09-29 10:06:10,248 INFO GGUF support: node is not installed.
2024-09-29 10:08:09,370 INFO GGUF support: node is not installed.
2024-09-29 10:08:10,777 INFO GGUF support: node is not installed.
2024-09-29 10:12:52,995 ERROR Job Job[local=bb599458-d05e-4a3a-bb9a-00760cb99818, remote=e3bd7176-3388-41c9-8b28-816d15f5619a] failed: mat1 and mat2 shapes cannot be multiplied (308x2048 and 768x320)
['  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 152, in recursive_execute\n    output_data, output_ui = get_output_data(obj, input_data_all)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 82, in get_output_data\n    return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\execution.py", line 75, in map_node_over_list\n    results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy_extras\\nodes_custom_sampler.py", line 612, in sample\n    samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 716, in sample\n    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 695, in inner_sample\n    samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 600, in sample\n    samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\utils\\_contextlib.py", line 115, in decorate_context\n    return func(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\k_diffusion\\sampling.py", line 600, in sample_dpmpp_2m\n    denoised = model(x, sigmas[i] * s_in, **extra_args)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 299, in __call__\n    out = self.inner_model(x, sigma, model_options=model_options, seed=seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 682, in __call__\n    return self.predict_noise(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 685, in predict_noise\n    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 279, in sampling_function\n    out = calc_cond_batch(model, conds, x, timestep, model_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\samplers.py", line 202, in calc_cond_batch\n    c[\'control\'] = control.get_control(input_x, timestep_, c, len(cond_or_uncond))\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\controlnet.py", line 203, in get_control\n    control = self.control_model(x=x_noisy.to(dtype), hint=self.cond_hint, timesteps=timestep.to(dtype), context=context.to(dtype), **extra)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\cldm\\cldm.py", line 430, in forward\n    h = module(h, emb, context)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\diffusionmodules\\openaimodel.py", line 60, in forward\n    return forward_timestep_embed(self, *args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\diffusionmodules\\openaimodel.py", line 44, in forward_timestep_embed\n    x = layer(x, context, transformer_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 694, in forward\n    x = block(x, context=context[i], transformer_options=transformer_options)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 621, in forward\n    n = self.attn2(n, context=context_attn2, value=value_attn2)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ldm\\modules\\attention.py", line 467, in forward\n    k = self.to_k(context)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1532, in _wrapped_call_impl\n    return self._call_impl(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\module.py", line 1541, in _call_impl\n    return forward_call(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\ComfyUI\\comfy\\ops.py", line 65, in forward\n    return super().forward(*args, **kwargs)\n', '  File "G:\\AI\\ComfyUI\\ComfyUI\\python\\lib\\site-packages\\torch\\nn\\modules\\linear.py", line 116, in forward\n    return F.linear(input, self.weight, self.bias)\n']
2024-09-29 10:22:58,851 INFO Loaded 11 sampler presets from C:\Users\aaaa\AppData\Roaming\krita\pykrita\ai_diffusion\presets\samplers.json
2024-09-29 10:22:58,956 INFO Extension initialized, Version: 1.22.0, Python: 3.10.7 (tags/v3.10.7:6cc6b13, Sep  5 2022, 14:08:36) [MSC v.1933 64 bit (AMD64)]
2024-09-29 10:22:58,956 INFO Loading settings from C:\Users\aaaa\AppData\Roaming\krita\ai_diffusion\settings.json
2024-09-29 10:22:58,957 INFO Found server installation v1.22.0 at G:\AI\ComfyUI\ComfyUI
2024-09-29 10:22:58,959 WARNING Failed to load default document settings: <class 'TypeError'> RecentlyUsedSync.__init__() got an unexpected keyword argument 'translation_enabled'
2024-09-29 10:23:00,738 INFO Connecting to http://127.0.0.1:8188
2024-09-29 10:23:01,417 WARNING Missing CLIP model clip_g for SD 3
2024-09-29 10:23:01,418 INFO -> No model matches search paths: clip_g
2024-09-29 10:23:01,418 INFO -> Available models: 
2024-09-29 10:23:01,418 WARNING Missing CLIP model clip_l for SD 3
2024-09-29 10:23:01,418 INFO -> No model matches search paths: clip_l
2024-09-29 10:23:01,418 INFO -> Available models: 
2024-09-29 10:23:01,418 INFO Found ControlNet model inpaint for SD 1.5: contr

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants