Description
Is there an existing issue for this problem?
- I have searched the existing issues
Operating system
Linux
GPU vendor
Nvidia (CUDA)
GPU model
GTX 1660
GPU VRAM
6GB
Version number
5.9.0rc2-cuda
Browser
Firefox 136.0.2
Python dependencies
{
"accelerate": "1.0.1",
"compel": "2.0.2",
"cuda": "12.4",
"diffusers": "0.31.0",
"numpy": "1.26.3",
"opencv": "4.9.0.80",
"onnx": "1.16.1",
"pillow": "11.0.0",
"python": "3.11.11",
"torch": "2.4.1+cu124",
"torchvision": "0.19.1+cu124",
"transformers": "4.46.3",
"xformers": null
}
What happened
I wanted to test the new pre-release with FLUX Fill support. I have downloaded the model from starter models. I cannot get it to work for inpainting.
When I create a raster layer and an inpainting mask layer, select the new FLUX Fill main model, draw an area for inpainting, press Invoke, the following error is presented:
Server Error
RuntimeError: mat1 and mat2 must have the same dtype, but got Float and BFloat16
I did not use any other layers, controls, IP adapter, Lora, nothing else.
The console log:
[2025-03-25 08:46:42,143]::[InvokeAI]::ERROR --> Error while invoking session a51cf2cc-e97c-4880-9d36-8776aa61815f, invocation b8b4c3dc-47d6-4513-bf2d-6e3c50524965 (flux_denoise): mat1 and mat2 must have the same dtype, but got Float and BFloat16
[2025-03-25 08:46:42,143]::[InvokeAI]::ERROR --> Traceback (most recent call last):
File "/opt/invokeai/invokeai/app/services/session_processor/session_processor_default.py", line 129, in run_node
output = invocation.invoke_internal(context=context, services=self._services)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/invokeai/invokeai/app/invocations/baseinvocation.py", line 303, in invoke_internal
output = self.invoke(context)
^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/opt/invokeai/invokeai/app/invocations/flux_denoise.py", line 156, in invoke
latents = self._run_diffusion(context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/invokeai/invokeai/app/invocations/flux_denoise.py", line 380, in _run_diffusion
x = denoise(
^^^^^^^^
File "/opt/invokeai/invokeai/backend/flux/denoise.py", line 75, in denoise
pred = model(
^^^^^^
File "/opt/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/invokeai/invokeai/backend/flux/model.py", line 110, in forward
img = self.img_in(img)
^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/invokeai/invokeai/backend/model_manager/load/model_cache/torch_module_autocast/custom_modules/custom_linear.py", line 82, in forward
return self._autocast_forward(input)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/invokeai/invokeai/backend/model_manager/load/model_cache/torch_module_autocast/custom_modules/custom_linear.py", line 76, in _autocast_forward
return torch.nn.functional.linear(input, weight, bias)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: mat1 and mat2 must have the same dtype, but got Float and BFloat16
What you expected to happen
FLUX Fill model can be used for inpainting.
How to reproduce the problem
I always have this issue, if FLUX Fill main model is selected. Both on canvas and on workflow.
Additional context
No response
Discord username
No response