lllyasviel

/

flux1-dev-bnb-nf4

like 593

Using online LoRAs in FP16: True
Loading Model: {'checkpoint_info': {'filename': 'E:\stable-diffusion-webui-forge\models\Stable-diffusion\flux_and_unet\flux1-dev-bnb-nf4-v2.safetensors', 'hash': 'f0770152'}, 'additional_modules': ['E:\stable-diffusion-webui-forge\models\VAE\ae.safetensors', 'E:\stable-diffusion-webui-forge\models\text_encoder\ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors', 'E:\stable-diffusion-webui-forge\models\text_encoder\t5xxl_fp16.safetensors'], 'unet_storage_dtype': None}
[Unload] Trying to free all memory for cuda:0 with 0 models keep loaded ... Current free memory is 9766.16 MB ... Current free memory is 9766.16 MB ... Current free memory is 9766.16 MB ... Unload model IntegratedAutoencoderKL Done.
StateDict Keys: {'transformer': 1722, 'vae': 244, 'text_encoder': 198, 'text_encoder_2': 220, 'ignore': 0}
CLIPTextModel Unexpected: ['transformer.logit_scale', 'transformer.text_projection']
Using Default T5 Data Type: torch.float16
Using Detected UNet Type: nf4
Using pre-quant state dict!
Traceback (most recent call last):
File "E:\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 30, in work
self.result = self.func(*self.args, **self.kwargs)
File "E:\stable-diffusion-webui-forge\modules\txt2img.py", line 123, in txt2img_function
processed = processing.process_images(p)
File "E:\stable-diffusion-webui-forge\modules\processing.py", line 800, in process_images
p.sd_model, just_reloaded = forge_model_reload()
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "E:\stable-diffusion-webui-forge\modules\sd_models.py", line 494, in forge_model_reload
sd_model = forge_loader(state_dict, additional_state_dicts=additional_state_dicts)
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "E:\stable-diffusion-webui-forge\backend\loader.py", line 283, in forge_loader
component = load_huggingface_component(estimated_config, component_name, lib_name, cls_name, local_path, component_sd)
File "E:\stable-diffusion-webui-forge\backend\loader.py", line 152, in load_huggingface_component
load_state_dict(model, state_dict)
File "E:\stable-diffusion-webui-forge\backend\state_dict.py", line 5, in load_state_dict
missing, unexpected = model.load_state_dict(sd, strict=False)
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 2201, in load_state_dict
load(self, state_dict)
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 2189, in load
load(child, child_state_dict, child_prefix) # noqa: F821
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 2189, in load
load(child, child_state_dict, child_prefix) # noqa: F821
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 2189, in load
load(child, child_state_dict, child_prefix) # noqa: F821
[Previous line repeated 1 more time]
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 2183, in load
module._load_from_state_dict(
File "E:\stable-diffusion-webui-forge\backend\operations_bnb.py", line 126, in load_from_state_dict
self.weight = ForgeParams4bit.from_prequantized(
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\bitsandbytes\nn\modules.py", line 281, in from_prequantized
self.quant_state = QuantState.from_dict(qs_dict=quantized_stats, device=device)
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\bitsandbytes\functional.py", line 709, in from_dict
qs_dict.update(unpack_tensor_to_dict(qs_dict.pop(first_qs_key)))
File "E:\stable-diffusion-webui-forge\venv\lib\site-packages\bitsandbytes\utils.py", line 198, in unpack_tensor_to_dict
unpacked_dict = json.loads(json_str)
File "C:\Python310\lib\json_init.py", line 346, in loads
return _default_decoder.decode(s)
File "C:\Python310\lib\json\decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "C:\Python310\lib\json\decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Expecting value: line 1 column 1 (char 0)