so i load gguf model where do i plug it ?

#2
by jonnytracker - opened

the sampler does not take the gguf socket output

Hi, i also had this question: Take the official workflow from here: https://comfyanonymous.github.io/ComfyUI_examples/hunyuan_video/ and replace the model loader with the unet loader (gguf) node and connect the model. that should work. (also don't forget to download the safetensors version of the llava-llama-3-8b text encoder). I did not try it yet, but according to City96's comments in this modelcard, this should be the way. :)

how much Vram for this? and how many time I can expect to generate?

Manager

Show Image Feed 🐍
1

sumurai fending off k-pop zombies
Select a fp8 weight_dtype if you are running out of memory.
UnetLoaderGGUF
Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got 'hyvid'

ComfyUI Error Report

Error Details

  • Node ID: 78
  • Node Type: UnetLoaderGGUF
  • Exception Type: ValueError
  • Exception Message: Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got 'hyvid'

Stack Trace

  File "/home/user/ComfyUI/execution.py", line 328, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "/home/user/ComfyUI/execution.py", line 203, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "/home/user/ComfyUI/execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)

  File "/home/user/ComfyUI/execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))

  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 254, in load_unet
    sd = gguf_sd_loader(unet_path)

  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 66, in gguf_sd_loader
    raise ValueError(f"Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got {arch_str!r}")

System Information

  • ComfyUI Version: v0.3.8
  • Arguments: main.py --listen 0.0.0.0 --port 8188 --fast
  • OS: posix
  • Python Version: 3.10.9 (main, Mar 8 2023, 10:47:38) [GCC 11.2.0]
  • Embedded Python: false
  • PyTorch Version: 2.5.1+cu124

Devices

  • Name: cuda:0 Quadro P5200 : cudaMallocAsync
    • Type: cuda
    • VRAM Total: 17055940608
    • VRAM Free: 16804151296
    • Torch VRAM Total: 0
    • Torch VRAM Free: 0

Logs

2024-12-18T18:03:51.541863 - [START] Security scan2024-12-18T18:03:51.541873 - 
2024-12-18T18:03:52.045627 - [DONE] Security scan2024-12-18T18:03:52.045640 - 
2024-12-18T18:03:52.082926 - ## ComfyUI-Manager: installing dependencies done.2024-12-18T18:03:52.082960 - 
2024-12-18T18:03:52.082979 - ** ComfyUI startup time:2024-12-18T18:03:52.082995 -  2024-12-18T18:03:52.083011 - 2024-12-18 18:03:52.0829672024-12-18T18:03:52.083025 - 
2024-12-18T18:03:52.083042 - ** Platform:2024-12-18T18:03:52.083055 -  2024-12-18T18:03:52.083068 - Linux2024-12-18T18:03:52.083082 - 
2024-12-18T18:03:52.083096 - ** Python version:2024-12-18T18:03:52.083108 -  2024-12-18T18:03:52.083120 - 3.10.9 (main, Mar  8 2023, 10:47:38) [GCC 11.2.0]2024-12-18T18:03:52.083134 - 
2024-12-18T18:03:52.083148 - ** Python executable:2024-12-18T18:03:52.083162 -  2024-12-18T18:03:52.083175 - /home/user/comfy/bin/python2024-12-18T18:03:52.083188 - 
2024-12-18T18:03:52.083202 - ** ComfyUI Path:2024-12-18T18:03:52.083215 -  2024-12-18T18:03:52.083228 - /home/user/ComfyUI2024-12-18T18:03:52.083241 - 
2024-12-18T18:03:52.083267 - ** Log path:2024-12-18T18:03:52.083328 -  2024-12-18T18:03:52.083342 - /home/user/ComfyUI/comfyui.log2024-12-18T18:03:52.083355 - 
2024-12-18T18:03:52.680309 - 
Prestartup times for custom nodes:2024-12-18T18:03:52.680341 - 
2024-12-18T18:03:52.680365 -    0.0 seconds:2024-12-18T18:03:52.680382 -  2024-12-18T18:03:52.680396 - /home/user/ComfyUI/custom_nodes/ComfyUI-Easy-Use2024-12-18T18:03:52.680409 - 
2024-12-18T18:03:52.680424 -    1.1 seconds:2024-12-18T18:03:52.680436 -  2024-12-18T18:03:52.680449 - /home/user/ComfyUI/custom_nodes/ComfyUI-Manager2024-12-18T18:03:52.680461 - 
2024-12-18T18:03:52.680474 - 
2024-12-18T18:03:53.867612 - Total VRAM 16266 MB, total RAM 63823 MB
2024-12-18T18:03:53.867710 - pytorch version: 2.5.1+cu124
2024-12-18T18:03:54.778034 - xformers version: 0.0.28.post3
2024-12-18T18:03:54.785525 - Set vram state to: NORMAL_VRAM
2024-12-18T18:03:54.785681 - Device: cuda:0 Quadro P5200 : cudaMallocAsync
2024-12-18T18:03:54.872411 - Using xformers attention
2024-12-18T18:03:55.617474 - [Prompt Server] web root: /home/user/ComfyUI/web
2024-12-18T18:03:55.853720 - ### Loading: ComfyUI-Manager (V2.55.4)2024-12-18T18:03:55.853756 - 
2024-12-18T18:03:55.883777 - ### ComfyUI Version: v0.3.8 | Released on '2024-12-18'2024-12-18T18:03:55.883809 - 
2024-12-18T18:03:56.256326 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json2024-12-18T18:03:56.256374 - 
2024-12-18T18:03:56.352414 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json2024-12-18T18:03:56.352455 - 
2024-12-18T18:03:56.499925 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json2024-12-18T18:03:56.500007 - 
2024-12-18T18:03:56.783747 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2024-12-18T18:03:56.783788 - 
2024-12-18T18:03:56.839245 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json2024-12-18T18:03:56.839287 - 
2024-12-18T18:03:56.871800 - /home/user/comfy/lib/python3.10/site-packages/albumentations/__init__.py:13: UserWarning: A new version of Albumentations is available: 1.4.23 (you have 1.4.15). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
  check_for_updates()
2024-12-18T18:03:57.113939 - [ReActor] - STATUS - Running v0.5.2-a1 in ComfyUI2024-12-18T18:03:57.113975 - 
2024-12-18T18:03:57.134866 - Torch version: 2.5.1+cu1242024-12-18T18:03:57.134897 - 
2024-12-18T18:03:57.247748 - ### Loading: ComfyUI-Impact-Pack (V7.14)2024-12-18T18:03:57.247791 - 
2024-12-18T18:03:57.834750 - ### Loading: ComfyUI-Impact-Pack (Subpack: V0.8)2024-12-18T18:03:57.834793 - 
2024-12-18T18:03:57.850040 - [Impact Pack] Wildcards loading done.2024-12-18T18:03:57.850082 - 
2024-12-18T18:03:57.852683 - Total VRAM 16266 MB, total RAM 63823 MB
2024-12-18T18:03:57.852749 - pytorch version: 2.5.1+cu124
2024-12-18T18:03:57.852798 - xformers version: 0.0.28.post3
2024-12-18T18:03:57.852882 - Set vram state to: NORMAL_VRAM
2024-12-18T18:03:57.852967 - Device: cuda:0 Quadro P5200 : cudaMallocAsync
2024-12-18T18:03:58.701935 - [comfy_mtb] | INFO -> loaded 91 nodes successfuly
2024-12-18T18:03:58.706378 - [comfy_mtb] | INFO -> Some nodes (2) could not be loaded. This can be ignored, but go to http://None:8188/mtb if you want more information.
2024-12-18T18:03:58.774627 - ------------------------------------------2024-12-18T18:03:58.774663 - 
2024-12-18T18:03:58.774682 - Comfyroll Studio v1.76 :  175 Nodes Loaded2024-12-18T18:03:58.774699 - 
2024-12-18T18:03:58.774714 - ------------------------------------------2024-12-18T18:03:58.774727 - 
2024-12-18T18:03:58.774742 - ** For changes, please see patch notes at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/blob/main/Patch_Notes.md2024-12-18T18:03:58.774756 - 
2024-12-18T18:03:58.774771 - ** For help, please see the wiki at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/wiki2024-12-18T18:03:58.774785 - 
2024-12-18T18:03:58.774799 - ------------------------------------------2024-12-18T18:03:58.774813 - 
2024-12-18T18:03:58.791696 - tqdm is already installed.2024-12-18T18:03:58.791730 - 
2024-12-18T18:03:58.792646 - Installing ImageReward...2024-12-18T18:03:58.792671 - 
2024-12-18T18:04:03.215464 - Pillow的当前版本11.0.0满足要求,无需安装10.1.0版本。2024-12-18T18:04:03.215507 - 
2024-12-18T18:04:03.215571 - huggingface_hub的当前版本0.26.3满足要求,无需安装0.20.1版本。2024-12-18T18:04:03.215595 - 
2024-12-18T18:04:03.416703 - PyTorch version 2.5.1 available.
2024-12-18T18:04:03.418219 - JAX version 0.4.36 available.
2024-12-18T18:04:03.695667 - CUDA extension not installed.
2024-12-18T18:04:03.696366 - CUDA extension not installed.
2024-12-18T18:04:03.699485 - auto-gptq的当前版本0.7.1满足要求,无需安装0.7.1版本。2024-12-18T18:04:03.699516 - 
2024-12-18T18:04:03.699579 - einops的当前版本0.8.0满足要求,无需安装0.7.0版本。2024-12-18T18:04:03.699603 - 
2024-12-18T18:04:03.699639 - torchvision is already installed.2024-12-18T18:04:03.699659 - 
2024-12-18T18:04:03.699712 - accelerate的当前版本1.1.1满足要求,无需安装0.25.0版本。2024-12-18T18:04:03.699738 - 
2024-12-18T18:04:03.760771 - timm的当前版本0.6.13低于要求的0.9.16,将尝试安装。2024-12-18T18:04:03.760806 - 
2024-12-18T18:04:06.017356 - timm已安装/更新至版本0.9.16。2024-12-18T18:04:06.017396 - 
2024-12-18T18:04:06.017490 - autoawq的当前版本0.2.3满足要求,无需安装0.2.3版本。2024-12-18T18:04:06.017510 - 
2024-12-18T18:04:06.019146 - tiktoken is already installed.2024-12-18T18:04:06.019174 - 
2024-12-18T18:04:06.025621 - attrdict is already installed.2024-12-18T18:04:06.025656 - 
2024-12-18T18:04:06.025741 - einops的当前版本0.8.0满足要求,无需安装0.7.0版本。2024-12-18T18:04:06.025763 - 
2024-12-18T18:04:06.025821 - sentencepiece的当前版本0.2.0满足要求,无需安装0.2.0版本。2024-12-18T18:04:06.025840 - 
2024-12-18T18:04:06.026056 - deepseek_vl is already installed.2024-12-18T18:04:06.026076 - 
2024-12-18T18:04:06.026116 - transformers的当前版本4.38.2满足要求,无需安装4.38.2版本。2024-12-18T18:04:06.026134 - 
2024-12-18T18:04:06.026187 - accelerate的当前版本1.1.1满足要求,无需安装0.29.3版本。2024-12-18T18:04:06.026205 - 
2024-12-18T18:04:06.091172 - bitsandbytes的当前版本0.45.0满足要求,无需安装0.43.1版本。2024-12-18T18:04:06.091208 - 
2024-12-18T18:04:06.091467 - Crypto is already installed.2024-12-18T18:04:06.091490 - 
2024-12-18T18:04:06.096097 - /home/user/ComfyUI/custom_nodes/Comfyui_image2prompt/js2024-12-18T18:04:06.096133 - 
2024-12-18T18:04:06.096152 - /home/user/ComfyUI/web/extensions/fofo2024-12-18T18:04:06.096168 - 
2024-12-18T18:04:06.273124 - [ComfyUI-Easy-Use] server: v1.2.5 Loaded2024-12-18T18:04:06.273186 - 
2024-12-18T18:04:06.273236 - [ComfyUI-Easy-Use] web root: /home/user/ComfyUI/custom_nodes/ComfyUI-Easy-Use/web_version/v2 Loaded2024-12-18T18:04:06.273286 - 
2024-12-18T18:04:06.295053 - [Crystools INFO] Crystools version: 1.21.0
2024-12-18T18:04:06.328830 - [Crystools INFO] CPU: Intel(R) Core(TM) i7-8850H CPU @ 2.60GHz - Arch: x86_64 - OS: Linux 5.14.0-284.30.1.el9_2.x86_64
2024-12-18T18:04:06.329116 - [Crystools INFO] Pynvml (Nvidia) initialized.
2024-12-18T18:04:06.329414 - [Crystools INFO] GPU/s:
2024-12-18T18:04:06.329637 - [Crystools INFO] 0) Quadro P5200
2024-12-18T18:04:06.329806 - [Crystools INFO] NVIDIA Driver: 550.54.14
2024-12-18T18:04:06.402090 - [Allor]: 0 nodes were overridden.2024-12-18T18:04:06.402144 - 
2024-12-18T18:04:06.772612 - [Allor]: 12 modules were enabled.2024-12-18T18:04:06.772646 - 
2024-12-18T18:04:06.772666 - [Allor]: 98 nodes were loaded.2024-12-18T18:04:06.772682 - 
2024-12-18T18:04:06.773522 - 
Import times for custom nodes:
2024-12-18T18:04:06.773592 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI_ImageToText
2024-12-18T18:04:06.773638 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/cg-use-everywhere
2024-12-18T18:04:06.773677 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/websocket_image_save.py
2024-12-18T18:04:06.773716 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/comfyui-inpaint-nodes
2024-12-18T18:04:06.773752 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Text_Image-Composite
2024-12-18T18:04:06.773823 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Custom-Scripts
2024-12-18T18:04:06.773879 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Florence2
2024-12-18T18:04:06.773931 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-OmniGen
2024-12-18T18:04:06.774021 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI_essentials
2024-12-18T18:04:06.774092 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI_UltimateSDUpscale
2024-12-18T18:04:06.774143 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Frame-Interpolation
2024-12-18T18:04:06.774198 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-KJNodes
2024-12-18T18:04:06.774249 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
2024-12-18T18:04:06.774331 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-GGUF
2024-12-18T18:04:06.774367 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI_Comfyroll_CustomNodes
2024-12-18T18:04:06.774444 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/x-flux-comfyui
2024-12-18T18:04:06.774498 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI_MiniCPM-V
2024-12-18T18:04:06.774549 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Manager
2024-12-18T18:04:06.774604 -    0.0 seconds: /home/user/ComfyUI/custom_nodes/img2txt-comfyui-nodes
2024-12-18T18:04:06.774640 -    0.1 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Crystools
2024-12-18T18:04:06.774676 -    0.1 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-HunyuanVideoWrapper
2024-12-18T18:04:06.774712 -    0.2 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Easy-Use
2024-12-18T18:04:06.774748 -    0.4 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Allor
2024-12-18T18:04:06.774788 -    0.6 seconds: /home/user/ComfyUI/custom_nodes/ComfyUI-Impact-Pack
2024-12-18T18:04:06.774825 -    0.8 seconds: /home/user/ComfyUI/custom_nodes/comfy_mtb
2024-12-18T18:04:06.774861 -    1.3 seconds: /home/user/ComfyUI/custom_nodes/comfyui-reactor-node
2024-12-18T18:04:06.774897 -    7.3 seconds: /home/user/ComfyUI/custom_nodes/Comfyui_image2prompt
2024-12-18T18:04:06.774935 - 
2024-12-18T18:04:06.784085 - Starting server

2024-12-18T18:04:06.784343 - To see the GUI go to: http://0.0.0.0:8188
2024-12-18T18:04:29.056951 - FETCH DATA from: /home/user/ComfyUI/custom_nodes/ComfyUI-Manager/extension-node-map.json2024-12-18T18:04:29.057043 - 2024-12-18T18:04:29.071999 -  [DONE]2024-12-18T18:04:29.072140 - 
2024-12-18T18:04:29.530488 - []2024-12-18T18:04:29.530522 - 
2024-12-18T18:04:29.530542 - []2024-12-18T18:04:29.530578 - 
2024-12-18T18:04:29.537670 - [ERROR] An error occurred while retrieving information for the 'CR Select Font' node.
2024-12-18T18:04:29.538235 - Traceback (most recent call last):
  File "/home/user/ComfyUI/server.py", line 579, in get_object_info
    out[x] = node_info(x)
  File "/home/user/ComfyUI/server.py", line 546, in node_info
    info['input'] = obj_class.INPUT_TYPES()
  File "/home/user/ComfyUI/custom_nodes/ComfyUI_Comfyroll_CustomNodes/nodes/nodes_graphics_text.py", line 467, in INPUT_TYPES
    file_list = [f for f in os.listdir(font_dir) if os.path.isfile(os.path.join(font_dir, f)) and f.lower().endswith(".ttf")]
FileNotFoundError: [Errno 2] No such file or directory: '/usr/share/fonts/truetype'

2024-12-18T18:24:09.133535 - got prompt
2024-12-18T18:24:09.137617 - Failed to validate prompt for output 75:
2024-12-18T18:24:09.137881 - * UNETLoader 12:
2024-12-18T18:24:09.137975 -   - Value not in list: unet_name: 'hunyuan_video_t2v_720p_bf16.safetensors' not in ['FLUX.1-schnell-dev-merged-fp8.safetensors', 'Shakker-Labs_FLUX.1-dev-ControlNet-Union-Pro-fp8.safetensors', 'flux1-dev-fp8-e5m2.safetensors', 'hunyuan_video_720_cfgdistill_fp8_e4m3fn.safetensors']
2024-12-18T18:24:09.138016 - * DualCLIPLoader 11:
2024-12-18T18:24:09.138052 -   - Value not in list: clip_name2: 'llava_llama3_fp8_scaled.safetensors' not in ['clip-vit-large-patch14/model.safetensors', 'clip_l.safetensors']
2024-12-18T18:24:09.138088 - Output will be ignored
2024-12-18T18:24:09.138143 - invalid prompt: {'type': 'prompt_outputs_failed_validation', 'message': 'Prompt outputs failed validation', 'details': '', 'extra_info': {}}
2024-12-18T18:24:21.431602 - got prompt
2024-12-18T18:24:21.432462 - Failed to validate prompt for output 75:
2024-12-18T18:24:21.432522 - * UNETLoader 12:
2024-12-18T18:24:21.432564 -   - Value not in list: unet_name: 'hunyuan_video_t2v_720p_bf16.safetensors' not in ['FLUX.1-schnell-dev-merged-fp8.safetensors', 'Shakker-Labs_FLUX.1-dev-ControlNet-Union-Pro-fp8.safetensors', 'flux1-dev-fp8-e5m2.safetensors', 'hunyuan_video_720_cfgdistill_fp8_e4m3fn.safetensors']
2024-12-18T18:24:21.432603 - * DualCLIPLoader 11:
2024-12-18T18:24:21.432638 -   - Value not in list: clip_name2: 'llava_llama3_fp8_scaled.safetensors' not in ['clip-vit-large-patch14/model.safetensors', 'clip_l.safetensors']
2024-12-18T18:24:21.432680 - Output will be ignored
2024-12-18T18:24:21.432723 - invalid prompt: {'type': 'prompt_outputs_failed_validation', 'message': 'Prompt outputs failed validation', 'details': '', 'extra_info': {}}
2024-12-18T18:25:10.907013 - got prompt
2024-12-18T18:25:10.909949 - Failed to validate prompt for output 75:
2024-12-18T18:25:10.910208 - * DualCLIPLoader 11:
2024-12-18T18:25:10.910458 -   - Value not in list: clip_name2: 'llava_llama3_fp8_scaled.safetensors' not in ['clip-vit-large-patch14/model.safetensors', 'clip_l.safetensors']
2024-12-18T18:25:10.910740 - Output will be ignored
2024-12-18T18:25:10.911025 - invalid prompt: {'type': 'prompt_outputs_failed_validation', 'message': 'Prompt outputs failed validation', 'details': '', 'extra_info': {}}
2024-12-18T18:25:30.290124 - got prompt
2024-12-18T18:25:30.293128 - Failed to validate prompt for output 75:
2024-12-18T18:25:30.293412 - * DualCLIPLoader 11:
2024-12-18T18:25:30.293650 -   - Value not in list: clip_name2: 'llava_llama3_fp8_scaled.safetensors' not in ['clip-vit-large-patch14/model.safetensors', 'clip_l.safetensors']
2024-12-18T18:25:30.293919 - Output will be ignored
2024-12-18T18:25:30.294144 - invalid prompt: {'type': 'prompt_outputs_failed_validation', 'message': 'Prompt outputs failed validation', 'details': '', 'extra_info': {}}
2024-12-18T18:25:52.165347 - got prompt
2024-12-18T18:25:52.168303 - Failed to validate prompt for output 75:
2024-12-18T18:25:52.168624 - * DualCLIPLoader 11:
2024-12-18T18:25:52.168671 -   - Value not in list: clip_name2: 'llava_llama3_fp8_scaled.safetensors' not in ['clip-vit-large-patch14/model.safetensors', 'clip_l.safetensors']
2024-12-18T18:25:52.168714 - Output will be ignored
2024-12-18T18:25:52.168776 - invalid prompt: {'type': 'prompt_outputs_failed_validation', 'message': 'Prompt outputs failed validation', 'details': '', 'extra_info': {}}
2024-12-18T18:54:52.476368 - got prompt
2024-12-18T18:54:52.572149 - Using xformers attention in VAE
2024-12-18T18:54:52.575084 - Using xformers attention in VAE
2024-12-18T18:54:53.141342 - WARNING path /home/user/ComfyUI/models/unet/hunyuan-video-t2v-720p-Q6_K.gguf exists but doesn't link anywhere, skipping.
2024-12-18T18:54:53.141612 - !!! Exception during processing !!! expected str, bytes or os.PathLike object, not NoneType
2024-12-18T18:54:53.142226 - Traceback (most recent call last):
  File "/home/user/ComfyUI/execution.py", line 328, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 203, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/home/user/ComfyUI/execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 254, in load_unet
    sd = gguf_sd_loader(unet_path)
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 39, in gguf_sd_loader
    reader = gguf.GGUFReader(path)
  File "/home/user/comfy/lib/python3.10/site-packages/gguf/gguf_reader.py", line 90, in __init__
    self.data = np.memmap(path, mode = mode)
  File "/home/user/comfy/lib/python3.10/site-packages/numpy/core/memmap.py", line 229, in __new__
    f_ctx = open(os_fspath(filename), ('r' if mode == 'c' else mode)+'b')
TypeError: expected str, bytes or os.PathLike object, not NoneType

2024-12-18T18:54:53.142473 - Prompt executed in 0.66 seconds
2024-12-18T18:54:58.621807 - FETCH DATA from: /home/user/ComfyUI/custom_nodes/ComfyUI-Manager/extension-node-map.json2024-12-18T18:54:58.621901 - 2024-12-18T18:54:58.630045 -  [DONE]2024-12-18T18:54:58.630137 - 
2024-12-18T18:54:58.849106 - []2024-12-18T18:54:58.849164 - 
2024-12-18T18:54:58.849236 - []2024-12-18T18:54:58.849296 - 
2024-12-18T18:54:58.857356 - [ERROR] An error occurred while retrieving information for the 'CR Select Font' node.
2024-12-18T18:54:58.857542 - Traceback (most recent call last):
  File "/home/user/ComfyUI/server.py", line 579, in get_object_info
    out[x] = node_info(x)
  File "/home/user/ComfyUI/server.py", line 546, in node_info
    info['input'] = obj_class.INPUT_TYPES()
  File "/home/user/ComfyUI/custom_nodes/ComfyUI_Comfyroll_CustomNodes/nodes/nodes_graphics_text.py", line 467, in INPUT_TYPES
    file_list = [f for f in os.listdir(font_dir) if os.path.isfile(os.path.join(font_dir, f)) and f.lower().endswith(".ttf")]
FileNotFoundError: [Errno 2] No such file or directory: '/usr/share/fonts/truetype'

2024-12-18T18:55:03.085446 - got prompt
2024-12-18T18:55:03.089778 - WARNING path /home/user/ComfyUI/models/unet/hunyuan-video-t2v-720p-Q6_K.gguf exists but doesn't link anywhere, skipping.
2024-12-18T18:55:03.090000 - !!! Exception during processing !!! expected str, bytes or os.PathLike object, not NoneType
2024-12-18T18:55:03.090365 - Traceback (most recent call last):
  File "/home/user/ComfyUI/execution.py", line 328, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 203, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/home/user/ComfyUI/execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 254, in load_unet
    sd = gguf_sd_loader(unet_path)
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 39, in gguf_sd_loader
    reader = gguf.GGUFReader(path)
  File "/home/user/comfy/lib/python3.10/site-packages/gguf/gguf_reader.py", line 90, in __init__
    self.data = np.memmap(path, mode = mode)
  File "/home/user/comfy/lib/python3.10/site-packages/numpy/core/memmap.py", line 229, in __new__
    f_ctx = open(os_fspath(filename), ('r' if mode == 'c' else mode)+'b')
TypeError: expected str, bytes or os.PathLike object, not NoneType

2024-12-18T18:55:03.090738 - Prompt executed in 0.00 seconds
2024-12-18T18:56:23.121019 - FETCH DATA from: /home/user/ComfyUI/custom_nodes/ComfyUI-Manager/extension-node-map.json2024-12-18T18:56:23.121121 - 2024-12-18T18:56:23.130420 -  [DONE]2024-12-18T18:56:23.130520 - 
2024-12-18T18:56:23.318854 - []2024-12-18T18:56:23.318912 - 
2024-12-18T18:56:23.318973 - []2024-12-18T18:56:23.319025 - 
2024-12-18T18:56:23.328575 - [ERROR] An error occurred while retrieving information for the 'CR Select Font' node.
2024-12-18T18:56:23.328804 - Traceback (most recent call last):
  File "/home/user/ComfyUI/server.py", line 579, in get_object_info
    out[x] = node_info(x)
  File "/home/user/ComfyUI/server.py", line 546, in node_info
    info['input'] = obj_class.INPUT_TYPES()
  File "/home/user/ComfyUI/custom_nodes/ComfyUI_Comfyroll_CustomNodes/nodes/nodes_graphics_text.py", line 467, in INPUT_TYPES
    file_list = [f for f in os.listdir(font_dir) if os.path.isfile(os.path.join(font_dir, f)) and f.lower().endswith(".ttf")]
FileNotFoundError: [Errno 2] No such file or directory: '/usr/share/fonts/truetype'

2024-12-18T18:56:29.278638 - got prompt
2024-12-18T18:56:29.293844 - WARNING path /home/user/ComfyUI/models/unet/hunyuan-video-t2v-720p-Q6_K.gguf exists but doesn't link anywhere, skipping.
2024-12-18T18:56:29.294683 - !!! Exception during processing !!! expected str, bytes or os.PathLike object, not NoneType
2024-12-18T18:56:29.295947 - Traceback (most recent call last):
  File "/home/user/ComfyUI/execution.py", line 328, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 203, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/home/user/ComfyUI/execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 254, in load_unet
    sd = gguf_sd_loader(unet_path)
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 39, in gguf_sd_loader
    reader = gguf.GGUFReader(path)
  File "/home/user/comfy/lib/python3.10/site-packages/gguf/gguf_reader.py", line 90, in __init__
    self.data = np.memmap(path, mode = mode)
  File "/home/user/comfy/lib/python3.10/site-packages/numpy/core/memmap.py", line 229, in __new__
    f_ctx = open(os_fspath(filename), ('r' if mode == 'c' else mode)+'b')
TypeError: expected str, bytes or os.PathLike object, not NoneType

2024-12-18T18:56:29.296937 - Prompt executed in 0.01 seconds
2024-12-18T18:58:04.496557 - got prompt
2024-12-18T18:58:04.555813 - !!! Exception during processing !!! Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got 'hyvid'
2024-12-18T18:58:04.555984 - Traceback (most recent call last):
  File "/home/user/ComfyUI/execution.py", line 328, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 203, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/home/user/ComfyUI/execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 254, in load_unet
    sd = gguf_sd_loader(unet_path)
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 66, in gguf_sd_loader
    raise ValueError(f"Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got {arch_str!r}")
ValueError: Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got 'hyvid'

2024-12-18T18:58:04.556332 - Prompt executed in 0.05 seconds
2024-12-18T18:59:55.650456 - got prompt
2024-12-18T18:59:55.707056 - !!! Exception during processing !!! Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got 'hyvid'
2024-12-18T18:59:55.707211 - Traceback (most recent call last):
  File "/home/user/ComfyUI/execution.py", line 328, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 203, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/user/ComfyUI/execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/home/user/ComfyUI/execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 254, in load_unet
    sd = gguf_sd_loader(unet_path)
  File "/home/user/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 66, in gguf_sd_loader
    raise ValueError(f"Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got {arch_str!r}")
ValueError: Unexpected architecture type in GGUF file, expected one of flux, sd1, sdxl, t5encoder but got 'hyvid'

2024-12-18T18:59:55.707659 - Prompt executed in 0.05 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"last_node_id":78,"last_link_id":217,"nodes":[{"id":16,"type":"KSamplerSelect","pos":[484,751],"size":[315,58],"flags":{},"order":0,"mode":0,"inputs":[],"outputs":[{"name":"SAMPLER","type":"SAMPLER","links":[19],"shape":3}],"properties":{"Node name for S&R":"KSamplerSelect"},"widgets_values":["euler"]},{"id":17,"type":"BasicScheduler","pos":[478,860],"size":[315,106],"flags":{},"order":9,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":216,"slot_index":0}],"outputs":[{"name":"SIGMAS","type":"SIGMAS","links":[20],"shape":3}],"properties":{"Node name for S&R":"BasicScheduler"},"widgets_values":["simple",20,1]},{"id":26,"type":"FluxGuidance","pos":[520,100],"size":[317.4000244140625,58],"flags":{},"order":11,"mode":0,"inputs":[{"name":"conditioning","type":"CONDITIONING","link":175}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[129],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"FluxGuidance"},"widgets_values":[6],"color":"#233","bgcolor":"#355"},{"id":45,"type":"EmptyHunyuanLatentVideo","pos":[475.540771484375,432.673583984375],"size":[315,130],"flags":{},"order":1,"mode":0,"inputs":[],"outputs":[{"name":"LATENT","type":"LATENT","links":[180],"slot_index":0}],"properties":{"Node name for S&R":"EmptyHunyuanLatentVideo"},"widgets_values":[848,480,73,1]},{"id":22,"type":"BasicGuider","pos":[600,0],"size":[222.3482666015625,46],"flags":{},"order":12,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":195,"slot_index":0},{"name":"conditioning","type":"CONDITIONING","link":129,"slot_index":1}],"outputs":[{"name":"GUIDER","type":"GUIDER","links":[30],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"BasicGuider"},"widgets_values":[]},{"id":67,"type":"ModelSamplingSD3","pos":[360,0],"size":[210,58],"flags":{},"order":10,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":217}],"outputs":[{"name":"MODEL","type":"MODEL","links":[195],"slot_index":0}],"properties":{"Node name for S&R":"ModelSamplingSD3"},"widgets_values":[7]},{"id":73,"type":"VAEDecodeTiled","pos":[1150,200],"size":[210,102],"flags":{},"order":15,"mode":0,"inputs":[{"name":"samples","type":"LATENT","link":210},{"name":"vae","type":"VAE","link":211}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[215],"slot_index":0}],"properties":{"Node name for S&R":"VAEDecodeTiled"},"widgets_values":[256,64]},{"id":8,"type":"VAEDecode","pos":[1150,90],"size":[210,46],"flags":{},"order":14,"mode":2,"inputs":[{"name":"samples","type":"LATENT","link":181},{"name":"vae","type":"VAE","link":206}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[],"slot_index":0}],"properties":{"Node name for S&R":"VAEDecode"},"widgets_values":[]},{"id":74,"type":"Note","pos":[1150,360],"size":[210,170],"flags":{},"order":2,"mode":0,"inputs":[],"outputs":[],"properties":{},"widgets_values":["Use the tiled decode node by default because most people will need it.\n\nLower the tile_size and overlap if you run out of memory."],"color":"#432","bgcolor":"#653"},{"id":13,"type":"SamplerCustomAdvanced","pos":[860,200],"size":[272.3617858886719,124.53733825683594],"flags":{},"order":13,"mode":0,"inputs":[{"name":"noise","type":"NOISE","link":37,"slot_index":0},{"name":"guider","type":"GUIDER","link":30,"slot_index":1},{"name":"sampler","type":"SAMPLER","link":19,"slot_index":2},{"name":"sigmas","type":"SIGMAS","link":20,"slot_index":3},{"name":"latent_image","type":"LATENT","link":180,"slot_index":4}],"outputs":[{"name":"output","type":"LATENT","links":[181,210],"slot_index":0,"shape":3},{"name":"denoised_output","type":"LATENT","links":null,"shape":3}],"properties":{"Node name for S&R":"SamplerCustomAdvanced"},"widgets_values":[]},{"id":75,"type":"SaveAnimatedWEBP","pos":[1410,200],"size":[315,366],"flags":{},"order":16,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":215}],"outputs":[],"properties":{"Node name for S&R":"SaveAnimatedWEBP"},"widgets_values":["ComfyUI",24,false,80,"default"]},{"id":25,"type":"RandomNoise","pos":[479,618],"size":[315,82],"flags":{},"order":3,"mode":0,"inputs":[],"outputs":[{"name":"NOISE","type":"NOISE","links":[37],"shape":3}],"properties":{"Node name for S&R":"RandomNoise"},"widgets_values":[387403512151819,"randomize"],"color":"#2a363b","bgcolor":"#3f5159"},{"id":44,"type":"CLIPTextEncode","pos":[420,200],"size":[422.84503173828125,164.31304931640625],"flags":{},"order":8,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":205}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[175],"slot_index":0}],"title":"CLIP Text Encode (Positive Prompt)","properties":{"Node name for S&R":"CLIPTextEncode"},"widgets_values":["sumurai fending off k-pop zombies"],"color":"#232","bgcolor":"#353"},{"id":77,"type":"Note","pos":[-103.88758087158203,-4.155503273010254],"size":[350,110],"flags":{},"order":4,"mode":0,"inputs":[],"outputs":[],"properties":{},"widgets_values":["Select a fp8 weight_dtype if you are running out of  memory."],"color":"#432","bgcolor":"#653"},{"id":11,"type":"DualCLIPLoader","pos":[-131.93722534179688,223.25059509277344],"size":[350,106],"flags":{},"order":5,"mode":0,"inputs":[],"outputs":[{"name":"CLIP","type":"CLIP","links":[205],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"DualCLIPLoader"},"widgets_values":["clip_l.safetensors","llava_llama3_fp8_scaled.safetensors","hunyuan_video"]},{"id":10,"type":"VAELoader","pos":[-121.54846954345703,421.03887939453125],"size":[350,60],"flags":{},"order":6,"mode":0,"inputs":[],"outputs":[{"name":"VAE","type":"VAE","links":[206,211],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"VAELoader"},"widgets_values":["hunyuan_video_vae_bf16.safetensors"]},{"id":78,"type":"UnetLoaderGGUF","pos":[-45.67967987060547,642.2286376953125],"size":[315,58],"flags":{},"order":7,"mode":0,"inputs":[],"outputs":[{"name":"MODEL","type":"MODEL","links":[216,217],"slot_index":0}],"properties":{"Node name for S&R":"UnetLoaderGGUF"},"widgets_values":["hunyuan-video-t2v-720p-Q6_K.gguf"]}],"links":[[19,16,0,13,2,"SAMPLER"],[20,17,0,13,3,"SIGMAS"],[30,22,0,13,1,"GUIDER"],[37,25,0,13,0,"NOISE"],[129,26,0,22,1,"CONDITIONING"],[175,44,0,26,0,"CONDITIONING"],[180,45,0,13,4,"LATENT"],[181,13,0,8,0,"LATENT"],[195,67,0,22,0,"MODEL"],[205,11,0,44,0,"CLIP"],[206,10,0,8,1,"VAE"],[210,13,0,73,0,"LATENT"],[211,10,0,73,1,"VAE"],[215,73,0,75,0,"IMAGE"],[216,78,0,17,0,"MODEL"],[217,78,0,67,0,"MODEL"]],"groups":[],"config":{},"extra":{"ds":{"scale":0.9625789447189521,"offset":[208.39536623285247,507.1831930059733]},"groupNodes":{},"ue_links":[]},"version":0.4}

Additional Context

(Please add any additional context or steps to reproduce the error here)

nevermind, just needed to update ComfyUI-gguf node

how much Vram for this? and how many time I can expect to generate?

When using hunyuan-video-t2v-720p-Q5_K_M.gguf, my RTX 3090 used less than 19G of memory and took about 6 minutes per video using the default settings from this workflow https://comfyanonymous.github.io/ComfyUI_examples/hunyuan_video/ after replacing the "Load Diffusion Model" node with "UNet Loader (GGUF)".

Sign up or log in to comment