XLabs-AI

/

flux-controlnet-canny

like 265

My controlnet loader is getting an error for this file in comfy

Error occurred when executing AV_ControlNetEfficientLoaderAdvanced:

'NoneType' object has no attribute 'keys'

File "/mnt/e/Projekty/_AI/ComfyUI/execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "/mnt/e/Projekty/_AI/ComfyUI/execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "/mnt/e/Projekty/_AI/ComfyUI/execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "/mnt/e/Projekty/_AI/ComfyUI/custom_nodes/comfyui-art-venture/modules/controlnet/__init__.py", line 347, in load_controlnet
control_net = load_controlnet(control_net_name, control_net_override, timestep_keyframe=timestep_keyframe)
File "/mnt/e/Projekty/_AI/ComfyUI/custom_nodes/comfyui-art-venture/modules/controlnet/__init__.py", line 23, in load_controlnet
return comfy_load_controlnet(control_net_name, timestep_keyframe=timestep_keyframe)
File "/mnt/e/Projekty/_AI/ComfyUI/custom_nodes/comfyui-art-venture/modules/controlnet/advanced.py", line 41, in comfy_load_controlnet
return loader.load_controlnet(control_net_name, timestep_keyframe=timestep_keyframe)[0]
File "/mnt/e/Projekty/_AI/ComfyUI/custom_nodes/ComfyUI-Advanced-ControlNet/adv_control/nodes.py", line 51, in load_controlnet
controlnet = load_controlnet(controlnet_path, tk_optional)
File "/mnt/e/Projekty/_AI/ComfyUI/custom_nodes/ComfyUI-Advanced-ControlNet/adv_control/control.py", line 468, in load_controlnet
control = comfy_cn.load_controlnet(ckpt_path, model=model)
File "/mnt/e/Projekty/_AI/ComfyUI/comfy/controlnet.py", line 433, in load_controlnet
return load_controlnet_mmdit(controlnet_data)
File "/mnt/e/Projekty/_AI/ComfyUI/comfy/controlnet.py", line 343, in load_controlnet_mmdit
model_config = comfy.model_detection.model_config_from_unet(new_sd, "", True)
File "/mnt/e/Projekty/_AI/ComfyUI/comfy/model_detection.py", line 284, in model_config_from_unet
unet_config = detect_unet_config(state_dict, unet_key_prefix)
File "/mnt/e/Projekty/_AI/ComfyUI/comfy/model_detection.py", line 37, in detect_unet_config
state_dict_keys = list(state_dict.keys())

We are working on ComfyUI node support, it will be available soon.

you can use this pull here if inpatient https://github.com/comfyanonymous/ComfyUI/pull/4260

i search "https://huggingface.co/InstantX/FLUX.1-dev-Controlnet-Canny-alpha/blob/main/canny.jpg". can u try its.

so far the results have been very poor - im assuming its a comfy thing vs a model thing as others via CLI seem to generate reliable results. Everything so far from it either doesn't impact the generation or immediately blurs it beyond recognition, very sharp dividing line around 0.7 strength.

it was a settings issue - worked it out
these worked for me

these worked for me
Can you share image with workflow?

Thanks orwellian 84, This is great! Can you please share the .json workflow?

Damn these are hard to make work. Even using their workflow with all of their nodes, it's garbage. This is the closest I've come to seeing it work, though I'm still not quite getting the results like the above example.