alimama-creative

/

SD3-Controlnet-Inpainting

like 17

I installed diffusers from the source code and ran experiments using dog and dog_mask in images. I found that the model still modified the entire image without any control
Code is：
res_image = pipe(
negative_prompt="deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, mutated hands and fingers, disconnected limbs, mutation, mutated, ugly, disgusting, blurry, amputation, NSFW",
prompt=prompt,
height=height,
width=width,
control_image=image,
control_mask=mask,
num_inference_steps=28,
generator=generator,
controlnet_conditioning_scale=0.95,
guidance_scale=20,
).images[0]

nothing happened.
if guidance_scale is set to 50 or bigger, result will be