alimama-creative

/

SD3-Controlnet-Inpainting

like 17

Sorry, we have no plans to open the training code, but most of the code is based on small modifications to the sd3 dream booth lora training script in the diffusers library, and the specific link can be found here （https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/train_dreambooth_lora_sd3.py）

Thanks a lot for the response!
And i'm curious about how to generate "controlnet-inpainting" dataset by using 12M laion2B?

It is obtained by filtering with high threshold values for resolution, aesthetics, and clip scores, and the mask is randomly generated.

Thanks so much for the reply !

Hi,
I have another question, what and how many devices did you use for training, and how many days did the training cost ?
Thanks a lot for the reply!

@ljp

16 x A100 used for a week.

how long does it take to get a decent result? maybe 1-3days and the model may rought converge? @ljp