294 13 114

Sayak Paul

sayakpaul

https://sayak.dev

RisingSayak

sayakpaul

AI & ML interests

Diffusion models, representation learning

Articles

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Feb 10, 2023

• 23

A Dive into Pretraining Strategies for Vision-Language Models

Feb 3, 2023

• 30

The State of Computer Vision at Hugging Face 🤗

Jan 30, 2023

• 4

Using LoRA for Efficient Stable Diffusion Fine-Tuning

Jan 26, 2023

• 26

Image Similarity with Hugging Face Datasets and Transformers

Jan 16, 2023

• 7

Deploying 🤗 ViT on Vertex AI

Aug 19, 2022

• 2

Deploying 🤗 ViT on Kubernetes with TF Serving

Aug 11, 2022

Deploying TensorFlow Vision Models in Hugging Face with TF Serving

Jul 25, 2022

Organizations

sayakpaul's activity

New activity in TencentARC/PhotoMaker 6 days ago

[ BUG ] An error is reported directly without any information.

#40 opened 6 days ago by

Paper99

New activity in mapo-t2i/mapo-beta 13 days ago

mapo-beta ? don't know about this model from paper.

#1 opened 13 days ago by

pljj315

New activity in hf-internal-testing/tiny-sdxl-custom-all 19 days ago

Fix imports for PR 8623

#5 opened 19 days ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-components 19 days ago

remove deprecated LoRA blocks

#1 opened 19 days ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-all 19 days ago

fix import wr.t. PR #6630

#2 opened 6 months ago by

sayakpaul

New activity in diffusers/community-pipelines-mirror 26 days ago

Revert incorrect commit

#2 opened 26 days ago by

Wauplin

New activity in stabilityai/stable-diffusion-3-medium 26 days ago

fix the diffusers documentation link

#73 opened 26 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 26 days ago

fix the documentation link

#12 opened 26 days ago by

sayakpaul

Delete transformer/diffusion_pytorch_model-00001-of-00002.safetensors

#11 opened 26 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 27 days ago

Upload folder using huggingface_hub

#7 opened 27 days ago by

sayakpaul

Upload folder using huggingface_hub

#6 opened 27 days ago by

sayakpaul

Upload folder using huggingface_hub

#5 opened 27 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium 27 days ago

Update README.md to include a note on diffusers

#62 opened 27 days ago by

sayakpaul

New activity in stabilityai/stable-diffusion-3-medium-diffusers 27 days ago

Upload folder using huggingface_hub

#4 opened 27 days ago by

sayakpaul

New activity in mapo-t2i/mapo-pick-safety 29 days ago

Update README for MaPO Pick-Safety checkpoint

#1 opened about 1 month ago by

JW17

New activity in mapo-t2i/pick-safety 30 days ago

Add disclaimer for harmful contents

#2 opened 30 days ago by

JW17

New activity in mapo-t2i/pick-style-cartoon about 1 month ago

Initial update for Pick-Style cartoon split

#1 opened about 1 month ago by

JW17

New activity in mapo-t2i/pick-safety about 1 month ago

Update model card for Pick-Safety

#1 opened about 1 month ago by

JW17

New activity in mapo-t2i/pick-style-pixel-art about 1 month ago

Update dataset card for pixel art split

#1 opened about 1 month ago by

JW17

New activity in mapo-t2i/mapo-pick-style-cartoon about 1 month ago

Update README for Pick-Style cartoon split MaPO checkpoint

#1 opened about 1 month ago by

JW17

New activity in mapo-t2i/mapo-pick-style-pixel-art about 1 month ago

Update README for pixel art MaPO checkpoint

#1 opened about 1 month ago by

JW17

New activity in diffusers/community-pipelines-mirror about 1 month ago

Create README.md

#1 opened about 1 month ago by

Wauplin

New activity in anyMODE/extraMODE-PixArtSigma about 1 month ago

Hello from the 🧨 Diffusers team

#1 opened about 1 month ago by

sayakpaul

New activity in hf-internal-testing/tiny-sdxl-custom-all about 1 month ago

Update unet/my_unet_model.py

#4 opened about 1 month ago by

sayakpaul

New activity in huggingface/documentation-images about 1 month ago

Marigold for ControlNet example images

#341 opened about 1 month ago by

toshas

marigold documentation files

#338 opened about 1 month ago by

toshas

marigold documentation files (2)

#339 opened about 1 month ago by

toshas

marigold documentation files (3)

#340 opened about 1 month ago by

toshas

New activity in diffusers/stable-diffusion-xl-inpainting about 2 months ago

🚩 Report: Not working

#34 opened 3 months ago by

bgonani1

New activity in PixArt-alpha/PixArt-Sigma-XL-2-1024-MS about 2 months ago

Add LoRAs

#1 opened about 2 months ago by

AeroDEmi

New activity in diffusers/tuxemon about 2 months ago

Update README.md

#1 opened about 2 months ago by

linoyts

New activity in latent-consistency/lcm-lora-sdxl about 2 months ago

Training details

#12 opened 6 months ago by

ywlee88

New activity in hf-internal-testing/diffusers-images 2 months ago

Upload lcm_lora/sdxl_lcm_lora.png with huggingface_hub

#39 opened 2 months ago by

sayakpaul

New activity in madebyollin/taesd-x4-upscaler 2 months ago

Training code

#1 opened 2 months ago by

sayakpaul

New activity in huggingface/documentation-images 2 months ago

Upload header_collage_sigma.jpg

#333 opened 2 months ago by

Lawrence-cj

New activity in TIGER-Lab/GenAI-Arena 2 months ago

PixArt Sigma?

#11 opened 2 months ago by

sayakpaul

New activity in diffusers/controlnet-canny-sdxl-1.0 2 months ago

Using non square images for training

#35 opened 2 months ago by

starinskycc

When generating indoor images, there is unexpected glowing. Can this be fixed?

#34 opened 2 months ago by

starinskycc

New activity in huggingface/documentation-images 2 months ago

3 image samples for huggingface InstantStyle documentation

#331 opened 2 months ago by

danny7017

New activity in diffusers/unofficial-SDXL-Turbo-i2i-t2i 2 months ago

Any additional configuration to achieve this speed?

#7 opened 2 months ago by

jduke99

commented a paper 2 months ago

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

Paper • 2404.16710 • Published Apr 25 • 56 •

New activity in diffusers/controlnet-depth-sdxl-1.0 3 months ago

Fix higher vRAM usage

#10 opened 3 months ago by

tolgacangoz

New activity in huggingface/diffusers-metadata 3 months ago

order JSON lines before uploading it so that the generated JSON file is stable

#2 opened 3 months ago by

julien-c

New activity in TIGER-Lab/GenAI-Arena 3 months ago

Make the preference data for text-to-image models available?

#7 opened 3 months ago by

sayakpaul

New activity in huggingface/documentation-images 3 months ago

Files for documentation of Block LoRA (PR: https://github.com/huggingface/diffusers/pull/7352)

#310 opened 3 months ago by

UmerHA

New activity in SPRIGHT-T2I/spright-t2i-sd2 3 months ago

update Readme

#1 opened 3 months ago by

gabsm

New activity in SPRIGHT-T2I/spright_coco 3 months ago

updating readme

#1 opened 3 months ago by

agneet

New activity in SPRIGHT-T2I/README 3 months ago

minor changes

#2 opened 3 months ago by

agneet

New activity in SPRIGHT-T2I/spright 3 months ago

updating cc+sa data card

#3 opened 3 months ago by

agneet

New activity in SPRIGHT-T2I/spright 4 months ago

Minor refactoring to the dataset card

#2 opened 4 months ago by

sayakpaul

Update README.md

#1 opened 4 months ago by

sayakpaul

New activity in diffusers/compute-pipeline-size 4 months ago

Seeking feedback

#2 opened 4 months ago by

sayakpaul

New activity in sayakpaul/demo-docker-gradio 4 months ago

fix outdated gr.inputs and gr.outputs

#2 opened 4 months ago by

chansung

New activity in hf-internal-testing/tiny-sdxl-custom-all 4 months ago

Update implementation so that it actually uses the custom classes

#3 opened 4 months ago by

sayakpaul

New activity in huggingface/HuggingDiscussions 4 months ago

[FEEDBACK] Collections

#12 opened 10 months ago by

victor

New activity in lysandre/github-release 4 months ago

append "all commits"

#4 opened 4 months ago by

sayakpaul

New activity in diffusers/compute-pipeline-size 4 months ago

Fetch files metadata directly from model_info call

#1 opened 4 months ago by

Wauplin

New activity in sayakpaul/mgie 5 months ago

How to run your code?

#1 opened 5 months ago by

Andyrasika

New activity in diffusers/pokemon-gpt4-captions 5 months ago

image / caption shift

#3 opened 5 months ago by

p-conscious

New activity in ali-vilab/i2vgen-xl 5 months ago

Update README.md

#11 opened 5 months ago by

sayakpaul

Sayak Paul

AI & ML interests

Articles

🧨 Diffusers welcomes Stable Diffusion 3

🤗 PEFT welcomes new merging methods

Welcome aMUSEd: Efficient Text-to-Image Generation

SDXL in 4 steps with Latent Consistency LoRAs

Personal Copilot: Train Your Own Coding Assistant

Exploring simple optimizations for SDXL

Finetune Stable Diffusion Models with DDPO via TRL

Introducing Würstchen: Fast Diffusion for Image Generation

Efficient Controllable Generation for SDXL with T2I-Adapters

Happy 1st anniversary 🤗 Diffusers!

Optimizing Stable Diffusion for Intel CPUs with NNCF and 🤗 Optimum

Instruction-tuning Stable Diffusion with InstructPix2Pix

Training a language model with 🤗 Transformers using TensorFlow and TPUs

ControlNet in Diffusers 🧨

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

A Dive into Pretraining Strategies for Vision-Language Models

The State of Computer Vision at Hugging Face 🤗

Using LoRA for Efficient Stable Diffusion Fine-Tuning

Image Similarity with Hugging Face Datasets and Transformers

Deploying 🤗 ViT on Vertex AI

Deploying 🤗 ViT on Kubernetes with TF Serving

Deploying TensorFlow Vision Models in Hugging Face with TF Serving

Organizations

sayakpaul's activity

[ BUG ] An error is reported directly without any information.

mapo-beta ? don't know about this model from paper.

Fix imports for PR 8623

remove deprecated LoRA blocks

fix import wr.t. PR #6630

Revert incorrect commit

fix the diffusers documentation link

fix the documentation link

Delete transformer/diffusion_pytorch_model-00001-of-00002.safetensors

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Upload folder using huggingface_hub

Update README.md to include a note on diffusers

Upload folder using huggingface_hub

Update README for MaPO Pick-Safety checkpoint

Add disclaimer for harmful contents

Initial update for Pick-Style cartoon split

Update model card for Pick-Safety

Update dataset card for pixel art split

Update README for Pick-Style cartoon split MaPO checkpoint

Update README for pixel art MaPO checkpoint

Create README.md

Hello from the 🧨 Diffusers team

Update unet/my_unet_model.py

Marigold for ControlNet example images

marigold documentation files

marigold documentation files (2)

marigold documentation files (3)

🚩 Report: Not working

Add LoRAs

Update README.md

Training details

Upload lcm_lora/sdxl_lcm_lora.png with huggingface_hub

Training code

Upload header_collage_sigma.jpg

PixArt Sigma?

Using non square images for training

When generating indoor images, there is unexpected glowing. Can this be fixed?

3 image samples for huggingface InstantStyle documentation

Any additional configuration to achieve this speed?

Fix higher vRAM usage

order JSON lines before uploading it so that the generated JSON file is stable

Make the preference data for text-to-image models available?

Files for documentation of Block LoRA (PR: https://github.com/huggingface/diffusers/pull/7352)

update Readme

updating readme

minor changes

updating cc+sa data card

Minor refactoring to the dataset card

Update README.md

Seeking feedback

fix outdated gr.inputs and gr.outputs

Update implementation so that it actually uses the custom classes