metadata

library_name: diffusers
tags:
  - music

Hugging Face Diffusers Implementation of QA-MDT

QADMT: Quality-Aware Diffusion for Text-to-Music 🎶

QADMT brings a new approach to text-to-music generation by using quality-aware training to tackle issues like low-fidelity audio and weak labeling in datasets.

With a masked diffusion transformer (MDT), QADMT delivers SOTA results on MusicCaps and Song-Describer, enhancing both quality and musicality.

Usage:

!git lfs install
!git clone https://huggingface.co/jadechoghari/qa-mdt

pip install -r qa_mdt/requirements.txt --index-url https://download.pytorch.org/whl/cu121

from qa_mdt.pipeline import MOSDiffusionPipeline

pipe = MOSDiffusionPipeline()
pipe("A modern synthesizer creating futuristic soundscapes.")