The Patchbay_

YuE

Open foundation model that turns lyrics into full songs — vocals and backing — across many genres.

LanguagePython
CategoryML & generative
LicenseApache-2.0
PlatformsLinux Windows macOS
InstallClone the repo and run the inference scripts
First released2025
MaintainedYes
LinksWebsite · Source

Strengths

Limitations

Best for

Self-hosting open full-song generation with vocals from your own lyrics.

Minimal example

# Clone the repo, then from inference/ run:
python infer.py \
  --stage1_model m-a-p/YuE-s1-7B-anneal-en-cot \
  --stage2_model m-a-p/YuE-s2-1B-general \
  --genre_txt ../prompt_egs/genre.txt \
  --lyrics_txt ../prompt_egs/lyrics.txt \
  --output_dir ../output

Alternatives to YuE

note-seqMagentaAudioCraft (MusicGen)DDSP

← Back to all tools