The Patchbay_

YuE

Open foundation model that turns lyrics into full songs — vocals and backing — across many genres.

LanguagePython
CategoryML & generative
LicenseApache-2.0 (code) · CC BY-NC 4.0 (weights)
PlatformsLinux
InstallClone the repo, then: python -m pip install .
First released2025 (YuE2 supersedes it)
MaintainedYes
LinksWebsite · Source
Full tutorialFull ACE-Step tutorial — the web UI, the Python API, and the retake / repaint / edit workflow

Strengths

Limitations

Best for

Self-hosting open full-song generation with vocals from your own lyrics.

Minimal example

git clone https://github.com/multimodal-art-projection/YuE.git
cd YuE && python3.12 -m venv .venv && source .venv/bin/activate
python -m pip install .

yue2 generate --request examples/song.json --output outputs/song
YuE2 replaced YuE. The current model plans an editable melody-and-chord score before rendering it, needs Linux and a 24 GB NVIDIA GPU, and outputs 48 kHz stereo. The original version is preserved on the YuE-v1 branch. Note the weights are CC BY-NC 4.0 even though the code is Apache-2.0.

Alternatives to YuE

note-seqMagentaAudioCraft (MusicGen)DDSP

Head to head

YuE2 vs MusicGen

← Back to all tools