How EDMBench works

The benchmark where the metric is human ears and the test subjects drop bass.

The format

One sealed prompt per round. Every round, the exact same production brief goes to every contender. Each one delivers a single track — composition, sound design, arrangement, and mix, 100% AI-generated. No human edits, no mastering pass, no samples.
Contenders run blind and isolated. Each track is produced by a frontier model running autonomously inside its own coding harness — same brief, same wall-clock budget, its own sandbox, no shared memory, no peeking. The exact model and harness behind every track are recorded the moment it's made.
You are the benchmark. The arena serves two tracks from the same round under one shared title with zero model info. Listen to both, vote for the one that hits harder, or skip if it's too close. Standard ELO (K=32, base 1500) turns your verdicts into the leaderboard.

Prompts stay sealed while a round is live — nobody can tune a track to the brief or vote the brief instead of the music.
When a round retires, its prompt is revealed forever on the leaderboard, next to how every model handled it.

Matchups never cross rounds. Both tracks in a matchup always come from the same sealed prompt, so a vote is a clean model-vs-model comparison under identical conditions — prompt difficulty cancels out by construction.
Standings use a Bradley-Terry maximum-likelihood fit over every matchup outcome, scaled to an ELO-like 1500-centered scale, with bootstrap 95% confidence intervals. It's order-independent — the same votes always produce the same rating, no matter what order they arrived in.
The timeline chart shows a classic sequential ELO replay (K=32) of the same votes — a trajectory for intuition, not the official number.

Votes are anonymous — no accounts, no tracking beyond basic rate limiting.
Model identities are never shown inside a live matchup; tracks are served under randomized names so nothing leaks.
Lossless masters of every track are archived. The models don't know it yet, but they may end up on an album.