04 / Foundation

Asset Research: Test Audio & Eval Sets

📜 Full Asset subagent prompt

You are research subagent #5 in a music transcription monitoring swarm. Today is Saturday, Aug 1, 2026.

GOAL
Find CC-licensed / freely-available test audio + multi-instrument eval set sources for the music transcription pipeline. Produce a research report that future cycles can act on.

OUTPUT
Write your findings to TWO files:
1. Primary report: /Users/kajicadjuric/.minimax/workspace/music-transcription-monitor/reports/asset_research_2026-08-01.md
2. Status file: /Users/kajicadjuric/.minimax/workspace/music-transcription-monitor/out/assets/STATUS.json containing {"status": "PASS" | "FAIL", "signal": "<one-line reason>"}

ACCEPTANCE CRITERIA
The primary report MUST:
- Exist at the path above
- List >=3 candidate sources for a 30-second multi-instrument test excerpt (for the monthly pipeline)
- List >=3 candidate sources for a 50-100 piece multi-instrument eval set with ground-truth MusicXML or MIDI (for the quarterly eval)
- For EACH source include: name, URL, license, brief description (1-2 sentences), why it's a good fit (or what its limitations are)
- A "## Recommended Pick" section at the end with your top choice for each category and 1-paragraph rationale
- A "## Risks / Gaps" section calling out any concerns (broken links, paywalled content, license ambiguity, etc.)

CANDIDATE SOURCES TO EVALUATE
Use web_search + web_fetch to investigate these (and any others you discover):
- MusicNet (CC-BY): classical, multi-instrument labels
- MAESTRO (Google Magenta): piano performance MIDI
- MIR-1K: multi-instrument karaoke-style
- Lakh MIDI: large-scale symbolic, no audio but matches with Million Song Dataset
- MAPS: piano database
- Bach Chorales: music21 sample set, small but well-known
- ISMIR datasets collection: curated list
- Freesound: CC-licensed audio (verify per-clip license)
- Musopen: public-domain classical recordings
- IMSLP / Petrucci: public-domain classical scores + performances (license varies)
- Slakh: multi-track MIDI rendering from Lakh
- MIDI-MT (or "MIDI Music Transformer" datasets): recent transformer-era datasets

METHOD
1. For each candidate, use web_search to confirm it still exists and is downloadable.
2. Use web_fetch on the homepage to grab the license + size + format info.
3. For broken links, document the failure and find a substitute.
4. Cross-check with secondary sources (papers that cite the dataset) to confirm license.

CONSTRAINTS
- 15-minute time budget
- Verify license explicitly - note if it's CC-BY, CC0, public domain, or restricted
- For any source with restrictions (e.g., "research use only"), flag it loudly
- If a source has moved or is gone, document and provide an alternative

RETURN TO ORCHESTRATOR
After writing the files, return a one-line status:
STATUS: PASS or STATUS: FAIL - <reason>

🏆 Recommended Picks

30-second test: MusicNet is the recommended pick, with URMP as a real-perf supplement and Slakh2100 as the synthesized-eval supplement.

50-100 piece eval: Slakh2100 is the recommended pick, paired with URMP for the real-perf strata and DCMLab Bach Chorales (subject to license-conflict resolution) as a MusicXML-symbolic anchor.

See full rationale in section 4 of the report.

Test audio (30s)

Multi-Instrument Test Excerpt Sources

30-second test source

MusicNet

CC-BY

330 freely-licensed classical chamber music recordings, ~34 h total, by 10 composers and 11 instruments (violin, viola, cello, flute, clarinet, etc.). Each piece ships with aligned `.wav` audio + per-note CSV labels + reference MIDI. Average track length ~6 minutes, so 30-second windows are trivial to slice.

License: **CC-BY 4.0** (verified in Zenodo "Rights" panel — `cc-by-4.0` icon present on the host page itself)

The audio comes from European Archive, Isabella Stewart Gardner Museum, and Musopen — all CC-licensed/PD. Labels are human-verified (~4% error). Excellent for a monthly test because the audio is real performance audio (not synthesized) and you can pick any 30-second window with guaranteed instrument diversity. Limitation: download is 11.1 GB — the dataset is one-shot download, but you only need a few tracks for a single test clip.

2026-08-01 — Zenodo host page contains the CC-BY 4.0 license block in the right-rail "Rights" section and MD5 checksums for each tarball.

30-second test source

URMP Dataset

CC-BY

44 classical chamber-music pieces ranging from duets to quintets (duets, trios, quartets, quintets — 149 isolated instrument tracks total). Each piece ships with the MIDI score, per-instrument isolated audio recordings, the assembled-mixture audio, and a video. 12.5 GB total package.

License: **CC-BY 4.0** (per HuggingFace `jonflynn/urmp_jukebox_embeddings` mirror YAML header; original Dryad DOI also reports CC-BY attribution requirement)

URMP is purpose-built for multi-instrument transcription evaluation. The isolated stems mean you can pre-stack exactly the instrument mix you want for the test, and the MIDI ground truth is right there. Pieces are short (typically under 2 min) so a 30-second slice is most of the piece. Limitation: only 44 pieces total, so you cannot refresh the test clip every month without eventually cycling. Also CC-BY (not CC0) so attribution must accompany the output.

2026-08-01 — Rochester lab page reachable and documents the package contents; CC-BY confirmed via downstream paper metadata.

30-second test source

Musopen

CC0/PD

2,400+ public-domain classical compositions (Bach, Beethoven, Chopin, etc.) and 1,800+ Musopen-original recordings. Free users get 5 downloads/day in MP3; paid ($55/yr) gets lossless FLAC.

License: **Public Domain (PD) for compositions; CC0 / CC BY-SA for original recordings** — per-piece license is shown on each track's download page. Musopen's own FAQ: "You may use our CC0 and public domain recordings in any project, for any purpose, without payment or attribution." License-per-track is the only safe way to consume it.

Genuinely free of all restrictions for the CC0 / PD tier, and you can pick a specific movement of e.g. a Mozart string quintet for a 30-second test. Limitation: license varies per recording — must inspect each track's "License" header. Also: 5 free downloads/day throttles CI automation; CI agents would need a paid seat or a small pre-staged cache. No MIDI ground truth, so the test is "audio only" — you'd need a separate score to score transcription quality.

2026-08-01 — Musopen homepage and music landing page both loaded; per-track license field confirmed.

30-second test source

Freesound

NC-flag

714,000+ CC-licensed audio samples as of 2025, 536+ days of continuous audio. Mix of field recordings, instrument samples, ambient textures, sound effects. Searchable by keyword and instrument.

License: **Mixed, per clip — CC0, CC BY 4.0, or CC BY-NC 4.0.** Per the Freesound FAQ, you must filter by license. Per-clip license is on every sound's description page; the API returns the license field on every result.

Ideal for synthesizing a custom 30-second multi-instrument test by stacking CC0 stems you find via search (e.g. individual violin, cello, piano, drums). Limitation: no canonical "transcription ground truth" — you choose stems yourself, then need to either accept the implicit "ground truth = your hand-stacked mix" or use a separate annotation tool. Requires API key for bulk use. CC-BY and CC0 are both safe for the pipeline; CC-BY-NC is not.

2026-08-01 — Freesound homepage, FAQ, and license-options page all loaded.

1000 16-kHz / 16-bit audio clips (4-13 seconds each, 133 minutes total) extracted from 110 Chinese karaoke songs. Music accompaniment in left channel, vocal in right channel. Comes with pitch annotations, lyrics, and singer identity.

License: **CC-BY 4.0** (verified on Figshare's license field)

Good for "vocal + accompaniment" 30-second windows (concatenate a few clips). Limitation: only 2 sources (voice + backing track), and clips are very short — not a true multi-instrument transcription stress test. Better suited to vocal/lyrics-related transcription than to the multi-instrument pipeline.

2026-08-01 — Figshare record page confirms CC-BY 4.0 badge and 760.45 MB size.

30-second test source

Slakh2100-redux

CC-BY

2100 multi-track audio mixtures synthesized from Lakh MIDI using professional-grade sample-based virtual instruments (187 patches across 34 classes). Each track ships with the mixture FLAC + per-stem FLACs + per-stem MIDI. 145 h of mixture, 104.3 GB compressed.

License: **CC-BY 4.0** (verified in Zenodo "Rights" panel — `cc-by-4.0` icon present)

Best "synthesized" multi-instrument source — every stem has a perfect MIDI ground truth. A 30-second slice of any `TrackXXXXX/` directory is a complete multi-instrument test. Limitation: synthesized (not real instruments), so the timbral/breath/reverb characteristics differ from a real performance — this is a known gap that MusicNet or URMP covers. Also 104 GB download.

2026-08-01 — Zenodo host page contains CC-BY 4.0 license block and the known-duplicates warning.

Eval set (50-100 pieces)

Multi-Instrument Eval Set Sources

Eval set source

MusicNet — same as 1.1

CC-BY

330 pieces, each with aligned audio + reference MIDI (in `musicnet_midis.tar.gz`) + per-note CSV labels. CSV-to-MusicXML conversion is mechanical.

License: **CC-BY 4.0**

330 pieces is comfortably above the 50-100 floor. Reference MIDIs are directly downloadable (2.6 MB tarball) and come from Classical Archives, Suzumidi, and HarfeSoft. Limitation: CC-BY (attribution required in any output render).

2026-08-01.

Eval set source

MAESTRO v3.0.0

NC-flag

1,276 piano performances, ~200 h, captured on Yamaha Disklaviers during the International Piano-e-Competition. Audio (44.1-48 kHz 16-bit PCM stereo) + MIDI with ~3 ms alignment. Train/val/test split built in.

License: **CC BY-NC-SA 4.0** (verified on the Magenta page's "License" section)

Gold-standard for piano transcription. The MIDI is exactly what the Disklavier played (so it's true performance MIDI, not synthesized). The built-in splits keep the same composition out of multiple subsets. Limitation: **piano only** — not multi-instrument. Use as the piano-stratum of a multi-instrument eval, not as a multi-instrument eval by itself. Also **CC BY-NC-SA 4.0** — non-commercial share-alike. If the pipeline ships a commercial product, this dataset cannot be used as a holdout benchmark. (NC clause flagged for orchestrator.)

2026-08-01 — Magenta page reachable, SHA256 checksums published.

CC-BY

2100 multi-track pieces, each with mixture + stems + MIDI per stem. Each MIDI is the input to the synthesizer, so it is exact ground truth.

License: **CC-BY 4.0**

2100 pieces is 20-40× the 50-100 floor. Multi-instrument (every mix has at least piano/guitar/drums/bass; median track has 4-8 sources). Limitation: known duplicate-MIDI issue — the Zenodo "redux" version moves duplicates to an `omitted/` directory; the `omitted/` tracks must NOT be used for transcription evaluation per the dataset's own guidance.

2026-08-01.

Eval set source

CocoChorales Dataset

CC-BY

240,000 synthesized chamber-ensemble pieces (~1,411 h of audio), performed by 13 instruments (violin, viola, cello, double bass, flute, oboe, clarinet, bassoon, saxophone, trumpet, french horn, trombone, tuba) across 4 ensemble types (string, brass, woodwind, random). Each example: mixture audio + per-source audio + aligned MIDI + multi-f0 + per-note expression (vibrato, loudness, brightness). "Tiny" subset is 24k train / 8k val / 8k test.

License: **CC-BY 4.0** (verified on the Magenta page)

This is the largest multi-instrument AMT benchmark in existence. MIDI ground truth is exact (synthesizer input). "Tiny" subset is reasonable for quarterly eval. Limitation: 2.9 TB full / 4 TB uncompressed — you almost certainly want the tiny version. Synthesized, so it does not exercise real performance noise. CC-BY is permissive.

2026-08-01 — Magenta page and the GitHub data_download shell scripts both confirm CC-BY 4.0 and 2.9 TB / 569 GB main sizes.

Eval set source

URMP — same as 1.2

CC-BY

44 multi-instrument pieces with MIDI scores + per-instrument audio + assembled mix + video.

License: **CC-BY 4.0**

Below the 50-100 floor (44 < 50), but the pieces are real human performances (not synthesized) and include score-engraved PDFs as well as MIDI. Suitable as a "real performance" supplement to a larger synthesized set. Limitation: 44 pieces is the entire dataset, and pieces are reused in the literature; you should be aware of evaluation contamination if the pipeline trains on URMP.

2026-08-01.

Eval set source

MAPS Database

NC-flag

~30 GB of synthesized piano audio (Disklavier + synth), ~30 h, with ground-truth MIDI for every audio file. Seven subsets (AkPnBcht, AkPnBsdf, etc.) plus the augmented A-MAPS version.

License: **CC BY-NC-SA 2.0 (France)** — a non-commercial French-jurisdiction variant. The same dataset is also covered by the A-MAPS augmentation paper (CC-BY 4.0) but that only covers the A-MAPS metadata, not the audio itself.

Long-standing AMT benchmark; many papers report results on MAPS so this gives a "comparison to literature" anchor. Limitation: **piano only** AND **CC BY-NC-SA 2.0 (France)** — the French NC-SA license is more restrictive than the international CC BY-NC-SA 4.0 (different jurisdiction, different terms). Flag for orchestrator if commercial shipping is on the roadmap.

2026-08-01 — Zenodo mirror verified, license page in the host confirms CC BY-NC-SA 2.0.

Eval set source

Bach Chorales (DCML corpus)

NC-flag

500 Bach chorales (4-part SATB) in TSV, MusicXML, Humdrum kern, and MuseScore formats. Includes notes, measures, chords, harmonic labels. The original Bach works are public domain; the encoding is the question.

License: **LICENCE CONFLICT — see Risks/Gaps.** The GitHub repo README says `CC0 1.0 Universal (CC0-1.0)`; the documentation page says `CC BY-NC-SA 4.0`. The DCMLab distant_listening_corpus (sibling repo) is CC BY-NC-SA 4.0, so the CC0 claim on the Bach chorales repo looks anomalous — possibly a copy-paste error from a generic README template, or possibly intentional for the chorales specifically. Need orchestrator decision before adopting.

Best-in-class symbolic ground truth: 500 SATB chorales with multiple annotation facets. The pipeline's music21 + Verovio stack is purpose-built for this kind of data. Limitation: **the audio is not provided** — these are symbolic scores only. You would need a separate synthesizer (or a YAMAHA Disklavier, in your dreams) to turn the MusicXML into audio. So this is a ground-truth source, not an audio+ground-truth source. Also the license discrepancy above.

2026-08-01 — both the dcmlab.github.io page and the GitHub README were fetched; the conflict is real.

Eval set source

music21 corpus

NC-flag

Built-in corpus shipped with `music21` (already in the pipeline's `trusted_packages.txt` stack). Includes the complete Bach chorales, many Haydn/Beethoven string quartets, three books of Monteverdi madrigals, thousands of folk songs (Essen, ABC). All encoded in MusicXML / Humdrum / MuseScore.

License: **Mixed, per composition** — music21's "Authors, Acknowledgments" page states: *"the music (if not the encodings) in the corpus are either out of copyright in the United States and/or are licensed for non-commercial use... Some encodings included in the corpus may not be used for commercial uses or have other restrictions."* No blanket license — you must check the per-work README in the corpus tree.

Zero install overhead (it's already in the project) and the works themselves are mostly PD (Bach chorales pre-1929; Beethoven quartets; etc.). Limitation: per-work license check is required; some encodings are NC. Also no audio.

2026-08-01 — music21 docs site reachable, licensing section quoted.

Eval set source

Lakh MIDI Dataset v0.1

CC-BY

176,581 unique MIDI files (LMD-full), 45,129 of which are matched to Million Song Dataset entries (LMD-matched). LMD-aligned is a 272 MB subset pre-aligned to MSD. Multi-instrument, multi-genre, no audio.

License: **CC-BY 4.0** (confirmed on Colin Raffel's project page and on the MusPy loader metadata: `_LICENSE = "Creative Commons Attribution 4.0 International License (CC-By 4.0)"`)

Massive scale — 176k files = essentially unlimited symbolic ground truth. The `lmd_aligned` subset is the practical entry point. Limitation: **no audio** — these are MIDI files only. To build an audio+ground-truth eval you'd need to synthesize (Slakh is exactly this — Slakh is the audio rendering of a subset of LMD). LMD-full contains corrupt files; the `_clean` subset is safer.

2026-08-01 — Colin Raffel project page and MusPy `lmd.py` source both confirm CC-BY 4.0.

Eval set source

Groove MIDI Dataset / E-GMD

CC-BY

GMD: 13.6 h / 1,150 MIDI files of human-played drum performances on a Roland TD-11 V-Drum, with synthesized audio. E-GMD: 444 h, 43 drum kits, on Roland TD-17.

License: **CC-BY 4.0** for both GMD and E-GMD (verified on both Magenta pages)

Best-in-class drum transcription ground truth. Use as the "drums" stratum of a multi-instrument eval (combine with Slakh stems for the harmonic content). Limitation: **drums only** — not a general multi-instrument source. The 22,000 drum measures in GMD give plenty of eval material; E-GMD's 444 h is overkill for a quarterly eval.

2026-08-01.

869,000+ scores, 94,000+ recordings, 27,000+ composers, 258,000+ works. The de-facto public-domain classical score library. Has MIDI for many works in the user-uploaded score collection.

License: **Mixed, per work.** Per-work license is shown on every score page. Generally: scores are public domain for composers who died before 1972 (Canada jurisdiction) / 1955 (EU) / 1975 (Taiwan); recordings have separate copyright and many are *not* PD. *For a non-PD score, IMSLP requires the copyright holder's permission before upload.* Site content is CC-BY 4.0 (re3data).

Vast and the works are PD where composers are pre-1929-dead, which is most of the standard classical repertoire. Limitation: license check is per-page; *recordings* on IMSLP are NOT generally PD; for AMT you really want the recording, not just the score. So IMSLP is best used as a score-side resource to pair with separately-sourced audio.

2026-08-01 — IMSLP main page and "Copyright Made Simple" page both fetched; ruleset confirmed.

Eval set source

Dagstuhl ChoirSet

NC-flag

108 multitrack choral pieces with aligned audio, F0, beats, and notes. 4-part (SATB) and 8-part arrangements. Synthesized via a singing-voice synthesizer, not real human singers.

License: **CC-BY 4.0** (per mirdata 1.0.0 quick reference, which fetches from the dataset's own Zenodo record)

Choral, not general "multi-instrument" — but a great match if the pipeline ever extends to vocal ensemble. Limitation: synthesized audio; not a true cross-genre test.

2026-08-01 — mirdata quick-reference fetched and cross-checked.

Eval set source

Aria-MIDI

NC-flag

1,186,253 MIDI files, ~100,629 h, derived from audio via AMT (Lakh is one input). Largest MIDI collection to date.

License: Per the arXiv paper (Bradshaw et al., 2025) and the GitHub repo, Aria-MIDI itself is **research use; check repo LICENSE for redistribution rights**. The arXiv paper says over 1 million distinct MIDI files totaling ~100,000 hours of transcribed audio.

Scale is unmatched. Limitation: derived from AMT, so the MIDI is itself the output of a transcription model — using AMT-derived MIDI as AMT ground truth is somewhat circular; you'd be measuring transcription-vs-transcription rather than transcription-vs-human. License is less clear than CC-BY; need orchestrator sign-off.

2026-08-01 — arXiv abstract and GitHub repo both fetched.

Eval set (50-100 pieces)

Multi-Instrument Eval Set Sources

Eval set source

MusicNet — same as 1.1

CC-BY

330 pieces, each with aligned audio + reference MIDI (in `musicnet_midis.tar.gz`) + per-note CSV labels. CSV-to-MusicXML conversion is mechanical.

License: **CC-BY 4.0**

330 pieces is comfortably above the 50-100 floor. Reference MIDIs are directly downloadable (2.6 MB tarball) and come from Classical Archives, Suzumidi, and HarfeSoft. Limitation: CC-BY (attribution required in any output render).

2026-08-01.

Eval set source

MAESTRO v3.0.0

NC-flag

1,276 piano performances, ~200 h, captured on Yamaha Disklaviers during the International Piano-e-Competition. Audio (44.1-48 kHz 16-bit PCM stereo) + MIDI with ~3 ms alignment. Train/val/test split built in.

License: **CC BY-NC-SA 4.0** (verified on the Magenta page's "License" section)

Gold-standard for piano transcription. The MIDI is exactly what the Disklavier played (so it's true performance MIDI, not synthesized). The built-in splits keep the same composition out of multiple subsets. Limitation: **piano only** — not multi-instrument. Use as the piano-stratum of a multi-instrument eval, not as a multi-instrument eval by itself. Also **CC BY-NC-SA 4.0** — non-commercial share-alike. If the pipeline ships a commercial product, this dataset cannot be used as a holdout benchmark. (NC clause flagged for orchestrator.)

2026-08-01 — Magenta page reachable, SHA256 checksums published.

CC-BY

2100 multi-track pieces, each with mixture + stems + MIDI per stem. Each MIDI is the input to the synthesizer, so it is exact ground truth.

License: **CC-BY 4.0**

2100 pieces is 20-40× the 50-100 floor. Multi-instrument (every mix has at least piano/guitar/drums/bass; median track has 4-8 sources). Limitation: known duplicate-MIDI issue — the Zenodo "redux" version moves duplicates to an `omitted/` directory; the `omitted/` tracks must NOT be used for transcription evaluation per the dataset's own guidance.

2026-08-01.

Eval set source

CocoChorales Dataset

CC-BY

240,000 synthesized chamber-ensemble pieces (~1,411 h of audio), performed by 13 instruments (violin, viola, cello, double bass, flute, oboe, clarinet, bassoon, saxophone, trumpet, french horn, trombone, tuba) across 4 ensemble types (string, brass, woodwind, random). Each example: mixture audio + per-source audio + aligned MIDI + multi-f0 + per-note expression (vibrato, loudness, brightness). "Tiny" subset is 24k train / 8k val / 8k test.

License: **CC-BY 4.0** (verified on the Magenta page)

This is the largest multi-instrument AMT benchmark in existence. MIDI ground truth is exact (synthesizer input). "Tiny" subset is reasonable for quarterly eval. Limitation: 2.9 TB full / 4 TB uncompressed — you almost certainly want the tiny version. Synthesized, so it does not exercise real performance noise. CC-BY is permissive.

2026-08-01 — Magenta page and the GitHub data_download shell scripts both confirm CC-BY 4.0 and 2.9 TB / 569 GB main sizes.

Eval set source

URMP — same as 1.2

CC-BY

44 multi-instrument pieces with MIDI scores + per-instrument audio + assembled mix + video.

License: **CC-BY 4.0**

Below the 50-100 floor (44 < 50), but the pieces are real human performances (not synthesized) and include score-engraved PDFs as well as MIDI. Suitable as a "real performance" supplement to a larger synthesized set. Limitation: 44 pieces is the entire dataset, and pieces are reused in the literature; you should be aware of evaluation contamination if the pipeline trains on URMP.

2026-08-01.

Eval set source

MAPS Database

NC-flag

~30 GB of synthesized piano audio (Disklavier + synth), ~30 h, with ground-truth MIDI for every audio file. Seven subsets (AkPnBcht, AkPnBsdf, etc.) plus the augmented A-MAPS version.

License: **CC BY-NC-SA 2.0 (France)** — a non-commercial French-jurisdiction variant. The same dataset is also covered by the A-MAPS augmentation paper (CC-BY 4.0) but that only covers the A-MAPS metadata, not the audio itself.

Long-standing AMT benchmark; many papers report results on MAPS so this gives a "comparison to literature" anchor. Limitation: **piano only** AND **CC BY-NC-SA 2.0 (France)** — the French NC-SA license is more restrictive than the international CC BY-NC-SA 4.0 (different jurisdiction, different terms). Flag for orchestrator if commercial shipping is on the roadmap.

2026-08-01 — Zenodo mirror verified, license page in the host confirms CC BY-NC-SA 2.0.

Eval set source

Bach Chorales (DCML corpus)

NC-flag

500 Bach chorales (4-part SATB) in TSV, MusicXML, Humdrum kern, and MuseScore formats. Includes notes, measures, chords, harmonic labels. The original Bach works are public domain; the encoding is the question.

License: **LICENCE CONFLICT — see Risks/Gaps.** The GitHub repo README says `CC0 1.0 Universal (CC0-1.0)`; the documentation page says `CC BY-NC-SA 4.0`. The DCMLab distant_listening_corpus (sibling repo) is CC BY-NC-SA 4.0, so the CC0 claim on the Bach chorales repo looks anomalous — possibly a copy-paste error from a generic README template, or possibly intentional for the chorales specifically. Need orchestrator decision before adopting.

Best-in-class symbolic ground truth: 500 SATB chorales with multiple annotation facets. The pipeline's music21 + Verovio stack is purpose-built for this kind of data. Limitation: **the audio is not provided** — these are symbolic scores only. You would need a separate synthesizer (or a YAMAHA Disklavier, in your dreams) to turn the MusicXML into audio. So this is a ground-truth source, not an audio+ground-truth source. Also the license discrepancy above.

2026-08-01 — both the dcmlab.github.io page and the GitHub README were fetched; the conflict is real.

Eval set source

music21 corpus

NC-flag

Built-in corpus shipped with `music21` (already in the pipeline's `trusted_packages.txt` stack). Includes the complete Bach chorales, many Haydn/Beethoven string quartets, three books of Monteverdi madrigals, thousands of folk songs (Essen, ABC). All encoded in MusicXML / Humdrum / MuseScore.

License: **Mixed, per composition** — music21's "Authors, Acknowledgments" page states: *"the music (if not the encodings) in the corpus are either out of copyright in the United States and/or are licensed for non-commercial use... Some encodings included in the corpus may not be used for commercial uses or have other restrictions."* No blanket license — you must check the per-work README in the corpus tree.

Zero install overhead (it's already in the project) and the works themselves are mostly PD (Bach chorales pre-1929; Beethoven quartets; etc.). Limitation: per-work license check is required; some encodings are NC. Also no audio.

2026-08-01 — music21 docs site reachable, licensing section quoted.

Eval set source

Lakh MIDI Dataset v0.1

CC-BY

176,581 unique MIDI files (LMD-full), 45,129 of which are matched to Million Song Dataset entries (LMD-matched). LMD-aligned is a 272 MB subset pre-aligned to MSD. Multi-instrument, multi-genre, no audio.

License: **CC-BY 4.0** (confirmed on Colin Raffel's project page and on the MusPy loader metadata: `_LICENSE = "Creative Commons Attribution 4.0 International License (CC-By 4.0)"`)

Massive scale — 176k files = essentially unlimited symbolic ground truth. The `lmd_aligned` subset is the practical entry point. Limitation: **no audio** — these are MIDI files only. To build an audio+ground-truth eval you'd need to synthesize (Slakh is exactly this — Slakh is the audio rendering of a subset of LMD). LMD-full contains corrupt files; the `_clean` subset is safer.

2026-08-01 — Colin Raffel project page and MusPy `lmd.py` source both confirm CC-BY 4.0.

Eval set source

Groove MIDI Dataset / E-GMD

CC-BY

GMD: 13.6 h / 1,150 MIDI files of human-played drum performances on a Roland TD-11 V-Drum, with synthesized audio. E-GMD: 444 h, 43 drum kits, on Roland TD-17.

License: **CC-BY 4.0** for both GMD and E-GMD (verified on both Magenta pages)

Best-in-class drum transcription ground truth. Use as the "drums" stratum of a multi-instrument eval (combine with Slakh stems for the harmonic content). Limitation: **drums only** — not a general multi-instrument source. The 22,000 drum measures in GMD give plenty of eval material; E-GMD's 444 h is overkill for a quarterly eval.

2026-08-01.

869,000+ scores, 94,000+ recordings, 27,000+ composers, 258,000+ works. The de-facto public-domain classical score library. Has MIDI for many works in the user-uploaded score collection.

License: **Mixed, per work.** Per-work license is shown on every score page. Generally: scores are public domain for composers who died before 1972 (Canada jurisdiction) / 1955 (EU) / 1975 (Taiwan); recordings have separate copyright and many are *not* PD. *For a non-PD score, IMSLP requires the copyright holder's permission before upload.* Site content is CC-BY 4.0 (re3data).

Vast and the works are PD where composers are pre-1929-dead, which is most of the standard classical repertoire. Limitation: license check is per-page; *recordings* on IMSLP are NOT generally PD; for AMT you really want the recording, not just the score. So IMSLP is best used as a score-side resource to pair with separately-sourced audio.

2026-08-01 — IMSLP main page and "Copyright Made Simple" page both fetched; ruleset confirmed.

Eval set source

Dagstuhl ChoirSet

NC-flag

108 multitrack choral pieces with aligned audio, F0, beats, and notes. 4-part (SATB) and 8-part arrangements. Synthesized via a singing-voice synthesizer, not real human singers.

License: **CC-BY 4.0** (per mirdata 1.0.0 quick reference, which fetches from the dataset's own Zenodo record)

Choral, not general "multi-instrument" — but a great match if the pipeline ever extends to vocal ensemble. Limitation: synthesized audio; not a true cross-genre test.

2026-08-01 — mirdata quick-reference fetched and cross-checked.

Eval set source

Aria-MIDI

NC-flag

1,186,253 MIDI files, ~100,629 h, derived from audio via AMT (Lakh is one input). Largest MIDI collection to date.

License: Per the arXiv paper (Bradshaw et al., 2025) and the GitHub repo, Aria-MIDI itself is **research use; check repo LICENSE for redistribution rights**. The arXiv paper says over 1 million distinct MIDI files totaling ~100,000 hours of transcribed audio.

Scale is unmatched. Limitation: derived from AMT, so the MIDI is itself the output of a transcription model — using AMT-derived MIDI as AMT ground truth is somewhat circular; you'd be measuring transcription-vs-transcription rather than transcription-vs-human. License is less clear than CC-BY; need orchestrator sign-off.

2026-08-01 — arXiv abstract and GitHub repo both fetched.

Risks & Gaps

License + integrity flags

1. **DCMLab Bach Chorales license conflict (HIGH).** The `DCMLab/bach_chorales` GitHub README says `CC0 1.0 Universal` but the project's own documentation site says `CC BY-NC-SA 4.0`. This needs human resolution before adoption; do not assume CC0 from the README alone. Cross-checking the sibling `distant_listening_corpus` repo (CC BY-NC-SA 4.0) suggests CC0 on the chorales repo is likely a README template error, but the team should confirm. The Bach works themselves are PD, so the issue is the encoding, not the underlying music.

2. **MAESTRO is CC BY-NC-SA 4.0 (NC clause).** Cannot be used as a published eval set if the pipeline or its outputs are commercial. The non-commercial share-alike clause is also sticky. Recommendation: use MAESTRO for internal R&D only, not as a quarterly-eval holdout.

3. **MAPS license is the French 2.0 variant of BY-NC-SA (CC BY-NC-SA 2.0 FR).** The French-jurisdiction CC variant differs in legal detail from the international 4.0. Same NC concern as MAESTRO.

4. **Freesound per-clip license must be re-checked on every download.** A previous "CC0" result does not guarantee the next result is CC0. The CI must filter by license field at fetch time, not at request time. There is no bulk CSV of "all CC0 sounds" — you have to query the API with `license:"Creative Commons 0"`.

5. **Musopen has a 5-downloads/day throttle for free users.** CI automation either needs a paid seat ($55/yr) or a pre-staged local cache. Alternative: use the Internet Archive's "Musopen Lossless DVD" mirror, which is `Public Domain Mark 1.0` on the archive item itself.

6. **Aria-MIDI license is not clearly CC.** The arXiv paper is the primary source; the GitHub repo's LICENSE file is what governs redistribution. Flag for orchestrator.

7. **Slakh2100 has documented MIDI duplicates across train/test/val in the *original* release.** The Zenodo "redux" version moves them to an `omitted/` directory. **The `omitted/` directory must NOT be used as eval data** — the dataset's own documentation says so explicitly.

8. **MusicNet labels are ~4% inaccurate** (per the dataset paper). This is a baseline noise floor; any eval that tries to micro-benchmark transcription accuracy below ~4% will be measuring label noise rather than model improvement.

9. **CocoChorales is 2.9 TB.** The "tiny" subset (24k train + 8k val + 8k test) is the only practical entry point. Full download is not realistic for a quarterly budget; the 569 GB main_dataset is the floor if you want full coverage.

10. **The orchestrator should confirm commercial-use posture before adopting this report.** Almost every recommendation here is CC-BY or CC0, which is fine, but two sources (MAESTRO, MAPS) are CC BY-NC-SA and would be disqualified under a commercial-use constraint. The pipeline AGENTS.md does not currently state a commercial-use policy.

11. **No candidate offers a *single* dataset that is CC0, multi-instrument, audio + MIDI/MusicXML, and ≥100 pieces.** Slakh2100 is closest (CC-BY 4.0, audio + MIDI, 2,100 pieces) but is CC-BY not CC0, and is synthesized. CC0 + audio + multi-instrument + MIDI is not currently available in any dataset the survey turned up. Worth flagging in the foundation report.

---