Hub

Pick a report or tool

02 / Weekly

arXiv Report

AMT × LLM/Agent/Foundation Model

10 papers

This week's most relevant papers combining Automatic Music Transcription with LLMs, agents, or foundation models. Clickable arXiv links, code repos, and a Copy Prompt button to re-run the agent.

Hot take MuScriptor
Open arXiv report

03 / Monthly

GitHub Pulse

Core repos + agent frameworks

1 watch

Recent activity across Demucs, Basic Pitch, MT3, music21, LangGraph, crewAI. Stars, latest releases, breaking changes. 1 repo gone (omnizart) and 1 dormant (basic-pitch).

Status 8/8 attempted
Open GitHub report

04 / Foundation

Asset Research

Test audio + eval sets

21 sources

CC-licensed test excerpts (30-second) and eval sets (50-100 pieces) for the pipeline. License verification on every source — NC flags called out.

Recommended MusicNet + Slakh2100
Open Assets report

All Reports

Total Links

Every URL aggregated

28 links

Every clickable link from every report, in one searchable page. Filter by title, source, or URL. Handy when you want to drop a batch into your browser tabs.

Filterable Yes
Open Links page

Tool

Solo Transcription Tester

Audio → notes → arrangement

Browser

Upload a solo instrument audio (or use a built-in sample) and the browser does monophonic pitch detection. Generates a multi-instrument description (key, range, suggested arrangement) from the detected notes.

Engine Web Audio + ACF2+
Open Tester

App

Transcriber

Audio → notes → notation → MIDI

Standalone

Full AMT standalone: drop audio or hold a mic, get FFT+HPS pitch detection, VexFlow notation, piano roll, and exports to SVG / PDF / MIDI / MusicXML / WAV segments. Dark + light theme.

Stack Web Audio · VexFlow · FFT
Open Transcriber

Tool · audio sweep

Multi-Device Audio Configurator

iPad + Mac + Mac mini, wired in 60 s

No server

Two tools in one: the audio-production resource cards (Ableton Link, RTP-MIDI, BlackHole, AudioGridder, AUM, REW + ResoScan) and a Session Configurator that turns your devices, DAW, iOS apps, and audio interface into six copy-pasteable setup blocks — sync config, audio routing, MIDI routing, OSC mapping, latency budget, and dual-destination recording. Vanilla JS, copy buttons.

Outputs 6 setup blocks
Open audio demo

Tool · cycle-5

AMT Demo + Long Horizon Prompt

Cycle-4 AMT + cycle-5 publishing

No server

Two tools in one page. Part A: the cycle-4 AMT resource cards (ACE-Step v1.5, Libretto, Rubato, Stable Audio 3.0, V2N) with cycle-3 winners carried forward. Part B: a Long Horizon Prompt generator — type a creative idea, get nine production-ready prompts: horizontal / vertical / square video, audio, music, social post, plus three new publishing outputs (lead sheet, engraving spec, MEI prep). Vanilla JS, copy buttons on every output.

Outputs 9 formats
Open demo

Tool · stage 2.5

MIDI-DDSP Timbre Transfer

MIDI → expressive audio · 4 timbres

No server

Stage 2.5 of the pipeline. Take a melody (text or built-in tune), pick one of the four MIDI-DDSP pretrained timbres (violin / flute / sax / trumpet, Apache 2.0), dial in the expression, hit Play — the browser uses the Web Audio API to synthesise it locally and plays through your speakers. Export WAV downloads the rendered audio. No fetch, no model download, no API. The real MIDI-DDSP neural synth path lives in setup/ddsp_transfer.py.

Stage 2.5 timbre
Open ddsp demo

Project

About this dashboard

Built by the music-transcription-monitor swarm. Each report has a Copy full prompt button — paste it into the agent to re-run the same sweep on a different date. Cycle-5 added Stage 2.5 — MIDI-DDSP timbre transfer (Apache 2.0, 4 instruments: violin / flute / sax / trumpet) with a browser preview + the real TensorFlow path in setup/ddsp_transfer.py. Cycle-5 also expanded the demo with three new publishing outputs (lead sheet, engraving spec, MEI prep) — total prompts 6 → 9 — and added a RESOURCES delta + INTEGRATION delta covering Sheet Sage, VeeHarmGen, BACHI, Verovio 6.0, LilyPond, OpenSheetMusicDisplay, Django-Music-Publisher, musicmetadata/cwr2, DiffRhythm 2, and the rest of the personal-publishing pipeline. Cycle-4 (ACE-Step / Libretto / Rubato / Stable Audio 3.0 / V2N) and the audio sweep (Ableton Link / RTP-MIDI / BlackHole / AudioGridder) carried forward unchanged.

To regenerate after the next swarm cycle, run python3 setup/build_dashboard.py.

Status v0.2 · interactive

01 / Pipeline

Pipeline Stages

Stage 1

Demucs

Source Separation

Not run

Split mixed audio into vocal, drums, bass, and other stems via Meta's hybrid Transformer.

Last run —

Stage 2

Basic Pitch

Audio → MIDI

Not run

Spotify's lightweight CNN+GRU transcriber emits note events and pitch contours.

Last run —

Stage 3

music21

Cleanup & Analysis

Not run

Python toolkit for quantization, key detection, voice leading, and MusicXML round-trip.

Last run —

Stage 4

MuseScore / Verovio

Engraving

Not run

Render the cleaned score to SVG / PNG with MEI notation and per-system layout.

Last run —

📋 Next Actions (cycle-5)

  • 1 Test the cycle-5 publishing demo — open demo/, scroll to Part B, click "Generate all formats" (auto-fires on load). Verify all 9 output cards populate: the 6 originals (horizontal/vertical/square video, audio, music, social) plus the 3 new publishing outputs (lead sheet, engraving spec, MEI prep). Click "Copy all 9" to test the bundle.
  • 2 Decide on the cycle-5 publishing stack — RESOURCES-cycle-5.md surfaces 13 new tools. The recommended "personal publishing company" stack is Sheet Sage + VeeHarmGen + music21 + LilyPond + OSMD + DMP + cwr2. License posture: GPL (LilyPond) + BSD-3 (OSMD) + MIT (DMP, cwr2) + CC BY-NC-SA 3.0 (Sheet Sage) — swap Sheet Sage for Basic Pitch if commercial.
  • 3 Run the 2025 AMT Challenge leaderboard (arXiv:2603.27528) — unchanged from cycle-4. MIROS = #1 (F1 0.5998), Basic Pitch = #14 (F1 0.0634). The canonical 2026 AMT benchmark.
  • 4 Download one MusicNet 30s clip + run through Sheet Sage — sheet-sage is the cycle-5 lead-sheet centerpiece (audio → melody + chords → LilyPond → PDF). Pairs with the existing MusicNet asset in assets/test_audio/. License: CC BY-NC-SA 3.0 (research only — verify before commercial).