Stage 1
Demucs
Source Separation
Split mixed audio into vocal, drums, bass, and other stems via Meta's hybrid Transformer.
—
Hub
02 / Weekly
AMT × LLM/Agent/Foundation Model
This week's most relevant papers combining Automatic Music Transcription with LLMs, agents, or foundation models. Clickable arXiv links, code repos, and a Copy Prompt button to re-run the agent.
03 / Monthly
Core repos + agent frameworks
Recent activity across Demucs, Basic Pitch, MT3, music21, LangGraph, crewAI. Stars, latest releases, breaking changes. 1 repo gone (omnizart) and 1 dormant (basic-pitch).
04 / Foundation
Test audio + eval sets
CC-licensed test excerpts (30-second) and eval sets (50-100 pieces) for the pipeline. License verification on every source — NC flags called out.
All Reports
Every URL aggregated
Every clickable link from every report, in one searchable page. Filter by title, source, or URL. Handy when you want to drop a batch into your browser tabs.
Tool
Audio → notes → arrangement
Upload a solo instrument audio (or use a built-in sample) and the browser does monophonic pitch detection. Generates a multi-instrument description (key, range, suggested arrangement) from the detected notes.
App
Audio → notes → notation → MIDI
Full AMT standalone: drop audio or hold a mic, get FFT+HPS pitch detection, VexFlow notation, piano roll, and exports to SVG / PDF / MIDI / MusicXML / WAV segments. Dark + light theme.
Tool · audio sweep
iPad + Mac + Mac mini, wired in 60 s
Two tools in one: the audio-production resource cards (Ableton Link, RTP-MIDI, BlackHole, AudioGridder, AUM, REW + ResoScan) and a Session Configurator that turns your devices, DAW, iOS apps, and audio interface into six copy-pasteable setup blocks — sync config, audio routing, MIDI routing, OSC mapping, latency budget, and dual-destination recording. Vanilla JS, copy buttons.
Tool · cycle-5
Cycle-4 AMT + cycle-5 publishing
Two tools in one page. Part A: the cycle-4 AMT resource cards (ACE-Step v1.5, Libretto, Rubato, Stable Audio 3.0, V2N) with cycle-3 winners carried forward. Part B: a Long Horizon Prompt generator — type a creative idea, get nine production-ready prompts: horizontal / vertical / square video, audio, music, social post, plus three new publishing outputs (lead sheet, engraving spec, MEI prep). Vanilla JS, copy buttons on every output.
Tool · stage 2.5
MIDI → expressive audio · 4 timbres
Stage 2.5 of the pipeline. Take a melody (text or built-in tune), pick one of the four MIDI-DDSP pretrained timbres (violin / flute / sax / trumpet, Apache 2.0), dial in the expression, hit Play — the browser uses the Web Audio API to synthesise it locally and plays through your speakers. Export WAV downloads the rendered audio. No fetch, no model download, no API. The real MIDI-DDSP neural synth path lives in setup/ddsp_transfer.py.
Project
Built by the music-transcription-monitor swarm. Each report has a Copy full prompt button — paste it into the agent to re-run the same sweep on a different date. Cycle-5 added Stage 2.5 — MIDI-DDSP timbre transfer (Apache 2.0, 4 instruments: violin / flute / sax / trumpet) with a browser preview + the real TensorFlow path in setup/ddsp_transfer.py. Cycle-5 also expanded the demo with three new publishing outputs (lead sheet, engraving spec, MEI prep) — total prompts 6 → 9 — and added a RESOURCES delta + INTEGRATION delta covering Sheet Sage, VeeHarmGen, BACHI, Verovio 6.0, LilyPond, OpenSheetMusicDisplay, Django-Music-Publisher, musicmetadata/cwr2, DiffRhythm 2, and the rest of the personal-publishing pipeline. Cycle-4 (ACE-Step / Libretto / Rubato / Stable Audio 3.0 / V2N) and the audio sweep (Ableton Link / RTP-MIDI / BlackHole / AudioGridder) carried forward unchanged.
To regenerate after the next swarm cycle, run python3 setup/build_dashboard.py.
01 / Pipeline
Stage 1
Source Separation
Split mixed audio into vocal, drums, bass, and other stems via Meta's hybrid Transformer.
Stage 2
Audio → MIDI
Spotify's lightweight CNN+GRU transcriber emits note events and pitch contours.
Stage 3
Cleanup & Analysis
Python toolkit for quantization, key detection, voice leading, and MusicXML round-trip.
Stage 4
Engraving
Render the cleaned score to SVG / PNG with MEI notation and per-system layout.
assets/test_audio/. License: CC BY-NC-SA 3.0 (research only — verify before commercial).