All projects

Open source

Tabscribe

Turns sheet music, MIDI, and audio into guitar tabs, offline, in your browser.

Problem, approach, result

Problem

I play guitar in a jazz band, and most of what I want to learn exists as a lead sheet, a MIDI file, or a recording. Not as tab. The tab sites stop at popular songs, and the transcriptions that do exist are often wrong. I wanted to hand over whatever file I had and get a tab I could edit, without uploading my music anywhere.

Approach

Every importer produces the same score model, and everything downstream reads from it: the tab engine, chord detection, the renderer, the player, and the exporters. The tab engine picks a string and fret for each note with the least hand movement, in standard tuning or any other.

Sheet music is the hard case. The optical music recognition is my own: it binarizes the page, finds the staves, strips the lines, finds the noteheads, and maps each one to a pitch. Anything it isn't sure about shows in amber next to the original page, so you can fix it in a few clicks. To stop guessing at how good it was, I built a benchmark of 14 public-domain scores with ground truth, so every change to the recognizer gets measured.

Result

One day of work against that benchmark took pitch accuracy on clean printed scores from 26% to 66%, and chord symbols on clean lead sheets now read at 97%. Degraded scans are still rough, at 25%, and that's the next thing to work on. The whole app is one static site that works offline, and your files never leave the browser.

66%up from 26%

Pitch accuracy (F1) on clean scans, averaged across the 14-piece benchmark.

Tabscribe showing a scanned page of Greensleeves on the right and the recognized guitar tab with chord names on the left
A scanned lead sheet in, tab with chord names out. The original page stays beside the tab so you can check it.
Tabscribe showing a short melody as guitar tab with rhythm stems, and the same melody in standard notation below it
The same tune from a notation file, with the standard notation view open underneath.

Notes in, tab out

Each note on the left lands on a string and fret on the right. A scripted demo of the idea. The real app does this from your files.

MIDI in
Tab out

Standard tuning, lowest fret that fits. No audio.

Try it live

The real app, running right here. It works fully in your browser, so your files never leave your device.

The app needs room to work, so on a small screen it opens on its own page.

Open the app (opens in a new tab)

What it reads

Inputs Tabscribe accepts and what it does with them
InputFormatsHow
Sheet musicPDF, PNG, JPGIn-browser optical music recognition
MIDIMIDI filesRead straight into the editor
NotationMusicXML, ABCParsed into editable tab
Tab filesGuitar ProOpened for editing
AudioRecordingsPitch detection into notes

Then: chord names and diagrams, playback with sampled acoustic guitar, and export to MIDI, MusicXML, and ASCII tab. It works offline as a PWA.

How it's built

  • React
  • TypeScript
  • Vite
  • VexFlow
  • abcjs
  • @tonejs/midi
  • pitchy
  • tesseract.js

Editor shortcuts

Click a note, then use the keys. Notes the app is less sure about show in amber.

  • ClickSelect a note
  • ↑ ↓Change pitch
  • 0 to 9Set the fret
  • SMove to another string
  • LLock the fingering
  • Cmd / Ctrl + ZUndo