SheetVideo
New
SheetVideo / Guides / Automatic sync

Sync sheet music to your performance video - automatically

You played it with rubato, a ritardando and a held fermata. A click track would lose you by bar four. SheetVideo listens to the recording itself and puts every bar where you actually played it.

Runs in your browser · no account to start · a free account to export

Chopin, Prelude in C minor: the score placed by SheetVideo from the recording alone. Turn the sound on and watch the lit note land on the attack.

The way it is usually done
  1. Export the score as images, one per line or page
  2. Drop them on a video timeline over the performance
  3. Scrub through, find each line change by ear, cut there
  4. Redo half of it when the tempo drifts in the second verse

Or play along to a click so the score can scroll at a fixed tempo - and give up the rubato that made the take worth posting.

With SheetVideo
  1. Add the recording
  2. And the score
  3. It syncs by itself
  4. Check what it flagged

No tapping beats. No tempo guessing. No keyframes.

Step by step

How to do it, click by click

Every picture below is the real SheetVideo editor, with what to click ringed and numbered. The example is a recording of Chopin’s Nocturne in E-flat, Op. 9 No. 2.

  1. 1Make a video: pick My recording + the score

    Open SheetVideo and click New video. Make a video asks what you have to start with: My recording + the score, Just a score, or Just my recording. Each card shows the kind of video it makes. For your own performance with its sheet music or tab on it, pick the first one.

    The button on this page opens it already set up for this kind of video: the look, the instrument and the shape. Nothing is final: once your video is open, every one of them is a click away.

    Make a video: My recording + the score, Just a score and Just my recording, each with a small moving picture
  2. 2Add your recording and your score

    Click Choose next to Your recording and pick the video of your performance, or drop it on the box. A video works, upright or landscape (MP4, MOV, WebM), and so does just the sound (MP3, WAV, M4A). Talking, tuning or silence before the first note is fine: there is nothing to trim.

    Then the score you played from: a PDF, MIDI, MusicXML or Guitar Pro file. Both can go in at once, dropped together. Click Sync and make my video. Both files stay on your computer, nothing is uploaded, and there is no account to make first.

    Both files chosen, with Sync and make my video ringed
  3. 3Say what you can hear

    A score with one part - or a piano’s two hands, which count as one - goes straight on. This MIDI has a second part, Music Box, that only doubles the piano, so the Music panel asks what you can hear in the recording, with the likely parts ticked.

    Tick the parts that stand out most in the recording: the more clearly they can be heard, the more precise the sync. Here that is the piano alone. Click Sync to Grand Piano.

    What can you hear in the recording?, with the piano ticked and Sync to Grand Piano ringed
  4. 4It syncs by itself

    There is no button to press. SheetVideo listens to the recording and matches the score to how you actually played it, rubato and all: the score on top, your recording below, lining up as it goes.

    A few seconds for a short clip, up to a minute for a long take; the four-and-a-half-minute Nocturne takes well under a minute. Everything happens on your computer.

    SheetVideo matching the score to the recording, the score above and the recording below
  5. 5Your video, made

    When the sync is done the picture is your video, exactly as it will export. Press play to watch the notes light up as they are played.

    Down the left is the rail: Music, Sync, Sheet, Instrument, Text, Background and Export, with Lesson and Brand at its foot. Each opens a panel beside the video, and every change shows on it at once. The Music panel says how the sync went, and whether any bars are worth a listen; the steps below go through the others one by one.

    On your very first video SheetVideo takes a shortcut: the Export panel opens by itself on Your video is ready, saying what was set up for it, so the first video is one click away. Every panel still works before you export, and after.

    The finished video in the editor, the Export panel open on Your video is ready
  6. 6Check the sync, if you want to

    The Sync panel says how the sync went and lists any bars it was less sure of, with their times. Checking them is optional; they are marked amber and red on the timeline under the video too.

    The review at the top takes them one at a time: Play the bar, and if the notes light up as you hear them, Sounds right moves on to the next. In the Nocturne they sit in the closing bars, where the cadenza is played very freely.

    The Sync panel, with the review and the bars worth a listen ringed
  7. 7A touch early or late?

    Under the review, Move where bar … starts shifts the bar you are on by 50 or 200 ms either way, and To playhead puts its start where the video is stopped. If the whole take feels early or late, More sync tools shifts all of it at once.

  8. 8Fix one bar by hand

    Stop on a bar that is off and click Fix sync here, under the video. Manual sync opens: the recording’s attacks across the top, the score’s notes underneath.

    Drag a note onto the attack it belongs to and only that stretch moves. Your fixes are kept if you ever sync again.

    Manual sync open under the video, the recording and the score’s notes lined up
  9. 9A lesson? Mark the parts you play

    Lesson is for a video where you talk between the playing, or play the same bars more than once, slowly and then up to speed. Find my lesson’s parts finds every part you play, at full speed or slowed down, and which bars of your score each one is, leaving the talking out. Or stop the video and click Add a section, then Start here and End here.

    Each section shows its bars, which you can change by number or pick by sight. Then each section is synced on its own, at the speed you played it, and the sheet music shows only while you play. A part you play that is not in your score can be marked No bars here. No sections keeps one sync for the whole video.

    The Lesson panel, with Find my lesson’s parts and Add a section ringed
In detail

What “in sync” means here

  • Median onset error under 5 ms, worst case 43 ms - under two frames at 30 fps
  • Tested on tempo warps from 0.6× to 1.75× the written tempo, with and without an opening rest
  • Follows rubato, ritardando, fermatas and meter changes without being told about them
  • The note under the playhead lights on its attack - the one you played, not the one a metronome expected
  • Every bar laid out on the video’s own timeline, so you can see the tempo curve and nudge any bar by hand

How the sync works, and how close it lands on sixteen real piano recordings →

Questions

Try it on one of your own takes

Free in your browser, export included - up to 60 seconds a video, with a small mark. Pro exports the whole take without it.