Having done a number of drum transcriptions so far, something I’ve been wanting to do for some time is to sync up a sheet music playthrough with the original audio of the performance in question. These kinds of videos have become pretty common within the last decade, such as on channels like Vic Firth’s:

These videos are invariably ambitious; most of the time, static screenshots of a PDF are added to a video, with one system of music visible at a time. Sometimes I see a simple playhead animation scrolling over the notes, but it never seems to be footage of notation software navigating a score synced up with some audio. I decided to give it a shot myself. How hard could it be?

I picked “Good Times Bad Times” as the test song since it was the first song I ever shared on the site, and it’s a pretty short song, so it couldn’t be too much of a headache.

The first task would be the biggest: getting a video of the sheet music from MuseScore. While Finale and Sibelius have “export as video” built-in, MuseScore does not. And according to this thread, there are no plans to implement such a feature. Anything is possible on a long enough timeframe, but considering that MuseScore has been around for over ten years and it still doesn’t have working double repeats, video export probably isn’t coming in hot.

The thread mentioned a convoluted workaround, which is really the story behind MuseScore’s shortcomings. The solution here is to upload your score to MuseScore.com, use your account to upload the score to YouTube, log into the proper YouTube account, and then download the video.

There’s a much better way, and that’s to simply use screen capture software. The next order of business was getting the capture to look good, and I quickly learned this would be no mean feat. Initially, I had to do some tweaking with the zoom level to keep parts of the score from getting chopped up:

Once that was sorted out, I started doing some recording, which led me to another problem. I must preface this by admitting that this is a bit more abstract… but see if you can spot the problem after watching this short video:

My issue is that, once things get going, the line of music that’s being played is always at the bottom of the screen, so it’s impossible to read ahead. To what extent this annoys other musicians is up for debate… but it sure annoyed me. I typically glance ahead when I navigate sheet music, although, for a transcription, the reader may just focus on what’s being played note-for-note.

In any case, I also felt like this was a waste of space since measures that have already been played are covering 75% of the screen.

A more refined approach was to switch the score to “Single Page” view, which lays out the sheet music in one giant, unending page. After some adjustments, I needed to figure out a way to smoothly scroll the page down during playback.

Unfortunately, I haven’t figured out how to do that yet, and I’m not sure I will. I didn't like that way of doing it manually, and while I tried to find out a way to scroll programmatically using something like Automator or Apple Scripts, I couldn’t crack it. MuseScore doesn’t let you scroll with the keyboard, so that’s not an option either.

For a moment, I thought I had a solution with a third approach: record one whole page at once and then use keyframes to basically move a mask downward:

It looks ok, but because of the zoom that’s needed, the notes look a bit fuzzy, even at 4K. Moreover, I would like it to keep scrolling down until the transcription ends, and with this approach, I would need to zoom out far enough to include all of the score in one shot, before zooming in a ridiculous amount in Final Cut:

That was a no-go.

Moreover, even when I got the scrolling to work in some capacity, the effect was a bit disorienting.

The fourth approach was to use Single Page View and do some editing to keep the lines being played in the center(ish) of the screen:

I only did the first 30 seconds of the tune because I couldn’t really find an efficient way to get it done for this method. In Single Page mode, MuseScore will put the next line of music into view, but that’s it — the software won’t move that system into the center of your screen. And ultimately the editing was way too time-consuming. Having to pause playback, reposition the score, and resume at every system is bad enough, but having to edit all that out?

And after all that work, I’m not sure I’m even happy with the result here, as the constant jumps are quite disorienting.

So at this point, I decided that an acceptable comprise would be to have four systems in view at a time. As you get towards the end of each group, your ability to read ahead does go down, but it gave me the best results so far. In addition, the groups of four make it easier to anticipate when the sheet music will jump around.

Better yet, I soon had an “ah-ha” moment: I could just cut the height of the pages in half, and make some tweaks so only four systems fit on a page. Once MuseScore gets to the end of a page, it jumps to the top of the next one, bringing the playhead is at the top of the screen again.

For those who lost count, this was method number five, and it was the approach I used to complete the project. I had to make a few edits to the score, and do a bit of cropping in Final Cut, but all in all, it wasn’t terribly tiresome.

Ostensibly, I could get any result I wanted if I was patient enough, but if I want to do a video like this for other transcriptions, I would need to keep the process fairly expedient. I can’t afford to invest 12 hours of tedious, pixel-perfect editing for each of these songs.

To conclude, the best balance of what I want and ease of creation is to cut the pages in half. Here is the final result:

One thing I have to say, this method does help out in allowing me to surreptitiously correct timing issues when the video jumps from one page to the next. ICWYW, I had to make about 9 edits to the video to keep it synced up. For the most part, Bonham was playing slightly behind the beat, unsurprisingly. If I did my job well then hopefully these edits are tough to spot.

For those who are familiar with MuseScore, you may be wondering if I messed around with another mode called “Continuous View” that extends the music to the right for on endless line. I did (so that’s six attempts in total), but I just didn’t dig the look of it; again, there’s a bit of wasted space for most of the screen. Moreover, I was having to deal with some weird formatting stuff, and MuseScore would also cut parts of measures off even as they were being played:

So for the umpteenth time, that wasn’t gonna work.

I may cook some more of these up in the future, but no promises. I think they’ll go right to YouTube; I don’t feel like making a blog post about each one. In the meantime, have a happy Fourth.