Today I’m at the Music Encoding Conference in Mainz, Germany, where I am giving a presentation on the work I have been doing over the past several months on music fonts for our new application. There are two major components to the work: firstly, a proposed new standard for how musical symbols should be laid out in a font, which I have called the Standard Music Font Layout (SMuFL to its friends, pronounced with a long “u”, so something like “smoofle”); and secondly, a new music font, called Bravura. Read on for more details.
We’re now a few days into April and our team has been working for Steinberg for five months (we started work on 5 November last year, which happened to be my birthday). Although I can’t share lots of details about what we’re working on, perhaps a few details of what we’ve been up to will be intriguing enough to be interesting.
With the exception of a visit to Hamburg to get to know some of our new colleagues in the middle of the month, for the rest of November we sat together in our temporary office with our notebooks on our laps, having a series of discussions about different functional areas of our future scoring program, essentially a big brain dump of the requirements we could remember from our days working on that other famous scoring program, and ideas we have about how we could improve each area.
Some really good ideas came out of those discussions, and indeed by the end of the month we had already settled on the basic conceptual model for how our new program would think about music, and how we could design the program in such a way that it would provide greater flexibility and freedom to composers and arrangers than other scoring programs.
Once all of us had filled our notebooks, we started transferring our notes to the internal wiki, fleshing them out and categorising them. By the end of the month, we had a pretty good high-level list of requirements, spanning more than 60 different functional areas. With all of these notes now safely transferred to our collective outboard brain, we were free to move on to the next challenge.
Having spent a whole month with the whole dirty dozen of us sitting together every day, we now started to divide and conquer: the testing team started generating test data (in MusicXML) based on the requirements we had discussed to date; the programmers started sketching architecture ideas on whiteboards; and my partner in crime Anthony (@anthughes) and I started discussing how we would start designing the user interaction and design of the program.
We also started going out to meet with music professionals and publishers. I was invited to attend a meeting of the Music Writers’ Committee at the Musicians’ Union, which led to our group discussion and brainstorming session a couple of months later, and along with Anthony and James (one of our wonderful programmers) we went out to meet with the editorial and engraving staff at Peters Edition and Boosey & Hawkes.
Anthony and I also went up to Amersham to meet with Bev Wilson, a very experienced engraver who worked for nearly thirty years for Halstan, which until the 1990s was one of the busiest music engraving houses in the UK. Halstan’s approach – which they called The Halstan Process – was unusual in as much as it was based on photographic reproduction of over-sized positive originals, produced by brushing ink (from a water-soluble ink block) through metal stencils onto white paper. For large-scale orchestral or band scores, engravers would sometimes have to work with the top of the page flipped up, over their heads and behind them to avoid it trailing on the floor in front of their desks! You can see and hear Bev talking about The Halstan Process in this video, produced for the Open University:
We were very interested to talk with Bev because we wanted to examine music engraving from first principles, not assuming that we knew how music spacing should be done just because we had previously worked on another scoring program. These days, Bev still works freelance as an engraver, mostly on choral music for Oxford University Press, though of course now he brings his experience to bear on his work using Sibelius rather than ink and stencils.
In the New Year, I started drafting the design for our application’s default music font. In keeping with our general approach to look further back than the computer engraving of the past 25 years or so, and to examine what was done before even music typewriters and other such short-lived technologies challenged the way that music had been prepared for publication for the preceding 200 years, I canvassed some experienced musicians to determine which scores from particular publishers in particular eras they especially liked the look of. Some of the more experienced engravers remembered the dry transfer system Not-a-set, which was used for a couple of decades after traditional engraving was deemed to have got too expensive and before computer engraving was capable of producing acceptable results.
Not-a-set was based on a set of engraving punches used by Schott, in turn based on the punches used by Breitkopf & Härtel, the world’s oldest music publishing house. Not-a-set would serve as an excellent starting point for a new music font, because the symbols are printed on the dry transfer sheets unencumbered by staff lines, so you can really examine the shapes of the symbols very closely in order to draw them in a vector drawing or font program.
Getting hold of Not-a-set wasn’t easy, since it hasn’t been used by anybody in anger for more than 20 years, but thanks to the generosity of Bev Wilson in the UK and Peter Simcich in the US, I was able to scrape together enough examples to be able to produce digital versions of the majority of the basic symbols.
When compared with, say, Opus, the look is more substantial, and in general the music appears a little bolder and blacker on the page, which aids legibility when reading at a distance.
Anthony, James and I also continued visiting music publishers, including a meeting with Paul Tyas and Elaine Gould, author of the wonderful Behind Bars, at Faber Music, and I also had a couple of very productive meetings with professionals working in the field of musical theatre, to get a feel for the specific requirements of people working in that field.
As the winter months dragged on, we kept warm in our basement office by slaving over our hot keyboards. The testing team had by now generated dozens, if not hundreds, of test cases in MusicXML format, exporting them from other scoring programs and stripping out data that doesn’t serve our purpose via XSLT, in some cases having to hand-code specific details because the MusicXML exporters doesn’t handle them, or indeed the scoring program itself doesn’t handle them.
Meanwhile, the programmers had started to build the lowest levels of the musical brain of our new scoring application, including fundamental things like deciding how pitch and duration of notes will be stored. One of the programmers spent a couple of days building a simple piano roll event view able to display pitch and duration of notes – but still no actual music notation display at this point. The simple piano roll display and the low-level engine were lashed together into a test harness application, which could import certain primitive types of data (notes, but not even rests at this point) into the low-level model. The very first steps had been taken!
I carried on working on music font design, and soon discovered that I needed to take a step back and consider how the font itself would be set up. Over the course of several weeks, I surveyed many existing music fonts, the Unicode range for musical symbols, and the standard texts on music notation to try to create a categorised list of all of the symbols used in Conventional Music Notation (Donald Byrd’s term). Although this work is far from complete, I have now built a list of around 800 unique symbols, divided between nearly 60 different categories. I will write more about this mapping and how I hope it can become a new standard for people who want to design music fonts in future.
Anthony and I also spent considerable time locked away in the broom cupboard-style meeting room in our temporary office discussing further user interaction principles. Being able to think freely about how every aspect of the application will work without worrying about having to fit features into a mature application with well-established idioms for interaction is incredibly liberating, and I am confident that we are coming up with better, simpler and more efficient workflows for inputting and editing notes and other musical objects in your score.
At the very end of February, we left our temporary home near Kings Cross and moved to our new permanent home a couple of miles to the east, a short walk from Old Street station. We now have plenty of room to spread out and, hopefully, to grow our team in the future.
The burgeoning test harness for our new program’s musical brain is now able to display real musical notes! It’s only a single line of notes, only the rhythms are displayed rather than the actual pitches, and the spacing is crude, but as a demonstration of the next steps in the musical brain’s understanding of music it’s an exciting moment: from the fundamental way in which pitch and duration are stored we can now see notes of the correct duration that can reformat and reflow themselves as they are edited. Baby steps, but important ones.
Another important step was the first few functions in our application’s scripting API. At the moment we’re using Lua, since it is highly portable, small, fast and efficient, well-suited to embedding, and already used with great success in a number of high-profile applications (including Adobe Lightroom) and game engines (the middleware used by developers to handle 3D graphics, physics, game logic etc. in games for consoles and PCs). The hope is that we will be able to deliver a fully-featured scripting API that will allow users of our application to create sophisticated scripts that can add valuable functionality to our application. Early investigations of using the Koneki IDE to write and debug scripts running in our test harness applications are promising, which means that script developers should have a very comfortable development environment for writing scripts for our application.
To help our testing team verify that the musical brain is doing the right kinds of things when performing simple editing operations, we’ve also started work on exporting MusicXML files from our test harness. Data can now be imported into our test harness via MusicXML, and then exported again, making it possible to see what is happening to the music in another scoring application.
By the end of March, I had completed first drafts of all 800 or so musical symbols that will be included in our new music font, and once our application is capable of displaying more than simply note durations, I will be able to iterate those designs and get more and more of the font looking great.
And the next five months…?
It’s too early to guess what the state of our burgeoning application will be in another five months. We are taking our time over the fundamental design decisions because we want to make sure we build the most forward-looking, flexible system possible. I will keep you posted!
I was asked to answer the question, “Does music notation software have a considerable impact on musicians?” on Quora. Here’s my answer. (If you want to follow me on Quora, here I am.)
I’m certain that music notation software has had an impact on musicians in many fields, both on the creation side with composers, arrangers and publishers, and on the consumption side, with performers. This impact is both positive and negative, of course, just as with any other tool.
Nearly two weeks ago, on the morning of 13 February, the whole of the Steinberg scoring team decamped to the London headquarters of the Musicians’ Union, a short walk from the Oval cricket ground, for a meeting with members of the MU’s Music Writers’ Committee and a number of other professional musicians from around the city. The purpose of the meeting was to share our plans with a group of top professional musicians and to solicit their feedback on those plans, as well as to hear from them their hopes and wishes for our new project. Read on to find out about how it went.
Shortly after we launched our new blog on Wednesday this week, we became aware of the fact that the name “Keeping Score” is a registered trademark in the United States, and we have been asked to change the name of the blog.
The new name will be Making Notes, which is both a charming musical pun and also a reflection of the work that lies ahead of us, namely to build software that will, in turn, allow you to make notes yourself.
We’re sorry for any inconvenience caused by this change of name, and hope that you will continue to stay tuned for updates on the development of our new software.
As part of this change, we will also shut down the blog’s own Facebook page (since it uses the trademarked name), and ask that you will kindly like Steinberg’s official Facebook page, so that future posts will appear automatically in your timeline, along with news relating to Steinberg’s other software and hardware products.
Welcome to Making Notes! I’m Daniel Spreadbury, and you may remember me from other notation programs and other blogs, but I’m very happy to be starting something new here, and to chronicle the development of Steinberg’s new music notation and composition application.
Our mission is simple: to create a next-generation application that meets the needs of today’s composers, arrangers, engravers, copyists, publishers, teachers and students. We know we have a big mountain to climb: we’re starting work on a new professional-level application for Windows and Mac (and hopefully mobile devices later on) and looking to bring it into a crowded market that already has two very capable and mature competitors, not to mention an explosion of new products that exploit mobile devices and the web.
Despite the magnitude of the task ahead of us, I believe we can be successful because of three things: our experience, our vision, and because we have the support of a great company. The 12 of us who currently make up Steinberg’s scoring team have, between us, nearly 100 years’ combined experience in developing world-beating professional notation software. The core of this same team was responsible for developing six major versions of Sibelius, introducing hundreds of innovative features over the past 14 years.
It’s rare for an established development team to get the chance to develop a whole new application in the same area as their previous one, and we believe our combined experience gives us a unique perspective on how to design a new application that will overcome the limitations of existing programs, escaping the legacy of code that is 20-plus years old. (Of course there are dangers inherent in starting again from scratch, but since we don’t have any code of our own to use, we have no choice in any case.)
We have a vision for a flexible, powerful music notation application that is equal to the task of notating today’s most challenging art music and capable of producing graphical results of the highest quality, while providing an environment for composing and arranging that is as close as possible to the simplicity of writing music with pencil and paper, or improvising at your instrument. I will share plenty more details about how that vision translates into design considerations in future posts.
Steinberg is the ideal home for our new venture, and we are beyond delighted that its leaders asked us to join their team. Steinberg builds tools that change musicians’ lives, and that comes from a deep understanding of what musicians need, often before they know they need it. Every one of our new colleagues that we have met shares our passion for music and delivering to customers what they want. We are looking forward to contributing directly to the amazing portfolio of products and technologies that Steinberg has built over its near 30-year history.
My aim is to involve you as directly as possible in the development of our new program, and to listen to your thoughts and ideas so that we can take them into account. At the same time, the number of companies actively working on professional music notation software is very small, and perhaps now numbers only two (one being Steinberg, the other MakeMusic). Despite the small number of big players, it is a very competitive niche of the music software market — with both many small start-ups and some decent open source solutions — and we don’t want to give away our best ideas before we’ve had a chance to make them into reality! All that said, I will share as much as I can of what we’re working on, because I hope you will be excited to hear about it, and it may spark off ideas that could help us to make our software even better.
I hope that this blog will also act as a catalyst for musicians who are working with other scoring and composition programs to get in touch and share their own ideas, wishes and dreams with me and the team. There must be things you wish you could do more efficiently, or things about your current application that drive you crazy. Tell me about them! You have an open invitation to email me, tweet at me, call me or, heck, send me a letter if you like. In my previous job I made myself as available as possible, and I want to build the same kind of close relationship with users of our new product. We can start now, even before the product is released: it could be that you tell us your idea at just the right time, and we are able to take them into consideration as we develop the program.
Please take a moment to follow this blog, to make sure you don’t miss anything. If you “like” the Steinberg page on Facebook, you will see each new post appear in your timeline. Alternatively, you could follow me on Twitter, where I will also be sure to share each new post.
That’s it for now. I’m excited to be able to start up the conversation, so please leave a comment to introduce yourself.