Cue Scoble tears. This is one hell of a technology from Microsoft Research that I think will have a huge impact on how amateurs and hobbyists write music. The technology and software prototype is called MySong.
In a nutshell, the software records your singing (preferably in tune) through a microphone, and it systematically generates an instrumental accompaniment for your song. The quality is even comparable with a professional accompanist, not to mention the cost and time involved.
If you don’t believe me, have a look at this quick 5-minute demo with loads of practical examples.
The technology was developed by Ian Simon from University of Washington in collaboration with Dan Morris and Summit Basu from Microsoft Research. They’ve published all of their research and methods in a paper (PDF) of the same name to present at the CHI Conference 2008 in a couple of months in Italy.
Without getting into too much detail, the technology uses the Hidden Markov statistical model which has been ‘trained’ by preprocessing a database of nearly 300 musical lead sheets. The sheets come from a variety of sources, genres and popularity to give a broad set of melody and chord sequence combinations. When it comes to the end user, it uses this abundance of data to find chord sequences which work best for each segment of melody. Presumably that means more ‘training’ can be done to improve the output even more.
The paper also points out “there is not a single correct accompaniment for a particular melody; chord selection will vary among musicians and genres, and a single musician may recognize many appropriate chord sequences for a single melody.” As a result, the software also gives the end user some room for creative adjustments in the form of “jazz factor” and “happy factor”. Both of which have a reasonable effect on the resulting accompaniment as demonstrated in the video.
If that wasn’t enough already, the researchers sought reviews from 30 independent musicians asking them to rate the different accompaniments produced by three different systems from one vocal input. They compared the result of MySong with hand-crafted chords and as well as Band-In-A-Box, the “state-of-the-art” commercially available software which they recognize to be the only automatic accompaniment generation system.
Here is just one example of the twelve they’ve ranked. I’ll leave you to judge for yourself.
| Original input | |
| MySong | |
| Band-In-A-Box | |
| Hand-crafted |
Like many cool technologies at Microsoft, this remains still a research project. Whilst there’s no written indication of a commercial product as a result of the technology, but I don’t see why they wouldn’t or even just release the software as is.
As for future work, they say “additional development will focus on improving and diversifying the audio generated by MySong; the system is already able to supply chords interactively to a pattern based arrangement tool, which results in compelling audio output. Several study participants indicated that MySong would be of significant value for learning music theory; we are thus excited about exploring educational applications of this technology.”
58 Comments
Cullen
Wow, pretty cool. MSR really is an amazing part of MS. They dream it, and make it! I think going forward, 10-15 years down the line, it will be MSRs projects raking in all the revenue.
Good_Bytes
This software as is, with a much nicer GUI, would be perfect as a Vista Ultimate Extra, and can really help selling Vista copies.
David Taraso
@Good_Bytes: Unfortunately, I doubt we’ll be seeing this technology, in it’s final state, for a while. At least not until Seven is on the shelf.
Ryan
How damn corny does this stuff have to be?
Toph
Haha I loved the usage scenarios & the credits music. I agree, sounds like a great Ultimate Extra.
Atin
Whoa! cool, i am thinking to share this with the pals at my blog
Orion
Sounds cool!
I wish that there was something where you could hum or sing a song and find relevant results for the song you hummed/sang.
Morten
From a musicians perspective this was just bad. The chords are predictable, even for a non-musician. The only thing worth noting is the pitch analyzer – which have been with us since the early Windows days. The jazz factor thingy made it a really bad software. “Let’s use dim-chords, even if they may not match”.
No thank you.
Matt Sharpe
Sounds useful, and very clever.
Does seem a bit like it takes the art or talent out of music writing though.
Justin
In the example, MySong outperformed Band-In-A-Box. I love that. Really amazing product.
Duncan Smart
To my untrained ears all the accompaniments sounded the same. Maybe if they switched the General MIDI sounds around a bit it would be more compelling/convincing.
Fred
Let me guess: Morten is the type of person that watches people play Guitar Hero and snarkily suggests that they learn to play a real guitar.
xaml
I guess something went wrong when i started MySong… or maybe not
http://www.mediafire.com/?3×1zx91ytyn
b3njo
Wait a minute. So this is the ‘tear huha’?
Simon
the piano and the chords are ever so cheesy…. literally dripping with cheese
Orion
Woah!
New website style!
Peter Kirn
@Fred: Sorry, I’m with Morten. And to use the Guitar Hero example, Guitar Hero and Rock Band took great pains to ensure the music sounds like the original.
The problem with this is, it doesn’t work right. The chords on “The Way You Look Tonight” don’t connect musically — and they’re wildly inferior to the original. What the demo really illustrates is that you can reproduce some basic harmonic rules, but not come out with something at all comparable to what a human would come up with.
Okay, I do see the idea of allowing amateurs to put together harmonies. But they need more control than two sliders. In fact, the beauty of sitting for hours with your guitar or keyboard is you eventually put together something meaningful. Mostly what this does is rob the musician of that choice.
I wrote some other ideas here:
http://createdigitalmusic.com/2008/02/29/mysong-your-own-virtual-tone- deaf-accompanist/
And, truly, this isn’t to be snobby — I think the untrained, amateur musician is going to have a better experience playing around with an instrument, or something like GarageBand if they can’t play, than they are with this. And you have a *different* experience when you learn to do something. Guitar Hero doesn’t replicate playing a guitar — that’s not the point. But this *is* trying to replicate something, and it isn’t succeeding. It’s a worthy task, and you learn a lot from what doesn’t work and what does, but it’s a long, long way from working the way it promises.
Edootjuh
For simple songs, I guess this is a pretty good program. But for more complicated ones Band in a Box (which I use) is much better. Though in the example the chords chosen by BiaB weren’t all matching, it was better and less predictible that MySong.
Oh and @Orion, you might like http://www.songtapper.com
Chad
Yuck, i don’t like this new website style.
Ollie
LOL. I absolutely love Emily – she’s the best of all of them. Congrats on the new website too, change the font to verdana though.
Jason Cox
I like the new theme Long, though its going to take some time to get used this smaller content area (well, I guess I could just close Favorites Center too…)
sb.net
This is stupid. It sounds like a technology from 1995. It’s like the “make your own music” program in Photo Story 3.
I love to write and produce music, and I’m going to go to college for music production (in 4 years). I can’t stand when companies come out with lame programs for “Music Production.” If their going to make a program, make it like Garageband on the mac.
I don’t like Garageband very much, but anyone that owns a mac can make music or podcasts. Garageband has really good loops, synths and effects, and you can choose to make your own melodies or not. In this it analyzes the pitch of the vocal (like melodyne (celemony.com)), and makes chords that work with your “song.” Technically it’s not your song. The same thing with loops (except for drum loops).
It’s just my opinion..
sb.net
BTW I also don’t like the new design..
Skeptic
What is the point of this article as it doesn’t even have a download for a demo program at the least….Yet another Tesla like promotion…
Peter Kirn
FYI, there are ways of producing music easily without a Mac. Steinberg’s Sequel is a very powerful alternative that’s cross platform, and there are entry-level versions of software from Cakewalk, Sony, etc. But then, yeah, that does beg the question of why you need the software to harmonize for you. It’s an interesting idea, but in practice doesn’t really make things any easier.
Sheikh
The new website design sucks. Either stick with the old one or modernize the new one. It’s not visually appealing.
Just an advice no offense. U have the right to do whatever u want. After all ur website.
Simon
The design of the website is okay, certainly needs improvement. The older one looked more professional I think.
James
don’t like the new design : (
switch back to the old one please ! it was simple and professional !
Anthony
The new design is cleaner, but that green bar on the left is very distracting!
Drew Smith
Love the new design Long, very clear and easy to use (and aestheticly appealing)
also, you need to put the “Genuine istartedsomething” button back on at the bottom
quikboy
Make it look visualy cooler, and you’ve got fans. I listened to all the samples, and I barely got much of a difference between them. MySong sounds promising.
But why do they always show off their stuff from Research? MSR is neat, but outside of MS fans, nobody hears much about it. And other people come out later and make similar-like things, and by the time MS rolls it out the door, they look like old news. Kind of dumb if you ask me. They should just finalize it right, and then show it off.
Daniel R. H.
OMG I want it!!!!!!, very cool and fun software, release this as a Vista Ultimate Extra!!!! I REALLY WANT IT!!!
ducky
To be perfectly honest, all the samples sound like crap, just my opinion. <_<
Mauro
What a peace of technology. (congrats for the new theme btw).
Drew
I don’t think it’s gonna help too many people. Awesome site design too.
dentaku
That music is quite predictable and rather cheezy.
It DID sound a bit better than band in a box though.
jason
Its nice idea, but sounds like it needs more work. All the songs really sound the same but just played at different speeds.
Looking forwad to the final release with some other tunes and instruments
Microscopics
Even if it’s not perfect, it’s impressive.
It may put me out of a job
Micah Kanchan
Great article, but I just needed to point out that I am a music producer, and there is a program called Antares AutoTune which does the same thing. (Ever heard T-Pain? He can’t sing without it!)
Alvin Brinson
I initially clicked with enthusiasm, and then disappointment filled me as I realized that it doesn’t do ANYTHING but pick chords and play them all back using the same rhythms and patterns. If I paid an accompanist to help write a song and this is what they came up with, I’d suggest they go back to 5th grade music class.
Adrian
Pretty cool, imho. But after listening to a few examples, all of the generated accompaniments start to sound like each other. A great next step for MySong would be to enable variety in rhythm and tempo of the accompanying chords, not just pitch. From the whitepaper:
“Chords are generated at a fixed interval that corresponds to a specific number of beats at the known tempo”
…which is what gives most of the tracks a bit of a lifeless, metronomic feel.
angus
where download this software
Jacob
Frankly, I dont like the whole idea at all. The beauty of creating music is that you are creating it, not some machine. It just takes the whole feeling out of it. Besides, all the computer is doing is telling which note the person is singing, and setting a standarized set of chords to it, no ingenuity involved.
Michelle
I was programming stuff like this in 1995 using MIDI. Never got results close to real musicians/composers so I gave it up. based on the gven examples, MSR’s work is impressive.
ghort
Honestly , the program is just as brainless as someone with no musical ability trying to write music. If you cant write music, and have no musical ability whatsoever , you shouldn’t try . ITs like someone getting a program that makes their drawings into architectural blueprints. It won’t make you an architect . That takes skill and dedication.
If you have to use a program like mysong to write your music for you, you probably shouldn’t quit your day job, and PLEASE whatever you do, don’t try to get in to the music industry,
there’s already enough talentless clones flooding the airwaves with garbage. Mysong would only contribute to that .
Bonnie teVelde
Wow, this is amazing for what it does. It blows the one in Garage Band to pieces. It even blows away the live accompaniment. I love the varied chords it generates considering they are a whole lot more interesting than the ones in most or even all pop songs today. I would most certainly use it with my music composition students, to show them how many different chord options are possible with a given melody, and to teach them how to hear which chords on the circle of fifths it is choosing… and why they sound the way they do.
I absolutely love it! I would buy it for my music school as a teaching aid in a heartbeat! A+++++
PS: For those who think it is so “canned” or “stupid”, lets see you come up with a better program!
Noisy V
This is another example of the “I need it now and I need to be able to do it now” attitude that permeates our society. If you bothered to even take music lessons for 1 year, you could do everything that this program claims to and would most likely do a better job considering the chord progressions this program puts together are questionable. As a very accomplished pianist, this program in no way emulates what a real accompanist would do for you.
And p.s. I love rockband and guitar hero
stu
Surely it’s PhotoBooth for singing.. and isn’t that the point? (and, if not, shouldn’t it be?!)
People love playing with PhotoBooth – gurning gleefully at their Macs with their friends, taking snapshots to put into their own little hall of mirrors. It’s pointless, but it’s fun for about ten minutes and gives you a nice warm & fuzzy feeling about using a Mac.
Windows can feel too worthy at times, bogged down in business justification, ROI and design-by-committee and a few “gimmicks” like this in the consumer-oriented “Home” editions would do no harm I’m sure.
It’d be great if it could do a spot of auto-tuning to a ‘best guess’ melody to suit a chord pattern, or even change the rhythm of the singing to suit a particular style, but I’m sure nobody’s intending it to replace years of study and natural talent… those suggesting it is are, quite frankly, just sounding a tad arrogant and elitist.
Mike Stivala
The Great Automatic Grammatizer brought screaming into the 21st century.
lawl
Anyone notice how this new “Microsoft” product sounds almost the exact same as the “state-of-the-art” software? This situation seems oddly familiar. hmm…
HillaryIs44
Ahhh!!! Kill it with fire! No one could possibly think that horrible vocals somehow sound fantastic with cheesy chords in the background. That first chick who murdered Sinatra – blasphemy!
Daniel R. H.
Is amazing how people confuse the purpose of the software, even thinking is made to make professional music! for god’s sake! is a software for amateurish and karaoke people!
Casper
cool idea, but needs more instruments.
Jon
Where can you download it?
Nicole
This is really cool!!!! How can I download this????
Zandormaz
I think this program is just a starting point in a new technology that will grow and someday will be usefull…
JWBreck
I am impressed. It kept the integrety of the submitted piece unlike BinB which warped the original. It is good enough to use as an early introduction to songwriting. It would improve as it is worked on. When you start working on a piece of music, how often do you change it, how often do you forget some of the magic you create in earlier renditions. This would be a fun program to have. I could never live with BinB. Keep working and good luck.
shane
hey this shane and i love this idea i want the software, the only think that i see that i have a problem with is the instrument, is it only piano? what if someone wants like a techno sound or a rock distortion sound to chords of the song they want to make.
Leave a Reply
Create Digital Music » MySong: Your Own Virtual, Tone-Deaf Accompanist
[...] MySong, from Microsoft Research, makes your singing sound a lot better than it really does [...]
Geek By Day » Blog Archive » Microsoft Research strikes again!
[...] MySong, a research project at Microsoft is an attempt to turn non-musicians into songwriters. Actually it’s an attempt to make non-musicians not have to hire a backup group. MySong takes automatic accompaniment one step further than merely following the input. Not only does it follow the tempo of the input, but it also harmonizes it. The type of accompaniment desired is affected by adjusting parameters that non-musicians can understand. As the above link shows, MySong produces better results than Band In A Box (BIAB) which is considered to be the best on the market today. I have used BIAB in the past and was not impressed then and I certainly am not now. It also shows something else. Art can be reduced to mathematical expressions. Notice the term mathematical *expressions*. Mathematics in this case is just an alternative form of expressing the same idea that would have been expressed using musical sounds. The exciting thing here is that since mathematics and computers are very precise, reproducing musical results with a reliable degree of accuracy is possible. Furthermore, this proves the link between programming languages and music to be mathematics as programming languages are certainly mathematical. Maybe a Haskell-derived music programming language is a concept worthy of further exploration? [...]
Mark Harrison: Microsoft Research MySong
[...] Microsoft Research MySong The MySong software records your singing (preferably in tune) through a microphone, and it systematically generates an instrumental accompaniment for your song. The quality is even comparable with a professional accompanist, not to mention the cost and time involved.More [...]
Daily Bits - March 1, 2008 | Alvin Ashcraft's Daily Geek Bits
[...] MySong, from Microsoft Research, Makes Your Singing Sound a Lot Better Than It Really Does and Low and Behold, the IE8 Install Screen (Long Zheng) [...]
technabob
microsoft mysong generates music from vocals…
Up until now, singers needed to either play an instrument or the help of a professional accompanist to help them realize their musical ideas. With this new technology coming out of Microsoft Research, vocalists need only sing their ideas into a microph…
Jackson Fish Market
[...] “In a nutshell, the software records your singing (preferably in tune) through a microphone, a… Posted on March 3rd, 2008 in Interesting [...]
Microsoft MySong Generates Music For Your Song, Is Questionable, Questonably Awesome! | gadget news
[...] March 10th, 2008 Filed Under gadgets MySong is a program from Microsoft Research that puts instrumental music to your singing. Now I’m not going to bore you with all the details of how it does that or anything, just know that if you have a mouth and tongue, you’re basically going to be a famous musician. You just sing into your microphone, and presto, the program adds musical accompaniment. No need to pay musicians to play actual instruments, their days are numbered! That being said, the program seems to lay down the same boring-ass piano riff no matter what you sing. Even after adjusting the “Happy Factor” control down to a minimum and cranking up “Jazz Factor”, the resulting song still smells like a cat’s ass. To the program’s credit though, the people demoing are clearly no-talent assclowns. NOTE: Skip to about 2:45 in the video for the start of the demos, hit the link to read more about how the program works. Thanks to Scott, who doesn’t need a program to produce songs that make the women swoon, for the tip MySong, from Microsoft Research, makes singing sound a lot better than it really is [istartedsomething] [...]
Mysong - suihkussa laulajasta esiintymislavojen tähdeksi? | Teknolelu
[...] jos kiinnostus aiheeseen säilyi vielä tämänkin jälkeen, saat lisää näytteitä ja tietoja lähteestä. (Arvostele klikkaamalla tähtiä) Loading [...]
Microsoft Research’s MySong Makes Musical Accompaniment For Your Singing [ | official tech blog
[...] just a Microsoft Research project, not an actual package you can purchase. Maybe in a few years? [IStartedSomething via Geekologie via [...]
My Song - UHU DotNetClub
[...] poco buscando información sobre Microsoft Research encontre esto en una web. Asi que ya nunca cantaras [...]
Spyware Confidential mobile edition
[...] people mention enough. My friend and wider-blogging symposium colleague, Long Zheng, often throws in an MSR mention with the things they are coming out with. It’s funny how these “products” have all hit the [...]
Microsoft Research announces Songsmith, make-your-own-song-from-vocals software - istartedsomething
[...] the product of a Microsoft Research project with a student from the University of Washington called MySong which was showed off in early 2008. The software can automatically provide musical melodies to accompany any vocal singing you [...]
Create your own songs, using just your voice! | TechMachi
[...] of a Microsoft Research project with a student from the University of Washington called MySong which was showed off in early 2008. The software can automatically provide musical melodies to accompany any vocal singing you [...]
Vous aussi devenez musicien en moins de 10 minutes !
[...] [...]