Archive for category events

1st Web Audio Conference

This January IRCAM and Mozilla will be hosting the 1st Web Audio Conference in Paris France.  From the conference page:

The WAC is the first international conference on web audio technologies and applications.

The conference welcomes web R&D developers, audio processing scientists, application designers and people involved in web standards.

The conference addresses research, development, design, and standards concerned with emerging audio-related web technologies such as Web Audio API, Web RTC, Web Sockets, and Javascript.

Contributions to the first edition of WAC are encouraged in, but not limited to, the following topics:

  • Innovative audio and music based web applications (with social and user experience aspects)
  • Client-side audio processing (real-time or non real-time)
  • Audio data and metadata formats and network delivery
  • Server-side audio processing and client access
  • Client-side audio engine and rendering
  • Frameworks for audio manipulation
  • Web Audio API design and implementation
  • Client-side audio visualization
  • Multimedia integration
  • Web standards and use of standards within audio based web projects
  • Hardware, tangible interface and use of Web Audio API

This is the first Call For Papers that I’ve seen that, in addition to a paper and poster track, also has a Gig submission track.  Yes, you can propose a 20 minute gig. Accepted gigs will be presented in the conference concert.  I’m thinking of a combined Infinite Jukebox + Ellie Goulding visualization – 20 minutes of flying cubes will show ‘em.

The submission deadline is October 10.  Time to dust off my Latex skills.

 

 

Leave a comment

How the Autocanonizer works

Last week at the SXSW Music Hack Championship hackathon I built The Autocanonizer. An app that tries to turn any song into a canon by playing it against a copy of itself.  In this post, I explain how it works.

At the core of The Autocanonizer are three functions – (1) Build simultaneous audio streams for the two voices of the canon (2) Play them back simultaneously, (3) Supply a visualization that gives the listener an idea of what is happening under the hood.  Let’s look at each of these 3 functions:

(1A) Build simultaneous audio streams – finding similar sounding beats
The goal of the Autocanonizer is to fold a song in on itself in such a way that the result still sounds musical.  To do this, we use The Echo Nest analyzer and the jremix library to do much of the heavy lifting. First we use the analyzer to break the song down into beats. Each beat is associated with a timestamp, a duration, a confidence and a set of overlapping audio segments.  An audio segment contains a detailed description of a single audio event in the song. It includes harmonic data (i.e. the pitch content), timbral data (the texture of the sound) and a loudness profile.  Using this info we can create a Beat Distance Function (BDF) that will return a value that represents the relative distance between any two beats in the audio space. Beats that are close together in this space sound very similar, beats that are far apart sound very different. The BDF works by calculating the average distance between overlapping segments of the two beats where the distance between any two segments is a weighted combination of the euclidean distance between the pitch, timbral, loudness, duration and confidence vectors.  The weights control which part of the sound takes more precedence in determining beat distance. For instance we can give more weight to the harmonic content of a beat, or the timbral quality of the beat. There’s no hard science for selecting the weights, I just picked some weights to start with and tweaked them a few times based on how well it worked. I started with the same weights that I used when creating the Infinite Jukebox (which also relies on beat similarity), but ultimately gave more weight to the harmonic component since good harmony is so important to The Autocanonizer.

(1B)  Build simultaneous audio streams  - building the canon
The next challenge, and perhaps biggest challenge of the whole app, is to build the canon – that is  - given the Beat Distance Function, create two audio streams, one beat at a time, that sound good when played simultaneously. The first stream is easy, we’ll just play the beats in normal beat order. It’s the second stream, the canon stream that we have to worry about.  The challenge: put the beats in the canon stream in an order such that (1) the beats are in a different order than the main stream, and (2) they sound good when played with the main stream.

The first thing we can try is to make each beat in the canon stream be the most similar sounding beat to the corresponding beat in the main stream.  If we do that we end up with something that looks like this:

Someone_Like_You__autocanonized__by_Adele-2

It’s a rat’s nest of connections, very little structure is evident.  You can listen to what it sounds like by clicking here: Experimental Rat’s Nest version of Someone Like You (autocanonized).  It’s worth a listen to get a sense of where we start from.  So why does this bounce all over the place like this?  There are lots of reasons: First, there’s lots of repetition in music – so if I’m in the first chorus, the most similar beat may be in the second or third chorus – both may sound very similar and it is practically a roll of the dice which one will win leading to much bouncing between the two choruses. Second – since we have to find a similar beat for every beat, even beats that have no near neighbors have to be forced into the graph which turns it into spaghetti. Finally, the underlying beat distance function relies on weights that are hard to generalize for all songs leading to more noise.  The bottom line is that this simple approach leads to a chaotic and mostly non-musical canon with head-jarring transitions on the canon channel.  We need to do better.

There are glimmers of musicality in this version though. Every once in a while, the canon channel will remaining on a single sequential set of beats for a little while. When this happens, it sounds much more musical. If we can make this happen more often, then we may end up with a better sounding canon. The challenge then is to find a way to identify long consecutive strands of beats that fit well with the main stream.  One approach is to break down the main stream into a set of musically coherent phrases and align each of those phrases with a similar sounding coherent phrase. This will help us avoid the many head-jarring transitions that occur in the previous rat’s nest example. But how do we break a song down into coherent phrases? Luckily, it is already done for us. The Echo Nest analysis includes a breakdown of a song into sections – high level musically coherent phrases in the song – exactly what we are looking for. We can use the sections to drive the mapping.  Note that breaking a song down into sections is still an open research problem – there’s no perfect algorithm for it yet, but The Echo Nest algorithm is a state-of-the-art algorithm that is probably as good as it gets. Luckily, for this task, we don’t need a perfect algorithm. In the above visualization you can see the sections. Here’s a blown up version – each of the horizontal colored rectangles represents one section:

Someone_Like_You__autocanonized__by_Adele-2

You can see that this song has 11 sections. Our goal then is to get a sequence of beats for the canon stream that aligns well with the beats of each section. To make things at little easier to see, lets focus in on a single section. The following visualization shows the similar beat graph for a single section (section 3) in the song:

Someone_Like_You__autocanonized__by_Adele-10

You can see bundles of edges leaving section 3 bound for section 5 and 6.  We could use these bundles to find most similar sections and simply overlap these sections. However, given that sections are rarely the same length nor are they likely to be aligned to similar sounding musical events, it is unlikely that this would give a good listening experience. However, we can still use this bundling to our advantage. Remember, our goal is to find a good coherent sequence of beats for the canon stream. We can make a simplifying rule that we will select a single sequence of beats for the canon stream to align with each section. The challenge, then, is to simply pick the best sequence for each section. We can use these edge bundles to help us do this.  For each beat in the main stream section we calculate the distance to its most similar sounding beat.  We aggregate these counts and find the most commonly occurring distance. For example, there are 64 beats in Section 3.  The most common occurring jump distance to a sibling beat is 184 beats away.  There are ten beats in the section with a similar beat at this distance. We then use this most common distance of 184 to generate the canon stream for the entire section. For each beat of this section in the main stream, we add a beat in the canon stream that is 184 beats away from the main stream beat. Thus for each main stream section we find the most similar matching stream of beats for the canon stream. This visualizing shows the corresponding canon beat for each beat in the main stream.

Someone_Like_You__autocanonized__by_Adele-2

This has a number of good properties. First, the segments don’t need to be perfectly aligned with each other.  Note, in the above visualization that the similar beats to section 3 span across section 5 and 6. If there are two separate chorus segments that should overlap, it is no problem if they don’t start at the exactly the same point in the chorus. The inter-beat distance will sort it all out.  Second, we get good behavior even for sections that have no strong complimentary section.  For instance, the second section is mostly self-similar, so this approach aligns the section with a copy of itself offset by a few beats leading to a very nice call and answer.

Someone_Like_You__autocanonized__by_Adele-2

That’s the core mechanism of the autocanonizer  - for each section in the song, find the most commonly occurring distance to a sibling beat, and then generate the canon stream by assembling beats using that most commonly occurring distance.  The algorithm is not perfect. It fails badly on some songs, but for many songs it generates a really good cannon affect.  The gallery has 20 or so of my favorites.

 (2) Play the streams back simultaneously
When I first released my hack, to actually render the two streams as audio, I played each beat of the two streams simultaneously using the web audio API.  This was the easiest thing to do, but for many songs this results in some very noticeable audio artifacts at the beat boundaries.  Any time there’s an interruption in the audio stream there’s likely to be a click or a pop.  For this to be a viable hack that I want to show people I really needed to get rid of those artifacts.  To do this I take advantage of the fact that for the most part we are playing longer sequences of continuous beats. So instead of playing a single beat at a time, I queue up the remaining beats in the song, as a single queued  buffer.  When it is time to play the next beat, I check to see if is the same that would naturally play if I let the currently playing queue continue. If it is I ‘let it ride’ so to speak. The next beat plays seamlessly without any audio artifacts.  I can do this for both the main stream and the canon stream. This virtually elimianates all the pops and clicks.  However, there’s a complicating factor. A song can vary in tempo throughout, so the canon stream and the main stream can easily get out of sync. To remedy this, at every beat we calculate the accumulated timing error between the two streams. If this error exceeds a certain threshold (currently 50ms), the canon stream is resync’d starting from the current beat.  Thus, we can keep both streams in sync with each other while minimizing the need to explicitly queue beats that results in the audio artifacts.  The result is an audio stream that is nearly click free.

(3) Supply a visualization that gives the listener an idea of how the app works
I’ve found with many of these remixing apps, giving the listener a visualization that helps them understand what is happening under the hood is a key part of the hack. The first visualization that accompanied my hack was rather lame:

Let_It_Be__autocanonized__by_The_Beatles

It showed the beats lined up in a row, colored by the timbral data.  The two playback streams were represented by two ‘tape heads’ – the red tape head playing the main stream and the green head showing the canon stream.  You could click on beats to play different parts of the song, but it didn’t really give you an idea what was going on under the hood.  In the few days since the hackathon, I’ve spent a few hours upgrading the visualization to be something better.  I did four things: Reveal more about the song structure,  show the song sections, show, the canon graph and animate the transitions.

Reveal more about the song
The colored bars don’t really tell you too much about the song.  With a good song visualization you should be able to tell the difference between two songs that you know just by looking at the visualization.   In addition to the timbral coloring, showing the loudness at each beat should reveal some of the song structure.   Here’s a plot that shows the beat-by-beat loudness for the song stairway to heaven.

Stairway_To_Heaven__autocanonized__by_Led_Zeppelin

You can see the steady build in volume over the course of the song.  But it is still less than an ideal plot. First of all, one would expect the build for a song like Stairway to Heaven to be more dramatic than this slight incline shows.  This is because the loudness scale is a logarithmic scale.  We can get back some of the dynamic range by converting to a linear scale like so:

Stairway_To_Heaven__autocanonized__by_Led_Zeppelin

This is much better, but the noise still dominates the plot. We can smooth out the noise by taking a windowed average of the loudness for each beat. Unfortunately, that also softens the sharp edges so that short events, like ‘the drop’ could get lost. We want to be able to preserve the edges for significant edges while still eliminating much of the noise.  A good way to do this is to use a median filter instead of a mean filter.  When we apply such a filter we get a plot that looks like this:

Stairway_To_Heaven__autocanonized__by_Led_Zeppelin

The noise is gone, but we still have all the nice sharp edges.  Now there’s enough info to help us distinguish between two well known songs. See if you can tell which of the following songs is ‘A day in the life’ by The Beatles and which one is ‘Hey Jude’ by The Beatles.

A_Day_in_the_Life__autocanonized__by_The_Beatles

Which song is it? Hey Jude or A day in the Life?

07_-_Hey_Jude__autocanonized__by_Beatles__The

Which song is it? Hey Jude or A day in the Life?

Show the song sections
As part of the visualization upgrades I wanted to show the song sections to help show where the canon phrase boundaries are. To do this I created a the simple set of colored blocks along the baseline. Each one aligns with a section. The colors are assigned randomly.

Show the canon graph and animate the transitions.
To help the listener understand how the canon is structured, I show the canon transitions as arcs along the bottom of the graph. When the song is playing, the green cursor, representing the canon stream animates along the graph giving the listener a dynamic view of what is going on.  The animations were fun to do. They weren’t built into Raphael, instead I got to do them manually. I’m pretty pleased with how they came out.

Stairway_To_Heaven__autocanonized__by_Led_Zeppelin

All in all I think the visualization is pretty neat now compared to where it was after the hack. It is colorful and eye catching. It tells you quite a bit about the structure and make up of a song (including detailed loudness, timbral and section info). It shows how the song will be represented as a canon, and when the song is playing it animates to show you exactly what parts of the song are being played against each other.  You can interact with the vizualization by clicking on it to listen to any particular part of the canon.

Stairway_To_Heaven__autocanonized__by_Led_Zeppelin

Wrapping up  – this was a fun hack and the results are pretty unique. I don’t know of any other auto-canonizing apps out there. It was pretty fun to demo that hack at the SXSW Music Hack Championships too. People really seemed to like it and even applauded spontaneously in the middle of my demo.  The updates I’ve made since then – such as fixing the audio glitches and giving the visualization a face lift make it ready for the world to come and visit. Now I just need to wait for them to come.

,

Leave a comment

The Autocanonizer

I’ve spent the last 24 hours at the SXSW Music Hackathon championship. For my hack I’ve built something called The Autocanonizer. It takes any song and tries to make a canon out of it. A canon is a song that can be played against a copy of itself.  The Autocanonizer does this by looking at the detailed audio in the song (via The Echo Nest analysis), and looks for parts of the song that might overlap well. It builds a map of all these parts and when it plays the song it plays the main audio, while overlapping it with the second audio stream.  It doesn’t always work, but when it does, the results can be quite fun and sometimes quite pleasing.

To go along with the playback I created a visualization that shows the song and the two virtual tape heads that are playing the song. You can click on the visualization to hear particular bits.

Let_It_Be__autocanonized__by_The_Beatles

 

There are some audio artifacts on a few songs still. I know how to fix it, but it requires some subtle math (subtraction) that I’m sure I’ll mess up right before the hackathon demo if I attempt it now, so it will have to wait for another day. Also, there’s a Firefox issue that I will fix in the coming days.  Or you can go and fix all this yourself because the code is on github.

,

3 Comments

The Perfect Music Hack Day – London 2013

This weekend, Music Hack Day returned to the city where it all began. On Saturday morning, nearly 200 hackers arrived with the hottest hackathon tickets at the Shoreditch Works Village Hall, in Hoxton Square to spend the weekend exercising their passion for music and technology. After 24 hours of hacking, over 50 hacks were built – hacks that let you explore, discover, arrange, create and play with music.

Augdrum - Hacked drum for use in 'expressive' performance

Augdrum – Hacked drum for use in ‘expressive’ performance

I’ve been to many Music Hack Days, and I must say this was a special one. It had all the magical ingredients to make this the perfect event. First, the Shoreditch Works Village Hall was the ideal hacking venue.

Getting ready to hack at the Shoreditch Village Hall

Getting ready to hack at the Shoreditch Works Village Hall

It is located in the heart of London’s exploding tech community, surrounded by pubs and restaurants (in my five minute walk from the hotel to the Village Hall, I walked past a dozen pubs).  The Village Hall had perfect power and ample bandwidth for 200 data-starved hackers. The hackathon was sold out and everyone showed up, so we were all tightly packed into the hall – adding to the crazy energy. There’s a coffee shop connected to the hall where baristas were preparing coffee for the hackers long into the night.

DSC_1338___Flickr_-_Photo_Sharing_

Food was not your standard hacker pizza – it was “modern British slow cooking” provided by the Bow Street Kitchen.  It really added to the London vibe.

Bow_Food___Flickr_-_Photo_Sharing_

Finally, Thomas Bonte of MuseScore was in attendance – Thomas is the official photographer of Music Hack Day. He’s been taking pictures of MHD since the very first one. He takes great pictures and makes them all available on Flickr via Creative Commons. Check out his full set of the event on Flickr. He took nearly all the photos in this blog post except for this one:

Thomas Bonte at work

Thomas Bonte at work

Since the event was sure to sell out (everyone wants to go to a London Music Hack day), only the most motivated hackers were able to get tickets. Motivated hackers are the best kind of hackers.

Full house - hacker style

Full house – hacker style

These are the folks that arrive early, stay late, work hard and finish their hacks on time – leading to a very high level of hacks being built.

Full house for hackers at Music Hack Day

Full house for hackers at Music Hack Day

The event kicked off with organizer Martyn Davies providing opening remarks, followed by API presentations by various companies.  By 2PM hacking was in full swing.

Martyn Davies kicking things off

Martyn Davies kicking things off

24 hours later,  51 hacks had been completed and submitted to hacker league.  The epic demo session started at 3PM and by 6PM all the demos  had been completed and prizes were awarded.  Unlike other hack days, all the prizes were pooled and distributed to the top hacks (determined by popular vote).

Andy Bennett's rather complicated demo

Andy Bennett’s rather complicated demo

A new and awesome twist to the demo session was provided by Becky Stewart’s hack. She created #mhdbingo – a set of custom bingo cards filled with common Music Hack Day tropes and memes. Each hacker received a unique bingo card to fill out during the demo session. Bingo wins were recorded by tweets with the #mhdbingo hashtag.  Here’s a sample bingo card:

It's the center square that's the most interesting.

It’s the center square that’s the most interesting.

Becky’s hack not only provided a little humor for the demo session, but was a great tool to keep the attendees focused on the demo during the nearly 3 hour demo session. There was a point near the end of the demo session when seemingly dozens of folks were praying for a hack that showed ‘tracks on a map’ – and yes, their prayers were answered.  Becky’s hack is on Github and she accepts pull requests so if you have suggestions for more MHD memes and tropes go ahead and add them and submit the pull requests. I’m sure #mhdbingo will become a fixture at future Music Hack days.

Watching the demos at Music Hack Day

Watching the demos at Music Hack Day

Some of my favorite hacks of the weekend are:

Hipster Robot - A hipster robotic arm that stops you listening to any music it deems “too mainstream”

Didgidoo - An electronically augmented didgeridoo.

Projects____Music_Hack_Day_London_2013____Hacker_League

#mhdbingo – the aforementioned Bingo game celebrating all our favourite Music Hack Day tropes.

Becky combines Latex and Bingo to reshape Music Hack Day forever

Becky combines Latex and Bingo to reshape Music Hack Day forever. Sitting behind her is someone else who, 10 years ago, reshaped music forever

notepad - Draw a piano on a paper pad, and start playing it!

playing_piano.png__637×475_

These are your Burns - takes your favourite bit of audio at the moment (Your ‘jam’ if you will) and creates a beautiful collage of memes, informed by the lyrics of the song, and presents them in a familiar documentary style.

Ben_Fields___Sam_Phippen___Flickr_-_Photo_Sharing_

MidiModulator - This Python script will take a song and modulate the pitch with the melody of a chosen score (basically, another song). Think of it as FM, except instead of a frequency we take an entire Christmas carol.

DSC_1526___Flickr_-_Photo_Sharing_

playsongsto.me -  a collaborative playlist tool with a difference – you have to convince your friends to keep adding tracks faster than you can listen to them or face the consequences!  This hack was created by Ross Penman – the youngest hacker to demo a project. I really liked his  unique double twist on the party playlister.

DSC_1530___Flickr_-_Photo_Sharing_

album pairs - a nearly ready for the iOs App Store is the Album Pairs app by Iain Mullan – its an album cover matching game – when you make the match the corresponding song is added to the playlist.

Block Surfer - Rhythms created from waves using a bit of 2D physics.

Chiptar - hacked a guitar to control an 8-bit C64-inspired synth engine. Using an accelerometer it’s also possible to control arpeggiation.

best new sounds at the hack

best new sounds at the hack

Attention Deficit Radio – This is my hack – Attention Deficit Radio creates a Pandora-like radio experience for music listeners with short attention spans.

Paul_Lamere___Flickr_-_Photo_Sharing_

The top popular crowd favorite was Lifesong. This hack was written by Ben Nunney entirely on an Amstrad 1512 – a mid-80s PC with 512k RAM and a 4Mhz processor. It’s based in Pascal with a BASIC wrapper around it.

DSC_1350___Flickr_-_Photo_Sharing_

Since this computer has no network, audio out, or video out, Ben had to resort to some unusual methods to demo his hack.

DSC_1667___Flickr_-_Photo_Sharing_-2

It was a really fun demo session. There were lots of unique hacks. See the full list on hacker league. Many APIs were used including Spotify, Deezer, Songkick, Last.fm, Twilio, SoundCloud, Discogs, MuseScore, MusicMetric and more. I was especially pleased to see that several dozen hacks use our Echo Nest API to make cool hacks.

Martyn doing his thing at Music Hack Day

Martyn doing his thing at Music Hack Day

Thanks to @martynd and everyone involved in organizing the Music Hack Day London. It really was the perfect Music Hack Day.

Thanks to Thomas Bonte for all the photos used in this post. Be sure to see the full set.

Leave a comment

Attention Deficit Radio

This weekend, I’ve been in London, attending the London Music Hack Day. For this weekend’s hack, I was inspired by daughter’s music listening behavior – when she listens to music, she is good for the first verse or two and the chorus, but after that, she’s on to the next song. She probably has never heard a bridge.  So for my daughter, and folks like her with short attention spans, I’ve built Attention Deficit Radio. ADR creates a Pandora-like radio station based upon a seed artist, but doesn’t bother you by playing whole songs. Instead, after about 30 seconds or so, it is on to the next song. The nifty bit is that ADR will try to beat-match and crossfade between the songs giving you a (hopefully) seamless listening experience as you fly through the playlist. Of course those with short attention spans need something to look at while listening, so ADR has lots of gauges that show the radio status – it shows the current beat, the status of the cross-fade, tempo and song loading status.

Attention_Deficit_Radio

There may be a few rough edges, and the paint is not yet dry, but give Attention Deficit Radio a try if you have a short listening attention span.

,

3 Comments

No, I will not build your app for free pizza

Opera_House.JPG__640×480__and_Inbox__2__-_paul_echonest.com_-_The_Echo_Nest_Mail

The Sydney Opera House hackathon is off to a bad start. The infamous institution is holding a hackathon next month. They are offering a prize of $4K AU (about $3, 750 US) along with ‘The glory of developing an app for Sydney Opera House which will be seen by millions of visitors every year’  for the best hack. The Register dove into the Terms & Conditions (warning, 2,000 words of legalize) and dug up all sorts of IP grabs. Bottom line, at the end of the hack the SOH can do just about anything it wants with what you built at the hackathon. To quote the Register:

“By entering this competition, every last line of code you cut becomes the property of the Sydney Opera House Trust.”

There’s also this little nugget in the T&C:

“By entering this Hackathon, you agree that use of information in our representatives’ unaided memories in the development or deployment of our products or services does not create liability for us”

One can just imagine how it this came about. Some biz guys (yeah, all evil comes from the biz guys) were sitting around thinking about how they could get their mobile app done for cheap. “Let’s do a hackathon! Toss a few bean bag chairs and power strips into a hotel conference room. Send in boxes of Pizza every 6 hours and out will pop dozens of apps to chose from. Even if none of the apps built are polished enough for release we will be able to mine all the best ideas from the most creative Australian techies and put them into our app when we finally hire that digital agency to build it.”

Unfortunately for the SOH, developers are too smart for that. They can do the math. To win a high profile hackathon with a goal of building a mobile app for millions of users, you probably need a team of four: the front-end programmer,  the back-end programmer, the designer and the do-everything-else-including-the-presentation guy/gal (a.k.a The Face).  At a modest $125 an hour per team member on the open market that team costs $500 per hour,  so 24 hours of hacking is worth about $12,000. (That’s not even counting the pre-hack work that any team going to win will do – getting the code repository setup, the tools primed, the workflow established).  The chance to win a $4K prize for $12K of work is just not worth it.  And of course, the SOH IP grab crosses the line. Any developer who goes to the SOH understanding the T&C will leave their best ideas at home. No one wants to give away their good ideas for nothing.

The Sydney Opera House is not the first example of a hackathon abuse nor will it be the last – but it highlights the wrong thinking that many businesses seem to have about hackathons – that hackathons are a way to get stuff built quickly and cheaply. So here’s some unsolicited advice to businesses thinking about holding hackathons from someone who’s been to lots of them and has seen how they work.

Hackathons are not competitions -  Hackers love to build stuff. We build apps, we build web sites, we build hardware gizmos, we build musical instruments. Hacking is all about being creative and building stuff. Nothing fosters creativity more than being in a room full of other like-minded folks. Folks that share your passion for building cool stuff. At a hackathon such as a Music Hack Day, the emphasis is not on prizes, the emphasis is on creativity.  At a Music Hack Day hackers form teams spontaneously to build stuff. They share ideas with each other, they help each other – they revel in every cool demo.  If you throw a big prize into the mix the dynamic changes dramatically. The hackathon becomes a competition.  Hackers become developers that are thinking strategically about how to win the prize. They don’t share ideas with others, they don’t go for the creative but risky idea – they go for the conservative idea and spend their extra energy making nice colors and fonts in the PowerPoint presentation for the demo.  In the early days of the Music Hack Day, we had one event where a big local sponsor brought a $10K cash prize. Not knowing any better, we went with it, but that was a mistake.  Yes, there were lots of hackers and lots of completed projects, but the whole vibe of the hackathon was different. The hackathon was no longer a center of creative sharing, instead it was a cut-throat event. The goal was no longer about being creative, the goal was to win $10K . We learned our lesson and now we make sure that prizes offered at Music Hack Days are modest. Note that there are some really good hackathons like HackerOlympics that are designed to be competitions. These hackathons value teams that can think quickly and creatively across a wide range of skill sets. Winners get bragging rights and modest prizes.

Don’t use a hackathon as a way to develop your app - no one wants to go to a hackathon to do work for someone else.  Hackers want to scratch their own creative itch , they don’t want to build your app for you.  No amount of free pizza is going to change that. Now,  if you’ve got a million dollars to spend, I’m sure you’ll get some good apps but that’s not the kind of hackathon I’d really want to go to.

Bottom line - if your hackathon has a T&C that requires developers to give up any rights to the stuff they’ve created at your hackathon you are doing it wrong.  If you are going to give away big prizes, don’t expect to have a creative, sharing atmosphere – if you give away big prizes expect to see people spend more time working on a powerpoint and less time on that creative but risky hack.  The currency at a hackathon should be creativity, not money or prizes and at the end of it all, the creators should own their own ideas. No amount of pizza should change that.

DSC_3200___Flickr_-_Photo_Sharing_

1 Comment

Children of the Hack (Angry Birds Edition)

I’m writing this post from Espoo Finland which is home to three disruptive brands: Nokia, who revolutionized the mobile phone market in the 1990s with its GSM technology;  Rovio, who brought casual gaming to the world with Angry Birds; and Children of Bodom perhaps one of the most well known melodic death metal bands. So it is not surprising that Espoo is a place where you will find a mix of high tech, playfulness and hard core music – which is exactly what I found this past weekend at the Helsinki Music Hack Day hosted at the Startup Sauna in Espoo Finland.

iPhoto

At the Helsinki Music Hack Day, dozens of developers gathered to combine their interest in tech and their passion for music in a 24 hour hacking session to build something that was music related. Representatives from tech companies such as SoundCloud, Spotify and The Echo Nest joined the hackers to provide information about their technologies and guidance in how to use their APIs.

After 24 hours, a dozen hacks were demoed in the hour-long demo session. There was a wide range of really interesting hacks. Some of my favorites are highlighted here:

Cacophony – A multi-user remote touch controlled beat data sequencer. This hack used the Echo Nest (via the nifty new SoundCloud/Echo Nest bridge that Erik and I built on the way to Espoo), to analyze music and then allow you to use the beats from the analyzed song to create a 16 step sequencer. The sequencer can be controlled remotely via a web interface that runs on an iPad. This was a really nice hack, the resulting sequences sounded great.  The developer, Pekka Toiminen used music from his own band Different Toiminen which has just released their first album. You can see the band and Pekka in the video:

It was great getting to talk to Pekka, I hope he takes his hack further and makes an interactive album for his band.

Hackface & Hackscan - by hugovk This is a pretty novel set of hacks. Hackface takes the the top 100 or 1000 artists from your listening history on Last.fm, finds photos of the artists (via the Echo Nest API), detects faces using a face detection algorithm, intelligently resizes them and composites them into a single image giving you an image of what your average music artist in your listening history looks like.

Projects____Music_Hack_Day_Helsinki_2013____Hacker_League-2

Hackscan - takes a video and summarizes it intelligently into a single image by extracting single columns of pixels from each frame.  The result is a crazy looking image that captures the essence of the video.

Hugo was a neat guy with really creative ideas. I was happy to get to know him.

Stronger Harder Faster Jester  – Tuomas Ahva and Valtteri Wikstrom built the first juggling music hack that I’ve seen in the many hundreds of hack demos I’ve witnessed over the years. Their hack used three bluetooth-enabled balls that when thrown triggered music samples.

Photo via @tuomasahvra

Photo via @tuomasahvra

 

The juggler juggles the balls in time with the music and the ball tossing triggers music samples that align with the music. The Echo Nest analysis is used to extract the salient pitch info for the aligment.  It was a really original idea and great fun to watch and listen to. This hack won the Echo Nest prize.

iPhoto

µstify - This is the classic boy meets girl story. Young man at his first hackathon meets a young woman during the opening hours of the hackathon.

Screenshot_11_18_13__5_55_PM

They decide to join forces and build a hack (It’s Instagram for Music!) and two days later they are winning the hackathon!  Alexandra and Arian built a nifty hack that builds image filters (in the style of Instagram) based upon what the music sounds like. They use The Echo Nest to extract all sorts of music parameters and use these to select image filters.  Check out their nifty presentation.

Gig Voter - this Spotify app provides a way for fans to get their favorite artists to come to their town. Fans from a town express an interest in an artist. Artists get a tool or helping them plan their tour based on information about where their most active fans actually are as well as helping them sell gigs to location owners by being able to prove that there is demand for them to perform at a certain location. Gig Voter uses Echo Nest data to help with the search and filtering.

Pitbull_-_What_would_you_like_to_see_us_do__and_Edit_Post_‹_Music_Machinery_—_WordPress

Hit factory  - Hit Factory is a generative music system that creates music based upon your SoundCloud tastes and adapts that music based upon your feedback . Unfortunately, no samples of the music are to be found online, but take my word, they were  quite interesting – not your usual slightly structured noise.

Abelton Common Denominator – a minimal, mini-moog style interface to simplify the interaction with Abelton – by Spotify’s Rikard Jonsson.

Dropbox_-_Screenshot_2013-11-17_13.45.46

Swap the Drop - this was my hack. You can read more about it here.

Swap_the_Drop_for_Kill_EVERYBODY_by_Skrillex

One unusual aspect of this Music Hack Day was that a couple of teams that encountered problems and were unable to finish their hacks still got up and talked about their failures.   It was pretty neat to see hardcore developers get up in front of a room full of their peers and talk about why they couldn’t get Hadoop to work on their terrabyte dataset or get their party playlister based on Meteor to run inside Spotify.

iPhoto

I’ve enjoyed my time in Espoo and Helsinki. The Hack Day was really well run. It was held in a perfect hacking facility called the Startup Sauna.

iPhoto

There was plenty of comfortable hacking spots, great wifi, and a perfect A/V setup.

@sferik in a classic hacking position

@sferik in a classic hacking position

The organizers kept us fed with great food (Salmon for lunch!), great music, including a live performance by Anni.

Anni performs. Photo by @sferik

Anni performs. Photo by @sferik

There was plenty of Angry Birds Soda.

iPhoto

Many interesting folks to talk to …

iPhoto

Thanks to Lulit and the rest of the Aaltoes team for putting together such a great event.

iPhoto

,

Leave a comment

Swap the Drop

I’ve been in Helsinki this weekend (which is not in Sweden btw) for the Helsinki Music Hack Day.  I wanted to try my hand at a DJ app that will allow you to dynamically and interactively mix two songs.  I started with Girl Talk in a Box, ripped out the innards and made a whole bunch of neat changes:

  1. You can load more than one song at a time. Each song will appear as its own block of music tiles.
  2. You can seamlessly play tiles from either song.
  3. You can setup branch points to let you jump from an point in one song to any point in another (or the same) song.
    Swap_the_Drop_for_Kill_EVERYBODY_by_Skrillex
  4. And the killer feature – you can have two active play heads  allowing you to dynamically interact with two separate audio streams.  The two play heads are always beat matched (the first play head is the master that sets the tempo for everyone else). You can cross-fade between the two audio streams – letting you move different parts of the song into the foreground and the background.

All the regular features of Girl Talk in a Box are retained – bookmarks, arrow key control, w/a/s/d navigation and so on.  See the help for more details on the controls.

You can try the app here:  Swap the Drop

, ,

Leave a comment

PAPPA – Paul’s Awesome Party Playlisting App

For my Boston Music Hack Day hack I built Yet Another Party Playlisting App (YAPPA), because the world needed another party playlister – but really, I built it because I needed another hack, because 15 hours into the 24 hour hackathon I realized that my first hack just wasn’t going to work (more on that in another post). And so, with 9 hours left in the hack day, I thought I would try my hand at the party playlisting app.

The YAPPA is a frequently built app. In some sense one can look at the act of building a YAPPA as a hacking exercise. Just as a still life painter will practice by painting a bowl of fruit, or a pianist will practice scales, a music hacker can build their hacking muscle by creating a YAPPA.

The essential features of a YAPPA are straightforward – create a listening experience for a party based upon the tastes of the guests.  Allow guests to suggest music for the party, apply some rules to select music that satisfies all the guests, and keep the music flowing.

With those features in mind, I created my party playlisting app. The interface is dead simple – guests can add music to the party via the master web interface or text the artist and song from the mobile phones to the party phone number. Once the party has started, PAPPA will keep the music flowing.

WSIW_-_Avicii-2

The key technology of PAPPA is how it picks the music to play next. Most YAPPAs will try to schedule music based on fairness so that everyone’s music taste is considered. Some YAPPAs also use song attributes such as song hotttnesss, song energy and danceability to make sure that the music matches the vibe of the party. PAPPA takes a very different approach to scheduling music. That’s because PAPPA takes a very different approach to parties. PAPPA doesn’t like parties. PAPPA wants everyone to go home. So PAPPA takes all of these songs that have been carefully texted to the party phone number, along with all the artist and song suggestions submitted via the web and throws them away. It doesn’t care about the music taste of the guests at the party. In fact it despises their taste (and the guests as well). Instead, PAPPA selects and plays the absolute worst music it can find. It gives the listener an endless string of the most horrible (but popular) music. Here’s a sample (the first 3 songs are bait to lure in the unwitting party guests):

  1. Royals by Lorde
  2. Levels by Avicii
  3. Blurred Lines by Robin Thicke
  4. #Twerkit featuring Nicki Minaj by Busta Rhymes
  5. From The Bottom Of My Broken Heart by Britney Spears
  6. Amigas Cheetahs by The Cheetah Girls
  7. Do Ya Think I’m Sexy by Paris Hilton
  8. Incredible by Clique Girlz
  9. No Ordinary Love by Jennifer Love Hewitt
  10. Mexican Wrestler by Emma Roberts
  11. I Don’t Think About It by Emily Osment
  12. A La Nanita Nana by The Cheetah Girls
  13. Don”t Let Me Be The Last To Know by Britney Spears
  14. Wild featuring Big Sean by Jessie J
  15. Heartbeat (Album Version) by Paris Hilton
  16. Love The Way You Love Me by The Pussycat Dolls
  17. When You Told Me You Loved Me by Jessica Simpson
  18. Jericho by Hilary Duff
  19. Strip by Brooke Hogan
  20. Pero Me Acuerdo De Tí by Christina Aguilera
  21. Bang Bang by Joachim Garraud
  22. Right Now featuring David Guetta (Sick Individuals Dub) by Rihanna
  23. Wilde Piraten by The Cool Kids
  24. Friend Lover by Electrik Red
  25. Betcha Can’t Do It Like Me by D4L
  26. Who’s That Girl by Hilary Duff
  27. Get In There, Frank! by Fun
  28. Hold It Don”t Drop It by Jennifer Lopez
  29. Sweet Sixteen by Hilary Duff
  30. Live It Up featuring Pitbull by Jennifer Lopez
  31. Freckles by Natasha Bedingfield
  32. I Want You by Paris Hilton
  33. Hold It Close by Fun
  34. Magic by The Pussycat Dolls
  35. How To Lose A Girl by Mitchel Musso
  36. Fairy Tales by JoJo
  37. Slow It Down featuring Fabolous (Album Version (Explicit)) by The-Dream
  38. Mr. Hamudah by Charles Hamilton
  39. Promise by Vanessa Hudgens
  40. Metamorphosis by Hilary Duff

How does PAPPA find the worst music in the world?  It looks through all the data that The Echo Nest is collecting about how people experience music online to find the songs that have been banned frequently. When a music listener says “ban this song” they are making a pretty strong statement about the song – essentially saying, “I do not ever want to hear that song again in my life”.  PAPPA finds these songs that have the highest banned-to-play ratio (i.e. the songs that have been proportionally banned the most when play count is taken into consideration) and adds them to the playlist. The result being a playlist filled with the most reviled music – with songs by Paris Hilton, Jennifer Love Hewitt and the great Emma Roberts. The perfect playlist to send your guests home.

At this moment, lets pause and listen to the song Mexican Wrestler by Emma Roberts:


What happens to all those carefully crafted text messages of songs sent by the guests?  No, there’s no Twilio app catching all those messages, parsing out songs and adding them to a play queue to be scheduled. They just go to my phone. That’s so if people are not leaving the party fast enough, I can use all the phone numbers of the guests to start to text them back and tell them they should go home.

photo-10

By the way, if you look at the songs that were texted to me during my two minute demo you’d realize how fruitless a YAPPA really is. There’s no possible way to make a party playlist that is going to satisfy everyone in the room. Tastes are too varied, and there’s always that guy who thinks he is clever by adding some Rick Astly to the party queue. Here’s what was texted to me during my two minute demo:

  1. Gregory Porter – be good
  2. Rebecca Black – It’s Friday
  3. Weird Al Yankovic – Fat
  4. Lady Gaga – Applause
  5. Weird Al Yankovic – Amish Paradise (from a different phone number from the other weird Al fan)
  6. Ghostbusters
  7. boss ass bitch
  8. Basement Jaxx raindrops
  9. John Mayer your body is a wonderland
  10. jay z holy grail
  11. Underworld spikee
  12. wake me up
  13. Britney Spears – Hit Me Baby One More Time
  14. Slayer War Ensemble
  15. Bieber baby
  16. KANYE
  17. Royksopp
  18. Ra Ra riot
  19. Rick Astley
  20. Mozart
  21. OSM
  22. Mikey Cyrus
  23. Hi paul
  24. Stevie wonder overjoyed

Imagine trying to build a party playlist based upon those 24 input songs. Admittedly, a hackathon demo session is not a real test case for a party playlister but I still think you’d end up with a terrible mix of songs that no smart algorithm, nor any smart human, could stitch together into a playlist that would be appropriate and pleasing for a party.  My guess is that if you did an A/B test for two parties, where one party played music based upon suggestions texted to a YAPPA and the other party played the top hotttest songs, the YAPPA party would always lose. I’d run this test, but that would mean I’d have to go to two parties. I hate parties, so this test will never happen. Its one of the flaws in our scientific method.

Who are the worst artists?
Looking at the PAPPA playlists I see a number of recurring artists – Britney Spears and Paris Hilton seem to be well represented. I thought it would be interesting to create a histogram of the top recurring artists in the most banned songs list.  Here’s the fascinating result:

PAPPA_-_Paul_s_Awesome_Party_Playlist_App

One thing I find notable about this list is the predominance of female artists.  Females outnumber males by a substantial amount.  Here’s some pie:

PAPPA_-_Paul_s_Awesome_Party_Playlist_App

80% of the most banned artists are female. A stunning result. There’s something going on here. Someone suggested that the act of banning a song is an aggressive act that may skew male, and many of these aggressively banning males don’t like to listen to female artists. More study is needed here. It may involve parties, so I’m out.

Wrapping it all up

I enjoyed creating my PAPPA YAPPA. Demoing it was really fun and the audience seemed to enjoy the twist ending.  The patterns in the data underlying the app are pretty interesting too. Why are so many banned songs by female artists?

If you are having your own party and want to use PAPPA to help enhance the party you can go to:

                     static.echonest.com/pappa/?phone=603+555+1212 

Just replace the phone number in the URL with your own and you are good to go.

PAPPA - Paul's Awesome Party Playlisting App - Ruining parties since 2013

PAPPA – Paul’s Awesome Party Playlisting App – Ruining parties since 2013

, , , , ,

1 Comment

Music Hack Day NYC

Music_Hack_Day_NYC_-_Splash

Music Hack Day NYC has just wrapped up, and what a great weekend it was!. Hosted at Spotify’s spiffy new headquarters in midtown, Music Hack Day NYC was the place to be if you are passionate music, technology and building stuff. During all night Friday and all day Saturday, hundreds of hackers used music APIs from companies like The Echo Nest, Soundcloud, Gracenote, Rdio and of course Spotify, to build next generation music apps.

spotify_entrance

It was a really fun event. The Spotify headquarters are perfect for hacking. Flawless and apparently limitless wifi/bandwidth, awesome A/V setup, and great sound for an unending social hacking playlist.

hackers-lg

Over the course of about 20 hours of hacking, 36 hacks were built and demoed.  There was quite a range of inventive hacks. Some of my favorites:

EERFY
The crowd favorite was Oscar Celma’s extremely clever EERFY – He solved the Music Industry Problem in 24 hours by turning it upside down with EERFY:

halfstep
Another favorite was Leo and Jason’s halfstep –  a chrome extension that motivates you to move more. How? If you only moved 20% of your movement goal yesterday, then halfstep will also let you listen to first 20% of any songs today. Check out the screencast of their hack.

Screenshot_10_21_13_12_27_PM

PartyOutlook
There were lots of great Echo Nest hacks including the Echo Nest prize winner partyOutlook by Matt Egan. PartyOutlook is a CocoaLibSpotify powered iPad jukebox that accepts tracks via the Twillio API and displays real-time information about the life of the party using Echo Nest song data. Allows an administrator to pause and play music, as well as skip tracks.

EFudpJI

TuneTravelr
Another really neat Echo Nest hack was TuneTravelr created by Chris Evans and Joshua Boggs. Tune Travelr  is a web app that  takes cities and locales a well as a time period and returns a  playlist of songs that were hot at the time. It uses the Echo Nest data to leverage some analytic querying, before pipping the results into Rdio’s web API for playback.

TuneTravelr

MoodVenue
MoodVenue used The Echo Nest API to help find out what’s going on tonight based on your mood and location.

Landing_Page___Mood_Venue

Repetition faceoff
Artists fight to the death, using only the sheer repetitive force of their music! By Brian McFee. Brian used the Echo Nest analysis data to build a custom metric for repetition for any song and used that to score songs by the artist for the face-off.

repfaceoff.png__1366×724_


Cheese Tray
A novel use of The Echo Nest API was Cheese Tray - A  Spotify app that takes selects randomly from among your Spotify playlists and analyzes it. It then adds to that playlist a song that best represents the average attributes of the playlist, as given by The Echo Nest API. Then, via SMS through the Twilio service, it sends a command to your Android device that changes its background to the album artwork for that average song.

logo (1)

Songs About
Uses wikipedia articles titled ‘List of songs about…” to generate Spotify/Rdio playlists about different subjects/places. Songs about used The Echo Nest’s Rosetta Stone to get the song IDs for playing in Spotify and Rdio.

Topics_and_Edit_Post_‹_Music_Machinery_—_WordPress-2


Awesome Chart Explorer

This is my hack. A visualization that lets you explore and listen to 50 years of Billboard charts.
ss

ccRex
Upload a song, ccRex’ll fetch Creative Commons music to match using Echo Nest song attributes to determine the best match.

CCREX

Other nifty Echo Nest hacks:

  • opporTUNEcontext dependent playlisting based upon weather, activity, location, time of day and your favorite genresopporTUNE____Music_Hack_Day_NYC_2013____Hacker_League
  • crowdPlay – an SMS enabled party playlisterCrowdPlay_-2
  • BPM Reader –  an app that updates a playlist in real-time based on user keyboard input correlated to BPM. Tap in your beat, and generate a playlist of songs with that rhythm.facemelter.neocities.org
  • Moody callsGet a phone call with a song that matches your moodMoodyCalls
  • Spotify V. Rdio -Pitting the two music platforms against each other using your listening history
    .
    Spotify_v._Rdio-2
  • Perl client for the Echo Nest – Ajax built a library that provides support for nearly all of The Echo Nest API features.
    trs-80_WWW-TheEchoNest

All in all, it was a great event with lots of awesome, innovative hacks and lots of smart people. A good time was had by all.  Thanks to Spotify and @mager for organizing the event. Well Done!

Andrew_Mager_-_SXSW_2010___Flickr_-_Photo_Sharing_

Leave a comment

Follow

Get every new post delivered to your Inbox.

Join 997 other followers