Echo Nest analysis and visualization for Dopplereffekt – Scientist

, , ,

1 Comment

Normalisr – Time-based charts of your last.fm data

Worth checking out: Normalisr

,

2 Comments

Goodnight Netbeans, Hello Eclipse

I’ve been a user of Netbeans, Sun’s Java IDE for about 5 years now. In general I’ve been pretty happy with it – it was the first IDE that made me want to give up using  VIM and a command line to develop Java.  However there have been some nagging issues in the last few releases.  Sometimes the Netbeans syntax highlighter will insist that there are syntax errors in the source when there are none.  No matter what I do, I can’t convince Netbeans that the code is good.  The code compiles and runs just fine, but Netbeans keeps telling me that there’s a problem with the code:

The ‘artist’ object indeed has a getHotness() method but Netbeans just doesn’t know about it.  There have been a few other problems – I’ve had to resort to the commandline for SVN – netbeans seems to get confused about my repository, and performance has always been a bit slow, (startup time in particular).

This week I saw that there’s a new release candidate for Netbeans 6.8. I downloaded and installed it, hoping that it would fix some of the problems I was having.  However, after using it for a few days I’m ready to toss it off my hard drive.

The performance of Netbeans on my system is abysmal.  The editor frequently freezes for 5 seconds or more,  likewise, I can’t scroll through a source file without seeing the beachball.  Even simple cursor movement can take a second for the editor to respond.  At first I assumed that there was something wrong with my install, so I uninstalled and re-installed, telling Netbeans to not import any of my old Netbeans data, but that didn’t help.  Looking at my CPU, I see that Netbeans wants to use nearly 100% of my CPU even when it is idling.

Compare the Netbeans CPU load to Eclipse as they both sit idle (this is after Netbeans has been running for 30 minutes at least, so it should be done with all of its scanning).   Now to be fair, I checked with SteveG – he said he hasn’t had any of these problems, so it seems that my performance issues with the new Netbeans are atypical, but that doesn’t really help me get my work done.

This week Google released GWT 2.0 – I’ve always been a big fan of GWT so I thought I’d give the new version a whirl.  GWT has really good Eclipse integration, so I used this as an excuse to give Eclipse a try.  So far, I like what I see.  The GWT and App engine integration is really well done.   I was able to create and deploy a GWT application to the Google app engine in about 30 minutes, while watching a rerun of the office (the episode where Dwight sets the office on fire and gives Stanley a heart attack).

And so, after using Netbeans for 5 years,  I’m ready to give Eclipse a try.  The next app from scratch I write I’ll use Eclipse.

3 Comments

Hottt or Nottt?

At the Echo Nest we have lots of data about millions of artists.  It can be interesting to see what kind of patterns can be extracted from this data.  Tim G suggested an experiment where we see if we can find artists that are on the verge of breaking out by looking at some of this data.   I tried a simple experiment to see what we could find.   I started with two pieces of data for each artist.

  1. Familiarity – this corresponds to how well known in artist is.  You can look at familiarity as the likelihood that any person selected at random will have heard of the artist.  Beatles have a familiarity close to 1, while a band like ‘Hot Rod Shopping Cart’ has a familiarity close to zero.
  2. Hotttnesss – this corresponds to how much buzz the artist is getting right now. This is derived from many sources, including mentions on the web, mentions in music blogs, music reviews, play counts, etc.

I collected these 2 pieces of data for 130K+ artists and plotted them.  The following plot shows the results.  The x-axis is familiarity and the y-axis is hotttnesss.   Clearly there’s a correlation between hotttnesss and familiarity.  Familiar artists tend to be hotter than non-familiar artists.  At the top right are the Billboard chart toppers like Kanye West and Taylor Swift, while at the bottom left are artists that you’ve probably never heard of like Mystery Fluid.    We can use this plot to find the up and coming artists as well as the popular artists that are cooling off.  Outliers to the left and  above the main diagonal are the rising stars (their hotttnesss exceeds their familiarity).  Here we see artists like Willie the Kid, Ben*Jammin and  ラディカルズ (a.k.a. Rock the Queen).  While artists below the diagonal are well known, but no longer hot. Here we see artists like Simon & Garfunkel, Jimmy Page and Ziggy Stardust.  Note that this is not a perfect science – for instance, it is not clear how to rate the familiarity for artist collaborations – you may know James Brown and you may know Luciano Pavarotti, but you may not be familiar with the Brown/Pavarotti collaboration – what should the familiarity of this collaboration be? the average of the two artists, or should it be related to how well known the collaboration itself is? Hotttnesss can also be tricky with extremely unfamiliar artists.  If a Hot Rod Shopping Cart track gets 100 plays it could substantially  increase the band’s hotttnesss (‘Hey! We are twice as popular as we were yesterday!’)

Despite these types of confounding factors, the familiarity / hotttnesss model still seems to be a good way to start exploring for new, potentially unsigned acts that are on the verge of breaking out.    To select the artists, I did the simplest thing that could possibly work: I created a ‘break-out’ score which is simply ratio of hotttnesss to familiarity.  Artists that have a high hotttnesss as compared to their familiarity are getting a lot of web buzz but are still relatively unknown.  I calculated this break-out score for all artists and used it to select the top 1000 artists with break-out potential, as well as the bottom 1000 artists (the fade-aways).  Here’s a plot showing the two categories:

Here are 10 artists with high break-out scores that might be worth checking out:

,

7 Comments

Rage against the pop machine this xmas

There’s a movement this year to take back the Christmas charts from smarmy pop artists churned out by music factories like the  X factor and Idol franchises.  The kickoff to this movement is this exhortation posted in the ‘Rage Against the machine for Xmas #1‘ Facebook group:

Fed up of Simon Cowell’s latest karaoke act being Christmas No.1?
Me too… So who’s up for a mass-purchase of the track ‘KILLING IN THE NAME’ from December 13th (DON’T BUY IT YET!) as a protest to the X-Factor monotony?

The group already has nearly 150K members and has received press coverage in stereoboard, nme, Drownedinsound and  BritishMusicScene.

Now ‘Killing in the name’ isn’t exactly your typical Christmas song, so to help get people into the spirit of the projects I thought I would try to make the song be a bit more appealing to those with traditional Christmas music sensibilities.  And so, I fired up the Echo Nest Jingler and generated a Christmas version of ‘Killing in the Name’.  (The Jingler is a bit of software that will Xmas-ify any song by automatically adding sleigh bells, signal bells and the occasional Santa-ho). Here are the results:

This is just to get you in the Rage against Christmas mood.  Remember to buy the track on December 13.

,

3 Comments

From Nickelback to Bickelnack

I saw that Nickelback  just received a Grammy nomination for Best Hard Rock Performance with their song ‘Burn it to the Ground’ and wanted to celebrate the event. Since Nickelback is known for their consistent sound, I thought I’d try to remix their Grammy-nominated performance to highlight their awesome self-similarity.  So I wrote a little code to remix ‘Burning to the Ground’ with itself.  The algorithm I used is pretty straightforward:

  1. Break the song down into smallest nuggets of sound (a.k.a segments)
  2. For each segment, replace it with a different segment that sounds most similar

I applied the algorithm to the music video.  Here are the results:

Considering that none of the audio is in its original order,  and 38% of the original segments are never used, the remix sounds quite musical and the corresponding video is quite watchable.  Compare to the original (warning, it is Nickelback):

Feel free to browse the source code, download remix and try creating your own.

, ,

13 Comments

Boston Music Hack Day is in the can.

I’ve almost recovered from the Boston Music Hack Day.  Here’s a retrospective of posts, tweets video and images about the event.  First, lots of people have written about their experiences at the hack day. Here’s a sampling:

Some Videos:

Ian Hogarth from Songkick:

Bodega Girls at the Echo Nestival

Photos:

Click for slide show

Lots of friendly tweets too.

 

,

Leave a comment

The Spotified Billboard Charts – now with real playlists

Last month I Spotified the Billboard charts by using the Billboard and Spotify APIs.  However, I wasn’t actually able to create real Spotify playlists since the Spotify web API doesn’t allow creating or manipulating playlists.  But now I’m a premium Spotify user and as a premium user I can use the libspotify / despotify API to do just about anything that the official Spotify client can do.  With my new found Spotify superpower, I revamped my Billboard charts creator to create real Spotify playlists:

The Spotified Billboard Singles Charts

Instead of having to click on every song to listen to it, just click on the chart – this will open the Spotify playlist – hit play and you’ll be in Billboard chart heaven (or hell, depending on your music taste).

To interact with Spotify I used Jotify – a Java client library (based on despotify)  for Spotify.  Jotify is  well written, full featured library written by Felix Bruns (who has been extremely helpful in answering my questions).   I highly recommend Jotify.

, ,

1 Comment

A Singular Christmas

Oh lookie – Brian has re-posted his Singular Christmas

,

Leave a comment

Visualizing the Artist Space

Take a look at Kurt’s weekend hack to make a visualization of the Echo Nest artist similarity space.  Very nice.  Can’t wait for Kurt to make it interactive and show artist info. Neat!

, , ,

3 Comments