Comments on: How to process a million songs in 20 minutes

By: Thierry BM

Thierry BM — Sun, 23 Oct 2011 02:03:47 +0000

Fun fact: if you want to run it on ~500 machines to impress your ISMIR colleagues but you’re an AWS newbie, you’re limited to 20 EC2 instances; still cool, but less “pazzaz”. Also AWS EMR takes about 3 min to actually start.

By: tanjk

tanjk — Thu, 08 Sep 2011 15:48:53 +0000

drums play notes.

By: test

test — Wed, 07 Sep 2011 20:34:04 +0000

I think the difference between musical notes and drum hits should be made here—those “dense” tracks are just a bunch of repetitive drum hits.

By: Twirrim

Twirrim — Wed, 07 Sep 2011 06:02:07 +0000

Arthur: Not true, Jeffrey Dean and Sanjay Ghemawat of Google were the creators of MapReduce. The concepts of mapping and reducing weren’t novel, but MapReduce is the name of Google’s implementation of the process, done in a way to suit clustering on their scale. You can read their paper here: http://static.googleusercontent.com/external_content/untrusted_dlcp/labs.google.com/en/us/papers/mapreduce-osdi04.pdf

By: Arthur Ice

Arthur Ice — Tue, 06 Sep 2011 20:36:06 +0000

Google popularized map reduce, they did not invent it.

By: ashwiniyer

ashwiniyer — Tue, 06 Sep 2011 14:15:22 +0000

Why Do I get the feeling that spotify has a similar technology in play?

By: Eugenio Tacchini

Eugenio Tacchini — Sun, 04 Sep 2011 22:28:18 +0000

Very interesting approach, thanks for sharing!