Small and furry, well ... definitely furry. [source]

Wednesday, January 5, 2011

In memory map/reduce framework

map/reduce frameworks are usually used for very large datasets. However the map/reduce workflow works well for some tasks.

Clojure makes it easy to have a map reduce framework that utilizes all the CPUs.



And here the word count (the map reduce "Hello World") example:

1 comment:

  1. good example!!

    but why (mapcat identity lst) instead (apply concat lst)??

    ReplyDelete