MapReduce as a monad transformer

Current status

A while ago, I wrote a piece describing a simple way of implementing MapReduce as a Monad in Haskell.  As part of my further research I’ve discovered that in fact MapReduce is very naturally a Monad Transformer.  This means that given any monadic type m one can associate to it a MapReduce type MapReduceT m.  If m is an Additive Monad, then so is MapReduceT m.

This is theoretically interesting, as well as providing a nice pedagogical introduction to Monad Transformers and Additive Monads.  Furthermore, I have proved that the Haskell State Monad is in fact the MapReduce type associated to the (rather trivial) monad of maps.  I’ve written this up in a short paper, and would welcome comments and, to be honest, suggestions as to anywhere I could try to publish it.

Next steps

I’m working (slowly) on a distributed version of this framework based on CloudHaskell, at the moment limiting myself to the original, simple MapReduce monad.  So far I have distributed storage working, so when I get the time, it should not take much more effort.  If anyone is interested in joining in with this research programme, I’d be very happy to share the work.

References

Here are the relevant papers:

  1. Map Reduce as a Monad: the original paper, published in The Monad Reader
  2. The MapReduce type of a Monad: the new paper describing MapReduceT and the relation to the State monad

Published by Julian Porter

Mathematician, Philosopher, Musician, Writer, Computer Scientist. Whatever I do I do it with passion, if not well.

4 replies on “MapReduce as a monad transformer”

Comments are closed.