Pinboard (jm)
https://pinboard.in/u:jm/public/
recent bookmarks from jmGoogle Replaces MapReduce With New Hyper-Scale Cloud Analytics System2014-06-26T12:42:20+00:00
http://www.datacenterknowledge.com/archives/2014/06/25/google-dumps-mapreduce-favor-new-hyper-scale-analytics-system/
jm“We don’t really use MapReduce anymore,” [Urs] Hölzle said in his keynote presentation at the Google I/O conference in San Francisco Wednesday. The company stopped using the system “years ago.”
Cloud Dataflow, which Google will also offer as a service for developers using its cloud platform, does not have the scaling restrictions of MapReduce. “Cloud Dataflow is the result of over a decade of experience in analytics,” Hölzle said. “It will run faster and scale better than pretty much any other system out there.”
Gossip on the mech-sympathy list says that 'seems that the new platform taking over is a combination of FlumeJava and MillWheel: http://pages.cs.wisc.edu/~akella/CS838/F12/838-CloudPapers/FlumeJava.pdf ,
http://static.googleusercontent.com/media/research.google.com/en/us/pubs/archive/41378.pdf']]>map-reduce google hadoop cloud-dataflow scalability big-data urs-holzle google-iohttps://pinboard.in/https://pinboard.in/u:jm/b:a9ddb55ae3e1/