Paper: M3R – Increased Performance for In-Memory H

For the weekend reads, a paper authored by a reseach team from IBM:

Main Memory Map Reduce (M3R) is a new implementation of the Hadoop MapReduce (HMR) API targeted at online analytics on high mean-time-to-failureclusters. It does not support resilience, and supports only those workloadswhich can fit into cluster memory. In return, it can run HMR jobs unchanged— including jobs produced by compilers for higher-level languages such asPig, Jaql, and SystemML and interactive front-ends like IBM BigSheets —while providing significantly better performance than the Hadoop engine onseveral workloads (e.g. 45x on some input sizes for sparse matrix vectormultiply). M3R also supports extensions to the HMR API which can enable MapReduce jobs to run faster on the M3R engine, while not affecting theirperfor- mance under the Hadoop engine.
Download PDF

Original title and link: Paper: M3R – Increased Performance for In-Memory Hadoop Jobs (NoSQL database?myNoSQL)

Paper: M3R – Increased Performance for In-Memory H

相关文章:

你感兴趣的文章:

标签云: