!!! Welcome to KMR

This is KMR, a high-performance map-reduce library.
KMR-1.0 is available on the K Computer in "/opt/aics/kmr" now (2013-04-26).
KMR works on ordinary clusters as well.

KMR is a set of high-performance map-reduce operations in the MPI (Message Passing Interface) environment.
It is to make programming for data-processing much easier by hiding low-level details of message passing.
Its main target is large-scale computers with thousands of nodes, K and Fujitsu FX10.
On these platforms, KMR provides utilities other than the map-reduce operations
to address issues such as accessing very large file-systems.

KMR assumes large amount of memory and designed to work on-memory, whereas most map-reduce implementations are designed to work with external (disk-based) operations.
So, data exchanges in KMR occur as message passing instead of remote file operations.
The KMR routines work in bulk-synchronous and the most part of the code is sequential, but the code inside the mapper and reducer are multi-threaded.

* Project Overview and other Activities of the Team:
** [http://mt.aics.riken.jp]


* Overview and API Document:
** [http://mt65.aics.riken.jp/kmrdoc/kmr-1.0/html/index.html]
** It is a Doxgen generated document, included in the installation.
* Overview and API Document (Newer, corrected, for the next release):
** [http://mt65.aics.riken.jp/kmrdoc/next/html/index.html]
** Documentation in the distribution is late, and it is placed here for late breaking.

!!Issue Tracker

* KMR Issue Tracker:
** [https://mt65.aics.riken.jp/jtrac/]
** Please make a new user by the login-page to report a new issue.


* Download:
** [https://mt65.aics.riken.jp/kmr/Wiki.jsp?page=Download]
** KMR source is available with LGPL-2.1.



This wiki also comes with ABSOLUTELY NO WARRANTY.
Contents are liable to change.



KMR is a product of AICS, Riken.
Part of the results is obtained by using K Computer at AICS, RIKEN.


Are you lost?, for wiki on mt65 try: [https://mt65.aics.riken.jp/wiki/]