This page (revision-133) was last changed on 19-Mar-2020 23:30 by kmrdev

This page was created on 09-Mar-2018 02:16 by UnknownAuthor

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
133 19-Mar-2020 23:30 2 KB kmrdev to previous
132 19-Mar-2020 23:29 2 KB kmrdev to previous | to last
131 19-Mar-2020 23:28 2 KB kmrdev to previous | to last
130 19-Mar-2020 23:27 2 KB kmrdev to previous | to last
129 19-Mar-2020 23:25 2 KB kmrdev to previous | to last
128 14-Feb-2020 17:16 3 KB kmrdev to previous | to last
127 14-Feb-2020 17:15 3 KB kmrdev to previous | to last
126 23-Aug-2018 21:05 3 KB kmrdev to previous | to last
125 23-Aug-2018 19:45 3 KB kmrdev to previous | to last
124 23-Aug-2018 19:09 3 KB kmrdev to previous | to last
123 23-Aug-2018 19:03 3 KB kmrdev to previous | to last
122 10-Jun-2018 18:03 3 KB kmrdev to previous | to last
121 10-Jun-2018 17:55 3 KB kmrdev to previous | to last

Page References

Incoming links Outgoing links

Version management

Difference between version and

At line 4 changed 2 lines
KMR-1.0 is available on the K computer since 2013-04-26.
KMR works on ordinary clusters as well.
KMR-1.0 is available since 2013-04-26.
KMR works on ordinary clusters as well as large-scale supercomputers.
KMR source code is available under the BSD license.
At line 7 changed one line
__Latest release is KMR-1.2 (2014-06-27)__.
__Latest release is KMR-1.9 (2018-08-27)__.
At line 11 changed 2 lines
Its main targets are large-scale supercomputers with thousands of compute nodes, such as K and Fujitsu FX10.
On these platforms, KMR provides utilities other than the map-reduce operations which address issues such as accessing very large file-systems.
Its main targets are large-scale supercomputers with thousands of compute nodes.
KMR provides utilities other than map-reduce operations to address issues such as accessing very large file-systems, on platforms K and Fujitsu FX10.
At line 14 changed one line
KMR is designed to work on-memory and exploits large amount of memory available on supercomputers, whereas most map-reduce implementations are designed to work with external (disk-based) operations.
KMR is designed to work in-memory and exploit large amount of memory available on supercomputers, whereas most map-reduce implementations are designed to work with external (disk-based) operations.
At line 18 removed 5 lines
!!Project Site
* Project Overview and other Activities of the Team at RIKEN:
** [http://mt.aics.riken.jp]
At line 25 changed 2 lines
* Overview and API Document:
** [http://mt.aics.riken.jp/kmr/docs/kmr-1.2/html/index.html]
* [Overview and API Document|https://riken-rccs.github.io/kmr/]
At line 28 removed 6 lines
//* Overview and API Document (Newer, corrected, for the next release):
//** [https://mt.aics.riken.jp/kmr/docs/next/html/index.html]
//** Documentation in the distribution is late, and it is placed here for late breaking.
* Tutorial:
** KMR Tutorial in AICS Software Seminar on May 20, 2014 (Japanese)
*** [Handout|Main/tutorial140520.pdf], [Q&A List|Main/tutorialQaA140520.pdf]
At line 37 changed 3 lines
* Source Code Download:
** [Download]
** KMR source is available with LGPL-2.1.
* [Download]
At line 41 changed one line
!!Issue Reporting
!!Tutorials
At line 43 changed 3 lines
* KMR Issue Tracker:
** [http://mt.aics.riken.jp/jtrac/]
** Please make a new user by the login-page to report a new issue.
* [Tutorial] (in Japanese)
At line 47 changed one line
!!Publications
!!Project Site
At line 49 changed 2 lines
* [cluster2013.pdf]: __K MapReduce: A Scalable Tool for Data-Processing and Search/Ensemble Applications on Large-Scale Supercomputers__. Motohiko Matsuda, Naoya Maruyama, and Shinichiro Takizawa. IEEE Cluster Computing (CLUSTER) 2013. (C) Copyright IEEE. [IEEE Explore|http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6702663].\\
It describes an overview and optimisations used in KMR.
* KMR in GitHub [https://github.com/riken-rccs]
* Issue reporting [https://github.com/riken-rccs/kmr/issues]
* Other software from RIKEN R-CCS [https://riken-rccs.github.io]
At line 52 changed one line
----
!!Publications
At line 54 changed one line
!!DISCLAIMER
* __K MapReduce: A Scalable Tool for Data-Processing and Search/Ensemble Applications on Large-Scale Supercomputers__. Motohiko Matsuda, Naoya Maruyama, and Shinichiro Takizawa. IEEE Cluster Computing (CLUSTER) 2013. (C) Copyright IEEE. [ieeexplore.ieee.org|https://ieeexplore.ieee.org/document/6702663]\\
It describes an overview and optimizations used in KMR.
At line 56 changed 3 lines
KMR comes with ABSOLUTELY NO WARRANTY.
This wiki also comes with ABSOLUTELY NO WARRANTY.
Contents are liable to change.
* __Supporting Workflow Management of Scientific Applications by MapReduce Programming Model__. Shinichiro Takizawa, Motohiko Matsuda, and Naoya Maruyama. IPSJ HPCS 2014. (in Japanese) [hpcs2014.pdf]\\
It describes some scientific applications workflow implemented in MapReduce using KMR.
At line 46 added 3 lines
* __Evaluation of Asynchronous MPI Communication in Map-Reduce System on the K Computer__. Motohiko Matsuda, Naoya Maruyama, and Shinichiro Takizawa. EuroMPI Workshop 2014. (C) Copyright ACM. [dl.acm.org|https://dl.acm.org/doi/10.1145/2642769.2642800]\\
It compares all-to-all collective communication versus asynchronous communication in shuffling communication, to qualify believed effectiveness of overlapping of communication and computation.
At line 64 changed 2 lines
KMR is a product of RIKEN AICS.
Part of the results is obtained by using the K computer at RIKEN AICS.
KMR is a product of RIKEN R-CCS.
Part of the results is obtained by using K computer at RIKEN R-CCS.
At line 57 added 6 lines
!!DISCLAIMER
KMR comes with ABSOLUTELY NO WARRANTY.
This wiki also comes with ABSOLUTELY NO WARRANTY.
Contents are liable to change.