note

【グイグイのDX学習マガジン】MapReduce（マップリデュース）

個人的な学習のための投稿していく「グイグイのDX学習マガジン」です。 DXに関連する用語を投稿しています。 MapReduce（マップリデュース） MapReduceを一言で説明するなら、「大きな仕事を『分ける（Map）』と『まとめる（Reduce）』の2段階で、みんなに ...
GitHub

Building a Distributed MapReduce Protocol (from Scratch)

About A fully custom MapReduce engine built from scratch using Python sockets (TCP). Designed and deployed on a distributed Linux cluster (Telecom Paris 30+VM). Implements WordCount and Distributed ...
GitHub

S-Varshaa-Sai-Sripriya/ScaleMap-MapReduce-Prototype-SLURM-Python-HPC-Big-Data

This work was developed and tested on Seawulf, Stony Brook University's research computing cluster. Seawulf is an HPC environment that provides login nodes, batch scheduling (SLURM), and shared ...
Built In Chicago

How C++ is Used in Big Data Development

Although not immediately obvious, C++ is used in Big Data along with Java, MapReduce, Python, and Scala. For example, if you’re using a Hadoop framework, it will be implemented in Java, but MapReduce ...