Repository navigation
hadoop-mapreduce
- Website
- Wikipedia
MapReduce, Spark, Java, and Scala for Data Algorithms Book
Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
Use the MapReduce's Java interface to distributed crawle the data of Chinese universities and learn basic knowledge of hdfs.
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Big data projects implemented by Maniram yadav
K-Means algorithm implementation with Hadoop and Spark for the course of Cloud Computing of the MSc AIDE at the University of Pisa.
A collection of mapreduce problems and solutions
This contain how to install Hadoop on google colab and how to run map-reduce in Hadoop
Projects done in the Cloud Computing course.
Source code for the examples in the book Cloud Computing Solutions Architect: A Hands-On Approach by Arshdeep Bahga and Vijay Madisetti
中文文本挖掘|舆情分析|Hadoop|Java|MapReduce
Data Engineering Course
Student projects in Big Data field.
2021 Spring (Distributed Computing Systems) 分布式系统与编程
Twitter + Flume + Hadoop (HDFS, MapReduce) + Neo4j + Pyhton
I installed Hadoop on Virtual Machine and all Assignments are performed on Ubuntu OS. Refer to this repo for completion of the Hadoop Assignments. It is recommended that you have a stable internet connection while doing these things.