Topic summary

hadoop

hadoop

Extracted from the Wikipedia article Apache Hadoop.

Overview

  • Hadoop Common - contains libraries and utilities needed by other Hadoop modules;
  • Hadoop Distributed File System (HDFS) - a distributed file-system that stores data on commodity machines, providing very high aggregate bandwidth across the cluster;
  • Hadoop YARN - (introduced in 2012) is a platform responsible for managing computing resources in clusters and using them for scheduling users' applications;
  • Hadoop MapReduce - an implementation of the MapReduce programming model for large-scale data processing.
  • Hadoop Ozone - (introduced in 2020) An object store for Hadoop