mapreduce on yarn
时间: 2023-10-28 14:52:04 浏览: 41
MapReduce on YARN is a distributed computing framework used for processing large sets of data across a cluster of nodes. YARN (Yet Another Resource Negotiator) is the resource management layer of Hadoop, which manages resources such as memory, CPU, and disk storage in a Hadoop cluster. MapReduce is a programming model used for processing and generating large data sets.
MapReduce on YARN allows users to run MapReduce jobs on a Hadoop cluster in a distributed manner, providing high scalability, fault tolerance, and resource management. YARN allows multiple applications to share the same cluster resources, including MapReduce, Spark, and other data processing frameworks.
MapReduce on YARN works by breaking down large data sets into smaller chunks, which are then processed in parallel across multiple nodes in the cluster. The results are then aggregated and returned to the user. This allows for efficient processing of large data sets, as well as fault tolerance in the event of node failures.
相关推荐
![docx](https://img-home.csdnimg.cn/images/20210720083331.png)
![pdf](https://img-home.csdnimg.cn/images/20210720083512.png)
![pdf](https://img-home.csdnimg.cn/images/20210720083512.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)
![](https://csdnimg.cn/download_wenku/file_type_ask_c1.png)