- Apache Hadoop 3 Quick Start Guide
- Hrishikesh Vijay Karambelkar
- 139字
- 2021-06-10 19:18:45
Workload and computational requirements
While the previous two areas cover the sizing of the cluster, the workload requirements drive the computational capabilities of the cluster. All CPU-intensive operations require a higher count of CPUs and better configuration for computing. The number of Mapper and Reducer jobs that are run as a part of Hadoop also contribute to the requirements. Mapper tasks are usually higher than Reducer tasks, for example. The ratio of Mapper and Reducer is determined by processing requirements at both ends.
There is no definitive count that one can reach regarding memory and CPU requirements, as they vary based on replicas of block, the computational processing of tasks, and data storage needs. To help with this, we have provided a calculator which considers different configurations of a Hadoop cluster, such as CPU-intensive, memory-intensive, and balanced.
- 大學(xué)計(jì)算機(jī)信息技術(shù)導(dǎo)論
- 零起步輕松學(xué)單片機(jī)技術(shù)(第2版)
- ETL with Azure Cookbook
- 一本書玩轉(zhuǎn)數(shù)據(jù)分析(雙色圖解版)
- 教父母學(xué)會上網(wǎng)
- 數(shù)據(jù)挖掘?qū)嵱冒咐治?/a>
- 21天學(xué)通Java Web開發(fā)
- 21天學(xué)通Visual C++
- 計(jì)算機(jī)與信息技術(shù)基礎(chǔ)上機(jī)指導(dǎo)
- DevOps Bootcamp
- Dreamweaver CS6中文版多功能教材
- 統(tǒng)計(jì)挖掘與機(jī)器學(xué)習(xí):大數(shù)據(jù)預(yù)測建模和分析技術(shù)(原書第3版)
- 基于ARM9的小型機(jī)器人制作
- 網(wǎng)絡(luò)服務(wù)器搭建與管理
- 三菱FX/Q系列PLC工程實(shí)例詳解