官术网_书友最值得收藏!

Chapter 3. Hadoop Essentials – Configurations, Unit Tests, and Other APIs

In this chapter, we will cover:

  • Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
  • Shared user Hadoop clusters – using Fair and Capacity schedulers
  • Setting classpath precedence to user-provided JARs
  • Speculative execution of straggling tasks
  • Unit testing Hadoop MapReduce applications using MRUnit
  • Integration testing Hadoop MapReduce applications using MiniYarnCluster
  • Adding a new DataNode
  • Decommissioning DataNodes
  • Using multiple disks/volumes and limiting HDFS disk usage
  • Setting the HDFS block size
  • Setting the file replication factor
  • Using the HDFS Java API
主站蜘蛛池模板: 南澳县| 宣武区| 永顺县| 新干县| 进贤县| 噶尔县| 乌海市| 甘德县| 准格尔旗| 南川市| 曲松县| 区。| 威宁| 罗城| 新乐市| 乾安县| 宿松县| 明光市| 项城市| 兖州市| 洪湖市| 临高县| 米易县| 霍山县| 芦溪县| 府谷县| 金堂县| 饶河县| 靖宇县| 洛隆县| 荥经县| 伊春市| 桂平市| 横山县| 潍坊市| 临夏县| 桐乡市| 广东省| 曲阳县| 通海县| 磐石市|