官术网_书友最值得收藏!

Chapter 3. Hadoop Essentials – Configurations, Unit Tests, and Other APIs

In this chapter, we will cover:

  • Optimizing Hadoop YARN and MapReduce configurations for cluster deployments
  • Shared user Hadoop clusters – using Fair and Capacity schedulers
  • Setting classpath precedence to user-provided JARs
  • Speculative execution of straggling tasks
  • Unit testing Hadoop MapReduce applications using MRUnit
  • Integration testing Hadoop MapReduce applications using MiniYarnCluster
  • Adding a new DataNode
  • Decommissioning DataNodes
  • Using multiple disks/volumes and limiting HDFS disk usage
  • Setting the HDFS block size
  • Setting the file replication factor
  • Using the HDFS Java API
主站蜘蛛池模板: 汉中市| 介休市| 蓝山县| 巧家县| 深泽县| 玉溪市| 尼木县| 闸北区| 乌兰县| 阜平县| 都昌县| 四平市| 鹿邑县| 错那县| 柘荣县| 溧水县| 全州县| 兴隆县| 新余市| 巨鹿县| 万盛区| 西宁市| 博白县| 绍兴市| 阳西县| 江达县| 阳谷县| 本溪市| 贺兰县| 山西省| 子洲县| 平陆县| 武乡县| 延边| 克东县| 尼玛县| 武城县| 杭锦旗| 新乐市| 屏山县| 六盘水市|