官术网_书友最值得收藏!

Reduce

The reducer takes the grouped data as input and runs a reduce function once per key grouping. The function is passed the key and an iterator over all of the values associated with that key. A wide range of processing can happen in this function, as we'll see in many of our patterns. The data can be aggregated, filtered, and combined in a number of ways. Once the reduce function is done, it sends zero or more key/value pairs to the final step, the output format. Like the map function, the reduce function will change from job to job since it is a core piece of logic in the solution. The reducer can have a lot of customization including writing output to HDFS, output to Elasticsearch index, and output to RDBMS or a NoSQL such as Cassandra, HBase, and so on. 

主站蜘蛛池模板: 陇川县| 青岛市| 平凉市| 黄浦区| 勃利县| 鱼台县| 边坝县| 定边县| 吉木萨尔县| 大港区| 阿拉善盟| 安溪县| 德兴市| 三门县| 芜湖县| 天气| 方山县| 乌什县| 满洲里市| 红河县| 怀集县| 通州市| 阳高县| 班玛县| 张家界市| 珠海市| 朝阳区| 西华县| 大化| 桂林市| 固原市| 黎川县| 建瓯市| 乌海市| 磐安县| 保山市| 南部县| 鄂托克旗| 新乡县| 临泽县| 新晃|