官术网_书友最值得收藏!

Big data application architecture

Big data, such as documents, web blogs, social networks, sensor data, and others, are stored in a NoSQL database, such as MongoDB, or a distributed filesystem, such as HDFS. In case we deal with structured data, we can deploy database capabilities using systems such as Cassandra or HBase, which are built atop Hadoop. Data processing follows the MapReduce paradigm, which breaks data processing problems into smaller sub problems and distributes tasks across processing nodes. Machine learning models are finally trained with machine learning libraries such as Mahout and Spark.

MongoDB is a NoSQL database, which stores documents in a JSON-like format. You can read more about it at  https://www.mongodb.org . Hadoop is a framework for the distributed processing of large datasets across a cluster of computers. It includes its own filesystem format, HDFS, job scheduling framework, YARD, and implements the MapReduce approach for parallel data processing. We can learn more about Hadoop at  http://hadoop.apache.org/ . Cassandra is a distributed database management system that was built to provide fault-tolerant, scalable, and decentralized storage. More information is available at  http://cassandra.apache.org/ . HBase is another database that focuses on random read/write access for distributed storage. More information is available at  https://hbase.apache.org/ .
主站蜘蛛池模板: 西吉县| 昌宁县| 南靖县| 宾阳县| 宣恩县| 衡山县| 新民市| 金堂县| 乐亭县| 衡山县| 桃园市| 昌平区| 平潭县| 梧州市| 万山特区| 乡宁县| 太和县| 高淳县| 萝北县| 满洲里市| 抚宁县| 宁武县| 偏关县| 禄劝| 长顺县| 敦化市| 嘉义市| 旌德县| 潮州市| 上饶县| 北流市| 昌吉市| 德惠市| 龙南县| 远安县| 金平| 永丰县| 秭归县| 子洲县| 互助| 小金县|