目錄(206章)
倒序
- Coverpage
- Title Page
- Copyright
- Building Data Streaming Applications with Apache Kafka
- Credits
- About the Authors
- About the Reviewer
- www.PacktPub.com
- Why subscribe?
- Customer Feedback
- Preface
- What this book covers
- What you need for this book
- Who this book is for
- Conventions
- Reader feedback
- Customer support
- Downloading the example code
- Downloading the color images of this book
- Errata
- Piracy
- Questions
- Introduction to Messaging Systems
- Understanding the principles of messaging systems
- Understanding messaging systems
- Peeking into a point-to-point messaging system
- Publish-subscribe messaging system
- Advance Queuing Messaging Protocol
- Using messaging systems in big data streaming applications
- Summary
- Introducing Kafka the Distributed Messaging Platform
- Kafka origins
- Kafka's architecture
- Message topics
- Message partitions
- Replication and replicated logs
- Message producers
- Message consumers
- Role of Zookeeper
- Summary
- Deep Dive into Kafka Producers
- Kafka producer internals
- Kafka Producer APIs
- Producer object and ProducerRecord object
- Custom partition
- Additional producer configuration
- Java Kafka producer example
- Common messaging publishing patterns
- Best practices
- Summary
- Deep Dive into Kafka Consumers
- Kafka consumer internals
- Understanding the responsibilities of Kafka consumers
- Kafka consumer APIs
- Consumer configuration
- Subscription and polling
- Committing and polling
- Additional configuration
- Java Kafka consumer
- Scala Kafka consumer
- Rebalance listeners
- Common message consuming patterns
- Best practices
- Summary
- Building Spark Streaming Applications with Kafka
- Introduction to Spark
- Spark architecture
- Pillars of Spark
- The Spark ecosystem
- Spark Streaming
- Receiver-based integration
- Disadvantages of receiver-based approach
- Java example for receiver-based integration
- Scala example for receiver-based integration
- Direct approach
- Java example for direct approach
- Scala example for direct approach
- Use case log processing - fraud IP detection
- Maven
- Producer
- Property reader
- Producer code
- Fraud IP lookup
- Expose hive table
- Streaming code
- Summary
- Building Storm Applications with Kafka
- Introduction to Apache Storm
- Storm cluster architecture
- The concept of a Storm application
- Introduction to Apache Heron
- Heron architecture
- Heron topology architecture
- Integrating Apache Kafka with Apache Storm - Java
- Example
- Integrating Apache Kafka with Apache Storm - Scala
- Use case – log processing in Storm Kafka Hive
- Producer
- Producer code
- Fraud IP lookup
- Storm application
- Running the project
- Summary
- Using Kafka with Confluent Platform
- Introduction to Confluent Platform
- Deep driving into Confluent architecture
- Understanding Kafka Connect and Kafka Stream
- Kafka Streams
- Playing with Avro using Schema Registry
- Moving Kafka data to HDFS
- Camus
- Running Camus
- Gobblin
- Gobblin architecture
- Kafka Connect
- Flume
- Summary
- Building ETL Pipelines Using Kafka
- Considerations for using Kafka in ETL pipelines
- Introducing Kafka Connect
- Deep dive into Kafka Connect
- Introductory examples of using Kafka Connect
- Kafka Connect common use cases
- Summary
- Building Streaming Applications Using Kafka Streams
- Introduction to Kafka Streams
- Using Kafka in Stream processing
- Kafka Stream - lightweight Stream processing library
- Kafka Stream architecture
- Integrated framework advantages
- Understanding tables and Streams together
- Maven dependency
- Kafka Stream word count
- KTable
- Use case example of Kafka Streams
- Maven dependency of Kafka Streams
- Property reader
- IP record producer
- IP lookup service
- Fraud detection application
- Summary
- Kafka Cluster Deployment
- Kafka cluster internals
- Role of Zookeeper
- Replication
- Metadata request processing
- Producer request processing
- Consumer request processing
- Capacity planning
- Capacity planning goals
- Replication factor
- Memory
- Hard drives
- Network
- CPU
- Single cluster deployment
- Multicluster deployment
- Decommissioning brokers
- Data migration
- Summary
- Using Kafka in Big Data Applications
- Managing high volumes in Kafka
- Appropriate hardware choices
- Producer read and consumer write choices
- Kafka message delivery semantics
- At least once delivery
- At most once delivery
- Exactly once delivery
- Big data and Kafka common usage patterns
- Kafka and data governance
- Alerting and monitoring
- Useful Kafka matrices
- Producer matrices
- Broker matrices
- Consumer metrics
- Summary
- Securing Kafka
- An overview of securing Kafka
- Wire encryption using SSL
- Steps to enable SSL in Kafka
- Configuring SSL for Kafka Broker
- Configuring SSL for Kafka clients
- Kerberos SASL for authentication
- Steps to enable SASL/GSSAPI - in Kafka
- Configuring SASL for Kafka broker
- Configuring SASL for Kafka client - producer and consumer
- Understanding ACL and authorization
- Common ACL operations
- List ACLs
- Understanding Zookeeper authentication
- Apache Ranger for authorization
- Adding Kafka Service to Ranger
- Adding policies
- Best practices
- Summary
- Streaming Application Design Considerations
- Latency and throughput
- Data and state persistence
- Data sources
- External data lookups
- Data formats
- Data serialization
- Level of parallelism
- Out-of-order events
- Message processing semantics
- Summary 更新時間:2022-07-12 10:38:49
推薦閱讀
- 數(shù)據(jù)庫系統(tǒng)原理及MySQL應用教程(第2版)
- HTML5+CSS3+JavaScript從入門到精通:上冊(微課精編版·第2版)
- 微信公眾平臺與小程序開發(fā):從零搭建整套系統(tǒng)
- Programming ArcGIS 10.1 with Python Cookbook
- Python高效開發(fā)實戰(zhàn):Django、Tornado、Flask、Twisted(第3版)
- C#程序設計
- HTML5從入門到精通 (第2版)
- 前端HTML+CSS修煉之道(視頻同步+直播)
- Java系統(tǒng)化項目開發(fā)教程
- Service Mesh實戰(zhàn):基于Linkerd和Kubernetes的微服務實踐
- C#程序設計(項目教學版)
- 3ds Max印象 電視欄目包裝動畫與特效制作
- C語言程序設計實訓教程與水平考試指導
- Java7程序設計入門經(jīng)典
- jQuery Mobile Web Development Essentials(Second Edition)
- Scratch超人漫游記:創(chuàng)意程序設計:STEAM創(chuàng)新教育指南
- Python程序設計
- JavaScript前端開發(fā)程序設計教程(微課版)
- 羅布樂思開發(fā)官方指南:Lua 語言編程
- 正則指引(第2版)
- SignalR Blueprints
- C++碼農(nóng)日記(全程視頻講解)
- Android設計模式與最佳實踐
- 面向?qū)ο蟮乃伎歼^程(原書第5版)
- HTML5+CSS3+JavaScript Web前端開發(fā)案例教程(慕課版)
- Reactive Programming for .NET Developers
- 麥克奇遇記:Scratch 2.0探險之旅(創(chuàng)客教育)
- Excel VBA程序開發(fā)自學寶典
- Mastering Cross:Platform Development with Xamarin
- 自己動手寫網(wǎng)絡爬蟲(修訂版)