ApacheKafkaisagreatopensourceplatformforhandlingyourreal-timedatapipelinetoensurehigh-speedfilteringandpatternmatchingonthe?y.Inthisbook,youwilllearnhowtouseApacheKafkaforefficientprocessingofdistributedapplicationsandwillgetfamiliarwithsolvingeverydayproblemsinfastdataandprocessingpipelines.ThisbookfocusesonprogrammingratherthantheconfigurationmanagementofKafkaclustersorDevOps.Itstartsoffwiththeinstallationandsettingupthedevelopmentenvironment,beforequicklymovingontoperformingfundamentalmessagingoperationssuchasvalidationandenrichment.HereyouwilllearnaboutmessagecompositionwithpureKafkaAPIandKafkaStreams.Youwilllookintothetransformationofmessagesindifferentformats,suchasext,binary,XML,JSON,andAVRO.Next,youwilllearnhowtoexposetheschemascontainedinKafkawiththeSchemaRegistry.YouwillthenlearnhowtoworkwithallrelevantconnectorswithKafkaConnect.WhileworkingwithKafkaStreams,youwillperformvariousinterestingoperationsonstreams,suchaswindowing,joins,andaggregations.Finally,throughKSQL,youwilllearnhowtoretrieve,insert,modify,anddeletedatastreams,andhowtomanipulatewatermarksandwindows.