Mastering Kafka Streams and ksqlDB (1 ed)

Working with unbounded, high-velocity data streams has long been a challenge. With Kafka Streams and ksqlDB, however, building powerful stream processing applications becomes both accessible and enjoyable. This practical guide teaches data engineers how to leverage these tools to move, enrich, and transform large volumes of data in real time, creating highly scalable solutions.

Authored by Mitch Seymour, data services engineer at Mailchimp, the book explains key stream processing concepts through real-world business problems. You’ll gain insight into the strengths of Kafka Streams and ksqlDB, helping you select the right tool for each project. For non-Java developers, the ksqlDB approach offers an approachable and intuitive introduction to stream processing.

What You Will Learn:

• Fundamentals of Kafka and the publish/subscribe communication pattern
• How to build both stateless and stateful stream processing applications using Kafka Streams and ksqlDB
• Advanced stateful operations, including windowed joins and aggregations
• The inner workings of stateful processing under the hood
• ksqlDB’s data integration capabilities via Kafka Connect
• Working with various collections in ksqlDB and performing push and pull queries
• Best practices for deploying Kafka Streams and ksqlDB applications to production

By the end of this book, you’ll have the expertise to design, implement, and operate real-time stream processing applications that are reliable, scalable, and ready for production.