Description

“Redpanda Streaming: Kafka‑Compatible Performance with Simple Ops”

Redpanda Streaming: High-Performance Kafka-Compatible Event Streaming

Event streaming is at the heart of modern data platforms, but managing traditional JVM-based Kafka clusters often introduces operational complexity, higher resource consumption, and unpredictable latency. Redpanda offers a streamlined alternative—a high-performance, C++-based, single-binary streaming platform that delivers Kafka API compatibility while significantly reducing infrastructure overhead.

Redpanda Streaming: Kafka-Compatible Performance with Simple Ops is designed for experienced data engineers, systems architects, and DevOps professionals who want to build scalable, low-latency, event-driven applications without the operational burden of traditional streaming platforms.

This comprehensive guide explores the architecture and design principles that make Redpanda a powerful solution for modern streaming workloads. You’ll gain a deep understanding of its thread-per-core execution model, Raft-based consensus, and the technologies that enable exceptional throughput and reliability.

Inside the book, you’ll learn how to:

• Design high-performance producers and consumers for reliable event streaming.
• Ensure data durability, fault tolerance, and efficient backpressure management.
• Understand Redpanda’s architecture and performance optimization techniques.
• Deploy and manage Redpanda using both Bring Your Own Cloud (BYOC) and serverless environments.
• Implement robust data governance with Schema Registry.
• Build declarative data pipelines using Redpanda Connect.
• Create real-time stream-to-table lakehouse architectures with Apache Iceberg.
• Scale event-driven systems while simplifying operations and infrastructure management.

Combining practical guidance with advanced architectural concepts, this book equips you with the knowledge to design, deploy, and operate high-performance streaming systems using Redpanda. Whether you’re modernizing existing Kafka workloads or building new event-driven platforms, you’ll discover strategies for achieving greater scalability, lower latency, and simpler operations.