Blog

Discover articles about Apache Kafka, Event Streaming, Real Time Data Processing, Apache Kafka Use Cases, and Strimzi for Kafka that inform, inspire, and give you the latest insights.

Start your Apache Kafka Journey here, and don't miss out on expert advice.

Latest Apache Kafka Blogs

Understanding Kafka Connect

Apache Kafka has become a central component of modern data architectures, enabling real-time data streaming and integration across distributed systems. Within Kafka’s ecosystem, Kafka Connect plays a crucial role as a powerful framework designed for seamlessly moving data between Kafka and external systems. Kafka Connect provides a standardized, scalable approach to data integration, removing the need for complex custom scripts or applications. For architects, product owners, and senior engineers, Kafka Connect is essential to understand because it simplifies data pipelines and supports low-latency, fault-tolerant data flow across platforms. But what exactly is Kafka Connect, and how can it benefit your architecture?

Apache Kafka
Kafka Topics and Partitions - The building blocks of Real Time Data Streaming

Apache Kafka is a powerful platform for handling real-time data streaming, often used in systems that follow the Publish-Subscribe (Pub-Sub) model. In Pub-Sub, producers send messages (data) that consumers receive, enabling asynchronous communication between services. Kafka’s Pub-Sub model is designed for high throughput, reliability, and scalability, making it a preferred choice for applications needing to process massive volumes of data efficiently. Central to this functionality are topics and partitions—essential elements that organize and distribute messages across Kafka. But what exactly are topics and partitions, and why are they so important?

Event Streaming
How to use Strimzi Kafka: Opening a Kubernetes shell on a broker pod and listing all topics

Strimzi Kafka offers an efficient solution for deploying and managing Apache Kafka on Kubernetes, making it easier to handle Kafka clusters within a Kubernetes environment. In this article, we'll guide you through opening a shell on a Kafka broker pod in Kubernetes and listing all the topics in your Kafka cluster using an SSL-based connection.

Strimzi Kafka

Browse by category:

Read more about Real Time Data & Event Streaming

Rachel van Egmond
August 9, 2024
Transforming Healthcare IT: Apache Kafka for Legacy Modernization
Transforming Healthcare IT: Apache Kafka for Legacy Modernization

Apache Kafka powers real-time data streaming and modernizes legacy healthcare systems. It enables seamless integration across platforms, improving efficiency and patient care by supporting standards like HL7, FHIR, and JSON. Kafka bridges old and new, enhancing data-driven healthcare.

Apache Kafka for Business
Rachel van Egmond
August 9, 2024
Transactional Outbox Pattern
Transactional Outbox Pattern

The Transactional Outbox Pattern addresses the dual-write problem by ensuring that database and message broker updates are atomic, consistent, and reliable, streamlining data synchronization between systems.

Apache Kafka
Rachel van Egmond
August 6, 2024
Kafka platform for energy
Kafka platform for energy

Kafka empowers energy providers to analyze real-time data from smart meters and IoT devices, enabling them to dynamically adjust the supply and encourage consumers to reduce consumption during peak times.

Apache Kafka for Business
Rachel van Egmond
August 1, 2024
Real-time data is revolutionizing energy solutions
Real-time data is revolutionizing energy solutions

Real-time data is at the core of this blog's exploration into Axual's platform and its transformative impact on a leading producer and supplier of natural gas, electricity, and heat in the Netherlands. Serving over 2 million business and residential customers, the company benefits significantly from dynamic pricing and telemetry collection. This discussion will highlight how real-time data processing revolutionizes the company's operations and aligns seamlessly with its business objectives.

Real Time Data Processing
Rachel van Egmond
July 26, 2024
TenneT Kafka for grid monitoring | use case
TenneT Kafka for grid monitoring | use case

TenneT, a leading European electricity Transmission System Operator, uses Axual's Kafka platform for real-time data streaming. This helps them monitor the grid better and make fast decisions. Axual's platform makes it easier for TenneT to handle large amounts of data, improve their technology, and work more efficiently.

Apache Kafka Use Cases
Rachel van Egmond
July 26, 2024
Energy Trading – checklist for Kafka implementation and process optimization
Energy Trading – checklist for Kafka implementation and process optimization

Implementing Apache Kafka in your energy trading system can feel overwhelming, with technical complexities, internal stakeholders, and extensive research to navigate. However, this climb can improve efficiency and innovation in your trading operations, offering new vistas of opportunity.

Apache Kafka for Business
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.