Kafka Meetup
Migrating from Zookeeper to KRaft without downtime for your clients
About the event:
We are super excited to bring the community of Kafka enthusiasts together again, and we are doing so with a bang! On October 8th, we are offering you a lineup of interesting speakers with even more interesting topics. Be sure not to miss this one!
We are extremely proud to have Jakub Scholz as a speaker. As a Senior Principal Software Engineer at Red Hat he is one of the core contributors of Strimzi. His talk will be around the much discussed change in Kafka: KRaft. The talk will be followed by a live demo/talk by Daniel Mulder (Axual) and we are happy to confirm Erik Lindeman (Alliander) as the third speaker of the evening.
AGENDA
17:30 Doors open
17:30 - 18:30 Networking, food & drinks
18:30 - 19:15 "KRaft: Apache Kafka without its ZooKeeper" by Jakub Scholz (Senior Principal Software Engineer @ Red Hat)
19:20 - 20:05 "Migrating from Zookeeper to KRaft without downtime for your clients" by Daniël Mulder (Senior Cloud Engineer @ Axual)
20:10 - 21:00 "The road of Alliander to the effective use of kafka for all its users.... and where to go from here" by Erik Lindeman (Alliander)
21:00 - 21:30 Drinks & Kafka chit-chat
ABSTRACTS
KRaft: Apache Kafka without its ZooKeeper
For many years, Apache Kafka relied on Apache ZooKeeper to maintain its metadata and for coordination. But that is coming to an end. After a lot of work in the Apache Kafka community, ZooKeeper is going away and will be completely removed in Apache Kafka 4.0. It is replaced with Kafka’s own Raft-inspired implementation called KRaft. This is a major architecture change for all Kafka users, including those running Kafka on Kubernetes. It also has a huge impact on projects such as Strimzi which provide tooling for running Apache Kafka on Kubernetes. So, how does it work? What are the (dis)advantages? What does a ZooKeeper-less Kafka cluster look like? What were the main challenges when implementing KRaft support in Strimzi? All of this will be answered in this talk. It will also show a demo of what Strimzi's KRaft support looks like and go through the current ZooKeeper removal timeline.
Migrating from Zookeeper to KRaft without downtime for your clients
In the talk from Jakub, you have learned a ton about KRaft and what the main differences are between Zookeeper and KRaft. But what if you want to do this migration yourself? What does the journey of a Kafka operations engineer using Strimzi look like? In this talk, Daniël will add practice to the theory and perform a live migration of a Strimzi setup with Zookeeper to one using KRaft WITHOUT downtime for a Kafka client connecting to the cluster. You will learn more about the steps required, necessary configuration and some of the observability aspects of such a migration. And of course you will have a better idea of how simple the migration can actually be. Perhaps, after following this talk, you feel confident to do this migration yourself, too?
The road of Alliander to the effective use of kafka for all its users.... and where to go from here
Alliander, a group of companies active in the utilities sector, has been using Kafka for about 4 years. It started with a saas application on prem without a dedicated team to manage all the problems, questions, wishes and updates that arose. After several years the growth in demand for connections to Kafka was such that a new solution was wanted. That’s why, two years ago, a migration to a new platform was started, supported by a new team dedicated only to Kafka. Erik will speak about the journey of Alliander, how the team shifted from setting up the platform and migrating to it to focusing on how to improve the "customer experience" for all the users and all possible use cases.
Location
Axual HQ (Jaarbeursplein 22, Utrecht)
Please RSVP so we can arrange enough food & drinks!
We are looking forward to welcoming you Kafka enthusiasts again on October 8th.
Team Kafka Meetup Utrecht
KRaft: Apache Kafka without its ZooKeeper
Watch the on-demand webinar as we discuss:
We are super excited to bring the community of Kafka enthusiasts together again, and we are doing so with a bang! On October 8th, we are offering you a lineup of interesting speakers with even more interesting topics. Be sure not to miss this one!
We are extremely proud to have Jakub Scholz as a speaker. As a Senior Principal Software Engineer at Red Hat he is one of the core contributors of Strimzi. His talk will be around the much discussed change in Kafka: KRaft. The talk will be followed by a live demo/talk by Daniel Mulder (Axual) and we are happy to confirm Erik Lindeman (Alliander) as the third speaker of the evening.
AGENDA
17:30 Doors open
17:30 - 18:30 Networking, food & drinks
18:30 - 19:15 "KRaft: Apache Kafka without its ZooKeeper" by Jakub Scholz (Senior Principal Software Engineer @ Red Hat)
19:20 - 20:05 "Migrating from Zookeeper to KRaft without downtime for your clients" by Daniël Mulder (Senior Cloud Engineer @ Axual)
20:10 - 21:00 "The road of Alliander to the effective use of kafka for all its users.... and where to go from here" by Erik Lindeman (Alliander)
21:00 - 21:30 Drinks & Kafka chit-chat
ABSTRACTS
KRaft: Apache Kafka without its ZooKeeper
For many years, Apache Kafka relied on Apache ZooKeeper to maintain its metadata and for coordination. But that is coming to an end. After a lot of work in the Apache Kafka community, ZooKeeper is going away and will be completely removed in Apache Kafka 4.0. It is replaced with Kafka’s own Raft-inspired implementation called KRaft. This is a major architecture change for all Kafka users, including those running Kafka on Kubernetes. It also has a huge impact on projects such as Strimzi which provide tooling for running Apache Kafka on Kubernetes. So, how does it work? What are the (dis)advantages? What does a ZooKeeper-less Kafka cluster look like? What were the main challenges when implementing KRaft support in Strimzi? All of this will be answered in this talk. It will also show a demo of what Strimzi's KRaft support looks like and go through the current ZooKeeper removal timeline.
Migrating from Zookeeper to KRaft without downtime for your clients
In the talk from Jakub, you have learned a ton about KRaft and what the main differences are between Zookeeper and KRaft. But what if you want to do this migration yourself? What does the journey of a Kafka operations engineer using Strimzi look like? In this talk, Daniël will add practice to the theory and perform a live migration of a Strimzi setup with Zookeeper to one using KRaft WITHOUT downtime for a Kafka client connecting to the cluster. You will learn more about the steps required, necessary configuration and some of the observability aspects of such a migration. And of course you will have a better idea of how simple the migration can actually be. Perhaps, after following this talk, you feel confident to do this migration yourself, too?
The road of Alliander to the effective use of kafka for all its users.... and where to go from here
Alliander, a group of companies active in the utilities sector, has been using Kafka for about 4 years. It started with a saas application on prem without a dedicated team to manage all the problems, questions, wishes and updates that arose.
After several years the growth in demand for connections to kafka was such that a new solution was wanted. That’s why, two years ago, a migration to a new platform was started, supported by a new team dedicated only to kafka. Erik will speak about the journey of Alliander, how the team shifted from setting up the platform and migrating to it to focusing on how to improve the "customer experience" for all the users and all possible use cases.
Location
Axual HQ (Jaarbeursplein 22, Utrecht)
Please RSVP so we can arrange enough food & drinks!
We are looking forward to welcoming you Kafka enthusiasts again on October 8th.
Team Kafka Meetup Utrecht
About the speakers
Daniel is a seasoned software engineer with over seven years of experience at Axual, where he specializes in building innovative solutions in the tech industry. Prior to joining Axual in 2017, Daniel worked as a Java Consultant at Capgemini, honing his expertise in Java development for nearly three years.
