Getting started with Confluent Kafka as a data professional – part 4

Overview

This is the 4th part of an article series explaining how to publish and consume your own events using the Confluent Platform for Kafka, and the corresponding C# libraries. Because of the length, the article has been broken up into four pieces. The first part explains the context, the 2nd part explains the code for the publisher, the 3rd part goes through the consumer code.

Finally, in this 4th part the end to end process will be demonstrated in a video.

Sample code is provided in https://github.com/RoelantVos/confluent-data-object-mapping.

Creating this working example with the provided resources was a bit of trial-and-error in some cases. Especially the .Net support is very new at the time of writing, hence the idea to publish my experiences here.

Most of the code has been modified from the excellent set of examples provided by Confluent on https://github.com/confluentinc/confluent-kafka-dotnet and https://docs.confluent.io/current/clients/dotnet.html.

Video overview

The video is uploaded to YouTube: https://youtu.be/3ng1v_SjDWc.

To create this demonstration I have compiled the producer console application, as it’s not possible to debug two separate applications in the same Visual Studio solution. While the producer is running like this we can debug the consumer to see what’s happening behind the scene.

Happy developing!