Kafka Go Getting Started

This project demonstrates how to use Go with Apache Kafka using the confluent-kafka-go client library. It includes simple producer and consumer examples, and a Docker Compose setup for running Kafka locally.

following Confluent documentation

Prerequisites

• Go 1.22+
• Docker
• Docker Compose

Project Structure

• producer.go: Kafka producer example
• consumer.go: Kafka consumer example
• docker-compose.yml: Local Kafka, Schema Registry, and related services
• go.mod, go.sum: Go module files

Getting Started

1. Start Kafka and Dependencies

Start the Kafka environment using Docker Compose:

docker-compose up -d

install go dependencies

go mod tidy

3. Run the Producer Send random purchase events to the purchases topic:

./out/producer

4. Run the Consumer Consume and print events from the purchases topic:

./out/consumer