Data Engineer
mediumde-kafka-streaming-basics
Kafka basics: topics, partitions, offsets, and consumer groups explained.
Answer
Kafka stores events in topics, split into partitions.
- Partitions provide ordering per partition
- Consumers track offsets
- Consumer groups share work across partitions
Design decisions include partition keys, retention, and delivery semantics (at-least-once). Idempotent processing and DLQs help handle retries safely.
Related Topics
KafkaStreamingDistributed Systems