Consumer group
Also called: Kafka consumer group, partition consumer group
A consumer group coordinates workers that share message consumption, but the precise rules depend on the messaging system. In Kafka’s partition-based consumer groups, each assigned partition belongs to one member at a time. Separate groups can independently read the same topic. This differs from a generic queue that distributes individual messages among available workers.
For example, a Kafka topic has four partitions and an indexing group has two consumers. Each consumer can own two partitions; a separate analytics group reads the topic independently. Membership changes can trigger reassignment, and committed offsets determine where processing resumes. Group membership alone does not make side effects exactly once. Other systems’ queue groups and Kafka’s share groups use different coordination models.
- Read first
- Kafka wire protocol
- Further reading
- Apache Kafka — KafkaConsumer API