Kafka wire protocol
Also called: Apache Kafka protocol
Kafka clients communicate with brokers using a versioned binary protocol over TCP. Requests cover operations such as discovering cluster metadata, producing records, and fetching records. Clients use metadata to find the brokers responsible for the topic partitions they need.
For example, a consumer requests records from a partition starting at an offset, while a producer sends records to its partition leader. Ordering is defined within a partition, not across an entire multi-partition topic. The wire protocol also carries coordination operations; Kafka is more than a generic queue with one global sequence.
- Further reading
- Apache Kafka — Protocol guide