Avro
A language-independent data serialization system that uses schemas to encode structured data, commonly in a compact binary format.
Kafka Streams in Action, Second Edition
Apache Avro is a data serialization system that uses schemas and supports language-independent serialization, code generation, and schema evolution.
- How it is used
- Enforces event-data contracts between Kafka producers and consumers through registered schemas and integrated serializers.
- How deep it goes
- Explains JSON record schemas, generated Java objects, serializer configuration, and specific versus generic consumer records; defers compatibility details.
- Examples
- Uses an Avengers schema and generated AvengerAvro objects, including a Black Widow event sent to and read from Kafka.
- What you can do after
- Apply it via KafkaAvroSerializer, KafkaAvroDeserializer, Schema Registry, and generated Java records.
Read how Kafka Streams in Action, Second Edition explains Avro →
Kafka for Architects
Avro is a data serialization system that represents structured records with schemas and a compact binary encoding.
- How it is used
- Defines language-independent event contracts and compact serialized data for Kafka-based customer events.
- How deep it goes
- Explains schema components, compact encoding, generated versus dynamic access, and registry-based serialization without an end-to-end implementation walkthrough.
- Examples
- Uses a Client record schema, an externally referenced user-profile schema, and Kafka producer and consumer configurations.
- What you can do after
- Apply it via Avro schemas and KafkaAvroSerializer to encode Kafka messages and maintain externally referenced event contracts.
Microservices Patterns, Second Edition
A schema-based data serialization system that supports compact encoding and schema resolution between writers and readers.
- How it is used
- Uses compact binary payloads for high-throughput interprocess communication.
- How deep it goes
- Contrasts field encoding with Protocol Buffers and explains schema-dependent deserialization, but does not detail registry operation.
- What you can do after
- Evaluate Avro’s compactness and schema requirements against the tooling and flexibility trade-offs of other message formats.
Read how Microservices Patterns, Second Edition explains Avro →
Apache Kafka in Action
Avro is a schema-based data serialization system that encodes structured data in a compact binary format.
- How it is used
- Provides compact, schema-governed messages for Kafka topics whose data must remain interpretable across consumers and schema versions.
- How deep it goes
- Explains binary encoding, self-describing messages, schema size trade-offs, registry identifiers, and compatibility, but not producer implementation.
- Examples
- Uses a product record with typed fields, an optional origin value, binary payload sizing, and schema IDs in Kafka messages.
- What you can do after
- Evaluate Avro deployments by balancing compact payloads, readable schemas, registry overhead, and compatibility across evolving consumers.
Also covered in
What to know first
- JSONJSON is a language-independent text-based data-interchange format that represents structured values using objects, arrays, strings, numbers, booleans, and null.
- JSON SchemaJSON Schema is a standard vocabulary and specification for describing, validating, and annotating the structure and constraints of JSON data.
- protobufProtocol Buffers is a language- and platform-neutral system for defining structured data schemas and serializing messages in a compact binary format, with support for generated code.
- bytesBytes are an ordered sequence of byte values, typically eight-bit units, used to represent binary data.
Related concepts
- binary formatkind of · A binary format is a defined representation that encodes information as machine-readable bits or bytes rather than as human-readable text.
- schema registryused by · A schema registry is a service that stores, versions, and provides schemas for structured data, often validating compatibility between schema versions.
- JSONuses · JSON is a language-independent text-based data-interchange format that represents structured values using objects, arrays, strings, numbers, booleans, and null.
- KafkaAvroSerializerused by · KafkaAvroSerializer is a Kafka serializer that encodes Avro records and communicates with Schema Registry to obtain their schemas.
Questions about Avro
What is Avro?
A language-independent data serialization system that uses schemas to encode structured data, commonly in a compact binary format.
Which Manning books explain Avro?
Kafka Streams in Action, Second Edition, Kafka for Architects, Microservices Patterns, Second Edition and Apache Kafka in Action.
What should I know before learning Avro?
Manning books that teach Avro usually introduce JSON, JSON Schema, protobuf and bytes first.
What is Avro a kind of?
Avro is a kind of binary format. A binary format is a defined representation that encodes information as machine-readable bits or bytes rather than as human-readable text.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.



