liveBook · Manning

Data mesh

As explained in Kafka for Architects

A data mesh architecture is a decentralized data architecture in which domain teams own and provide data products under federated governance.

A data mesh decentralizes analytical data ownership. Instead of making a central warehouse team collect and interpret every domain, domain teams publish reliable data products for others to consume. section 7.2

A workable data mesh combines four principles:

  • Domain ownership: domain teams decide what data to expose, how to structure it, and how to maintain its quality. section 7.2 section 7.2.1
  • Data as a product: published data has clear contracts, quality guarantees, and semantics that make it reliable for consumers. section 7.2 section 7.2.1
  • Federated governance: decentralized teams still follow shared business, legal, security, and interoperability standards. section 7.2 section 7.2.1
  • Self-serve platform: automated tools expose planned changes and let consumers access data without depending heavily on a central team. section 7.2

Kafka can provide the integration layer: topics and schemas establish domain boundaries, while producers publish data products and consumers use them independently. Schema Registry supports technical data contracts, but cross-domain products still require collaboration, and the mesh remains a conceptual framework rather than a prescribed technology. section 7.2.1 section 7.2

Replacing the analytical bottleneck

A warehouse-centered organization makes analytical teams gather data from every domain and build logic across changing application models. A mesh shifts responsibility to those domains, with Kafka exposing their data products and shared governance preserving enterprise-wide requirements. section 7.1.5 section 7.2

How Kafka for Architects covers it

How deep it goes
Defines four principles and maps them to Kafka, but stops short of prescribing an implementation technology or detailed operating procedures.
Examples
Contrasts a central data warehouse with domain-owned analytical data published through Kafka topics and schemas.
What it assumes
Assumes familiarity with analytical repositories and microservice principles, while defining the data mesh principles explicitly.
What you can do after
Evaluate whether Kafka can support domain ownership, data products, federated governance, and self-serve analytical access.
How it connects
Connects domain ownership and data products with federated governance, self-serve platforms, event-driven systems, Kafka topics, and Schema Registry.

Also explained in

Compare how 3 books explain data mesh →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Kafka for Architects. The section links point to the parts of the book it draws on.