liveBook · Manning

Managed Kafka service

As explained in Kafka for Architects

A managed Kafka service is a hosted Kafka offering in which an external provider operates the Kafka infrastructure.

A managed Kafka service is a hosted Kafka offering in which a cloud provider provisions and operates the infrastructure. It shifts hardware maintenance, cluster configuration, monitoring, patching, and updates away from the customer, allowing teams to focus on application development. section 9.2.1

Evaluate the trade-offs against operating Kafka on premises:

  • Reduce infrastructure workload, including provisioning, monitoring, security patching, and disaster-recovery operations. section 9.2.1
  • Accept less control over broker configuration and Kafka version upgrades. section 9.2.1
  • Account for higher costs at scale and possible vendor lock-in through proprietary features and integrations. section 9.2.1

Choosing a deployment model

A small company can use a managed service to avoid operating brokers and observability infrastructure. A large enterprise with dedicated Kafka engineers may choose on-premises Kafka to fine-tune performance and optimize costs. section 9.2.1

How Kafka for Architects covers it

How deep it goes
Contrasts operational responsibilities, configuration limits, upgrade control, cost, and lock-in without detailing provider implementation.
Examples
Contrasts managed Kafka for small companies with on-premises Kafka for enterprises owning Kafka engineering expertise.
What it assumes
Assumes familiarity with Kafka deployment and related mechanisms such as SASL, SSL, monitoring, and replication.
What you can do after
Evaluate deployment fit by weighing operational effort, tuning control, upgrade autonomy, cost, and provider dependence.
How it connects
Connects Kafka deployment with cloud providers, authentication, monitoring, disaster recovery, replication, and vendor lock-in.

Also explained in

Compare how 2 books explain managed Kafka service →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Kafka for Architects. The section links point to the parts of the book it draws on.