Confluent REST Proxy

As explained in Kafka for Architects

Confluent REST Proxy is a service that exposes Kafka production, consumption, and administration operations through HTTP-based interfaces.

Confluent REST Proxy provides an HTTP-based intermediary for clients that need to produce, consume, or administer Kafka without using Kafka’s native client protocol. section 4.5 section 4.7

The proxy supports an architecture in which:

• Clients send requests and receive responses through HTTP or HTTPS. section 4.5
• The proxy translates requests between REST representations and Kafka’s native protocol. section 4.5 section 4.7
• Applications can produce and consume messages and manage topics, brokers, configurations, and other Kafka cluster entities. section 4.5 section 4.6
• The approach is useful when a preferred programming language lacks a compatible Kafka client library, but it is not suitable for every use case. section 4.5 section 12.2.1

Cloud gateway integration

An AWS architecture can place Amazon API Gateway alongside the REST Proxy, connecting HTTP-based Kafka access with AWS services, API publishing, and AWS Identity-based authentication and authorization. section 4.5

Figure 4.23 Communicating to Kafka through REST

Use the architecture figure to trace client requests through the REST Proxy to Kafka and back as HTTP responses. section 4.5

How Kafka for Architects covers it

How deep it goes

Explains the intermediary architecture and protocol translation, but stops short of detailed endpoint or configuration walkthroughs.

Examples

Uses a client-to-proxy-to-Kafka architecture and an Amazon API Gateway integration scenario.

What it assumes

Assumes familiarity with Kafka operations and HTTP, while defining how REST requests mediate access to Kafka’s protocol.

What you can do after

Apply it to expose Kafka operations through HTTP and integrate Kafka with clients or cloud gateways.

How it connects

Connects Kafka clients with REST APIs, Kafka native protocol, Kafka Bridge, API Gateway, and cloud identity services.

liveBookmanning.com

Read Kafka for Architects on liveBook Get the book at manning.com

Related concepts

• RESTuses · REST is an architectural style for distributed hypermedia systems that organizes interactions around resources and representations through constraints including a uniform interface, stateless communication, cacheability, and layered components.
• Kafka protocoluses · The Kafka protocol is the binary client-server request-and-response protocol used by Kafka clients and brokers to communicate.
• HTTPuses · HTTP is a standardized application-layer protocol that defines request-and-response messages for transferring resource representations between networked systems.
• Apache Kafkauses · Apache Kafka is a distributed event-streaming platform for publishing, storing, processing, and consuming streams of records.
• Kafka client libraryalternative to · A Kafka client library is software that provides APIs and client-side behavior for applications to connect to Kafka and produce or consume records.

This explainer was generated by Manning's knowledge graph from the text of Kafka for Architects. The section links point to the parts of the book it draws on.