This chapter covers:
- Exploring helpful scripting administration client options
- Examining REST APIs, tools, and utilities that can be leveraged for management
- Mananging the logs of Kafka and ZooKeeper
- Monitoring the cluster with JMX and related metrics
- Understanding how advertised listeners work with clients
- Tracing example using interceptors with headers
We have spent some time discussing brokers in depth in Chapter 6 and client concerns throughout the earlier chapters. We’ve seen some best practices that can be applied in most situations, but there will always be environments where special handling is required. The best way to keep a cluster moving along is to understand the data that is flowing through it, and to monitor that activity at runtime. While operating Kafka may not be as involved as writing and running Java applications per se, it still requires monitoring log files and being aware of what is happening with our workloads.
So far, we have performed most of our cluster management activities with the command line tools that come with Kafka. And in general, we will need to be comfortable with a shell environment to set up and install Kafka. However, there are some helpful options we can use to branch out from these provided scripts.