Part 3. Techniques for handling telemetry

 

Part 1 taught you the overall architecture of telemetry systems, and part 2 gave many examples of real-world telemetry systems in a variety of settings. I hope that you found some familiar ground in part 2. Part 3 is all about specific techniques. This part is a toolbox; each chapter solves a problem facing telemetry systems.

Note

These chapters can be read selectively, though the structured logging concepts in chapter 12 show up again in chapters 13–16. For this reason, you should consider reading chapter 12 regardless of what else you plan to read.

Chapter 11 dives into the performance bane of telemetry systems: regular expressions. Powerful but slow, regular expressions are hard to avoid if your telemetry systems have to deal with telemetry data coming from hardware systems. This chapter provides several easy techniques to speed the regular expressions you can’t avoid. Not everyone needs to optimize regular expressions, but if you do, you really do.

Chapter 12 covers standardized logging formats and how to build them. When you have the luxury of controlling the format your telemetry emits as, such as with production code your organization writes, great gains in maintainability and performance can be realized. Getting there takes some work (see section 4.2 for that story), but this chapter is about the technical details of making standards happen.