11 Generative AI in Platform Engineering

This chapter covers

Impact of Generative AI (Gen AI)and Large Language Models (LLMs) in platform engineering
Measuring improvements in platform engineering through AI methodologies
How to improve developer experience through Generative AI
How is Generative AI improving the observability space?
What are the new frontiers in platform engineering within IDPs and overall developer experience where we should expect more

Gen AI and LLMs are reshaping platform engineering, making it possible to generate complete or partial solutions with well-crafted prompts. This capability is precious in streamlining complex decision-making processes, such as selecting optimal runtime environments or identifying the most suitable architectural patterns. In traditional platform engineering, predictive AI has been used to simplify decision-making by using decision trees and models to hone in on specific approaches. GenAI extends this capability by providing context-aware solutions tailored to an organization's unique needs.

As we have done in the past chapters, we'll continue to apply the principles we discuss to PETech, using specific examples.

11.1 Impact of GenAI and LLMs in Platform Engineering

11.1.1 Enhancing LLMs with Retrieval-Augmented Generation (RAG)

11.1.2 Training and Epochs for Improving Quality of Results

11.1.3 Sustainability Impact of LLM Training

11.2 Measuring Through Modern AI Technologies

11.2.1 Reporting on the Measurements

11.3 Future of Improving DevEx Through GenAI

11.3.1 The impact of copilot tools

11.3.2 Conversational interface driven operational improvements

11.3.3 Automated Resource Optimizations

11.4 Generative AI Enabling Observability

11.4.1 Anomaly Detection and Root Cause Analysis

11.4.2 Predictive Analytics and Proactive Remediation

11.4.3 Automated Incident Response and Resolution

11.4.4 Security Observability and Threat Detection

11.4.5 Automated Log Analysis and Insights

11.4.6 Exercise 11.1: Automated Observability Configuration using Gen AI

11.5 Newer Frontiers of Platform Engineering Within IDP and DevEx Evolution

11.5.1 Product Engineering improvements through automated code learning and remediation

11.6 Summary