liveBook · Manning

Control

As explained in Software Testing with Generative AI

Control is the degree of influence and insight available over a language-model process, its behavior, its deployment, and access to its outputs.

Control measures how much influence and insight people have over an LLM process, its behavior, deployment, privacy, and access to outputs. section 10.2.3

RAG frameworks can reduce control when hosted tools obscure data storage, retrieval relevance algorithms, vector-database relationships, model selection, or response behavior. Privacy controls may also be limited. section 10.2.3

Fine-tuning provides more control through experimentation: teams choose and format datasets, select the model, adjust tuning settings, and manage each process step. That control requires substantial preparation and repeated, time-consuming runs. section 10.2.3

How Software Testing with Generative AI covers it

How deep it goes
Defines control through influence, insight, behavior, deployment, and privacy, then traces concrete sources of control loss and gain.
Examples
Uses hosted RAG platforms, vector-database storage and relevance, OpenAI APIs, curated datasets, and repeated tuning runs as examples.
What you can do after
Evaluate how platform opacity, data choices, model selection, and tuning steps affect influence over an LLM system.
How it connects
Connects control with RAG, fine-tuning, vector databases, privacy, model selection, and APIs.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Software Testing with Generative AI. The section links point to the parts of the book it draws on.