liveBook · Manning

Environment

Also called external world

An environment is the external context, system, or conditions within which an agent or application operates and interacts.

How 10 Manning books explain it

Applied Reinforcement Learning

An environment is the external system or setting with which an agent interacts and whose responses produce consequences for the agent's actions.

How it is used
Uses environments to model business decisions and provide safe feedback for agent experimentation.
How deep it goes
Develops a design framework and a warehouse implementation, including state, reset, movement, rewards, and a random-agent sanity check.
Examples
Uses warehouse order picking and an ad campaign simulation to illustrate sequential and one-step environments.
What you can do after
Build environments from scratch by scoping a business process and implementing its state, transitions, and feedback.

Read how Applied Reinforcement Learning explains environment →

Platform Engineering on Kubernetes

An environment is a distinct deployment context in which an application and its supporting resources run.

How it is used
Provides distinct places to test releases, serve users, or give development teams isolated application instances.
How deep it goes
Works through configuration-based promotion and a provisionable development environment, while leaving broader platform configuration outside the walking skeleton.
Examples
Uses a Conference application development environment provisioned as a vcluster and an Environment Kubernetes resource showing its requested configuration.
What you can do after
Operate/configure it by requesting an isolated development environment through the platform API and connecting to the provisioned virtual cluster.

Read how Platform Engineering on Kubernetes explains environment →

ASP.NET Core in Action, 3e

A hosting environment is the runtime context that identifies where an application is running and determines environment-specific configuration and behavior.

How it is used
Enables applications to vary configuration and behavior between development, staging, and production.
How deep it goes
Explains how to identify an environment, load corresponding settings, customize middleware, and select an environment locally.
Examples
Uses development and production databases, environment-specific JSON files, and conditional exception handling as examples.
What you can do after
Operate and configure an ASP.NET Core hosting environment, then select environment-specific settings and middleware.

Read how ASP.NET Core in Action, 3e explains environment →

Optimization Algorithms: AI techniques for design, planning, and control problems

An environment is the external set of conditions that interacts with an organism’s genotype to influence its characteristics.

How it is used
Introduces environment as a factor interacting with genotype to produce phenotype.
How deep it goes
Defines the genotype–environment relationship without detailing environmental mechanisms.
Examples
Uses a toy organism with appetite, movement, feet, and skin genes without specifying an environmental effect.
What you can do after
Supports evaluating how genotype and environment jointly relate to observable characteristics.

Read how Optimization Algorithms: AI techniques for design, planning, and control problems explains environment →

Get Programming: Learn to code with Python

How it is used
Uses environments to explain how modules and function calls keep internal work separate while passing needed results outward.
How deep it goes
Traces function calls through parameter mapping, local variables, returned values, and the end of a scope.
Examples
Uses independent researchers in a group project and a word-length function call to illustrate separate working spaces.
What you can do after
Understand which variables belong to a function call and how inputs and return values cross its boundary.

Read how Get Programming: Learn to code with Python explains environment →

Grokking AI Algorithms, Second Edition

An environment is the external setting in which an agent acts and receives consequences or feedback, including a simulated setting that models a market.

How it is used
Uses an environment as the setting for an agent to learn action sequences from rewards and penalties.
How deep it goes
Defines simulator responsibilities and illustrates action and reward handling in Python, while simplifying the parking lot's dynamics.
Examples
Illustrates environments with dog training, a self-driving car in a parking lot, and a simulated financial market.
What you can do after
Evaluate how simulator actions and rewards support a goal, including how poorly chosen rewards can encourage repeated movement.

Read how Grokking AI Algorithms, Second Edition explains environment →

Robotics for Programmers

The physical setting and conditions in which a robot operates and that its actions may alter.

How it is used
Frames robotics as a feedback loop in which perception and action repeatedly interact with a changing physical world.
How deep it goes
Defines the environment, explains its changing state and loop behavior, and stops short of detailed physical modeling.
Examples
Uses a wheel-turning mobile robot, falling objects, and humans or machines sharing and changing the environment.
What you can do after
Evaluate and understand how environmental constraints shape robot architecture, sensing, planning, and actuation.

Read how Robotics for Programmers explains environment →

Terraform in Depth: Infrastructure as Code with Terraform and OpenTofu

An environment is an isolated instance of a software system with independently managed infrastructure, configuration, and state.

How it is used
Uses isolated infrastructure instances to support development, testing, production, regional deployment, and customer installations.
How deep it goes
Explains lifecycle, environment types, variable-based variation, and thin root modules, but defers sensitive-value handling details.
Examples
Uses a Factory Analytics developer instance, staging and production flow, regional deployments, and an application-module configuration.
What you can do after
Operate environments via Terraform by applying isolated instances, configuring differences, and destroying temporary feature environments.

Read how Terraform in Depth: Infrastructure as Code with Terraform and OpenTofu explains environment →

Build a Robo-Advisor with Python (From Scratch)

An environment is the external system in which a reinforcement-learning agent takes actions and from which it receives observations and rewards.

How it is used
Frames stock and bond markets as the setting where an investor-agent learns decisions through trial, error, and reward feedback.
How deep it goes
Models states with discretized wealth and time, including a log-wealth grid that reflects widening wealth dispersion.
Examples
Uses stock and bond markets, investor allocation, and a wealth-time grid for goals-based investing.
What you can do after
Evaluate/understand how to represent a financial environment with wealth states, time steps, investment actions, and reward feedback.

Read how Build a Robo-Advisor with Python (From Scratch) explains environment →

Machine Learning System Design

A computational representation of an online environment that generates or replays interactions for offline algorithm evaluation.

How it is used
Evaluates alternative models offline by replaying historical interactions and estimating product metrics.
How deep it goes
Explains the replay procedure, derived metrics, worked outcomes, and its non-ideal relationship to online performance.
Examples
Uses banner-to-landing-page transitions, purchases, product counts, conversion rates, and profit-per-click scenarios.
What you can do after
Evaluate different models against estimated online product metrics before broader deployment.

Read how Machine Learning System Design explains environment →

Also covered in

What to know first

Related concepts

Questions about environment

What is environment?

An environment is the external context, system, or conditions within which an agent or application operates and interacts.

Which Manning books explain environment?

Applied Reinforcement Learning, Platform Engineering on Kubernetes, ASP.NET Core in Action, 3e, Optimization Algorithms: AI techniques for design, planning, and control problems, Get Programming: Learn to code with Python, Grokking AI Algorithms, Second Edition, Robotics for Programmers, Terraform in Depth: Infrastructure as Code with Terraform and OpenTofu and 2 more.

What should I know before learning environment?

Manning books that teach environment usually introduce language model, machine learning, reinforcement learning and reward signal first.

What kinds of environment are there?

Kinds of environment include highly adversarial environment, partially observable environment, production and staging environment.

What is environment also called?

Environment is also called external world.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.