liveBook · Manning

Q-table

A Q-table is a lookup table storing estimated action values for state-action pairs in a tabular reinforcement-learning system.

How 2 Manning books explain it

Grokking AI Algorithms, Second Edition

A Q-table is a tabular reinforcement-learning model that stores estimated values for actions in particular states.

How it is used
Uses a Q-table as the learned model for selecting actions during and after Q-learning in a simulation.
How deep it goes
Traces initialization, action selection and table updates in a simulation, then tests the trained table.
Examples
Uses grid positions and a parking-lot simulation to illustrate state-action scores and testing.
What you can do after
Evaluate/understand how to select an action from a trained table and recognize its limits with unseen states.

Read how Grokking AI Algorithms, Second Edition explains Q-table →

Evolutionary Deep Learning: Genetic algorithms and neural networks

A Q-table is a tabular representation that stores estimated action-quality values for states in a Q-learning agent.

How it is used
Stores action-quality estimates that guide an agent’s next action in discrete reinforcement-learning environments.
How deep it goes
Defines the table layout, initialization, action policy, update equation, training loop, and exploration schedule without deriving Q-learning theory.
Examples
Uses OpenAI Gym’s FrozenLake environment, NumPy arrays, epsilon-greedy selection, training episodes, and evaluation runs.
What you can do after
Builds a tabular Q-learning agent, train it across episodes, and inspect its learned action values.

Read how Evolutionary Deep Learning: Genetic algorithms and neural networks explains Q-table →

Also covered in

What to know first

Related concepts

Questions about Q-table

What is Q-table?

A Q-table is a lookup table storing estimated action values for state-action pairs in a tabular reinforcement-learning system.

Which Manning books explain Q-table?

Grokking AI Algorithms, Second Edition and Evolutionary Deep Learning: Genetic algorithms and neural networks.

What should I know before learning Q-table?

Manning books that teach Q-table usually introduce action, environment, state and policy first.

What is Q-table a kind of?

Q-table is a kind of language model. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.

What are the parts of Q-table?

Q-table includes action-value function.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.