liveBook · Manning

DQN

Also called deep Q-learning, deep q-network

A deep Q-network (DQN) is a reinforcement-learning method that uses a neural network to approximate the state-action value function in Q-learning.

How 2 Manning books explain it

Applied Reinforcement Learning

Deep Q-network (DQN) is a reinforcement-learning algorithm that uses a neural network to approximate action values for Q-learning.

How it is used
Uses DQN for sequential decisions under uncertainty when tabular values cannot feasibly represent the state space.
How deep it goes
Develops the instability rationale, stabilization mechanisms, and a worked implementation with network updates and a training loop.
Examples
Works through simulated radiotherapy planning and identifies inventory ordering, energy dispatch, dynamic pricing, trading, and recommendation applications.
What you can do after
Builds a DQN agent from scratch for a simulated treatment environment, including replay, action selection, network updates, and a curriculum.

Read how Applied Reinforcement Learning explains DQN →

Evolutionary Deep Learning: Genetic algorithms and neural networks

Deep Q-learning is reinforcement learning that uses a deep neural network to approximate action-value estimates instead of storing them only in a Q-table.

How it is used
Applies deep learning to reinforcement-learning environments where neural networks replace Q-tables or policies.
How deep it goes
Explains the Q-learning target, network architecture, exploration, replay, and training loop, but does not derive the method mathematically.
Examples
Uses CartPole, Acrobot, MountainCar, LunarLander, Atari games, Gym notebooks, training plots, and replay-code exercises.
What you can do after
Build it from scratch in Keras, train it on Gym environments, inspect rewards and losses, and experiment with environments and hyperparameters.

Read how Evolutionary Deep Learning: Genetic algorithms and neural networks explains DQN →

Also covered in

What to know first

Related concepts

Questions about DQN

What is DQN?

A deep Q-network (DQN) is a reinforcement-learning method that uses a neural network to approximate the state-action value function in Q-learning.

Which Manning books explain DQN?

Applied Reinforcement Learning and Evolutionary Deep Learning: Genetic algorithms and neural networks.

What should I know before learning DQN?

Manning books that teach DQN usually introduce action, state, reward signal and convolutional neural network first.

What is the difference between DQN and continuous action space?

A deep Q-network (DQN) is a reinforcement-learning method that uses a neural network to approximate the state-action value function in Q-learning. A continuous action space is an action space in which actions can take real-valued values within specified bounds.

What is DQN a kind of?

DQN is a kind of off-policy method. An off-policy method learns or evaluates a target policy using experience generated by a different behavior policy.

What is DQN also called?

DQN is also called deep Q-learning or deep q-network.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.