liveBook · Manning

Gating

Also called gate

Gating is the selective regulation of information flow within a computational system, controlling what information is passed, retained, combined, or suppressed.

How 6 Manning books explain it

Sutskever's List

Gating is a learned mechanism that controls how much newly computed information is combined with retained information.

How it is used
Uses learned gates to control information retention, updates, and output in recurrent memory.
How deep it goes
Explains LSTM gate roles and elementwise filtering, then relates gating to RMC memory updates.
Examples
Uses an LSTM cell diagram and an RMC task comparing vectors by distance from a reference.
What you can do after
Understand how gates regulate memory retention, updating, and exposure in recurrent models.

Read how Sutskever's List explains gating →

Natural Language Processing in Action, Second Edition

A logic gate in a gated recurrent network is a learned signal-control mechanism that regulates how information passes into or out of the recurrent state.

How it is used
Explains how GRUs and LSTMs preserve useful information across long token sequences.
How deep it goes
Works from an if-statement analogy through learned thresholds and gate equations, while omitting full training procedures.
Examples
Uses long-text token memory, GRU gate equations, LSTM state-update equations, and architecture figures as concrete examples.
What you can do after
Build GRU and LSTM gate calculations using sigmoid, tanh, learned weights, biases, and recurrent states.

Read how Natural Language Processing in Action, Second Edition explains gating →

LLMs in Production

A gating mechanism selectively controls how information enters, remains in, or leaves a recurrent model state.

How it is used
Uses gates to preserve useful sequence information and select experts during recurrent modeling or mixture-of-experts fine-tuning.
How deep it goes
Explains gating through LSTM memory cells, sequence-length effects, bidirectionality, and an implementation comparison, but not individual gate equations.
Examples
Uses Twitter sentiment analysis, variable-length padded sequences, word embeddings, and an RNN-versus-LSTM training comparison.
What you can do after
Evaluate/understand how LSTM gating improves long-sequence processing and compare it with an RNN in a sentiment workflow.

Read how LLMs in Production explains gating →

Inside Deep Learning: Math, Algorithms, Models

A mechanism that modulates information flow by multiplying signals by gate values, typically in the range from zero to one.

How it is used
Uses gates in LSTMs to manage context and hidden-state information over time.
How deep it goes
Defines gate multiplication and the three LSTM gate roles, without deriving their full computations.
Examples
Illustrates a signal α multiplied by sigmoid outputs of 0, 1, or an intermediate value.
What you can do after
Apply gating by multiplying a signal by a sigmoid-produced value to regulate its information flow.

Read how Inside Deep Learning: Math, Algorithms, Models explains gating →

Machines that Think

Gating is the selective control of information flow into, out of, or within a computational state.

How it is used
Introduces gating as a way for recurrent networks to preserve or discard information across long sequences.
How deep it goes
Explains learned gate values and the roles of LSTM gates, and contrasts them with the simpler GRU structure.
Examples
Uses a sentence with intervening words between its subject and predicate to illustrate preserved context.
What you can do after
Evaluate gated recurrent memory by weighing selective retention against sequential processing and the limits of a compressed state.

Read how Machines that Think explains gating →

Build AI Drug Discovery Pipelines

Recurrent gating is the controlled regulation of information retained, forgotten, or incorporated by a recurrent neural-network state.

How it is used
Supports molecular generation by preserving sequence information needed for long-range SMILES structure and validity.
How deep it goes
Explains gate roles, state equations, internal weight matrices, and a PyTorch GRU cell implementation.
Examples
Uses benzene and a longer molecular SMILES string to illustrate distant ring closures, parentheses, and structural consistency.
What you can do after
Build it from scratch with PyTorch by implementing reset, update, candidate-state, and hidden-state computations.

Read how Build AI Drug Discovery Pipelines explains gating →

Also covered in

What to know first

Related concepts

Questions about gating

What is gating?

Gating is the selective regulation of information flow within a computational system, controlling what information is passed, retained, combined, or suppressed.

Which Manning books explain gating?

Sutskever's List, Natural Language Processing in Action, Second Edition, LLMs in Production, Inside Deep Learning: Math, Algorithms, Models, Machines that Think and Build AI Drug Discovery Pipelines.

What should I know before learning gating?

Manning books that teach gating usually introduce feedforward network, recurrent neural network, tanh and backpropagation first.

What kinds of gating are there?

Kinds of gating include hard gating, noisy gating and soft gating.

What is gating part of?

Gating is part of GRU. A gated recurrent unit (GRU) is a recurrent neural-network architecture that uses learned gates to regulate information flow and update a hidden state across sequence steps.

What is gating also called?

Gating is also called gate.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.