Gating
Gating is the selective regulation of information flow within a computational system, controlling what information is passed, retained, combined, or suppressed.
Sutskever's List
Gating is a learned mechanism that controls how much newly computed information is combined with retained information.
- How it is used
- Uses learned gates to control information retention, updates, and output in recurrent memory.
- How deep it goes
- Explains LSTM gate roles and elementwise filtering, then relates gating to RMC memory updates.
- Examples
- Uses an LSTM cell diagram and an RMC task comparing vectors by distance from a reference.
- What you can do after
- Understand how gates regulate memory retention, updating, and exposure in recurrent models.
Natural Language Processing in Action, Second Edition
A logic gate in a gated recurrent network is a learned signal-control mechanism that regulates how information passes into or out of the recurrent state.
- How it is used
- Explains how GRUs and LSTMs preserve useful information across long token sequences.
- How deep it goes
- Works from an if-statement analogy through learned thresholds and gate equations, while omitting full training procedures.
- Examples
- Uses long-text token memory, GRU gate equations, LSTM state-update equations, and architecture figures as concrete examples.
- What you can do after
- Build GRU and LSTM gate calculations using sigmoid, tanh, learned weights, biases, and recurrent states.
Read how Natural Language Processing in Action, Second Edition explains gating →
LLMs in Production
A gating mechanism selectively controls how information enters, remains in, or leaves a recurrent model state.
- How it is used
- Uses gates to preserve useful sequence information and select experts during recurrent modeling or mixture-of-experts fine-tuning.
- How deep it goes
- Explains gating through LSTM memory cells, sequence-length effects, bidirectionality, and an implementation comparison, but not individual gate equations.
- Examples
- Uses Twitter sentiment analysis, variable-length padded sequences, word embeddings, and an RNN-versus-LSTM training comparison.
- What you can do after
- Evaluate/understand how LSTM gating improves long-sequence processing and compare it with an RNN in a sentiment workflow.
Inside Deep Learning: Math, Algorithms, Models
A mechanism that modulates information flow by multiplying signals by gate values, typically in the range from zero to one.
- How it is used
- Uses gates in LSTMs to manage context and hidden-state information over time.
- How deep it goes
- Defines gate multiplication and the three LSTM gate roles, without deriving their full computations.
- Examples
- Illustrates a signal α multiplied by sigmoid outputs of 0, 1, or an intermediate value.
- What you can do after
- Apply gating by multiplying a signal by a sigmoid-produced value to regulate its information flow.
Read how Inside Deep Learning: Math, Algorithms, Models explains gating →
Machines that Think
Gating is the selective control of information flow into, out of, or within a computational state.
- How it is used
- Introduces gating as a way for recurrent networks to preserve or discard information across long sequences.
- How deep it goes
- Explains learned gate values and the roles of LSTM gates, and contrasts them with the simpler GRU structure.
- Examples
- Uses a sentence with intervening words between its subject and predicate to illustrate preserved context.
- What you can do after
- Evaluate gated recurrent memory by weighing selective retention against sequential processing and the limits of a compressed state.
Build AI Drug Discovery Pipelines
Recurrent gating is the controlled regulation of information retained, forgotten, or incorporated by a recurrent neural-network state.
- How it is used
- Supports molecular generation by preserving sequence information needed for long-range SMILES structure and validity.
- How deep it goes
- Explains gate roles, state equations, internal weight matrices, and a PyTorch GRU cell implementation.
- Examples
- Uses benzene and a longer molecular SMILES string to illustrate distant ring closures, parentheses, and structural consistency.
- What you can do after
- Build it from scratch with PyTorch by implementing reset, update, candidate-state, and hidden-state computations.
Read how Build AI Drug Discovery Pipelines explains gating →
Also covered in
- Agent Design PatternsIn early access (MEAP)
- Retrieval Augmented Generation, The Foundational IdeasIn early access (MEAP)
- Data Without Labels
What to know first
- feedforward networkA feedforward network is a neural network whose computations proceed from inputs toward outputs through directed connections without recurrent cycles or feedback.
- recurrent neural networkA recurrent neural network is a neural network that processes ordered inputs while carrying and updating an internal state across successive steps.
- tanhThe hyperbolic tangent, or tanh, is a smooth nonlinear function that maps real-valued inputs to values between −1 and 1.
- backpropagationBackpropagation is reverse-mode differentiation that propagates derivatives backward through a computational graph to compute gradients of an output or loss with respect to inputs and parameters.
Related concepts
- thresholduses · A threshold is a boundary value used to determine whether a measured quantity meets a criterion or changes a classification, decision, or action.
- GRUpart of · A gated recurrent unit (GRU) is a recurrent neural-network architecture that uses learned gates to regulate information flow and update a hidden state across sequence steps.
- LSTMused by · A long short-term memory (LSTM) network is a recurrent neural-network architecture with gated memory cells that control information flow and model dependencies in sequential data.
Questions about gating
What is gating?
Gating is the selective regulation of information flow within a computational system, controlling what information is passed, retained, combined, or suppressed.
Which Manning books explain gating?
Sutskever's List, Natural Language Processing in Action, Second Edition, LLMs in Production, Inside Deep Learning: Math, Algorithms, Models, Machines that Think and Build AI Drug Discovery Pipelines.
What should I know before learning gating?
Manning books that teach gating usually introduce feedforward network, recurrent neural network, tanh and backpropagation first.
What kinds of gating are there?
Kinds of gating include hard gating, noisy gating and soft gating.
What is gating part of?
Gating is part of GRU. A gated recurrent unit (GRU) is a recurrent neural-network architecture that uses learned gates to regulate information flow and update a hidden state across sequence steps.
What is gating also called?
Gating is also called gate.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.





