liveBook · Manning

Language model

As explained in Build AI Drug Discovery Pipelines

A language model assigns probabilities to sequences or predicts the next token from preceding tokens.

A language model assigns probabilities to sequences or predicts the next token from preceding tokens. In drug discovery, a related kind of sequence-trained foundation model can produce representations called embeddings for downstream tasks. section 13.1.2

Protein-sequence embeddings

A foundation model trained on protein sequences can generate embeddings used for structure prediction and function annotation. Information about a binding-site environment can also help guide molecular generation. A sequence-trained foundation model is not necessarily a language model. section 13.1.2

How Build AI Drug Discovery Pipelines covers it

How deep it goes
Mentions sequence-trained foundation models and their applications without explaining language-model training or next-token prediction.
Examples
Uses protein-sequence embeddings for structure prediction and function annotation.
How it connects
Connects sequence-trained foundation models with protein structure prediction, function annotation, and molecular generation.

Also explained in

Compare how 89 books explain language model →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build AI Drug Discovery Pipelines. The section links point to the parts of the book it draws on.