liveBook · Manning

Dense vector

As explained in Building Reliable AI Systems

A numerical vector in which most or all dimensions have nonzero values.

A dense vector is a numerical representation of meaning produced by an embedding model. In semantic retrieval, document chunks and user queries are encoded into the same vector space so the system can find nearby matches. section 4.0

For retrieval systems, keep these implementation details in view:

  • Embedding quality affects whether relevant queries and documents align; weak domain fit can return unrelated passages. section 4.0
  • Match the vector database index dimension to the embedding model output; health-care embeddings are typically 768 dimensions in the example. section 4.5.4

Health-care policy search

A policy assistant encodes policy chunks and a question such as “Is physical therapy covered?” as vectors, then uses similarity search to retrieve relevant passages. section 4.0 section 4.5.4

How Building Reliable AI Systems covers it

How deep it goes
Explains semantic representation, typical dimensions, and index matching, but does not examine vector mathematics.
Examples
Uses a physical-therapy coverage query and health-care policy chunks encoded as vectors.
What you can do after
Apply it via SentenceTransformers embeddings and Pinecone similarity search to retrieve semantically related policy chunks.
How it connects
Links embeddings to similarity search, vector databases, and retrieval-augmented generation.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Building Reliable AI Systems. The section links point to the parts of the book it draws on.