liveBook · Manning

Unstructured data

As explained in The Art of AI Product Development

Unstructured data is information without a consistent predefined tabular or schema-based organization, such as free text or images.

Unstructured data lacks consistent tabular or schema-based organization. Free text, images, sales calls, and emails require preprocessing, cleaning, and structuring before effective training, inference, or analysis. section 12.1.2 section 9.1.1

Treat unstructured sources according to their access and meaning:

  • Query sales calls and emails with retrieval-augmented generation rather than specialized structured-data methods. section 9.1.1
  • Expect different repositories, connectors, and questions across files, databases, cloud stores, and other sources. section 9.1.1
  • Use data-engineering pipelines to improve quality and make text or images usable for generative AI systems. section 12.1.2

Product-roadmap research

A product manager can combine sales calls, user interviews, reviews, usage data, and competitive research. RAG can retrieve signals from unstructured calls and emails, while specialized algorithms query structured usage data; starting with the most important sources limits complexity. section 9.1.1

How The Art of AI Product Development covers it

How deep it goes
Defines the category and identifies preprocessing needs, but stops short of detailing specific cleaning or structuring procedures.
Examples
Uses free text, images, sales calls, emails, user interviews, and product reviews as representative sources.
What you can do after
Apply it via retrieval-augmented generation and data-engineering pipelines while separating unstructured from structured sources.
How it connects
Connects unstructured data with generative AI, data engineering, retrieval-augmented generation, structured data, and Text2SQL.

Also explained in

Compare how 11 books explain unstructured data →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of The Art of AI Product Development. The section links point to the parts of the book it draws on.