Unstructured data
Unstructured data is information that lacks a fixed, predefined schema or consistently organized fields or records.
Elasticsearch in Action, Second Edition
Unstructured data is data that does not conform to a fixed field-based or tabular schema, such as free-form text.
- How it is used
- Supports full-text search when users need relevant results from free-form text instead of exact field matches.
- How deep it goes
- Defines schema-free data and explains relevance-oriented querying, then defers analyzer configuration for synonyms, stemming, and spelling variations.
- Examples
- Uses a quotation about imagination and knowledge to contrast direct word matches with synonyms, misspellings, and abbreviations that miss.
- What you can do after
- Apply it via Elasticsearch full-text queries to retrieve and rank documents matching users’ text searches.
Read how Elasticsearch in Action, Second Edition explains unstructured data →
AI-Powered Search
Unstructured data is information without a rigid predefined schema, often containing rich content and relationships in flexible forms such as text, images, video, and audio.
- How it is used
- Frames flexible content and queries as sources of structure that search systems can use to find relationships and meaning.
- How deep it goes
- Defines common formats and develops a relational-join analogy through shared terms and entity resolution, before hands-on implementation.
- Examples
- Uses conference mentions, variations of a person’s name, and event logs to illustrate document links and mixed data.
- What you can do after
- Evaluate and understand how flexible content can encode relationships, and why matching references requires attention to ambiguity.
Data Without Labels
Unstructured data lacks an easily usable row-and-column schema and may include text, images, audio, or video.
- How it is used
- Guides the choice of preparation and analysis for text, images, audio, and video that do not readily form tables.
- How deep it goes
- Defines the category and explains numerical image pixels and text vectors, but does not specify one conversion procedure for every modality.
- Examples
- Uses customer reviews and transcribed calls as text sources, alongside medical-image and autonomous-driving applications.
- What you can do after
- Evaluate/understand it by recognizing when data needs numerical representation and potentially more advanced analysis than a structured table.
Delivering Machine Learning Projects: From design to deployment
An unstructured field is a data field containing content such as images, text, or sounds without a fixed tabular representation.
- How it is used
- Guides data surveys and exploratory analysis of information resources used by ML projects.
- How deep it goes
- Provides survey checks and image-analysis criteria while deferring deeper investigation beyond the initial survey.
- Examples
- Uses building incident descriptions and prelabeled image collections to illustrate quality checks.
- What you can do after
- Evaluate unstructured resources for useful content, quality issues, and image dataset biases.
Fight Fraud with Machine Learning
Unstructured data is data without a consistent predefined tabular or schema-based organization, such as free text, images, audio, video, or graphs.
- How it is used
- Guides fraud-system selection when raw images, text, audio, video, or graphs are available.
- How deep it goes
- Defines the modality through fraud examples and model-selection guidance, without detailing feature-extraction algorithms.
- Examples
- Uses phishing email text, selfie and deepfake verification, raw phone-call audio, and image, text, audio, video, and graph inputs.
- What you can do after
- Evaluate/understand which detection approach may fit structured, unstructured, or semi-structured fraud inputs.
Read how Fight Fraud with Machine Learning explains unstructured data →
Essential GraphRAG
Unstructured data is information without a predefined tabular or schema-based organization, such as free-form text.
- How it is used
- Supports contextual retrieval in RAG while motivating conversion into structured representations for precise questions.
- How deep it goes
- Explains retrieval limits and extraction into graphs, but stops short of detailing extraction prompts or database schemas.
- Examples
- Uses article text, legal contracts, customer-support transcripts, and medical information as representative unstructured sources.
- What you can do after
- Build it from scratch by extracting structured information from raw text and importing it into a knowledge graph.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Data whose varied modalities and organization do not conform to a fixed rows-and-columns schema.
- How it is used
- Frames the practical choice between tabular workflows and deep-learning approaches for varied, non-matrix data.
- How deep it goes
- Defines the format, lists modalities, explains feature engineering, and reaches end-to-end representation learning without implementation details.
- Examples
- Uses images, video, audio, text, JSON sensor data, and social media streams as representative inputs.
- What you can do after
- Evaluate whether a dataset requires handcrafted feature extraction or can support end-to-end deep-learning transformations.
Fast Python: High performance techniques for large datasets
- How it is used
- Frames unstructured data as a growing computational burden in the case for more efficient data processing.
- How deep it goes
- Notes its greater computational demands but stops short of explaining processing methods.
- What you can do after
- Understand why unstructured data raises computational demands during data processing.
Read how Fast Python: High performance techniques for large datasets explains unstructured data →
The Art of AI Product Development
Unstructured data is information without a consistent predefined tabular or schema-based organization, such as free text or images.
- How it is used
- Guides the preparation and retrieval of text, images, calls, and emails for AI training, inference, and product analysis.
- How deep it goes
- Defines the category and identifies preprocessing needs, but stops short of detailing specific cleaning or structuring procedures.
- Examples
- Uses free text, images, sales calls, emails, user interviews, and product reviews as representative sources.
- What you can do after
- Apply it via retrieval-augmented generation and data-engineering pipelines while separating unstructured from structured sources.
Read how The Art of AI Product Development explains unstructured data →
Machine Learning System Design
Data that lacks a fixed machine-readable schema for its content, such as free text or images.
- How it is used
- Positions unstructured data as multimodal input for deep-learning systems, feature extraction, monitoring, and similarity retrieval.
- How deep it goes
- Explains embeddings, centralized storage, derived monitoring signals, and staged validation, without detailing model internals.
- Examples
- Uses marketplace images, descriptions, reviews, image brightness, text length, and audio-frequency distributions as concrete cases.
- What you can do after
- Diagnose unstructured-data failures with derived statistics and incorporate embeddings into shared ML pipelines when justified.
Read how Machine Learning System Design explains unstructured data →
Knowledge Graphs and LLMs in Action
Unstructured data is information lacking a fixed tabular or schema-constrained organization, such as free-form documents.
- How it is used
- Feeds knowledge-graph construction, retrieval, recommendation, decision support, and other applications that require mining distributed information.
- How deep it goes
- Explains the extraction pipeline and linguistic obstacles, but stops short of detailed algorithmic or implementation specifications.
- Examples
- Uses emails, legislation, research papers, regulatory reports, clinical documents, and scientific publications as source artifacts.
- What you can do after
- Build knowledge graphs from documents by extracting entities and relationships, then support retrieval, integration, and hypothesis generation.
Read how Knowledge Graphs and LLMs in Action explains unstructured data →
Learn AI Data Engineering
Unstructured data is information that lacks a consistently organized schema for its content and fields.
- How it is used
- Guides decisions about extracting, enriching, validating, and routing variable content through data pipelines.
- How deep it goes
- Defines unstructured inputs and explains selection, extraction, validation, cost, and failure handling without detailing model internals.
- Examples
- Uses free text, HTML, PDFs, images, product pages, and noisy event records as extraction and pipeline examples.
- What you can do after
- Apply it via an LLM and deterministic validation to extract structured fields while controlling cost, errors, and review workflows.
Read how Learn AI Data Engineering explains unstructured data →
Financial AI in Practice
Information that does not conform to a predefined schema for direct machine-readable interpretation.
- How it is used
- Frames unstructured data as one of the diverse inputs analyzed in financial AI and fraud detection.
- How deep it goes
- Names financial examples and describes multisource integration, but gives no schema, representation, or processing procedure.
- Examples
- Identifies regulatory reports, filings, and customer communications as financial examples.
Read how Financial AI in Practice explains unstructured data →
Also covered in
- Microsoft Azure in Action
- AI Agents in Action
- Effective Data Analysis
- Data Analysis with LLMs
- Snowflake Data Engineering
- The Well-Grounded Data Analyst
- Starting Data Analytics with Generative AI and Python
- Writing for Developers: Blogs that get read
- Digital Twins in Action
- Building Web APIs with ASP.NET Core
- Build an AI Agent (From Scratch)
- Grokking Statistics
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- machine learningMachine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
- artificial intelligenceArtificial intelligence is the field of computing concerned with creating systems that perform tasks associated with intelligence, such as learning, reasoning, perception, and decision-making.
- deep learningDeep learning is a machine-learning approach that uses neural networks with multiple computational layers to learn representations from data.
Related concepts
- structured datacontrasts with · Structured data is information organized according to a defined schema or arrangement that makes its elements and relationships consistently interpretable and processable.
- textincludes · Text is written or digitally encoded linguistic or symbolic content represented as characters, words, tokens, or other textual units.
- retrieval-augmented generationused by · Retrieval-augmented generation is a technique that retrieves relevant information from external sources and supplies it as context to a generative model when producing an output.
- deep learningused by · Deep learning is a machine-learning approach that uses neural networks with multiple computational layers to learn representations from data.
- language modelused by · A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- Claudeused by · Claude is a family of large language models developed by Anthropic, along with the conversational AI assistants and services built around them.
Questions about unstructured data
What is unstructured data?
Unstructured data is information that lacks a fixed, predefined schema or consistently organized fields or records.
Which Manning books explain unstructured data?
Elasticsearch in Action, Second Edition, AI-Powered Search, Data Without Labels, Delivering Machine Learning Projects: From design to deployment, Fight Fraud with Machine Learning, Essential GraphRAG, Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI, Fast Python: High performance techniques for large datasets and 5 more.
What should I know before learning unstructured data?
Manning books that teach unstructured data usually introduce language model, machine learning, artificial intelligence and deep learning first.
What is the difference between unstructured data and structured data?
Unstructured data is information that lacks a fixed, predefined schema or consistently organized fields or records. Structured data is information organized according to a defined schema or arrangement that makes its elements and relationships consistently interpretable and processable.
What kinds of unstructured data are there?
Kinds of unstructured data include text.
What is unstructured data also called?
Unstructured data is also called unstructured information.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.












