liveBook · Manning

Real data

As explained in Vibe Engineering

A real-world dataset is a collection of observations gathered from an actual domain or operational process rather than generated artificially.

Real data comes from an actual domain or operational process. For pharmaceutical analytics, scraped product records can reflect real prices, manufacturers, and compositions, unlike synthetic records. That realism can make analyses more relevant, but scraped data may be noisy and limited to a particular market. section 4.1 section 4.7

Dataset choice depends on the task and the data’s limitations:

  • Real product records can support exploratory analysis of market distributions and prices, and clustering by manufacturer or composition. section 4.1
  • Text fields such as names and compositions can support NLP or categorization, but prediction may be limited when no target label is available. section 4.1
  • Check record count, language, domain scope, and cleaning needs; a large dataset may still require translation or substantial data preparation. section 4.1

Indian medicine records

The Indian Medicine Dataset is described as containing about 253,973 real medicine records, with product details such as pricing and manufacturer. Its scale and real-market data can support analysis, but its scraped records may be inconsistent and its scope is primarily Indian medicines. section 4.1

Use Case
Dataset A (Indian)
Dataset B (Synthetic)
Exploratory Data Analysis (EDA)
✅ Strong — real distributions, price trends
⚠️ Limited — synthetic distributions
Supervised ML for Prediction
⚠️ Limited (no target label by default)
⚠️ Same — likely no target labels
Clustering / Unsupervised learning
✅ Yes — cluster by manufacturer, composition
⚠️ Yes but less real-world meaning
NLP/Categorization
⚠️ Yes — text fields (names/composition)
⚠️ Yes (names) but synthetic semantics
Recommender systems
⚠️ Possible but needs augmentation
❌ Limited
Benchmarking models / DEMO
⚠️ Possible but raw
✅ Ideal due to cleaner, controlled data
Aspect
Indian Medicine Dataset (A)
Kaggle Medicine Dataset (B)
Source
Scraped real data
Synthetic generated data
Size
~250 K records
~50 K records
Real-world
✅ Yes
❌ No
Cleanliness
⚠️ No (requires cleaning)
✅ Likely
Usability for Research
High
Moderate
ML Power
Good for real analysis
Good for ML practice

Compare real and synthetic medicine datasets by source, size, cleanliness, and suitability for different analysis and modeling tasks. section 4.1

How Vibe Engineering covers it

How deep it goes
Compares dataset size, language, cleanliness, scope, and suitability for analytics and machine-learning tasks.
Examples
Uses scraped Indian medicine product records and contrasts them with a smaller synthetic medicine dataset.
What you can do after
Evaluate dataset suitability by comparing realism, scale, cleanliness, scope, and fit for the intended task.
How it connects
Connects real data to synthetic data, exploratory data analysis, clustering, NLP, and supervised machine learning.

Also explained in

Compare how 3 books explain real data →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Vibe Engineering. The section links point to the parts of the book it draws on.