liveBook · Manning

Data analysis

As explained in Vibe Engineering

Data analysis, or analytics, is the systematic inspection, transformation, and interpretation of data to discover patterns, derive insights, and support decisions.

Data analysis inspects and interprets data to answer questions or discover patterns. An LLM can suggest datasets, analytical questions, and notebook code, but its suggestions still need review: a dataset must be available and suited to the intended analysis. section 4.1 section 4.3

Start by checking a dataset’s download availability, size, and suitability for the intended task. Real data can support analysis of real-world distributions but may require cleaning; synthetic data may be cleaner for demonstrations while offering less meaningful real-world patterns. section 4.1

Use Case
Dataset A (Indian)
Dataset B (Synthetic)
Exploratory Data Analysis (EDA)
✅ Strong — real distributions, price trends
⚠️ Limited — synthetic distributions
Supervised ML for Prediction
⚠️ Limited (no target label by default)
⚠️ Same — likely no target labels
Clustering / Unsupervised learning
✅ Yes — cluster by manufacturer, composition
⚠️ Yes but less real-world meaning
NLP/Categorization
⚠️ Yes — text fields (names/composition)
⚠️ Yes (names) but synthetic semantics
Recommender systems
⚠️ Possible but needs augmentation
❌ Limited
Benchmarking models / DEMO
⚠️ Possible but raw
✅ Ideal due to cleaner, controlled data
Aspect
Indian Medicine Dataset (A)
Kaggle Medicine Dataset (B)
Source
Scraped real data
Synthetic generated data
Size
~250 K records
~50 K records
Real-world
✅ Yes
❌ No
Cleanliness
⚠️ No (requires cleaning)
✅ Likely
Usability for Research
High
Moderate
ML Power
Good for real analysis
Good for ML practice

Compare real and synthetic medicine datasets across exploratory analysis, prediction, clustering, and benchmarking. section 4.1

Choose an analysis approach based on what is already known:

  • For unfamiliar data, ask an LLM to suggest questions and generate an exploratory notebook. Candidate questions include price distributions, leading manufacturers, discontinuation rates, and differences by composition or type. section 4.3
  • For known questions, specify the dataset path, calculations, charts, and output requirements in the prompt. Include the data directory in the path so the generated notebook does not look for the file in the wrong location. section 4.3.1

Analyzing a pharmaceutical dataset

A targeted notebook request ranks the top 10 manufacturers by product count and plots their counts alongside average prices. It also calculates the number and percentage of discontinued products, charts counts and average prices by medicine type, and exports plots as high-resolution PNGs. section 4.3.1

How Vibe Engineering covers it

How deep it goes
Details dataset-selection checks and notebook prompts, including requested calculations, charts, and exports.
Examples
Uses medicine datasets to examine manufacturer product counts, prices, discontinuations, and medicine types.
What you can do after
Apply it via Jupyter Notebook by prompting for exploratory or question-driven analysis.
How it connects
Connects exploratory data analysis with dataset selection, machine learning, clustering, and benchmarking.

Also explained in

Compare how 12 books explain data analysis →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Vibe Engineering. The section links point to the parts of the book it draws on.