liveBook · Manning

Data curation

As explained in Deep Learning with R, Third Edition

Data curation is the selection, cleaning, organization, and quality management of data for analysis or machine learning.

Data curation selects, cleans, organizes, and quality-checks data so models learn from informative, low-noise examples. For deep learning, better data often improves generalization more reliably than changing the model. section 5.1.2

Prioritize data that makes the learning problem easier to interpolate:

  • Increase coverage of the input space, especially near decision boundaries. section 5.1.2
  • Preserve informative features and remove overly noisy or inaccurate data. section 5.1.2

Randomly shuffled MNIST labels

An MNIST classifier is trained after randomly shuffling the training labels. The runnable experiment keeps the images but destroys the input–label relationship, illustrating why model capacity cannot compensate for poor curation.

How Deep Learning with R, Third Edition covers it

How deep it goes
Connects curation to manifold coverage and interpolation, but stops short of a procedural curation workflow.
Examples
Uses MNIST with randomly shuffled labels to expose the consequences of corrupted training relationships.
What you can do after
Apply via data improvements that increase informative, accurate, low-noise, and dense coverage before changing the model.
How it connects
Ties data curation to feature engineering, training data, input manifolds, interpolation, and generalization.

Also explained in

Compare how 2 books explain data curation →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Deep Learning with R, Third Edition. The section links point to the parts of the book it draws on.