9 Advanced data annotation and augmentation

 

This chapter covers

  • Evaluating annotation quality for subjective tasks
  • Optimizing annotation quality control with machine learning
  • Treating model predictions as annotations
  • Combining embeddings/contextual representations with annotations
  • Using search and rule-based systems for data annotation
  • Bootstrapping models with lightly supervised machine learning
  • Expanding datasets with synthetic data, data creation, and data augmentation
  • Incorporating annotation information into machine learning models
 
 

9.1 Annotation quality for subjective tasks

 
 
 

9.1.1 Requesting annotator expectations

 
 
 
 

9.1.2 Assessing viable labels for subjective tasks

 
 
 

9.1.3 Trusting an annotator to understand diverse responses

 
 
 

9.1.4 Bayesian Truth Serum for subjective judgments

 
 
 
 

9.1.5 Embedding simple tasks in more complicated ones

 
 
 

9.2 Machine learning for annotation quality control

 

9.2.1 Calculating annotation confidence as an optimization task

 
 

9.2.2 Converging on label confidence when annotators disagree

 
 
 

9.2.3 Predicting whether a single annotation is correct

 
 
 

9.2.4 Predicting whether a single annotation is in agreement

 
 
sitemap

Unable to load book!

The book could not be loaded.

(try again in a couple of minutes)

manning.com homepage