This chapter covers:

  • Introducing the design principles of differentially private machine learning algorithms
  • Designing and implementing differentially private supervised learning algorithms (e.g., Naive Bayes classification, logistic regression and linear regression)
  • Designing and implementing differentially private unsupervised learning algorithms (e.g., K-means clustering)
  • Working with a case study on “Differentially Private Principal Component Analysis” to walk you through the process of designing and analyzing a differentially private machine learning algorithm

In the previous chapter, we have looked into the definition and general usage of differential privacy, the properties of differential privacy that works under different scenarios (e.g., post-processing property, group property and composition properties), and widely adopted differential privacy mechanisms in use today, that have served as the most important building blocks in various privacy-preserving algorithms and applications. In this chapter, we will walk through how to use those building blocks to design and implement various differentially private machine learning algorithms, and how to apply such algorithms in real-world scenarios. This chapter covers the 2nd part of differential privacy for machine learning.

3.1   How to Apply Differential Privacy in Machine Learning?

3.2   Differentially Private Supervised Learning Algorithms

3.3   Differentially Private Unsupervised Learning Algorithms

3.4   Case Study: Differentially Private Principal Component Analysis

3.4.1   The Privacy of PCA Over Horizontally Partitioned Data

3.4.2   The Design of Differentially Private PCA Over Horizontally Partitioned Data

3.4.3   Experimental Evaluation

3.5   Summary

sitemap