3 Advanced concepts of differential privacy for machine learning

 

This chapter covers

  • Design principles of differentially private machine learning algorithms
  • Designing and implementing differentially private supervised learning algorithms
  • Designing and implementing differentially private unsupervised learning algorithms
  • A walk-through of the process of designing and analyzing a differentially private machine learning algorithm

In the previous chapter, we investigated the definition and general usage of differential privacy and the properties of differential privacy that work under different scenarios (e.g., post-processing property, group property, and composition properties). We also looked into common and widely adopted differentially private mechanisms that have served as essential building blocks in various privacy-preserving algorithms and applications. This chapter will walk through how to use those building blocks to design and implement multiple differentially private machine learning algorithms and how to apply such algorithms in real-world scenarios. This will be our second part of differential privacy for machine learning.

Timeline Description automatically generated

We are now at the third chapter of this book. This chapter is the second part of differential privacy in our discussion. This chapter will mainly look at how differential privacy can be implemented in machine learning algorithms by looking at different examples and implementation codes.

3.1 How to Apply Differential Privacy in Machine Learning?

 
 

INPUT PERTURBATION

 
 

ALGORITHM PERTURBATION

 

OUTPUT PERTURBATION

 
 
 
 

OBJECTIVE PERTURBATION

 
 
 

3.2 Differentially Private Supervised Learning Algorithms

 
 

3.2.1 Differentially Private Naive Bayes Classification

 
 
 

NAIVE BAYES CLASSIFICATION

 

DISCRETE NAIVE BAYES

 
 
 

GAUSSIAN NAIVE BAYES

 
 
 

DIFFERENTIALLY PRIVATE NAIVE BAYES CLASSIFICATION

 
 

Formulating the Sensitivity of Model Parameters

 
 
 

The Algorithm of Differentially Private Naive Bayes Classification

 
 
 

Usage of Differentially Private Naive Bayes Classification in Python

 

Applying Naive Bayes with No Privacy

 
 
 

Applying Differentially Private Naive Bayes

 

3.2.2 Differentially Private Logistic Regression

 
 
 

LOGISTIC REGRESSION

 
 

DIFFERENTIALLY PRIVATE LOGISTIC REGRESSION

 
 
 

Formulating the Sensitivity

 
 
 

The Algorithm of Differentially Private Logistic Regression

 
 
 
 
sitemap

Unable to load book!

The book could not be loaded.

(try again in a couple of minutes)

manning.com homepage
test yourself with a liveTest