concept probabilistic programming in category probabilistic programming

appears as: probabilistic programming
Practical Probabilistic Programming

This is an excerpt from Manning's book Practical Probabilistic Programming.

1.1. What is probabilistic programming?

Probabilistic programming is a way to create systems that help us make decisions in the face of uncertainty. Lots of everyday decisions involve judgment in determining relevant factors that we don’t directly observe. Historically, one way to help make decisions under uncertainty has been to use a probabilistic reasoning system. Probabilistic reasoning combines our knowledge of a situation with the laws of probability to determine those unobserved factors that are critical to the decision. Until recently, probabilistic reasoning systems have been limited in scope, and have been hard to apply to many real-world situations. Probabilistic programming is a new approach that makes probabilistic reasoning systems easier to build and more widely applicable.

To understand probabilistic programming, you’ll start by looking at decision making under uncertainty and the judgment calls involved. Then you’ll see how probabilistic reasoning can help you make these decisions. You’ll look at three specific kinds of reasoning that probabilistic reasoning systems can do. Then you’ll be able to understand probabilistic programming and how it can be used to build probabilistic reasoning systems through the power of programming languages.

A probabilistic programming system is, very simply, a probabilistic reasoning system in which the representation language is a programming language. When I say programming language, I mean that it has all the features you typically expect in a programming language, such as variables, a rich variety of data types, control flow, functions, and so on. As you’ll come to see, probabilistic programming languages can express an extremely wide variety of probabilistic models and go far beyond most traditional probabilistic reasoning frameworks. Probabilistic programming languages have tremendous expressive power.