liveBook · Manning

Optuna

Optuna is an open-source Python framework for automated hyperparameter optimization through repeated trials that explore parameter configurations.

How 3 Manning books explain it

Inside Deep Learning: Math, Algorithms, Models

A hyperparameter-optimization library that searches parameter spaces by running trials and using a model to guide new suggestions.

How it is used
Tunes hyperparameters without gradients by comparing trial scores, including accuracy or error, to guide later choices.
How deep it goes
Explains the objective-and-trial workflow and sequential Bayesian suggestions, while deferring the model’s technical details.
Examples
Uses a two-variable toy function and proposes tuning fully connected or convolutional networks on FashionMNIST.
What you can do after
Apply Optuna by defining a trial-based objective, choosing a study direction, and running a specified number of trials.

Read how Inside Deep Learning: Math, Algorithms, Models explains Optuna →

Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

Optuna is an open-source hyperparameter optimization framework that adaptively searches parameter configurations through repeated trials.

How it is used
Deploys adaptive Bayesian search to refine XGBoost hyperparameters for classification and regression workflows.
How deep it goes
Explains studies, objectives, trial suggestions, evaluation choices, storage, and visual diagnostics, but defers algorithmic internals.
Examples
Uses XGBoost classification and Tokyo Airbnb regression, including optimization histories, parameter-importance plots, and reported best configurations.
What you can do after
Apply it via Python to construct studies, run configurable trials, select best parameters, and inspect optimization results.

Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains Optuna →

Designing Deep Learning Systems: A guide for software engineers

Optuna is an open-source Python library for automated hyperparameter optimization with trial pruning, parallel execution, and visualization.

How it is used
Automates hyperparameter searches for model training on local machines or managed clusters.
How deep it goes
Explains objective functions, studies, suggestions, pruning, and parallel setup, but remains an overview rather than search-algorithm internals.
Examples
Uses scikit-learn SVR and RandomForest regressors, sampled parameters, dataset splitting, and mean squared error.
What you can do after
Apply via Optuna by defining an objective, creating a study, setting a trial quota, and optionally sharing relational storage.

Read how Designing Deep Learning Systems: A guide for software engineers explains Optuna →

Also covered in

What to know first

Related concepts

Questions about Optuna

What is Optuna?

Optuna is an open-source Python framework for automated hyperparameter optimization through repeated trials that explore parameter configurations.

Which Manning books explain Optuna?

Inside Deep Learning: Math, Algorithms, Models, Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI and Designing Deep Learning Systems: A guide for software engineers.

What should I know before learning Optuna?

Manning books that teach Optuna usually introduce Bayesian optimization, accuracy, epoch and hyperparameter tuning first.

What is Optuna a kind of?

Optuna is a kind of Bayesian optimization. Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.