liveBook · Manning

Progress bar

As explained in Software Engineering for Data Scientists

A progress bar, or progress monitor, is a visual indicator that reports the completion status of an ongoing operation.

A progress bar, or progress monitor, shows how far an ongoing operation has progressed. It makes long-running data-science work less uncertain, including model training, data extraction, and webpage downloads. section 5.0

Use progress monitoring when execution time or completion status matters:

  • Wrap an iterable with tqdm to report completed and remaining loop iterations. section 5.1
  • Monitor list comprehensions, dictionary comprehensions, and model-training workflows. section 5.1 section 5.5
  • Set scikit-learn's verbose argument to print status updates during hyperparameter searches. section 5.2.1

Track webpage downloads

Install tqdm with pip, import it, and wrap the ticker list in the loop: `for ticker in tqdm(tickers):`. The terminal then reports progress, while exception handling records tickers whose downloads fail.

How Software Engineering for Data Scientists covers it

How deep it goes
Explains installation, iterable wrapping, comprehension support, and verbose search output, but stops short of implementation internals.
Examples
Demonstrates webpage downloads, customer-churn model metrics, random-forest training, and randomized hyperparameter search.
What it assumes
Assumes basic Python iteration and machine-learning workflows while teaching progress monitoring from installation and simple wrapping.
What you can do after
Apply it via tqdm or scikit-learn's verbose argument to monitor iterable execution and model-training progress.
How it connects
Connects progress bars with Python loops, list comprehensions, model training, hyperparameter tuning, and timeouts.

Also explained in

Compare how 3 books explain progress bar →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Software Engineering for Data Scientists. The section links point to the parts of the book it draws on.