Data frame
A data frame is a two-dimensional tabular data structure with labeled rows and columns that can contain values of different types.
Pandas Workout: 200 exercises to make you a stronger data analyst
A pandas DataFrame is a two-dimensional labeled tabular data structure organized into rows and columns.
- How it is used
- Organizes tabular records for selecting, updating, analyzing, importing, combining, and cleaning data.
- How deep it goes
- Works through construction, indexed selection, column arithmetic, concatenation, missing values, and CSV import without yet using grouping or date-time parsing.
- Examples
- Uses product inventory revenue, taxi trips, temperatures, cryptocurrency prices, Unix passwd records, and parking violations.
- What you can do after
- Apply it via pandas to create, filter, update, combine, import, and clean labeled tables.
Read how Pandas Workout: 200 exercises to make you a stronger data analyst explains data frame →
Starting Data Analytics with Generative AI and Python
A DataFrame is a two-dimensional tabular data structure whose rows and columns can hold labeled, potentially heterogeneous data.
- How it is used
- Uses DataFrames to hold imported business records and intermediate results for data-quality checks, joins, and analysis.
- How deep it goes
- Works through inspection, cleaning, merging, and grouping operations without explaining DataFrame internals.
- Examples
- Uses e-commerce CSVs, customer and order identifiers, review-score distributions, and Portuguese customer comments.
- What you can do after
- Apply it via pandas to inspect tables, check data quality, join related records, and prepare grouped results.
Read how Starting Data Analytics with Generative AI and Python explains data frame →
Cyber Threat Hunting
A data frame is a two-dimensional tabular data structure with labeled rows and columns.
- How it is used
- Organizes network connection events for beaconing investigations and later machine-learning feature extraction.
- How deep it goes
- Defines the table structure and demonstrates loading, typing, grouping, transforming, filtering, sorting, and deduplicating rows without describing pandas internals.
- Examples
- Uses 667,827 network events and a 320,044-row connection dataset to derive timing, count, variance, and byte-difference fields.
- What you can do after
- Apply it via pandas to load event data, derive connection features, and narrow repeated communications for investigation.
Snowflake Data Engineering
A data frame is a tabular data structure that represents a relational dataset and supports operations such as selection, filtering, ordering, grouping, and combining.
- How it is used
- Builds Snowflake pipeline steps for querying, transforming, loading, and persisting relational data.
- How deep it goes
- Explains construction, schemas, lazy actions, CSV ingestion, joins, tables, and views without detailing SQL translation internals.
- Examples
- Demonstrates holiday-date dimensions, staged bakery orders, an orders-date join, and CSV extracted from email output.
- What you can do after
- Apply it via Snowpark Python to create, transform, inspect, join, and save relational data sets.
Fast Python: High performance techniques for large datasets
- How it is used
- Uses pandas data frames for in-memory taxi-trip analysis while testing loading, memory use, and computation speed.
- How deep it goes
- Works through column types, memory measurements, row traversal, vectorization, and chunking; focuses on performance practice rather than defining table internals.
- Examples
- Uses January 2020 New York City taxi trips for memory inspection, tip calculations, and chunked CSV-to-Parquet conversion.
- What you can do after
- Apply it via pandas to load selected columns, reduce memory use, benchmark calculations, and process files in chunks.
Read how Fast Python: High performance techniques for large datasets explains data frame →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
A pandas DataFrame is a two-dimensional labeled tabular data structure with rows and columns that can hold heterogeneous data types.
- How it is used
- Organizes heterogeneous tabular data for exploration, transformation, visualization, and machine-learning preparation.
- How deep it goes
- Defines labeled rows and columns, demonstrates construction and row access, and outlines common processing operations.
- Examples
- Uses a four-person demographic table, three joined product tables, and concatenated CSV training subsets.
- What you can do after
- Apply it via pandas to create, label, access, merge, and transform tables for analysis or modeling.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains data frame →
Effective Data Analysis
A dataframe is a tabular data structure with labeled rows and columns that can hold variables of different types.
- How it is used
- Structures external API and scraped website data for analysis, refreshable stakeholder deliverables, and downstream visualization workflows.
- How deep it goes
- Explains construction, field selection, parsing, type conversion, and aggregation, but does not develop dataframe internals.
- Examples
- Uses seven-day weather forecasts, nested JSON responses, scraped forecast cards, temperature and wind-speed parsing, and daily summaries.
- What you can do after
- Builds pandas data frames from API or HTML records, cleans columns, and produces grouped summaries for analysis.
DuckDB in Action
A data frame is a two-dimensional tabular data structure with labeled rows and columns, such as the structure provided by pandas.
- How it is used
- Uses in-memory tables as SQL-queryable inputs and analysis-ready outputs across Python, visualization, and pipeline workflows.
- How deep it goes
- Demonstrates construction, filtering, parameterization, conversion, and pipeline ingestion, without detailing data-frame internals.
- Examples
- Uses authors, tennis tournament levels, player-match results, and interactive tables as concrete data-frame examples.
- What you can do after
- Apply it via pandas and DuckDB to query, transform, return, visualize, and pipeline structured in-memory data.
Data Pipelines with Apache Airflow, Second Edition
A pandas DataFrame is a two-dimensional labeled tabular data structure provided by the pandas library.
- How it is used
- Serves as the working tabular form between reading pipeline inputs, transforming their contents, and writing results.
- How deep it goes
- Demonstrates pandas reads, grouping, chained transformations, and writes, but does not explain DataFrame internals.
- Examples
- Uses user-event counts, reusable taxi and bike transformations, and recipe chunks prepared for vectorization.
- What you can do after
- Apply it via pandas and Airflow to aggregate events, compose reusable transformations, and prepare files for later pipeline steps.
Read how Data Pipelines with Apache Airflow, Second Edition explains data frame →
Statistics Every Programmer Needs
A data frame is a tabular data structure organized into labeled rows and columns that may hold different types of values.
- How it is used
- Supports importing, inspecting, transforming, summarizing, and modeling tabular observations in practical Python analyses.
- How deep it goes
- Explains construction, copying, assignment, grouping, inspection, indexing, and summary statistics without descending into pandas internals.
- Examples
- Uses NFL play data, stock prices, simulated distributions, piston measurements, and diagnostic-test contingency tables.
- What you can do after
- Apply it via pandas to load, inspect, reshape, group, summarize, and index labeled tabular data.
Read how Statistics Every Programmer Needs explains data frame →
The Quick Python Book, Fourth Edition
A data frame is a two-dimensional tabular data structure with labeled rows and columns that can hold and manipulate heterogeneous data.
- How it is used
- Uses data frames as pandas’ working structure for loading, cleaning, selecting, and combining tabular data.
- How deep it goes
- Works through construction, column selection, and cleaning with small examples rather than storage internals.
- Examples
- Demonstrates a numeric grid, a weather CSV with percentage strings, and sales calls joined to revenue.
- What you can do after
- Apply it via pandas to clean columns, filter rows, and merge datasets on shared fields.
Read how The Quick Python Book, Fourth Edition explains data frame →
Investing for Programmers
A DataFrame is a tabular data structure organized into labeled rows and columns that may contain values of different types.
- How it is used
- Organizes accounting, portfolio, market, ratio, and currency data for programmatic financial analysis.
- How deep it goes
- Explains labeled rows and columns, selection, merging, conversion, and aggregation, but does not detail DataFrame internals.
- Examples
- Demonstrates Microsoft statements, quarterly statements, portfolio positions, ticker-based metric merges, currency conversion, and aggregate investment values.
- What you can do after
- Build it from scratch by retrieving financial data, selecting metrics, merging DataFrames, standardizing currencies, and calculating portfolio values.
Data Storytelling with Altair and AI
A pandas DataFrame is a two-dimensional labeled tabular data structure with rows and columns.
- How it is used
- Prepares tabular data for Altair charts, annotations, supporting visuals, and calls to action.
- How deep it goes
- Demonstrates loading, date parsing, filtering, reshaping, missing-value removal, grouping, column creation, and direct construction without describing pandas internals.
- Examples
- Uses tourist-arrivals and airport datasets, a small Name-Age-City table, sports image URLs, a baseline value, and CTA text-image records.
- What you can do after
- Apply it via pandas and Altair to load, prepare, construct, and supply tables for layered data-story charts.
Read how Data Storytelling with Altair and AI explains data frame →
Build Python Web Apps with Streamlit
A dataframe is a two-dimensional tabular data structure organized into rows and columns, with each column holding values of a data type.
- How it is used
- Supports loading, inspecting, manipulating, analyzing, and displaying structured tabular data in Python dashboards.
- How deep it goes
- Defines rows, columns, and data types, then demonstrates loading, inspection, selection, filtering, and previewing; advanced pandas details remain deferred.
- Examples
- Uses sales_data.csv, pandas read_csv, df.info(), df.head(), selected sales columns, and editable Streamlit data frames.
- What you can do after
- Build a basic data workflow that loads a CSV, inspects its schema, selects data, and previews the result in Streamlit.
Read how Build Python Web Apps with Streamlit explains data frame →
Outlier Detection in Python
A dataframe is a tabular data structure with labeled rows and columns for storing and manipulating heterogeneous data.
- How it is used
- Supports tabular preparation, transformation, filtering, and analysis for ordinary and large-scale datasets.
- How deep it goes
- Defines the structure and demonstrates practical operations, but does not descend into dataframe internals or implementation details.
- Examples
- Uses encoded network records, robust scaling, ranked row values, and Prophet timestamps, observations, forecasts, and confidence bounds.
- What you can do after
- Operate/configure pandas, Spark, or Dask dataframes for preprocessing and simple analytical filtering.
Grokking Machine Learning
A DataFrame is a two-dimensional labeled tabular data structure provided by Pandas for storing and manipulating heterogeneous columns.
- How it is used
- Stores tabular datasets for inspection, cleaning, preprocessing, and machine-learning workflows.
- How deep it goes
- Defines DataFrames, loads one from CSV, explains indexing, and demonstrates inspection and column selection.
- Examples
- Uses the 891-row, 12-column Titanic passenger dataset, including survival, age, fare, cabin, and embarkation columns.
- What you can do after
- Operate Pandas to load, inspect, select, save, and reload a tabular dataset.
Data Without Labels
A dataframe is a two-dimensional tabular data structure whose rows represent observations and whose columns represent labeled variables that may have different types.
- How it is used
- Structures scraped reviews and cleaned analytical variables before sentiment analysis, plotting, persistence, and deployment-oriented data checks.
- How deep it goes
- Demonstrates construction, loading, inspection, column transformation, merging, and duplicate removal without explaining dataframe internals.
- Examples
- Uses Amazon-style customer reviews, sentiment-score columns, CSV persistence, plots, and dummy duplicate rows as concrete artifacts.
- What you can do after
- Builds and operates pandas data frames for collecting records, inspecting quality, transforming columns, joining results, and removing duplicates.
Natural Language Processing in Action, Second Edition
A DataFrame is a tabular data structure organized into labeled rows and columns that may contain heterogeneous values.
- How it is used
- Represents token counts as labeled document-by-word tables for inspecting and computing on text vectors.
- How deep it goes
- Explains construction, labels, missing values, row inspection, and high-dimensional vocabulary columns without descending into implementation internals.
- Examples
- Uses short bias-related documents, token counters, vocabulary columns, df.head(), and df.iloc[10] to inspect results.
- What you can do after
- Build it from scratch by converting token-count dictionaries into a cleaned, inspectable pandas DataFrame.
Read how Natural Language Processing in Action, Second Edition explains data frame →
Advanced Algorithms and Data Structures
A DataFrame is a two-dimensional labeled tabular data structure whose columns can have different types.
- How it is used
- Uses Pandas DataFrames to organize CSV statistics for grouped performance analysis.
- How deep it goes
- Explains the table-like role and grouping workflow, but does not detail DataFrame implementation internals.
- Examples
- Uses Huffman encoding statistics grouped by test case, method, and branching factor.
- What you can do after
- Apply it via Pandas to transform CSV statistics, partition and group records, and prepare comparative results.
Read how Advanced Algorithms and Data Structures explains data frame →
Related concepts
- read_csvproduced by · read_csv is a function that parses comma-separated or otherwise delimited text into a tabular data structure.
- time seriesincludes · A time series is a sequence of observations indexed or ordered by time.
- pandasused by · pandas is an open-source Python library that provides labeled data structures and tools for manipulating and analyzing tabular and other structured data.
- data groupingused by · Data grouping is the organization of data into groups according to shared values, keys, or other criteria, supporting grouped processing, analysis, or retrieval.
- columnhas part · A column is a vertical sequence or field in a tabular, grid, or matrix structure whose elements share a common position, attribute, or role.
- CSVproduces · CSV is a plain-text format for tabular data, representing records as rows and fields as values separated by delimiters, conventionally commas, with quoting conventions for special content.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.