Generative modeling
Generative modeling is a machine-learning approach that learns patterns or a data distribution to generate new samples resembling the data.
Starting Data Analytics with Generative AI and Python
A machine-learning model that generates new content, such as text, code, or explanations, from learned patterns and user instructions.
- How it is used
- Supports business data analysis from problem framing and data preparation through coding, visualization, and interpretation.
- How deep it goes
- Explains iterative analytical workflows and limitations while deliberately avoiding model architecture details and advanced API integration.
- Examples
- Uses product-category sales across Brazilian regions and customer-review analysis to demonstrate AI-assisted analytics.
- What you can do after
- Apply generative AI via ChatGPT or Gemini to plan analyses, generate code, and refine answers while testing outputs.
Read how Starting Data Analytics with Generative AI and Python explains generative modeling →
Introduction to Generative AI, Second Edition
Generative AI is the area of artificial intelligence focused on models that produce new content such as text, images, audio, or code.
- How it is used
- Frames generative modeling as a foundation for content creation and human–AI collaboration across work, education, and creative industries.
- How deep it goes
- Surveys content types and applications, contrasts generation with classification, and identifies training-data repetition as a privacy risk.
- Examples
- Illustrates generation with the synthetic puffer-coat image, prompted ketchup artwork, and a pianist’s live AI improvisation.
- What you can do after
- Evaluate and understand generative outputs by weighing creative uses against accuracy, privacy, and consent risks.
Read how Introduction to Generative AI, Second Edition explains generative modeling →
Generative AI in Action
Generative AI is an artificial-intelligence approach that produces new content or processes rather than merely classifying or predicting properties of existing inputs.
- How it is used
- Positions generative modeling as a way to create content and augment enterprise workflows and customer services.
- How deep it goes
- Explains learned patterns, probabilistic outputs, and enterprise implementation steps while deferring detailed machine-learning and deep-learning treatment.
- Examples
- Uses a launch-email prompt, entity extraction from a caller message, and an enterprise chatbot workflow.
- What you can do after
- Apply it via GPT-4 to draft text and extract entities from supplied content.
Read how Generative AI in Action explains generative modeling →
Coding with AI
Artificial intelligence that produces new content, such as text, source code, documentation, or tests, from learned patterns and input instructions.
- How it is used
- Supports Python development from planning and scaffolding through testing and documentation.
- How deep it goes
- Explains learned patterns and prediction, sketches Transformer processing, and develops a practical workflow for reviewing and revising generated code.
- Examples
- Uses a HAM radio practice-exam application, generated Flask scaffolding, and AI-assisted test suites as development examples.
- What you can do after
- Apply it via ChatGPT, GitHub Copilot, and Blackbox AI to scaffold an application and revise generated suggestions.
Build Financial Software with Generative AI (From Scratch)
Generative artificial intelligence, or generative AI, produces new content such as text, code, images, or other data from learned patterns and input.
- How it is used
- Uses generative AI as a development assistant for an ACH dashboard, from coding and troubleshooting to test data generation.
- How deep it goes
- Introduces practical prompting and iterative code refinement, while stopping short of a comprehensive treatment of generative AI.
- Examples
- Works through a Python balance formatter, a faulty transaction list, and an HTML5 D3.js bar chart.
- What you can do after
- Apply it via ChatGPT to refine code and investigate bugs, then test results and verify version-specific suggestions.
Read how Build Financial Software with Generative AI (From Scratch) explains generative modeling →
Effective Conversational AI
An AI model that creates new content, such as text, images, audio, or code, from learned patterns or conditioning information.
- How it is used
- Supports customer-facing answers and build-time improvements alongside controlled conversational AI.
- How deep it goes
- Explains text generation through next-word prediction and develops practical selection, guardrail, and assessment criteria without deep implementation code.
- Examples
- Uses varied bakery recipe requests, password-reset training utterances, process flows, and conversation transcripts as practical cases.
- What you can do after
- Evaluate/understand it by choosing controlled or generated responses, testing correctness, and setting guardrails proportionate to the risk of errors.
Read how Effective Conversational AI explains generative modeling →
First-Party Data Activation
Artificial intelligence that generates new content, such as text, images, audio, video, or code, from learned patterns.
- How it is used
- Supports marketing ideation, personalization, and decision-making using first-party data.
- How deep it goes
- Defines model types and transformer origins, then surveys marketing applications and adoption considerations without implementation details.
- Examples
- Illustrates personalized fashion-retail emails and natural-language exploration of customer segments.
- What you can do after
- Evaluate generative marketing opportunities and risks against available data, workflows, and organizational governance.
Read how First-Party Data Activation explains generative modeling →
Data Without Labels
Generative AI is artificial intelligence that generates new content, such as text, images, or video, from learned patterns and an input prompt or other condition.
- How it is used
- Positions generative modeling as a way to create new content and synthetic data rather than only predict or classify.
- How deep it goes
- Defines the data-distribution objective and gives an integration checklist, but does not work through a generative-model implementation.
- Examples
- Uses text drafting, translation, chatbots, image generation, and synthetic data to illustrate possible outputs.
- What you can do after
- Evaluate/understand it by distinguishing generation from classification and planning data preparation, model selection, and validation for a use case.
Build AI Drug Discovery Pipelines
A generative model learns patterns or a probability distribution from data and can produce new samples with similar characteristics.
- How it is used
- Supports de novo molecular design and property-guided exploration of chemical space.
- How deep it goes
- Develops autoencoders into variational autoencoders, explaining latent-space regularization, sampling, and training difficulties.
- Examples
- Uses molecular SMILES reconstruction and Chemistry42-generated scaffolds compared with ChEMBL to illustrate generation and novelty.
- What you can do after
- Build it from scratch as a molecular generator using an autoencoder and variational autoencoder approach.
Read how Build AI Drug Discovery Pipelines explains generative modeling →
Build AI-Enhanced Web Apps
Generative AI is an artificial-intelligence paradigm that generates new content from learned patterns rather than only classifying inputs or following predefined rules.
- How it is used
- Introduces generative modeling as the content-generation capability behind adaptive web applications.
- How deep it goes
- Explains pattern-based generation, next-word prediction, self-attention, and supporting web application components without mathematical detail.
- Examples
- Uses marketing image and copy generation, customer-support responses, and a voice-based interview assistant to illustrate applications.
- What you can do after
- Apply it via the Vercel AI SDK to build generative features in React and Next.js applications.
Read how Build AI-Enhanced Web Apps explains generative modeling →
AI for Everyday IT
Generative AI is a class of artificial intelligence systems that produces new content, such as text, images, code, or structured data, from learned patterns and inputs.
- How it is used
- Supports IT workflows, workplace communication, disaster recovery documentation, and application features.
- How deep it goes
- Defines generative AI as learning patterns to create content and distinguishes text and image generators without explaining model internals.
- Examples
- Uses a MySQL disaster recovery documentation prompt and a comparison of responses to a physical stacking problem.
- What you can do after
- Apply it via tools such as ChatGPT or Azure OpenAI Service to draft content and gather requirements for IT tasks.
Inside AI
Generative artificial intelligence is an approach in which models produce new content such as text, images, audio, or code from learned patterns.
- How it is used
- Introduces generative AI as a way to create content and make AI tools accessible to nontechnical users.
- How deep it goes
- Defines generation through learned patterns and traces its statistical roots, without detailing model implementation.
- Examples
- Illustrates generation with customer-support responses, coding assistance, and a legal brief containing fabricated cases.
- What you can do after
- Evaluate generative AI applications by weighing their content-creation benefits against inaccuracies, harmful outputs, and intellectual property concerns.
Effective Data Analysis
A class of artificial-intelligence systems that generates new content such as text, code, images, audio, or video from learned patterns and inputs.
- How it is used
- Positions generative AI as an assistant for analytics workflows and organizational decision support.
- How deep it goes
- Defines generative AI and outlines an iterative evaluation workflow without explaining model training internals.
- Examples
- Uses customer login summaries and a rat-sightings prediction exercise to illustrate prompted analysis.
- What you can do after
- Evaluate chatbot-generated analyses by refining prompts, inspecting code and metrics, and comparing results with an existing model.
Read how Effective Data Analysis explains generative modeling →
Writing for Developers: Blogs that get read
Artificial intelligence that generates new content such as text, images, audio, or code from learned patterns.
- How it is used
- Supports rapid gap-finding and grammar checking during technical writing, while preserving human control over content and revisions.
- How deep it goes
- Explains practical prompts and review safeguards, but stops short of describing model internals or reliable automated judgment.
- Examples
- Uses engineering-blog gap prompts, grammar-rule questions, full-article checks, and automated detection of article and its/it’s errors.
- What you can do after
- Apply it via an AI chatbot to surface possible omissions or language errors, then diagnose each suggestion before changing the draft.
Read how Writing for Developers: Blogs that get read explains generative modeling →
The Art of AI Product Development
Artificial intelligence that generates new content such as text, images, audio, or code from learned patterns.
- How it is used
- Positions generative AI as one solution type to consider when choosing how to address a product problem.
- How deep it goes
- Defines content generation through learned patterns and contrasts system types, without explaining model internals.
- Examples
- Uses movie-review sentiment analysis to compare GPT-4o with logistic regression, and names healthcare and product design as generative applications.
- What you can do after
- Evaluate whether generative or predictive AI better fits a task, considering cost and privacy as well as capability.
Read how The Art of AI Product Development explains generative modeling →
Deep Learning with R, Third Edition
Generative AI comprises computational models that produce new content such as text, images, audio, or code from learned patterns.
- How it is used
- Introduces generative modeling as a way to produce content and augment creative work.
- How deep it goes
- Explains self-supervised reconstruction and sampling from learned structure, without deriving the underlying mathematics.
- Examples
- Illustrates generation with a prompted Midjourney image, next-word prediction, and image denoising.
- What you can do after
- Evaluate and understand how generative models learn patterns and produce content in response to prompts.
Read how Deep Learning with R, Third Edition explains generative modeling →
Data-Driven Cybersecurity
Generative AI is artificial intelligence that creates new content such as text, images, audio, or code from learned patterns.
- How it is used
- Uses generated data and reports to support cybersecurity metrics analysis, scenario testing, and decision-making.
- How deep it goes
- Works through a prompt-to-chart data pipeline and incident examples, but does not develop model-training internals.
- Examples
- Uses fictitious failed-login records, a failure-reason bar chart, and an incident-response table.
- What you can do after
- Apply it via a local language model to generate test data and draft analyses, then validate findings before acting.
Read how Data-Driven Cybersecurity explains generative modeling →
Graph Neural Networks in Action
A deep generative model is a generative model that uses neural networks to learn and generate data distributions.
- How it is used
- Uses learned data distributions to sample synthetic examples and, in graph settings, support reconstruction and edge prediction.
- How deep it goes
- Explains the probability distinction and graph autoencoder mechanisms, then compares architecture trade-offs without a rigorous derivation.
- Examples
- Uses boat and airplane images, synthetic faces, candidate drugs, and graph edge prediction as examples.
- What you can do after
- Apply it via PyTorch Geometric to build graph autoencoders for edge prediction and choose between GAE and VGAE for graph tasks.
Read how Graph Neural Networks in Action explains generative modeling →
How Large Language Models Work
Generative AI/ML is the area of artificial intelligence and machine learning concerned with producing new content or outputs.
- How it is used
- Frames content generation as a capability for evaluating applications, limitations, and deployment decisions across AI systems.
- How deep it goes
- Defines generated outputs and sketches input-output behavior, but stops short of implementation details or building models from scratch.
- Examples
- Uses haiku generation, text summarization, rewriting, detail addition, completion, and multimodal input-output transformations.
- What you can do after
- Evaluate/understand what generative systems can produce, where they may fit, and when reliability or cost makes them unsuitable.
Read how How Large Language Models Work explains generative modeling →
Outlier Detection in Python
A generative model represents a process or probability distribution capable of assigning likelihoods to observations or generating new observations.
- How it is used
- Uses probability models to assess typicality, generate synthetic observations, and support outlier detection.
- How deep it goes
- Explains likelihood fitting, sampling, covariance assumptions, and reconstruction-based variants, but does not derive their mathematics.
- Examples
- Uses baseball records, Gaussian clusters, synthetic samples, covariance expansion, and image outlier-detection methods.
- What you can do after
- Evaluate typicality, generate synthetic tabular data with GMMs, and compare generative detectors using synthetic data or pseudo-ground truth.
Read how Outlier Detection in Python explains generative modeling →
Learn Generative AI with PyTorch
A class of AI systems that create new content such as text, images, code, audio, music, or video rather than only classifying existing inputs.
- How it is used
- Explains how AI systems produce novel content instead of only recognizing or labeling existing inputs.
- How deep it goes
- Defines outputs, contrasts probability objectives, and sketches GANs and Transformers without developing training procedures or derivations.
- Examples
- Uses dog-and-cat image synthesis, text-to-image systems, ChatGPT, generated music, legal documents, code, audio, and video.
- What you can do after
- Evaluate/understand how generative and discriminative models differ and identify major generative model families and applications.
Read how Learn Generative AI with PyTorch explains generative modeling →
Acing the CCNA Exam: Volume 2 Advanced Networking and Security
Generative AI is artificial intelligence that produces new content such as text, code, configurations, or designs from learned patterns and supplied requirements.
- How it is used
- Supports network automation by generating operational artifacts and assisting intent-based networking.
- How deep it goes
- Defines learned-pattern generation and contrasts prediction, but stops short of explaining model internals or implementation procedures.
- Examples
- Uses ChatGPT, Gemini, Midjourney, DALL-E, scripts, diagrams, documentation, and plug-and-play deployments as examples.
- What you can do after
- Evaluate generative AI as an aid for producing network scripts, diagrams, documentation, deployments, and intent-based configurations.
Investing for Programmers
Artificial intelligence that generates new content or information, including text, images, code, or synthesized insights.
- How it is used
- Supports financial research by generating summaries, company insights, sentiment analysis, and scenario-oriented analysis.
- How deep it goes
- Defines GenAI, contrasts it with discriminative ML, and demonstrates applications while deferring transformer and attention internals.
- Examples
- Uses earnings reports, news articles, social media sentiment, management questions, investment scorecards, and Python LLM integrations.
- What you can do after
- Apply it via Python and LLM platforms to research companies, generate insights, and identify features for focused ML models.
Read how Investing for Programmers explains generative modeling →
Deep Learning with Python, Third Edition
AI systems that generate new text, images, or other content in response to prompts by modeling the distribution of data.
- How it is used
- Uses learned data distributions to generate content from prompts across text, images, video, and sound applications.
- How deep it goes
- Explains self-supervised objectives, parameters, representations, and sampling, but stops short of specific model architectures or implementation code.
- Examples
- Uses ChatGPT, Gemini, Claude, and Midjourney alongside next-word prediction and image denoising as concrete examples.
- What you can do after
- Evaluate generative AI applications by relating their prompted outputs to self-supervised training and learned model representations.
Read how Deep Learning with Python, Third Edition explains generative modeling →
The Complete Obsolete Guide to Generative AI
A machine-learning model that produces new content resembling patterns learned from its training data.
- How it is used
- Applies generative AI tools to practical work such as analysis, summarization, fine-tuning, and content generation.
- How deep it goes
- Introduces model classes and prompt controls while minimizing under-the-hood theory and technical background.
- Examples
- Illustrates iterative code generation and model-to-model feedback, alongside analysis, summarization, audio, and video use cases.
- What you can do after
- Apply it via interactive tools and APIs to configure prompts and automate model interactions.
Read how The Complete Obsolete Guide to Generative AI explains generative modeling →
Grokking Machine Learning, Second Edition
A model that learns the structure of data well enough to generate new data resembling its training dataset.
- How it is used
- Contrasts answering predictive questions with creating new data resembling a dataset.
- How deep it goes
- Defines generation and names major model families, but defers detailed algorithms and implementation.
- Examples
- Uses faces, realistic images, videos, paintings, music, stories, and poetry as generated outputs.
- What you can do after
- Evaluate/understand how generative models differ from predictive models and what kinds of data they can produce.
Read how Grokking Machine Learning, Second Edition explains generative modeling →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Artificial intelligence that generates new content, such as text, images, code, or structured outputs, from learned patterns.
- How it is used
- Supports text processing, tabular-data analysis, feature engineering, coding, visualization, reporting, and machine-learning pipeline work.
- How deep it goes
- Explains practical capabilities and workflow applications, but stops short of detailing model architecture, training, or generation algorithms.
- Examples
- Uses textual table fields, CSV analysis, generated Python functions, visualizations, reports, pipeline code, documentation, and summarized logs.
- What you can do after
- Apply it via ChatGPT’s Advanced Data Analytics API or Gemini for Google Cloud to analyze data and support pipeline development.
Evolutionary Deep Learning: Genetic algorithms and neural networks
Generative modeling is the machine-learning task of modeling a data-generating process so that its outputs can be replicated or newly generated.
- How it is used
- Frames image replication as a generative-modeling problem and connects it to later generative deep-learning applications.
- How deep it goes
- Implements encoding, rendering, fitness evaluation, and genetic search, but stops short of developing GAN internals.
- Examples
- Uses EvoLisa, polygon brushes, target and random renderings, pixel-error fitness, and alternative rectangle or polyfill formats.
- What you can do after
- Build it from scratch as a DEAP genetic-algorithm pipeline that encodes, renders, evaluates, and evolves image-producing individuals.
Build a Text-to-Image Generator (from Scratch)
Generative AI is a class of machine-learning models that creates new content resembling patterns learned from data.
- How it is used
- Creates novel content for text, image, audio, video, editing, design, education, medicine, and entertainment.
- How deep it goes
- Explains the definition, major architectures, diffusion process, applications, and originality debate without detailing full model implementation.
- Examples
- Uses ChatGPT, DALL-E 2, Imagen, Stable Diffusion, photo editing, medical diagrams, and generated essays or code.
- What you can do after
- Evaluate generative applications, explain diffusion-based image creation, and recognize originality, copyright, and deepfake risks.
Read how Build a Text-to-Image Generator (from Scratch) explains generative modeling →
Machines that Think
A generative architecture is a neural-network design organized to learn data patterns and synthesize new examples that follow them.
- How it is used
- Frames neural-network architectures as tools for synthesizing new samples that reflect learned data patterns.
- How deep it goes
- Explains latent-space generation in VAEs and adversarial training in GANs without detailing implementation.
- Examples
- Uses image generation, audio, style transfer, creative applications, and a Picasso-forger analogy as examples.
- What you can do after
- Understand how VAEs and GANs generate samples through different architectural mechanisms.
Spring AI in Action
Generative AI is artificial intelligence that produces new content such as text, images, audio, or code from learned patterns.
- How it is used
- Powers Spring Boot applications that answer questions and generate content through natural-language interaction.
- How deep it goes
- Defines generated content, prompts, and nondeterminism, then demonstrates a simple REST application without detailing model internals.
- Examples
- Uses question answering, document summarization, sentiment analysis, content moderation, classification, image generation, and sky-color responses.
- What you can do after
- Build it from scratch as a Spring Boot question-and-answer service using Spring AI and a supported AI provider.
Just Use Postgres!
Generative AI comprises artificial-intelligence models that produce new content such as text, images, audio, or code from learned patterns.
- How it is used
- Builds recommendation services, chatbots, watchlist agents, and retrieval-augmented applications around generated content.
- How deep it goes
- Explains models, prompts, embeddings, tools, and application patterns without descending into model internals.
- Examples
- Uses movie recommendations, a Shrek filmography question, conversational chatbots, embeddings, and watchlist management.
- What you can do after
- Build it from scratch by combining LLMs, embeddings, Postgres, pgvector, similarity search, and RAG.
Also covered in
- Secure APIs
- AI-Powered Search
- AI Agents and Applications
- Data Storytelling with Altair and AI
- DuckDB in Action
- PostgreSQL Mistakes and How to Avoid Them
- Software Testing with Generative AI
- Data Pipelines with Apache Airflow, Second Edition
- Build Python Web Apps with Streamlit
- Grokking Relational Database Design
- Machine Learning Platform Engineering
- Grokking AI Algorithms, Second Edition
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- ChatGPTChatGPT is OpenAI’s conversational AI service, which lets users interact with generative AI models and related tools through natural-language prompts.
- artificial intelligenceArtificial intelligence is the field of computing concerned with creating systems that perform tasks associated with intelligence, such as learning, reasoning, perception, and decision-making.
- machine learningMachine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
Related concepts
- language modelincludes · A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- Gaussian mixture modelincludes · A Gaussian mixture model is a probabilistic model that represents a distribution as a weighted combination of Gaussian component distributions.
- socio-technical systempart of · A socio-technical system is an interdependent arrangement of people, technology, processes, and social or organizational structures that interact to achieve outcomes.
- artificial intelligencekind of · Artificial intelligence is the field of computing concerned with creating systems that perform tasks associated with intelligence, such as learning, reasoning, perception, and decision-making.
- variational autoencoderincludes · A variational autoencoder is a generative neural network that learns a probabilistic latent representation of data and decodes samples from it to reconstruct or generate data.
- generative adversarial networkincludes · A generative adversarial network is a generative model in which a generator and a discriminator are trained adversarially, with the generator learning to produce samples resembling data from a target distribution.
Questions about generative modeling
What is generative modeling?
Generative modeling is a machine-learning approach that learns patterns or a data distribution to generate new samples resembling the data.
Which Manning books explain generative modeling?
Starting Data Analytics with Generative AI and Python, Introduction to Generative AI, Second Edition, Generative AI in Action, Coding with AI, Build Financial Software with Generative AI (From Scratch), Effective Conversational AI, First-Party Data Activation, Data Without Labels and 24 more.
What should I know before learning generative modeling?
Manning books that teach generative modeling usually introduce language model, ChatGPT, artificial intelligence and machine learning first.
What kinds of generative modeling are there?
Kinds of generative modeling include language model, Gaussian mixture model, variational autoencoder and generative adversarial network.
What is generative modeling a kind of?
Generative modeling is a kind of artificial intelligence. Artificial intelligence is the field of computing concerned with creating systems that perform tasks associated with intelligence, such as learning, reasoning, perception, and decision-making.
What is generative modeling part of?
Generative modeling is part of socio-technical system. A socio-technical system is an interdependent arrangement of people, technology, processes, and social or organizational structures that interact to achieve outcomes.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.































