Computer vision
Computer vision is the field of computing concerned with extracting and interpreting information from images, video, and other visual data.
Web Components in Action
Computer vision is the computational analysis of images or video to infer information about the physical world.
- How it is used
- Enables augmented-reality libraries to locate real-world surfaces where virtual objects can be placed.
- How deep it goes
- Explains feature points and detected surfaces conceptually, without detailing computer-vision algorithms or implementation.
- Examples
- Uses floors, tables, and walls as detected surfaces and an ARCore demonstration of virtual-object placement.
- What you can do after
- Evaluate/understand how ARKit and ARCore use camera-derived features to support virtual-object placement.
Read how Web Components in Action explains computer vision →
AI for Everyday IT
Computer vision is the use of computational methods to interpret and analyze visual information in images or video.
- How it is used
- Uses visual analysis to support workplace troubleshooting, design, and presentation practice.
- How deep it goes
- Explains practical uses and task breakdowns through examples, without describing vision model internals.
- Examples
- Illustrates transcription of a Latin tablet, analysis of presentation recordings, and matching an image’s artistic style.
- What you can do after
- Apply it via ChatGPT or GPT-4o to analyze images or recordings and request task-specific feedback.
Inside AI
Computer vision is the field concerned with enabling computers to interpret and analyze visual images or video.
- How it is used
- Frames computer vision as both a comparison with human perception and a potential aid to medical diagnosis.
- How deep it goes
- Explains perception and recognition through comparisons and reported limitations, without implementation details.
- Examples
- Uses cat recognition, COVID-19 chest-image diagnosis, and a one-pixel modification experiment.
- What you can do after
- Evaluate computer vision claims by distinguishing pattern recognition from understanding and considering bias, methodological flaws, and fragility.
How Large Language Models Work
Computer vision is the field concerned with enabling computational systems to analyze and interpret visual data.
- How it is used
- Explains how transformer-based systems interpret images, detect objects, identify objects, and generate images.
- How deep it goes
- Traces image-to-vector patch extraction and reverse reconstruction, but stops short of detailed training procedures or mathematical derivations.
- Examples
- Uses image patches, RGB vectors, a 16 × 16 patch containing 768 values, and patch extraction and combination diagrams.
- What you can do after
- Evaluate/understand how images become transformer inputs and how transformer outputs become images.
Read how How Large Language Models Work explains computer vision →
Digital Twins in Action
Computer vision is the computational analysis of images or video to derive information about objects, activities, and environments.
- How it is used
- Extracts machine-readable observations from photographs, video, and engineering diagrams for digital twins.
- How deep it goes
- Works through meter-image preprocessing and webcam object detection, while treating diagram extraction as a candidate for expert validation.
- Examples
- Uses an analog water meter, room occupancy video, and a piping and instrumentation diagram as extraction examples.
- What you can do after
- Apply it via Tesseract OCR and YOLOv8 to extract meter readings and detect objects in webcam frames.
Fight Fraud with Machine Learning
Computer vision is the field of computing concerned with programmatically interpreting images and videos.
- How it is used
- Applies image and video interpretation to identity fraud, online KYC, face verification, and document forgery detection.
- How deep it goes
- Connects fraud tasks to segmentation and CNNs, while deferring the detailed construction of a complete KYC system.
- Examples
- Uses live-selfie checks, identity-card photographs, face matching, information extraction, and forged-receipt segmentation.
- What you can do after
- Builds or evaluates image-based fraud checks for selfies, identity documents, faces, and receipts.
Read how Fight Fraud with Machine Learning explains computer vision →
Build AI-Enhanced Web Apps
Computer vision is the field concerned with enabling computers to interpret and reason about visual data.
- How it is used
- Enables applications to interpret images for object recognition, visual question answering, captioning, and image-based responses.
- How deep it goes
- Details image submission, processing, comprehension, and response generation while deferring implementation details.
- Examples
- Uses broken-appliance diagnosis, image captioning, visual question answering, and cat-image classification.
- What you can do after
- Apply it via an LLM API that accepts image data and prompts for vision-based responses.
Read how Build AI-Enhanced Web Apps explains computer vision →
Investing for Programmers
Computer vision is the field of enabling computers to interpret and analyze visual information such as images and video.
- How it is used
- Uses visual data as an alternative information source for analyzing companies, deployments, and market-relevant activity.
- How deep it goes
- Describes object counting and model training, but stops short of implementation details, evaluation metrics, or algorithm design.
- Examples
- Counts car brands in street imagery and evaluates Tesla Vision as a potential LiDAR replacement.
- What you can do after
- Apply it via computer vision algorithms to extract vehicle counts and assess visual-data opportunities.
Read how Investing for Programmers explains computer vision →
Deep Learning with R, Third Edition
Computer vision is the field concerned with enabling computers to interpret and analyze visual data such as images and video.
- How it is used
- Frames visual understanding through deep-learning applications such as classification, segmentation, detection, OCR, and autonomous systems.
- How deep it goes
- Defines three foundational tasks and mentions specialized ones, while deferring detailed convolutional-network architectures and training methods.
- Examples
- Uses photo search, video-call backgrounds, autonomous driving, OCR, robotics, medical diagnosis, and dogs-versus-cats classification.
- What you can do after
- Apply convolutional neural networks and pretrained models to image-classification problems and related visual tasks.
Read how Deep Learning with R, Third Edition explains computer vision →
Build Your Own Robot: Using Python, CRICKIT, and Raspberry Pi
Software that enables computers to interpret and analyze visual information.
- How it is used
- Enables robots to inspect camera feeds, recognize targets, and guide movement toward desired objects or locations.
- How deep it goes
- Explains camera input, QR detection, decoding, video sharing, and robot search without detailing underlying vision algorithms.
- Examples
- Uses face detection, QR-tagged objects, Raspberry Pi camera feeds, and a searching robot as concrete examples.
- What you can do after
- Build a robot capability that detects and decodes QR codes, streams camera video, and searches for matching targets.
Read how Build Your Own Robot: Using Python, CRICKIT, and Raspberry Pi explains computer vision →
Also covered in
- Spring AI in Action
- Grokking Machine Learning
- Microsoft Azure in Action
- Transfer Learning for Natural Language Processing
- Hugging Face in Action
- Google Anthos in Action
- Deep Learning with Python, Third Edition
- Grokking AI Algorithms, Second Edition
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- machine learningMachine learning is a field of computational methods in which systems learn patterns or relationships from data to make predictions, decisions, or other outputs.
- pixelA pixel is either a discrete image sample carrying visual information at a raster location or, in CSS, an abstract reference unit for rendered dimensions.
- promptA prompt is text or other input supplied to an AI model to provide instructions, context, or other information that guides its response or generated output.
Related concepts
- image segmentationhas part · Image segmentation is a computer-vision task that partitions an image and assigns labels to its pixels or regions to delineate objects or meaningful areas.
- object detectionincludes · Object detection is a computer-vision task that identifies object instances in visual data, assigns them categories, and estimates their locations.
- classifierhas part · A classifier is a predictive model that assigns an input to one or more discrete classes or categories.
- edge computinguses · Edge computing is a distributed computing approach that places computation and data processing near the users, devices, or sources and destinations of data.
- digital imageuses · A digital image is a digital representation of visual content, commonly encoded as an arrangement of pixels or other graphical elements.
Questions about computer vision
What is computer vision?
Computer vision is the field of computing concerned with extracting and interpreting information from images, video, and other visual data.
Which Manning books explain computer vision?
Web Components in Action, AI for Everyday IT, Inside AI, How Large Language Models Work, Digital Twins in Action, Fight Fraud with Machine Learning, Build AI-Enhanced Web Apps, Investing for Programmers and 2 more.
What should I know before learning computer vision?
Manning books that teach computer vision usually introduce language model, machine learning, pixel and prompt first.
What kinds of computer vision are there?
Kinds of computer vision include object detection.
What are the parts of computer vision?
Computer vision includes image segmentation and classifier.
What is computer vision also called?
Computer vision is also called machine vision.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.









