liveBook · Manning

Tracked surface

As explained in Web Components in Action

A tracked surface is a physical planar area inferred from camera observations and represented for placement of virtual content.

A tracked surface is a planar area inferred from camera observations. Computer vision identifies 3D features, links them, and represents the result as a floor, table, or wall. section 15.2

Tracked surfaces support placement by connecting observation to spatial content:

  • Finds notable real-world features as 3D points through the phone camera. section 15.2
  • Links those points into a recognizable planar surface such as a floor, table, or wall. section 15.2
  • Provides an area where a virtual 3D object or scene can be placed. section 15.2

Placing an object on a found surface

An ARCore experience observes a room through a phone camera, links detected 3D features into a floor, and places a virtual object on that floor. section 15.2

How Web Components in Action covers it

How deep it goes
Explains the inference chain from 3D camera features to linked planar surfaces, without detailing tracking algorithms.
Examples
Uses floors, tables, walls, and an ARCore scene placing a virtual object in the real world.
What it assumes
Assumes camera observations and computer vision, while introducing how detected 3D points become surfaces.
What you can do after
Apply it via ARKit or ARCore to place virtual objects or scenes on detected real-world surfaces.
How it connects
Connects computer vision, augmented reality, ARKit, ARCore, and virtual object placement.

This explainer was generated by Manning's knowledge graph from the text of Web Components in Action. The section links point to the parts of the book it draws on.