Spatial computing

Spatial computing refers to 3D human–computer interaction techniques that are perceived by users as taking place in the real world, in and around their bodies and physical environments, instead of constrained to and perceptually behind computer screens or in purely virtual worlds. This concept inverts the long-standing practice of teaching people to interact with computers in digital environments, and instead teaches computers to better understand and interact with people more naturally in the human world. This concept overlaps with and encompasses others including extended reality, augmented reality, mixed reality, natural user interface, contextual computing, affective computing, and ubiquitous computing. The usage for labeling and discussing these adjacent technologies is imprecise.

Spatial computing devices include sensors—such as RGB cameras, depth cameras, 3D trackers, inertial measurement units, or other tools—to sense and track nearby human bodies (including hands, arms, eyes, legs, mouths) during ordinary interactions with people and computers in a 3D space. They further use computer vision to attempt to understand real world scenes, such as rooms, streets or stores, to read labels, to recognize objects, create 3D maps, and more. Quite often they also use extended reality and mixed reality to superimpose virtual 3D graphics and virtual 3D audio onto the human visual and auditory system as a way of providing information more naturally and contextually than traditional 2D screens.

Spatial computing often refers to personal computing devices like headsets and headphones, but other human-computer interactions that leverage real-time spatial positioning for displays, like projection mapping or cave automatic virtual environment displays, can also be considered spatial computing if they leverage human-computer input for the participants.

Reeve, D. E. (April 1985). "Computing in the geography degree: limitations and objectives". Journal of Geography in Higher Education. 9 (1): 37–44. doi:10.1080/03098268508708923. ISSN 0309-8265.

↑ "Towards intelligent spatial computing for the Earth sciences in South Africa". 1993.

↑ Greenwold, Simon (June 2003). "Spatial Computing" (PDF). MIT Graduate Thesis. Retrieved 22 December 2019.

↑ Microsoft HoloLens (2019-06-17). Airbus drives innovation and accelerates production with Azure mixed reality and HoloLens 2. Retrieved 2025-05-28 – via YouTube.

↑ "Magic Leap: Founder of Secretive Start-Up Unveils Mixed-Reality Goggles". Rolling Stone. Archived from the original on 2017-12-20. Retrieved 2025-06-18.

↑ "The Meta Quest 3: Spatial Computing and Mixed Reality Are Things Now". Display Daily. 2023-09-28. Retrieved 2025-05-28.