What Is Spatial Computing?

Key takeaways

Spatial computing combines several technologies, including machine learning and the Internet of Things (IoT), to merge the physical and digital world.

• Some job roles that involve spatial computing include a spatial computing prototyper, earning a median annual salary of $97,000 [1].

• Examples of spatial computing include virtual reality (VR), augmented reality (AR), and mixed reality (MR).

• You can prepare for a career in spatial computing by taking courses and boot camps or earning a certification or degree.

Explore spatial computing and how you can start on this career path. Afterward, if you’re ready to take the first step toward a career in spatial computing, consider the Extended Reality for Everybody Specialization from the University of Michigan. In just two months, you can learn the underlying concepts, enabling technologies, and key applications for extended reality. Upon completion, you’ll earn a shareable certificate to display on your resume or LinkedIn profile.

What is spatial computing technology?

Spatial computing combines several different technologies, such as machine learning (ML), haptic feedback, and the Internet of Things (IoT), to read the physical world and integrate digital information into it, ultimately combining the two. These experiences can be completely immersive or can add digital elements to the real world.

There are many devices, such as Apple Vision Pro, that employ spatial computing, but far beyond personal uses, the field is poised to affect several industries because of its high-impact technologies. For instance, spatial computing can be used to model an immersive end result before time and materials are spent producing it.

Spatial computing also collects data, which machines can use to optimize and automate human processes. For example, imagine a “smart building” with cameras and sensors that track how people move, from a conference room to offices to lobbies to the cafeteria, and so forth. The system then analyzes the data and signals the building’s controls to adjust lighting and temperature in unoccupied spaces to save energy.

Spatial computing examples

Spatial computing is an umbrella term that encompasses technological experiences like virtual reality (VR) and augmented reality (AR), as well as related concepts such as mixed reality and extended reality.

• Virtual reality (VR): A fully immersive visual environment that blocks the view of a real environment and replaces it with a virtual one

• Augmented reality (VR): When digital content is transposed onto the real world while still allowing visibility of the real-world environment

• Mixed reality (MR): When digital content is transposed onto a view of the real world, while allowing the elements to interact with one another

• Extended reality (XR): An umbrella term that includes VR, AR, and MR

How does spatial computing work?

The technology behind spatial computing that enables it to blend the digital and physical world is fascinating. Explore some of the specific technologies behind it: 

• Computer vision: When software can understand the content of an image (what it would mean to a human) instead of just reading an image’s pixels

• Sensor fusion: When a machine combines sensory data from multiple sensors, like cameras or GPS

• Spatial mapping: When a machine creates a 3D map of an area using data captured by cameras or sensors

• Haptic feedback systems: When a device communicates with humans with a tactile experience, such as a phone vibrating when a call comes through

• Machine learning (ML): When a system gathers and analyzes spatial data to find patterns and automate processes

• Edge computing: When data is processed physically close to where it’s being used—the “edge” of a network—rather than sending data to a central data processing center 

• Robotics: When robots use spatial data to move around and perform tasks, and even enhance remote work with “surrogate” robots

• Internet of Things (IoT): When a network of physical devices uses spatial data to understand a physical environment and enhance humans’ experiences

Read more: What Is a Digital Twin? Definition, Types, and Uses

VR headsets

A common way to experience what spatial computing offers is to use a VR headset. A headset is a piece of hardware that slips over your eyes and is held in place by a band or straps around the back of your head. It then projects a virtual view. Your view changes as motion sensors detect where you’re looking when you move your head or change directions. Headsets may feature eye tracking, hand-gesture recognition, and voice recognition capabilities to make your experience as natural and intuitive as possible. 

Some of the headsets offered by major brands include:

• Apple Vision Pro: A spatial operating system device that you can navigate using your hands, eyes, and voice to enjoy entertainment, apps, games, photos, videos, video conversations, and more

• Microsoft HoloLens: A holographic device for use in the workplace that helps enterprise-level organizations collaborate, featuring hand-tracking, voice commands, eye-tracking, and spatial mapping

• Meta Quest 3: An MR headset connecting teams, individuals, creators, and loved ones, and enabling an immersive experience in gaming, entertainment, the workplace, and more

• Magic Leap: An AR device for the workplace that enables a remote AR collaboration experience, including remote assistance and a lifesize overlay, for enterprise-level organizations 

What are examples of spatial computing technology?

As human-computer interaction becomes more widespread, it can enhance our lives in a variety of ways, making our hobbies, passions, educational experiences, and jobs more immersive. Explore the range of possibilities:

Navigation

Take the fastest, most direct route to your destination using location-based service apps like Waze or Google Maps. These apps determine your location and provide relevant information, such as nearby gas stations, restaurants, and traffic congestion. 

Stargazing

Download a stargazing app like SkySafari or Night Sky and point your phone at a segment of the sky to learn more about stars and constellations. 

Virtual home design

Use a 3D home designer app like Homestyler to envision the look and layout of your interior space before you make changes. 

Gaming

Immerse yourself in 3D environments and experience gaming worlds as though you are actually in them. Manipulate virtual objects and move about in these worlds with the use of voice commands, motion sensors, and haptic feedback. 

Health and fitness

Enhance physical performance by tracking your movements and analyzing them for ways you can improve your athletic activity. 

Virtual shopping 

“Try on” clothing virtually or see how products might look in your environment before you buy them. 

Spectator sports

Watch your favorite sports team virtually from a specific vantage point, such as the 50-yard line of a football game or courtside at a basketball game.

Education

Explore concepts, subjects, and skills in immersive environments with 3D models, simulations, and virtual “group” activities. 

Industrial factory settings 

Digitize physical space to analyze workers’ movement patterns, interactions with machines, and how long they spend on individual tasks. Then use this information to optimize their processes. 

Health care 

Improve the safety and accuracy of surgical procedures, train medical students, consult with patients, and conduct clinical trials.

Architecture and design

Create immersive design models that allow clients and stakeholders to understand a proposed design better before making decisions. 

Data science

Collect data that has a geographical or spatial component and use approaches from data science, computer science, statistics, machine learning, automation, and artificial intelligence to solve complex spatial problems. 

How to get into spatial computing

With all the possibilities that spatial computing enables, becoming more involved in this field—for fun or to launch a career—can offer many rewards, from finding job opportunities to exploring your passions in ways you’ve only imagined. Explore these actionable steps you can take to get started in spatial computing: 

1. Experience spatial computing as a user.

Have fun with this first step as you gain insights into what this technology is capable of. While some of the headsets, glasses, and wearable sensors might be expensive to purchase, you may be able to find ways to access these devices for free or at a low cost:

• AR and VR experiences at art galleries or tech events 

• AR and VR product demos in stores 

• Apps on your smartphone, like Google AR and VR

• MR community networking events 

2. Take spatial computing courses and boot camps.

To deepen your spatial computing knowledge for both personal and professional purposes, watch online training, such as Apple’s video series on spatial computing or XR Bootcamp’s beginner, intermediate, and advanced classes in AR, VR, and MR. 

Also consider courses in skills related to spatial computing, such as:

• Programming languages: Python, C++, and Java

• 3D creation tools: Unreal Engine, Unity, ARCore, ARKit, and WebXR

• Design tools: 3D modeling/design, animation, sound design, wireframing 

• Data analysis and machine learning: TensorFlow, scikit-learn, PyTorch

Additional ways to prepare for spatial computing jobs

To thrive in spatial computing, you’ll also need workplace skills like communication, collaboration, and creativity, as well as technical skills from other fields like project management.

3. Research spatial computing jobs.

Start exploring career possibilities by seeing what roles companies are hiring for. Given that spatial technology is an emerging field, job titles may vary from one company or industry to the next, so read job listings carefully for mentions of “spatial technology, ” even if the titles themselves don’t mention it. You can consider jobs like spatial computing prototyper, spatial information technology specialist, and spatial solutions architect.

Spatial computing prototyper

Median annual US salary (Glassdoor): $97,000 [1]

Job outlook (projected growth from 2024 to 2034): 7 percent [2]

As a spatial computing prototyper, you will collaborate with artists and engineers to create new user experiences, drawing upon skills in Python, C++, VR/AR, game design, 3D design, and a relevant degree. In this role, you will experiment with spatial computing to design experiences for users to interact with. 

Spatial information technology specialist

Median annual US salary (Glassdoor): $100,000 [3]

Job outlook (projected growth from 2024 to 2034): 8 percent [2]

As a spatial information technology specialist, you will develop spatial computing applications, drawing upon skills in C++ and other programming languages. You can also specialize in geospatial technology or research. 

Spatial solutions architect

Median annual US salary (Glassdoor): $215,000 [4]

Job outlook (projected growth from 2024 to 2034): 12 percent [5]

As a spatial solutions architect, you will advise on AR/VR strategy, build architectures and prototypes, and deliver workshops, drawing upon skills in 3D development, immersive applications, and large-scale computing. In this role, you will organize and coordinate the work of varied departments to create spatial or geospatial software.

All salary information represents the median total pay from Glassdoor as of March 2026. These figures include base salary and additional pay, which may represent profit sharing, commissions, bonuses, or other compensation. 

4. Earn credentials. 

To land a job in spatial computing, you may need specific credentials or education that demonstrate your expertise in this field. Universities are beginning to offer degrees in spatial computing, spatial data science, and spatial information science, as well as spatial computing coursework as part of degree programs in broader subject areas. Depending on your goals, you can also consider getting a degree in one of these areas:

• Human-computer interaction

• Product design

• Visual design

• Game design

• Film

• Computer science

If you already have a degree and want to add a credential in spatial computing (or a related area) to your resume, consider a Professional Certificate or certification, like the Certified Augment Reality Developer (AR) Certification.

What’s the future of spatial computing?

This field is growing! According to Grand View Research, the US spatial computing market reached $35.9 billion in 2023 and is expected to grow at a compounded annual growth rate of 17.7 percent through 2030, reaching $116.6 billion [6]. As the technology expands, be on the lookout for how AR, VR, and MR become more mainstream and accessible to everyone, from developers, engineers, and early adopters to hobbyists and creators.

Explore our free career-building resources

Establish a new professional network by subscribing to our Career Chat newsletter on LinkedIn. Then check out these additional free resources to help you learn more about spatial computing:

• Watch on YouTube: How to Use Azure AI Vision & Speech Together

• Discover certificate options: 6 Machine Learning Certificates + How to Choose the Right One for You

• Explore career options: Machine Learning Career Paths: Explore Roles & Specializations

Accelerate your career growth with a Coursera Plus subscription. Whether you enroll in the monthly or annual option, you’ll get access to over 10,000 courses.

Build job-ready skills with Coursera Plus

Start 7-day free trial

• 
• 
• 
• 

Start 7-day free trial