Spatial computing isn’t a better screen. It’s the end of the screen — and the beginning of something we don’t have good language for yet.
By Futurist Thomas Frey
Every generation of computing has been defined by where the computer lived.
The mainframe lived in a room. The desktop lived on a desk. The laptop lived in a bag. The smartphone lived in a pocket. Each transition compressed the computer further into the fabric of daily life — made it more personal, more portable, more present. Each one seemed, at the time, like the logical endpoint. Each one turned out to be a waypoint.
The next transition is the most fundamental of all, and it’s happening now in early, awkward, expensive form. The computer is leaving the device entirely — dissolving out of the screen, out of the rectangle, and into the physical space around you. Computing is becoming spatial. And when that transition completes, the way we work, create, communicate, heal, build, and inhabit the world will look as different from today as today looks from the era of the mainframe.
What Spatial Computing Actually Is
The term gets used loosely, so let’s be precise. Spatial computing is the integration of digital information and digital interaction into three-dimensional physical space — not displayed on a surface you look at, but overlaid on, embedded in, or mixed with the environment you inhabit. Your hands become the input device. Your field of view becomes the display. The room becomes the computer.
This is distinct from virtual reality, which replaces the physical world with a digital one. Spatial computing works with physical space rather than substituting for it. A digital object appears on your physical desk. A data visualization floats at eye level in your actual office. A surgical overlay maps onto a real patient in a real operating room. The physical and the digital occupy the same space simultaneously, each enriching the other rather than one displacing the other.
Spatial computing blends digital content with the physical world, providing an infinite canvas that enables businesses to reinvent workspaces and enhance everyday productivity — with apps freed from the boundaries of a display, so they can appear side by side at any scale.
That last phrase — freed from the boundaries of a display — is the key. Every limitation of every screen-based computing paradigm has been, fundamentally, the limitation of the frame. The frame constrains size, constrains dimensionality, constrains the relationship between the information and the physical context it’s meant to inform. Spatial computing removes the frame. The information lives in the world.
Where It Actually Stands Right Now
Apple’s Vision Pro, now running on the M5 chip with visionOS 26, is the current high-water mark for spatial computing at consumer scale — and it is instructive both for what it demonstrates and for what it reveals about how far the technology still has to travel.
The Vision Pro set a new benchmark for mixed reality, with ultra-high-resolution displays, spatial audio, and seamless integration into Apple’s ecosystem — and the 2025 M5 update refines the experience in meaningful ways, especially for the professionals and developers who rely on it most. The comfort improvements matter more than they might seem. A technology that people can wear for eight hours rather than ninety minutes is a categorically different tool for professional use.
The enterprise adoption is where the most interesting things are happening. A New York ophthalmologist became the first surgeon to perform cataract surgery using the Vision Pro, with a platform called ScopeXR that streams live feeds from 3D digital surgical microscopes directly into the headset, overlaying preoperative diagnostic data on the operative field. That surgeon’s observation about the implications deserves to be taken seriously: the ability to bring the world’s best specialist into any operating room, at any hour, from anywhere on the planet, is not a marginal improvement in surgical capability. It’s a structural change in the geography of expertise.
NVIDIA’s Omniverse platform is streaming massive 3D engineering and simulation datasets to Vision Pro, enabling enterprises to build digital twins of products, facilities, and processes to test and optimize designs before constructing them in the physical world. JigSpace is using on-device AI to make complex technical information — wind turbines, manufacturing assemblies, industrial systems — inspectable and understandable in three dimensions rather than in flat documents and slide decks. Zillow is letting people walk through homes before they exist or before they visit.
visionOS 26 introduces widgets that become spatial and seamlessly integrate into a user’s space, spatial scenes that use generative AI to add stunning lifelike depth to photos, and new shared spatial experiences for Vision Pro users in the same room. Each of these is a small step. Collectively they represent a platform being built out into daily life — the same pattern that made the smartphone first essential and then invisible.
The Honest Constraints
Apple’s senior vice president of worldwide marketing says the only thing he’s unsure about is when spatial computing will take off — not whether. That distinction is important, and the honest assessment of where the technology sits right now requires holding both truths simultaneously.
Apple shipped just 390,000 Vision Pro units in 2024, and around 3,000 apps are designed specifically for Vision Pro — a figure that lags far behind the rapid growth of the iPhone App Store after its launch in 2008. Meta still dominates the broader sector at around 80% of sales with its Quest headsets.
The weight, the price — currently around $3,500 — and the social awkwardness of wearing a computing device on your face in shared environments are real constraints that no software update resolves. The technology is demonstrably capable. The form factor is not yet socially normalized. These are two different problems with two different solutions on two different timelines.
Reports suggest Apple’s focus may be pivoting toward lightweight smart glasses, where Meta has already seen success — a strategic acknowledgment that the path to mass adoption runs through wearability that’s closer to sunglasses than to a device strapped to your face. That pivot, if it happens, doesn’t represent a retreat from spatial computing. It represents the technology finding its consumer form.
The Industries Being Rebuilt
The enterprise applications are already outrunning the consumer narrative, and they tell a clearer story about where the fundamental value is.
Healthcare is the most immediately transformative domain. The surgical overlay application is only the most dramatic example. Medical training, patient education, remote consultation, rehabilitation therapy, anatomical visualization for diagnosis — every application that currently relies on two-dimensional representations of three-dimensional biological systems improves when the representation becomes three-dimensional and spatially accurate. A medical student learning cardiac anatomy by examining a floating, rotatable, accurate-scale model of a specific patient’s heart is learning in a way that no textbook or even cadaver can fully replicate.
Manufacturing and industrial design are equally transformed. The ability to walk through a full-scale digital prototype of a product or facility before a single physical component is manufactured eliminates entire categories of expensive mistakes. Boeing, Airbus, and automotive manufacturers have been using early versions of spatial visualization tools for years. The current generation makes those tools accessible to design teams, maintenance technicians, and training programs rather than restricting them to specialized visualization labs.
Architecture and real estate are obvious beneficiaries. The Zillow application is the consumer version of a transformation happening across the entire built environment industry — the shift from two-dimensional representations of three-dimensional spaces to three-dimensional representations experienced at actual scale. A client who has walked through a building that doesn’t exist yet makes better decisions and has more realistic expectations than one who has approved a floor plan and a rendering.
Education is perhaps the deepest long-term opportunity. Every concept that is currently taught through abstraction — molecular biology, astrophysics, history, engineering mechanics, musical structure — can be taught through experience when the teaching environment is spatial. The difference between telling a student that a cell membrane is selectively permeable and letting them interact with a spatially accurate model of one at the scale of a room is the difference between a description and an understanding.
The Competitive Landscape
Apple and Meta are the current leading platforms, but the competitive dynamics are more complex than a two-company race.
Meta’s strategy has been volume and accessibility — Quest headsets at consumer price points, building the installed base that attracts developers, who build the applications that attract more users. The mixed reality space is heating up, with competitors like Meta, Samsung, and others ramping up their efforts. Samsung’s entry into smart glasses signals that the major consumer electronics manufacturers understand that spatial computing is not a niche category but a platform transition — the kind that reshapes the entire device landscape rather than adding a new device type to an existing one.
Microsoft’s HoloLens, which pioneered many of the enterprise spatial computing use cases now being adopted on Vision Pro, has receded from its early prominence — a cautionary tale about the difficulty of defining a market before the hardware is comfortable and affordable enough for broad adoption. The underlying technology and the enterprise relationships Microsoft built remain valuable, but the first-mover advantage in hardware platform transitions is less durable than it is in software.
The Chinese manufacturers — Xreal, ByteDance’s Pico, and several others — are building competent spatial computing hardware at significantly lower price points than Apple, targeting the consumer segments and the emerging-market enterprise customers that premium Western hardware can’t reach. The spatial computing platform war will be fought across multiple price tiers simultaneously, and the winner at the premium tier is not guaranteed to be the winner at scale.
What Changes When This Matures
The full implications of spatial computing at maturity are difficult to overstate and easy to understate simultaneously.
Consider what happens to the office when the desk can be anywhere. The monitor, the keyboard, the physical separation between information and physical environment — all of these disappear when computing is spatial. The office becomes a coordination space for humans rather than an infrastructure space for computers. The work can happen anywhere the worker is, with the full computing environment available in physical space around them. Remote work stops being a degraded version of office work and becomes simply work — as rich, as collaborative, as spatially aware as any physical office, without the commute.
Consider what happens to retail when every product can be experienced before purchase in accurate three-dimensional scale in the customer’s actual space. The furniture you want, placed in your actual living room, at actual scale, in the actual light of the actual time of day — before you buy it, before it ships, before a truck arrives. The reduction in returns alone would transform the economics of e-commerce.
Consider what happens to training across every industry when the training environment is fully spatial. The aviation simulator, the surgical trainer, the nuclear power plant emergency response drill — all of these currently require expensive dedicated physical infrastructure. Spatial computing makes them available wherever the trainee is, at whatever frequency the training schedule requires, at a fraction of the current cost.
The Longer View
Every platform transition in computing history has been preceded by a period of expensive, awkward, early hardware that served a small professional and enthusiast market while the technology matured toward the form that would achieve mass adoption. The mainframe gave way to the minicomputer, which gave way to the personal computer, which gave way to the laptop, which gave way to the smartphone. At each transition, the device that would eventually dominate looked nothing like the devices that preceded it.
The Apple Vision Pro is the expensive, awkward early hardware. It is demonstrating the capability while the industry works toward the form that mass adoption requires — lighter, cheaper, socially acceptable, integrated into daily life as seamlessly as the smartphone has been integrated. That form is probably a pair of glasses indistinguishable from ordinary eyewear that delivers spatial computing overlaid on the normal visual field. It is probably five to ten years away as a mass-market product.
What happens between now and then is the platform being built — the developer ecosystem, the enterprise applications, the standards and protocols, the user interaction patterns that will define spatial computing the way the swipe and the tap defined mobile computing. The companies and individuals investing in that platform-building now are positioning themselves for a transition that will look, in retrospect, as obvious and as total as every previous computing platform transition looks in retrospect.
The computer is leaving the screen. The question isn’t whether. It’s how fast.
Related Reading
Apple Vision Pro and the Enterprise: What Spatial Computing Actually Delivers
Apple Newsroom — The most comprehensive documentation of current real-world enterprise spatial computing deployments — the actual applications, the actual workflows, and the actual companies building on the platform today
The Spatial Computing Market: Forecast and Competitive Landscape
IDC — Rigorous market analysis of where spatial computing hardware and software stand today, what the adoption trajectory looks like across consumer and enterprise segments, and how the competitive dynamics between Apple, Meta, and emerging players are likely to resolve
When Computing Leaves the Screen: The Full Implications of Spatial Interfaces
Harvard Business Review — A strategic analysis of the second and third-order business implications of spatial computing at maturity — how it transforms office design, retail, training, healthcare, and the economics of every industry that currently depends on two-dimensional representations of three-dimensional reality