What is Spatial Computing?
Reality Vision: XR and AI News (Vol.2)
Spatial Computing is increasingly on everyone's radar these days, yet it often brings about questions regarding its relationship with Extended Reality (XR), causing people to wonder if it's something entirely new thing or not. In this article, my goal is to dig deeper into what Spatial Computing really means and make it simple for anyone to grasp. We will discover why industry leaders like Apple, Meta, Microsoft, Sony, AWS and many others are focusing on this technology and its impacts in the near future. I think Spatial Computing goes beyond being the newest trend in AR/VR or Mixed Reality; it's also a new approach to how we use and interact with information and all machines around us. Yet, there's much more to talk about so let's dive in.
Before explaining the term in detail, I think it's a better idea to understand its origins and early mentions in the tech literature. Even though the term “Spatial Computing” gathered widespread attention during Apple's WWDC in June 2023, it has been used within the XR tech industry for quite some time. Long before Apple, companies like Magic Leap and Microsoft have been associating this term with their Mixed Reality headsets, embracing Spatial Computing as a core concept since nearly the inception of their products. Also companies like PTC specialized on XR and IoT and many others, have also shared so many videos showcasing compelling applications and examples, further evidencing the term's established presence in the industry.
Term of Spatial Computing
The term “Spatial Computing” was first introduced by Simon Greenwold's 2003 MIT thesis, where he envisioned machines interacting meaningfully with our physical spaces. This vision, once a forward-looking concept, has been steadily realized thanks to breakthroughs in AI, camera sensors, computer vision, IoT, and AR. These technological advancements have not just brought Spatial Computing to life but have set the stage for its integration into our daily lives and workflows.
This new concept is also deeply examined in the book "The Infinite Retina" which was published in 2020 by Irena Cronin and Robert Scoble. The authors depict Spatial Computing as a transformative shift, moving computing beyond the confines of traditional screens to an immersive integration with our daily environment. The book envisions a future where technology is an intrinsic part of every aspect of our lives, seamlessly blending with our reality through AR, VR, autonomous vehicles, delivery robots, and a multitude of other sophisticated technologies, heralding a new era in our interaction and engagement with the world around us.
Furthermore, tech giants such as Meta, Microsoft, and Amazon are not just participants but are shaping this evolving domain of Spatial Computing. Microsoft defines Spatial Computing as devices understanding and digitally representing their surroundings, heralding novel capabilities in human-robot interaction. Amazon Web Services (AWS) envisions Spatial Computing as a blend of the virtual and physical worlds, enhancing how we visualize, simulate, and interact with data, as emphasized by their VP of Technology, Bill Vass, who notes, "Spatial Computing is what powers collaborative experiences." Also, Meta's CTO, Andrew Bosworth, introduced the Meta Quest 3 as the "best value spatial computing headset on the market for a long time to come," signaling the industry's ambitious vision.
Tim Cook, CEO of Apple, declared that the era of spatial computing had arrived. He also added that “Apple Vision Pro is the most advanced consumer electronics device ever created. Its revolutionary and magical user interface will redefine how we connect, create, and explore.”
Finally in the CES 2024, Sony has just announced its new Extended Reality (XR) devices as a tool that is designed for “Spatial Content Creation Experiences”.
So what is Spatial Computing?
Until that part, we've encountered various explanations of "Spatial Computing", often converging in their fundamental concepts. With keeping all these in mind, I am proposing my own definition, reflecting the collective essence of all previous definitions and perspectives by adding the latest insights and developments of 2024. So here is my own summary and definition that what I understand from the term until now:
"Spatial Computing is a new form of computing that transforms how humans interact with digital data and machines, with a seamless and immersive way in our real physical world. It moves us away from the limitations of 2D screens and interfaces, enabling us a more immersive and 3D experience interaction with the digital content, while providing a closer connection between humans, machines and data in the physical environments around us that we live and work in."
Spatial Computing encompasses much more than just AR/VR or Mixed Reality but represents a broader paradigm involving AI, Computer Vision, the Internet of Things (IoT) and Extended Reality to seamlessly integrate the digital and physical worlds. This approach revolutionizes how we interact with data and our environment, facilitating seamless human-to-human and human-computer interactions in real physical spaces.
In Spatial Computing, digital and physical realms converge, allowing digital objects to exist and be interacted with in our physical spaces. It enables machines not only to display digital information in the context of the real world but also to understand and respond to the physical environment. This integration empowers users to interact with digital content as naturally as they would with tangible objects.
In today's digital age, data is abundant and ever-present, virtually floating around us. Yet, our existing technology limits us to capturing and interacting with this data through constrained 2D screens like computer monitors or smartphone displays. The approach of Spatial Computing promises to revolutionize this dynamic, making all this data accessible in a 3D, immersive, and volumetric manner, allowing it to envelop and interact with us in our own physical space.
Spatial Computing goes beyond watching movies in immersive mode with your Apple Vision Pro or Quest 3. Picture characters stepping out of the screen and scenes wrapping around your space, inviting you to interact with the storyline as though you're an integral part of it. This technology animates narratives right in your living room, transforming you from a mere spectator to an active participant in the evolving story.
New way of interaction with machines
Spatial Computing also revolutionizes how we control machines, robots, sensors and other the Internet of Things (IoT) devices, moving beyond traditional input methods to a more intuitive, human-centric form of communication. Users can control devices through gesture recognition, where subtle hand movements are interpreted by sensors and translated into commands, allowing for a fluid, natural interaction. Voice commands further simplify the interaction, enabling users to instruct machines using natural language, making the technology more accessible and reducing the learning curve. Spatial Computing also leverages eye-tracking technology, allowing devices to respond to the user's gaze direction, making interactions more intuitive and reducing the need for physical controllers.
Moreover, Spatial Computing devices are equipped with advanced contextual awareness, enabling them to navigate and operate autonomously within a space, understanding their surroundings, and adapting their operations accordingly. This leads to smarter, more autonomous machines and robots that can perform complex tasks with minimal human intervention, enhancing efficiency and opening new possibilities in various sectors.
Spatial Computing will not just change how we see and interact with digital content; it will transform our entire approach to control and collaborate with machines, make the interaction more natural, efficient, and aligned with our physical world. The potential applications are vast, ranging from gaming and entertainment to education, healthcare, and beyond.
Next Big Thing or another buzz word
I believe that we are just in the beginning of a significant paradigm shift, as Spatial Computing is reshaping our interactions with data and machines and fundamentally altering our connection with the world. This transformation goes beyond mere industry hype; it's a tangible and impactful change.
Just as the web itself has evolved, so too are the interfaces between humans and computers undergoing a significant transformation. Moving away from traditional interaction tools like keyboards and mice and the confines of 2D monitors, we're embracing more intuitive and immersive methods. Eye tracking, haptic feedback, and gesture recognition are becoming the new norm, fundamentally changing the dynamics of how we engage with digital content. This shift heralds the transition from a flat, passive user experience to a three-dimensional, interactive web, where our physical movements and sensory inputs blend seamlessly with the digital world. I am taking this one step further by suggesting that;
"Spatial Computing could be the forerunner of an even more integrated technology era, serving as the gateway to the breakthrough domain of Brain-Computer Interfaces (BCI) such as Neuralink system."
In this imminent future, our thoughts and intentions could directly shape and interact with our digital environment, thanks to interfaces that connect our neural pathways with computational systems, paving the way for a profound synergy between human intellect and technological capabilities.
As you see, we've only scratched the surface of Spatial Computing. Topics like its current opportunities and challenges on both business & tech side, the ongoing race among leading firms, and the details of UX/UI design all need a deeper look. In future articles, we'll explore these important aspects one by one, highlighting the many sides of Spatial Computing and its impact on our tech-driven world. So keep following my article series!
Don't forget to subscribe to my Newsletter and follow me on LinkedIn to stay updated on the latest news & insights in Spatial Computing, Extended Reality (XR), Augmented Reality (AR) and Artificial Intelligence (AI). All images that haven't been sourced were created with Midjourney.