top of page

What is Extended Reality? 

By Yuval Kahlon, 4 min read 

15h of June, 2024 

Takeaway

  • Extended reality (XR) is an umbrella term that includes several technologies  

  • These technologies focus on creating new experiences using virtual content 

  • The prominent ones are Virtual Reality (VR) and Augmented Reality (AR) 

  • Each technology has its strengths and weaknesses, so it is important to gain general knowledge about these before choosing which technology to use for one’s purposes 

1.png

Using  extended reality for design and engineering by linking a CAD system with a VR headset (Credit: ThisIsEngineering)

Most chances are that you have heard one of the following terms recently – virtual reality, augmented reality, mixed reality, cross-reality...the list goes on. While it may be difficult to get a hold of the “reality” behind these terms, we can help make sense of the big picture using a few important distinctions. Since all the above are a part of the world of Extended Reality, the question we should really ask is, what is Extended Reality? 

 

XR: A Brave New World

Digital technologies have enabled us to produce virtual content (images, videos, models, sounds and even smells). Since we can use such content to create new experiences, the content can “extend” what we experience as real. Unsurprisingly, the technologies which do so are referred to as “Extended Reality” technologies, or simply XR. Imagine that you can put on a set of glasses which will show you the pipes going through the ceiling in your living room, by drawing virtual pipes that match the shape/position/color of the real ones. In this case, without the technology, you are unable to experience the existence of those pipes, so that the technology extends what you can experience. It’s that simple.

 

Many Realities? Yes, but not too Many 

Considering the plethora of terms in the field (some of which we mentioned above), you might still be confused, and rightfully so. For those new to XR, a good first step would be to have a strong grasp on the difference between two of its principal technologies – virtual reality (VR) and Augmented Reality (AR).

 

Earlier we said that XR consists of producing new experiences by using virtual content. The main difference between XR technologies lies in the way that the virtual information is integrated with the physical world around us. In the case of Augmented Reality (AR), virtual information is added to the physical world, typically by wearing a headset which projects a hologram. The hologram does not replace what we see, it augments it. In Virtual Reality (VR), however, virtual information replaces the view of the physical environment around us. This means that the only thing you see is the virtual world projected to your eyes by VR goggles. The reason it's important to distinguish AR from VR, is not only that they are the principal technologies of XR, but also that their applications can be very different. In other words, each is useful in specific scenarios, and less useful in others. Let’s look at a few examples.

 

To understand this better, consider a fashion designer designing a new dress. If the designer wants to see how the dress would look on her model before making it, XR can help. In this case, the model is “real” (physical) while the dress is not (virtual). AR technology can help merge them, by projecting the virtual dress on the physical body of the model. As another example, see the image below, in which a virtual balcony was added to an existing building, to help the architects make design decisions.

2.png

Designing on site-using AR (credit: Prof. Fujii Haruyuki, Iioka Yukiharu, Arch. Shan Lin Chin, Arch. Wu Haonan).

​​

By contrast, imagine an architect who is designing a hospital in another country, and cannot travel often to see the site for the project. In this case, we can project a virtual model of the area in VR, to provide the architect with a realistic experience of the site, to help them design. In the image below, a Japanese garden was recreated in VR, so that visitors can view it regardless of their physical location. Interestingly, VR technology has been recently integrated with eye tracking technology, which enables us to not only show a space to a person, but to collect data from that person regarding their attention, while viewing the space. ​

3.png

Enabling a user to experience an architectural site using VR technology; the site displayed is the famous
Japanese garden of Ryoan-ji, Kyoto (credit: Prof. Oki Takuya, Prof. Fujii Haruyuki, Weam Numan). 

​​​

We hope this short article has helped you gain a general understanding of the basic terms and types of technologies in XR. If you would like to know more, you are welcome to subscribe to our newsletter. We also invite contributions from design technologists across the globe, so feel free to reach out. 

YUVAL_PORTRAIT

Dr. Yuval Kahlon is an educator, researcher and entrepreneur with interests in design computing and human intelligence. He has trained many professionals by working with institutions such as the Israeli Association of United Architects, as well as with major Israeli architectural design firms such as MYS Architects. His research focuses on the development of interactive environments for design education and practice, using state-of-the art technologies in XR and eye tracking. Kahlon is an Assistant Professor at the School of Environ. & Society, Tokyo Institute of Technology, Japan.

Keywords. extended reality (XR), human-computer interaction (HCI), cyber-physical experience


Acknowledgements. aaa

​
External Links. https://www.researchgate.net/publication/374030054_The_Holographic_Studio_Real-time_virtual_teleportation_in_Mixed_Reality_for_enhancing_design_education​

WOW

How is AR revolutionizing design processes?

HU ET AL. GAZE SHARING CONDITION -  INSTRUCTOR VIEW

What happens when instructors can see through students' eyes?

KAHLON EYE TRACKING EXAMPLE VR

How does VR help to study heritage sites?

KAHLON EYE TRACKING OKU
Screen Shot 2025-02-14 at 14.05.06
KAHLON ET AL. IGS
KAHLON ET AL. HOLOGRAPHIC STUDIO
KAHLON ET AL. AR OKINAWA
VR EYE TRACKING
KAHLON MR BUILDING
VR
KAHLON ET AL GAZE SHARING
bottom of page