Wie messen Sie die Wirkung von VR auf die Nutzer?

A System Usability Questionnaire (SUS) and a VR Sickness Questionnaire are both tools used to assess different aspects of user experience in VR applications. These questionnaires are valuable tools for gathering quantitative data on user experience. They can help identify areas where improvements are needed, whether in terms of system design and usability, or in managing potential discomfort or side effects like VR sickness. It’s important to administer these questionnaires after users have had a chance to interact with the VR application to ensure their responses are based on actual experiences.

Many modern VR headsets come with built-in eye-tracking capabilities. This can show where users are looking in a VR environment and for how long. Using heatmaps, visual representations of where users most frequently interact or look can he tracked to provide insights into what parts of the VR environment are most engaging or require optimization Similarly Motion Tracking can be used to monitor the movement and gestures of users by utilizing the sensors in VR controllers and headsets. This can help determine how users navigate or interact with objects.

Well in my opinion the key to improve UX is by improving angular movement in existing VR devices. Our inner ear is responsible for understanding gravity, angular velocity etc. Hence light weight devices shall win the race... Precise calibration and registration of sensors & autonomous drift correction models can be tested to be implemented over these outstanding tech.

I believe that objective user behavior is the best way, that is not "prodded." Aka hand over the headset, say as few words as possible, wait for questions. Then observe (or record) the user behavior, perhaps they smile, perhaps they laugh out loud, maybe they duck, etc. Then see if they ask to stop the experience and how long that takes. Then when they remove the headset, listen and watch to their feedback or what they say. Record how long your conversation is and perhaps keep a record of themes and words they mention, emotions they describe, etc. In conclusion I personally am inclined to observe stealthily, but it also depends on your population and what experience you are providing.

Have an understanding of the user experience of your VR experiences. Test the duration of your sessions to see how long they can last or would like to last using your application. Tracking where your users are looking at gives an indication of how you're designing the level that is working in influencing your users' attention. Tracking where your users are interacting gives you an insight into whether your instructions are working or not, or even the type of users you testing it on. Test these metrics as early as possible. The sooner you test it out, the more chances you can iterate.

Many of the instruments that were traditionally used to evaluate 2D learning approaches are now being effectively applied to IVR. For participants experiencing IVR for the first time, it may be advisable to use open-ended inquiries to encourage them to reflect on their experience and thoroughly process it before moving on to a targeted answer survey. If you have ever guided new participants into a social IVR session, you will understand how much there is to process first. 💎

In the realm of VR, particularly in experiences featuring user avatars, there are critical factors to assess, namely: User's sense of embodiment Presence These aspects can be quantified through a set of questionnaires. User embodiment can be evaluated using the standardized embodiment questionnaire devised by Peck T. et al., as well as the IPQ (Immersive Presence Questionnaire). By employing these two metrics, developers and designers can gain valuable insights into how users: a. Perceive their avatars (virtual selves) b. Perceive the virtual environment

VR questionnaires are a helpful tool for targeted feedback. I also urge developers not to underestimate the power of the user's initial emotional response. Craft opportunities to have an open dialogue with users immediately following your experience. This innately human touch offers an opportunity for users to spontaneously share their personal experience, offering a deeper insight into the emotional effectiveness of your project. Whether a VR questionnaire or one-on-one feedback, remain open and receptive to the user's point of view. Tucked behind their response, you may find clues to where your experience is working and where there is room for further development.

This is important especially now, as VR quickly expands beyond gaming, architecture, and other fields whose users are already comfortable navigating and interacting with virtual environments. As VR becomes a venue for meetings, collaboration, events, exhibitions, and engagement, more of its intended users will be everyday people who have no prior experience with immersive technology. Familiar survey tools enable all users to share essential insights about their experience with developers in a known format. Simple things like knowing how to move, use tools, grab things, and share content in VR can be the most impactful to new users in achieving a sense of presence. Surveys can reveal where these gaps are, and help developers to bridge them.

When we have our customers try out our haptic products, we kindly ask them to complete a brief quiz. They usually respond to our questions with genuine enthusiasm, often because they are pleased with the experience. In fact, from some of our testers, we receive exceptionally valuable feedback and ideas. These feedback sessions can be conducted either one-on-one or through methods such as a post-game or post-experience screen or interface, accompanied by small tokens of appreciation or an honorarium for the user. Consistently gathering feedback and immersing ourselves in the customer experience is an indispensable requirement in this rapidly evolving field.

It is important to always inform users about the kind of data you're collecting and obtain their consent before monitoring their actions or gathering any data. Some XR devices available now (or hitting the market shortly) will have the capability to monitor physiological responses right out of the box (pupil movement and dilation fir example) while other devices can be added to standard VR headsets without being obvious what they are or what they are doing (including ECG and EEG monitors). Privacy and ethical considerations are crucial in user research and analytics, and it is important not to violate users right to privacy by gathering this type of data without their express consent.

Our first Pilot with Oculus and Children’s Hospital of Los Angeles included the use of HEXO suits that measured physiological response to live action scenarios Vs Simulated VR experiences. We also measured cortisol levels pre and post IRL and VR. The results were very telling. When developing virtual experiences. The physiological impact on users, can significantly increase a sense of realism and imprint. This is critical when we discuss the use of VR as a replacement for real life experiences. Especially in skills training use cases.

VR physiological measurement tools can be extremely helpful in understanding how users are responding to your VR experience in ways users may not be able to verbally express. If you are a developer interested in using VR physiological devices, I recommend brainstorming creative ways in which the device you choose can become an integral part of the overall experience. Without leaning too far into the VR Ethical Considerations discussion below, I also recommend being extremely forthcoming with users about why these VR physiological devices are being used and how you plan to protect user data.

In order to ensure the effective, and ethical use of VR applications, consider implementing two key features: Regular Timeouts: This aligns with responsible VR use and helps users maintain focus and awareness. By incorporating regular breaks, we promote a mindful VR experience Personalized Environments: Provide users with the ability to choose their preferred virtual environments. Analyzing user choices in these environments can offer valuable insights into their mental states. By understanding these patterns, companies can tailor VR experiences to align with users' emotional needs, bringing a more personalized and effective interaction. By integrating these features, VR applications can enhance user well-being and gather valuable data

Based on my VR research in healthy and clinical (especially eye disorder patients) groups in the Netherlands and India, I would suggest: 1. Identify target audience and concerns: Who are VR users? Luminance, vection? Potential motion sickness or epilepsy issues? 2. User Experience Surveys: Assess comfort, immersion, and task perspicuity (if the VR app involves tasks). Talk extensively to users. 3. Interaction Metrics: Utilize VR devices' eye tracking and head tracking for gaze and navigation metrics. Controller feedback for tactile metrics. 4. Physiological Indicators: Measure skin conductance and heart rate. 5. Explore multimodal neuroimaging (EEG+VR or fMRI+VR) if funding allows. Also, consider prospective long-term studies.

An often overlooked - but undeniably crucial - tool is the ability to gauge time. If your VR experience is a repeatable (most often medical use cases), where a user goes through the same experience again, this becomes an important way to drive outcomes. For instance, if a medical practicioner is able to measure the amount of time it took a patient to perform an action in VR in week 1 vs. week 4 (post treatment), this would result in data that can lead to a potential better diagnosis or line of treatment. This is not limited to just medical use cases - things like doing r&d on car assembly, soft and hard skill training, and so on. This type of data enables stakeholders design better rubrics.

The first 30 seconds of new users trying the VR application is, most of the times, the best measure of how it puts them at ease. More than 90% of the people we had trying our VR experiences (mostly training programs) in the last 2 years expressed their feelings within the first minute, mostly with their face, hands and voice. Yes, any application can have several features that need to be leveraged later on during the usage, but building a wall before actually getting to the core of the application won't help at all. In VR, given the huge immersion it provides, this is especially true since users should dive into an environment where they feel comfortable and naturally understand what surronds them from the very first moment.

The tools mentioned are not designed for behavioral measurements and seem quite difficult to adapt for that purpose. This is one of the best measurements I know of, it is very expensive because it requires a one-on-one interaction with the user and a qualified user experience designer. But in early stage of a product is the most rewarding.

Ethical practices during the development and distribution of your VR experience should be at the forefront of your mind as a developer. However you choose to measure the impact of user engagement, taking into consideration the content of your experience is key when making ethical considerations such as trigger warnings, parental guidance parameters, proper headset usage, repetitive stress injury guidelines, medical device advisories, and accessibility measures.

Consider your deployment strategy. Rolling out VR in a pilot may be an advisable approach over a “big bang”. Getting feedback from a smaller pilot group is often easier Spotting gaps in documentation, communication and UX (motion sickness, controller interaction, navigation, etc) are easier to catch and fix Training in VR requires extra coordination. You’ll still work with SMEs and managers, but you may have to also educate your own team. Your new best friends will be the IT department who are crucial allies in rollout, updating, data collection and security. VR learning programs need a Program Manager, not just an enthusiastic Learning Experience Designer, Training Manager or even Executive champion to succeed.

How do you measure "pleasure" do you map the number of receptors on the tongue (if measuring the pleasure of having ice-cream?) How do you measure the intensity of an orgasm? - dopamine levels?... How do you measure 'grieving'... The amount of tears per second flowing?... 'Emotion Engineering' with VR: The point is, VR is such a powerful medium, it 'connects' directly to, and activates our primitive brain (limbic / lizard brain) - if you fall in VR do you fall in real-life? Yes, you do! Ask anyone who's played walk-the-plank in VR. While we can attempt to 'measure' the success of a VR project, we must keep in mind the deep visceral effect VR is capable of on us; the un-measurable far outweighs anything sensors or questionnaires can.

You as a developer should not be thinking about this alone, even if you have a lot of accumulated knowledge about game mechanics and technical feats on your back. UX teams are well accustomed to testing responses on users, involve your UX team or an external one, before, during, and after release. They may think about and validate lots of metrics that a developer may not think about. Try to gather UX professionals with expertise in VR in your team, as VR user experience is a whole new expanding field that has its own rules, and there are already seasoned professionals out there who will give you some unique perspectives.

A experiences are being created there is a lot to be gained from early user testing with a method called Brown Boxing, which is essentially creating a life sized cardboard model to watch the natural interactions with the physical example before designing it in VR for a full immersive experience.

Compare users' cognitive, emotional, or behavioural metrics before and after experiencing VR content to assess any changes or improvements. Pre-post comparisons are a valuable method for assessing the effects of virtual reality on users over time. This approach involves measuring specific variables or outcomes before and after users engage with VR experiences. It helps researchers and practitioners understand how VR interventions or exposures may have influenced users' cognitive, emotional, or behavioural states.