Happy to share a talk that is online about my eye-hand symbiosis project, which I've been working on for over a decade. I tried to make it less sciency and connect more to recent industry developments.
Thanks to the XR Design Community for the invite, and thanks to the wonderful host, Pip Turner. The Q&A session was one of the longest I've ever experienced—but in the best possible way! 😂
https://lnkd.in/diQh2mQ5
Talk overview:
1) Why is the interplay between eyes and hands particularly compelling now? I discuss its historical significance in #HCI, tracing back to the 1980s, and how it connects to the evolution from mouse-based interfaces to touch and 3D gestures. Overview article here: https://lnkd.in/d_7GzFCn)
2) Eye-hand symbiosis: What are the foundational concepts for eye-hand UI? I explore how eye-hand interaction merges key characteristics of traditionally distinct direct and indirect input devices Overview article here: https://lnkd.in/deKp4nDD)
3) Gaze + Hand design issues: Issues that can make or break eye-hand input, such as division of labour, multimodal timing, composition, gesture support, precision. Overview article here: https://lnkd.in/dqeEFSQg
4) Direct and Indirect Interaction: How eyes and hands offer new ways to combine the traditionally separate direct and indirect input characteristics. I am writing up a new article to provide more detail, stay tuned!
5) I touch upon social media reactions of the Apple #VisionPro, e.g., the debate on hand-tracking vs. controllers, or Antony Vitillo (aka Skarredghost) article on its UX
https://lnkd.in/dWrajeDP
Note: I am not responsible for the interior design of my office. The designer (my 5-year-old daughter) seems to have a knack for ambivalent drawings (the orange drawing is apparently not a fly with huge eyes, but a ladybug) 🤣 .
#uiux #AR #VR #XR #3DUI #spatialcomputing #pen #gaze #eyetracking
Want to learn about how to design for gaze + hand tracking?
We've (finally!) published the talk Ken Pfeuffer gave earlier this year to the XR Design Discord server!
In it, he details all the awesome research he's done looking into these interactions - this is a must watch!
https://lnkd.in/dffQ9F9C
✨ Join the XR Design Discord server: https://lnkd.in/dRtTCcPq ✨
#xr #eyetracking #handtracking #designtalks #spatialdesign #uxtalks #interactiondesign