Pico OS 5.12 offers phone mirroring and improves passthrough and hand tracking

Pico's new operating system, Pico OS 5.12, brings a number of long-awaited innovations in the world of virtual reality, with functionalities designed to enhance the immersive experience. Among the main new features are the mirroring of the phone screen, keyboard and mouse support, and improvements in passthrough and hand tracking. This launch comes just six weeks after the release of the Pico 4 Ultra and promises to optimize the features of one of the most advanced virtual reality devices on the market.

Screen mirroring capabilities: take your phone into the virtual world

With Pico OS 5.12, phone screen mirroring becomes a reality. This feature, compatible with both iOS and Android devices, allows users to view and control their phone from Pico's virtual reality headset. Now, any content on the phone can appear on a 2D floating panel in VR or mixed reality, offering similar integration to the Apple Vision Pro, which allows mirroring of iPhones, although the difference is that Pico supports a wider range of devices.

For users of other VR headsets like the Meta Quest, this option requires the use of USB-C cables and capture cards, making Pico's solution a much more convenient and practical option.

Improvements in hand tracking: natural control and quick response

The improved controller-free hand tracking is another standout feature of Pico OS 5.12. ByteDance, Pico's parent company, says this update brings improved response speed and optimized stability in fast-moving and occlusion situations. In addition, the enhancements allow for much more precise finger movements and less interference from accidental touches, giving users greater flexibility and control in the VR experience.

These improvements in hand tracking are especially valuable for applications and games that require detailed control of natural gestures and movements, a key step on the path to more intuitive and seamless virtual reality experiences.

Enhanced passthrough: clarity and stability in many lighting conditions

Pico passthrough has also been optimized in this update, fixing some of the most common issues in this type of technology. Improvements include significantly reducing distortion at close range and reducing "ground shake" in high-light conditions, such as sunny outdoors. These improvements make the viewing experience more stable and enjoyable in varied environments, allowing the user greater integration with their physical environment without sacrificing quality.

Other notable improvements in Pico OS 5.12

In addition to the main innovations, Pico OS 5.12 includes a number of improvements that optimize different aspects of the headset and its usability:

• Bluetooth keyboard and mouse support: The home space is now compatible with Bluetooth keyboards and mice, allowing for more precise navigation and control.
• Improved multi-window experience: With greater clarity in text and the ability to open multiple windows in the browser, users can manage multiple applications simultaneously.
• Video player and photo viewer improvements: The passthrough mode in the video player allows you to adjust and resize the playback windows, also improving the visual effects in the immersive mode for spatial photos and videos.
• Pico Motion Tracker: Motion tracking is now more accurate, especially in positions such as sitting or lying down, and the option to disable inactivity detection is included to prevent the viewfinder from automatically going into sleep mode.
• Developer SDK updates: With a focus on the continuous development of mixed reality experiences, Pico OS 5.12 includes enhancements to hardware simulation and environment sensing capabilities, along with specific development samples for MR and AR Foundation.

What are Pico Motion Trackers?

Pico Motion Trackers are devices that offer precise tracking of the user's movements, especially useful for applications that require detailed recording of posture and movement, such as advanced workouts or simulators. With this update, waist trackers have improved in accuracy in detecting resting postures, and the inactivity detection function can now be disabled, ideal for extended sessions.

Conclusion

Pico OS 5.12 represents a significant leap in VR software development, with features and enhancements that optimize the experience for Pico 4 Ultra users. From phone screen mirroring to advanced passthrough and optimized hand tracking, these innovations cement Pico as a solid choice in the VR market.

For those looking for an advanced VR experience, the usability and performance improvements in Pico OS 5.12 make this headset a multifunctional tool that continues to raise the bar in the VR industry.

FAQs

Can I use phone screen mirroring in Pico OS 5.12 with any mobile model?

Yes, it is compatible with both Android and iOS devices.

How does the new hand tracking system improve in Pico OS 5.12?

The system has improved in response speed and movement accuracy, allowing for more natural and fluid control.

Is passthrough mode effective outdoors?

Pico OS 5.12 optimized passthrough to reduce distortion and improve stability in high-light conditions, such as outdoors.

Is it compatible with Bluetooth keyboards and mice?

Yes, the Pico home space now supports Bluetooth devices such as keyboards and mice.

Can multiple browser windows be opened with this update?

Yes, Pico OS 5.12 allows you to open multiple windows simultaneously for better multitasking management.

What improvements does the Developer SDK include?

The SDK now enables hardware simulation without a physical device and offers new samples for MR, AR, and motion tracking development.

Binarybox Studios | Connecting worlds, creating experiences