Role: XR Developer
Description: Current Augmented Reality devices rely heavily on live environment mapping to provide convincing world-relative experiences through user interaction with the real world. This mapping is obtained and updated through many different algorithms but often contains holes and other mesh artifacts when generated in less ideal scenarios, like outdoors and with fast movement. In this paper, we present the Interaction-Triggered Estimation of AR Object Placement on Indeterminate Meshes, a work-in-progress application providing a quick, interaction-triggered method to estimate the normal and position of missing mesh in real-time with low computational overhead. We achieve this by extending the user’s hand using a group of additional raycast sample points, aggregating results according to different algorithms, and then using the resulting values to place an object.
Software Used: MRTK, World Locking Tools, Unity
Hardware Used: HoloLens 2, Trimble HoloTint
Media: