Physically-based Interaction in AR
In this research, we present an AR framework that allows natural hand and tangible AR interaction for physically-based interaction and environmental awareness to support face-to-face collaboration using Microsoft Kinect. Our framework comprises six major components: (1) marker tracking (2) depth acquisition (3) image processing (4) physics simulation (5) communication and (6) rendering. The resulting augmented environment supports occlusion, shadows, and physically-based interaction of real and virtual objects. We propose three methods of natural hand representations including mesh-based, direct sphere substitution and variational optical flow.
T. Piumsomboon, A. Clark and M. Billinghurst. Physically-based Interaction for Tabletop Augmented Reality Using a Depth-sensing Camera for Environment Mapping. In Proceedings of Image and Vision Computing New Zealand (IVCNZ’11), pp. 161-166, 2011.
T. Piumsomboon, A. Clark, A. Umakatsu and M. Billinghurst. Physically-based natural hand and tangible AR interaction for face-to-face collaboration on a tabletop. In IEEE Symposium on 3D User Interfaces (3DUI’12), pp. 155-156, 2012.