Physically-based Interaction in AR

In this research, we present an AR framework that allows natural hand and tangible AR interaction for physically-based interaction and environment awareness to support face-to-face collaboration using Microsoft Kinect.

Our framework comprises of six major components: (1) marker tracking (2) depth acquisition (3) image processing (4) physics simulation (5) communication and (6) rendering.

The resulting augmented environment supports occlusion, shadows, and physically-based interaction of real and virtual objects. We propose three methods of natural hand representations including mesh-based, direct sphere substitution and variational optical flow.

T. Piumsomboon, A. Clark and M. Billinghurst. Physically-based Interaction for Tabletop Augmented Reality Using a Depth-sensing Camera for Environment Mapping. In Proceedings of Image and Vision Computing New Zealand (IVCNZ’11), pp. 161-166, 2011.

T. Piumsomboon, A. Clark, A. Umakatsu and M. Billinghurst. Physically-based natural hand and tangible AR interaction for face-to-face collaboration on a tabletop. In IEEE Symposium on 3D User Interfaces (3DUI’12), pp. 155-156, 2012.


© 2017 by Thammathip Piumsomboon

  • email
  • Facebook Clean Grey
  • LinkedIn Clean Grey