Advanced Reality Technology Laboratory
Research Projects
Telepresence and remote communication through realistic and expressive individual 3D avatars
(2021～： Michal Joachimczak, Juan Liu, Hiroshi Ando)
We have developed REXR (Realistic and EXpressive 3D avataR) technology to construct an individual’s realistic and expressive 3D avatar using a single camera by integrating multiple AI modules. Such avatars can show fine facial expressions and gestures from any viewpoint in 3D virtual environments in order to facilitate mutual understanding in remote communication.
MR telepresence technology and analysis of human behavior and bio-signals
（2017： Michal Joachimczak, Juan Liu, Hiroshi Ando）
We have developed MR (Mixed Reality) telepresence technology that reconstructs and transmits the 3D shape of a person in real time using depth sensor information and allows a person in a remote location to communicate with the transmitted virtual 3D image in real space by wearing an MR headset. Our human behavioral and bio-signal data suggest that using MR communication system we may modulate the user’s mental states (e.g., stress level) in ways that are not possible in face-to-face communication.
