Zhang, Ju; Ma, Fang; Pi, Yuke; Du, Haoyang and Pan, Xueni. 2025. Digital twin embodied interactions design: Synchronized and aligned physical sensation in location-based social VR. Frontiers in Virtual Reality, 6, 1499845. ISSN 2673-4192 [Article]

Text frvir-1-1499845.pdf - Published Version Available under License Creative Commons Attribution. Download (2MB)

Abstract or Description

Digital twin technologies have become increasingly relevant in virtual reality, offering precise 1:1 mapping between physical environments and their virtual counterparts. While previous work has focused on object interaction through passive haptics, little attention has been given to how such environments can support social and embodied interactions that feel natural and expressive. In this work, we extend the digital twin paradigm by integrating full-body avatars, hand tracking, and voice-driven facial animation into a location-based VR environment. To explore the interactive potential of this dual-realm environment, we propose three categories of cross-realm embodied interaction: (1) Tangible interaction, exemplified by spatially aligned object manipulation; (2) Social gesture, supported through expressive hand and body movement; and (3) Social touch, including co-located tactile actions such as handshakes and hugs. We developed a prototype system showing all three embodied interactions, supported by passive haptics, precise spatial alignment, and real-time multiplayer synchronization. We also introduced a low-cost, Wi-Fi-based motion tracking prototype to enhance interaction with movable physical elements. We evaluate the system through expert interviews, identifying key themes related to spatial trust, tactile realism, and interpersonal presence. Our findings suggested that precise alignment and embodied social cues significantly enhance immersion and social connectedness. This work contributes towards a replicable framework for designing socially immersive digital twin experiences and opens new directions for location-based VR in collaborative and educational contexts.

Item Type:	Article
Identification Number (DOI):	https://doi.org/10.3389/frvir.2025.1499845
Additional Information:	Funding: This work received support from the Arts and Humanities Research Council (AH/ T011416/1) to JZ, FM and XP. YP and XP are supported by the Economic and Social Research Council (ES/W003120/1).
Data Access Statement:	The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Keywords:	digital twin, virtual reality, social interaction, passive haptic, hand tracking, embodiment, full-body avatar, social presence
Departments, Centres and Research Units:	Computing
Dates:	Date Event 21 September 2024 Submitted 29 April 2025 Accepted 21 May 2025 Published
Item ID:	38888
Date Deposited:	05 Jun 2025 08:02
Last Modified:	05 Jun 2025 08:02
Peer Reviewed:	Yes, this version has been peer-reviewed.
URI:	https://research.gold.ac.uk/id/eprint/38888

View statistics for this item...

Edit Record (login required)