CHINESE POETIC REALM EMPOWERING ASD PRECURSOR DEFECT INTERVENTION: WEARABLE-FREE MULTIMODAL IDENTIFICATION AND PERSONALIZED ADAPTATION IN DIGITAL TWIN METAVERSE

Abstract

Traditional identification of ASD precursor defects is accompanied by a sense of oppression due to the participation of medical staff, which easily induces fear in children, leads to distorted behavioral expression, and impairs the accuracy of identification. Adhering to the core logic of "no medical staff involvement + digital twin metaverse immersion + oppression-free experience + multimodal dynamic identification + personalized adaptation for each individual", this study takes the Chinese poetic realm as the spiritual core and constructs a metaverse role-playing scenario based on wearable-free somatosensory carriers and digital twin technology, abandoning medical staff participation throughout the process to eliminate children's fear and sense of oppression. Children engage in immersive role-playing in the metaverse space to achieve the dual goals of "intervening while learning and educating through entertainment". Through multi-dimensional data collection, four-dimensional information including motor behavior, voice, emotional response and knowledge acquisition of children during their experience in the poetic realm and role interaction is captured in real time, so as to accurately identify ASD precursor defects, real emotional states (fear, tension, relaxation, etc.) and learning effects. Based on the identification results, a "personalized adaptation for each individual" scheme is generated to dynamically adjust the artistic conception of scenarios, the difficulty of roles, interaction forms and feedback mechanisms. This study constructs an integrated system of "metaverse role-playing as identification, emotion as adaptation basis, poetic realm as intervention carrier, and experience as learning process", which solves the problems of distorted expression caused by oppression and lack of interest in traditional interventions, and provides a new intervention path with humanistic care, identification accuracy, learning value and personalized adaptation for ASD precursor defects.