Skin-Integrated Sensors and Haptic Interfaces for VR and AR
皮肤集成传感器和触觉反馈界面在VR/AR中的应用
Xinge Yu（于欣格）
ABSRACT
Technologies for virtual and augmented reality (VR and AR) create human experiences through visual and auditory stimuli that replicate sensations associated with the physical world. The most widespread VR/AR systems use head-mounted displays, accelerometers and speakers as the basis for three-dimensional, computer-generated environments that can exist in isolation or as overlays with actual scenery. By comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface for VR/AR technology that could, nevertheless, greatly enhance experiences, at a qualitative level, with direct relevance in areas ranging from communications and social media, to gaming, entertainment and prosthetics technology. Here we present materials, device structures, power delivery strategies and communication schemes as the basis for a wireless, battery-free platform of electronic systems and haptic interfaces capable of softly laminating onto the skin to communicate information via spatio-temporally programmable patterns of localized mechanical vibrations. The resulting technology, which we refer as epidermal VR, creates many opportunities where the skin provides an electronically programmable communication and sensory input channel to the body, as demonstrated through example applications in social media/personal engagement, prosthetic control/feedback and gaming/entertainment.
虚拟现实（VR）和增强现实（AR）的技术是通过模拟外界的诸如声音和视觉刺激，并复制呈现给人体的感受器官实现虚拟的“真实”体验。目前广为人们熟知和认识的VR/AR是基于头戴式眼镜的3D立体成像技术加上一定的声音效果。除了视觉和听觉意外，针对人体皮肤的触觉感受的开发缺非常少。触觉在VR/AR中可以更为真实的提供虚拟现实的体验复制，从而可以用于诸如社交媒体、游戏装备、娱乐、和假肢的控制与传感等领域的诸多应用，因此有着非常重要的意义。报告将涉及新型基于无线控制、无电池驱动、皮肤集成的传感与触觉反馈界面的VR/AR技术。这种新型的VR/AR电子皮肤通过先进功能材料的选择，工程力学的设计、电子电路的优化、软硬件的协同与交互从而实现系统级别的集成，把此类技术扩展至4维甚至5维，实现触觉的反馈与控制。
BIOGRAPHY
Dr Xinge Yu is currently an Assistant Professor of Biomedical Engineering at City University of Hong Kong (CityU). Xinge Yu got his bachelor degree form University of electronics Science and Technology of China (UESCT) in 2009 and conducted his Ph.D. research in printable flexible electronics at Northwestern University and received his Ph.D. degree in Optical Engineering from UESTC in 2015. From 2015 to 2018, Xinge Yu was a postdoctoral research associate at Northwestern University and University of Illinois at Urbana-Champaign, where he was working on flexible bio-electronics. Now Xinge Yu’s research group is focusing on skin-integrated electronics and systems for biomedical applications. He has published over 70 papers in the top journals, such as Nature, Nature Materials, Nature Biomedical Engineering, Nature Communications, PNAS, Science Advances etc., and held 15 patents pending or granted. Dr Yu serves as an associate director of the CAS-CityU Joint Lab on Robotics, and an associate editor of IEEE Open Journal of Nanotechnology. Dr Yu is also the recipient of New Innovator of IEEE NanoMed, MINE Young Scientist Award.
于欣格，香港城市大学生物医学工程系助理教授、博导。2009年本科毕业于电子科技大学。2009-2015年，于美国西北大学与电子科技大学联合培养攻读博士，从事柔性金属氧化物的柔性化与大规模打印的研究，并于2015年获得博士学位。于2015-2018年先后在美国西北大学生物集成电子研究中心和伊利诺伊大学材料工程系担任博士后研究员，从事皮肤集成电子、生物电子以及多学科交叉的相关研究。目前研究方向为新型柔性电子材料与器件在生物医疗领域的应用。近年来，已在Nature, Nature Materials, Nature Biomedical Engineering, Science Advances, PNAS, Advanced Materials等学术期刊发表论文70余篇。担任香港城市大学-中科院机器人联合实验室副主任，IEEE新纳米技术杂志的副主编，获得IEEE纳米医学发明家奖，MINE青年科学家奖等荣誉奖项。