Researchers at Ulsan National Institute of Science and Technology (UNIST) have unveiled a pioneering technology for real-time human emotion recognition, poised to transform various industries, particularly wearable systems. Overcoming the challenge of abstract emotional data, the team developed a multi-modal system integrating verbal and non-verbal expression data, utilizing a personalized skin-integrated facial interface (PSiFI) system powered by friction charging. This bidirectional triboelectric strain and vibration sensor enable simultaneous data sensing and integration, with a fully integrated data processing circuit ensuring wireless real-time emotion recognition, even when individuals are wearing masks.
Through machine learning algorithms, the technology demonstrates remarkable accuracy in recognizing human emotions, showcased in a digital concierge application within virtual reality (VR) environments. By integrating facial muscle deformation and vocal cord vibrations, the system provides personalized services based on users' emotions, promising possibilities for portable emotion recognition devices and next-generation digital platform services. Collaboration with Nanyang Technical University in Singapore, supported by the National Research Foundation of Korea (NRF) and the Korea Institute of Materials (KIMS), underscores the significance of this advancement in human-machine interface (HMI) devices, paving the way for enhanced interaction capabilities between humans and machines.
