2023.02.06 Monday
Interactive Cyber-Physical Human: Generating Contact-Rich Whole-Body Motions
The platform uses human measurement data, musculoskeletal analysis, and machine learning, to enable the development of humanoid robots and robot simulations
Performing human-like motions that involve multiple contacts is challenging for robots. In this regard, a researcher from the Tokyo University Science has envisioned an interactive cyber-physical human (iCPH) platform with complementary humanoid (physical twin) and simulation (digital twin) elements. iCPH combines human measurement data, musculoskeletal analysis, and machine learning for data collection and augmentation. As a result, iCPH can understand, predict, and synthesize whole-body contact motions.
Humans naturally perform numerous complex tasks. These include sitting down, picking something up from a table, and pushing a cart. These activities involve various movements and require multiple contacts, which makes it difficult to program robots to perform them.
Recently, Professor Eiichi Yoshida of the Tokyo University of Science has put forward the idea of an interactive cyber-physical human (iCPH) platform to tackle this problem. It can help understand and generate human-like systems with contact-rich whole-body motions. His work was published in Frontiers in Robotics and AI.
Prof. Yoshida briefly describes the fundamentals of the platform. "As the name suggests, iCPH combines physical and cyber elements to capture human motions. While a humanoid robot acts as a physical twin of a human, a digital twin exists as a simulated human or robot in cyberspace. The latter is modeled through techniques such as musculoskeletal and robotic analysis. The two twins complement each other."
This research raises several key questions. How can humanoids mimic human motion? How can robots learn and simulate human behaviors? And how can robots interact with humans smoothly and naturally? Prof. Yoshida addresses them in this framework. First, in the iCPH framework, human motion is measured by quantifying the shape, structure, angle, velocity, and force associated with the movement of various body parts. In addition, the sequence of contacts made by a human is also recorded. As a result, the framework allows the generic description of various motions through differential equations and the generation of a contact motion network upon which a humanoid can act.
Second, the digital twin learns this network via model-based and machine learning approaches. They are bridged together by the analytical gradient computation method. Continual learning teaches the robot simulation how to perform the contact sequence. Third, iCPH enriches the contact motion network via data augmentation and applies the vector quantization technique. It helps extract the symbols expressing the language of contact motion. Thus, the platform allows the generation contact motion in inexperienced situations. In other words, robots can explore unknown environments and interact with humans by using smooth motions involving many contacts.
In effect, the author puts forward three challenges. These pertain to the general descriptors, continual learning, and symbolization of contact motion. Navigating them is necessary for realizing iCPH. Once developed, the novel platform will have numerous applications.
"The data from iCPH will be made public and deployed to real-life problems for solving social and industrial issues. Humanoid robots can release humans from many tasks involving severe burdens and improve their safety, such as lifting heavy objects and working in hazardous environments. iCPH can also be used to monitor tasks performed by humans and help prevent work-related ailments. Finally, humanoids can be remotely controlled by humans through their digital twins, which will allow the humanoids to undertake large equipment installation and object transportation," says Prof. Yoshida, on the applications of iCPH.
Using the iCPH as ground zero and with the help of collaborations from different research communities, including robotics, artificial intelligence, neuroscience, and biomechanics, a future with humanoid robots is not far.
Reference
| Title of original paper | : | Towards understanding and synthesis of contact-rich anthropomorphic motions through interactive cyber-physical human |
| Journal | : | Frontiers in Robotics and AI |
| DOI | : | 10.3389/frobt.2022.1019523 |
|
Title: Interactive cyber-physical human (iCPH) platform for investigation of contact-rich whole-body human-like motions
Caption: iCPH utilizes human measurement data, musculoskeletal analysis, and machine learning, enabling complementary humanoid robots (physical twins) and robot simulations (digital twins) to understand, predict, and synthesize human-like contact motions.
Credit: Eiichi Yoshida from the Tokyo University of Science
License Type: Original Content
Usage Restrictions: Not to be reproduced without permission
About The Tokyo University of Science
Tokyo University of Science (TUS) is a well-known and respected university, and the largest science-specialized private research university in Japan, with four campuses in central Tokyo and its suburbs and in Hokkaido. Established in 1881, the university has continually contributed to Japan's development in science through inculcating the love for science in researchers, technicians, and educators.
With a mission of "Creating science and technology for the harmonious development of nature, human beings, and society", TUS has undertaken a wide range of research from basic to applied science. TUS has embraced a multidisciplinary approach to research and undertaken intensive study in some of today's most vital fields. TUS is a meritocracy where the best in science is recognized and nurtured. It is the only private university in Japan that has produced a Nobel Prize winner and the only private university in Asia to produce Nobel Prize winners within the natural sciences field.
About Professor Eiichi Yoshida
from Tokyo University of Science
Eiichi Yoshida is a Professor at the Department of Applied Electronics, Faculty of Advanced Engineering in the Tokyo University of Science. He received a Doctorate in Engineering from the University of Tokyo in 1996. He is an IEEE Fellow. He received Chevalier, l'Ordre National du Mérite from the French Government in 2016. His research interests include mechanics and mechatronics, robotics and intelligent systems, and intelligent robotics. He has published over 200 research papers, which have been cited more than 8,000 times. He is currently working on the interactive cyber-physical human platform that can understand and synthesize contact-rich whole-body human-like motions.