Japan's National Institute of Advanced Industrial Science and Technology (AIST), an independent administrative institution, has developed a speech recognition function in real environment using an array of microphones, successfully extending the sensing capability of humanoid robot under the Humanoid Robotic Project HRP-2 "Prométhée".
The microphone array consists of eight omnidirectional microphones mounted around the robot's head (Fig. 1 left). The sound source is located on the basis of difference in times for arrival to individual microphones, and at the same time, a camera mounted at the robot's head detects, tracks and locates a person giving the vocal instruction. Stable speech recognition is obtained by combining information derived from the microphone array and the camera and by isolating and eliminating noises. Hardware to eliminate noises in real time has been developed and built into a robot, making it possible for a human operator to give robot vocal instructions, and to control IT appliances through a robot, even in a field where multiple noise sources such as TV exist.
The present study has been carried out as a part of AIST Project "Development of Humanoid Robot Type Intelligence Booster Platform" (fiscal years 2003-05).
|
|
|
 |
Fig. 1. (Left) A head of a humanoid robot equipped with a microphone array. Arrows show positions of mounted microphones. (Right) A multi-channel signal processing hardware built in a robot. |
It is expected, therefore, that natural communications may be realized in the living environment between a human operator and a humanoid robot through the auditory function of robot.
The present study has been carried out as a part of AIST Project "Development of Humanoid Robot Type Intelligence Booster Platform" (fiscal years 2003-05).
Since the announcement of Humanoid Robot P2 by Honda Motor Co., Ltd. in 1996, R&D works on the humanoid robot have been increased energetically not only in Japan but also over the world. In the technological strategic map for robotics drafted by the Ministry of Economy, Trade and Industry (METI), it is planned to ensure practical use of robots supporting human labor in the living environment by 2025, such as supporting household works, self-reliance support, assistance and nursing care for aged persons.
While previous R&D efforts for humanoid robot technology have been focused on robot locomotion aiming at safe and stable walks and behaviors, as well as robot vision, little have been done in full-scale technological development of hearing function of robot, which plays an important role in establishing natural communications between humans and robots.
In the living environment, where practical use of next generation robots is expected, direct human-robot interaction through voice channel is growing to one of key perceptive functions of robot.