Integrating Robots with Speech recognition to perform Tasks

The speech recognition system is a comfortable and quicker way to control the machines in today's life and is a hot topic in the development of social assistive robots. In this paper, the speech recognition system is integrated with the robotic operating system (ROS) and implemented onto a mobile robot called “FREIGHT”. This paper also describes the implementation of speech recognition system with robot’s movement according to human’s spoken commands. The system will first convert the audio streams into text through Automatic Speech Recognizer (ASR) using Picovoice API, Natural Language Processing (NLP) is also done on Picovoice framework to retrieve the navigation task, Human-Robot Interaction associated model and use this model information to plan the route. This method is used to provide an efficient approach to translate natural language tasks to machine understandable format.

Experimental Demonstrations