SPOKEN INTERACTION BETWEEN HUMAN AND MACHINE: MULTILINGUAL HELPDESK SYSTEM

Interaction between human and machine has been investigated to communicate with machine by using eyeball tracking, voice tone and gesture speed methods to teach the machine with human factors involved. In this project, spoken interaction between human and machine method is explained and demonstrated by using a school international office "helpdesk" system. International students can speak their fu-st language to this system which can be called "user friendly" system. When student speaks to this system, they will feel as comfortable as speaking to a real receptionist. The premier aim of this project is to distinguish which language user speaks to the system according to the first utterance, and then the system can switch to the desired language interface. A good grammar structure can provide an ability to the system to deal with real-time decision making response to user that are explained and discussed