IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING 1 An Android for Enhancing Social Skills and Emotion Recognition in People With Autism

Abstract—It is well documented that the processing of social and emotional information is impaired in people with autism. Recent studies have shown that individuals, particularly those with high functioning autism, can learn to cope with common social situa-tions if they are made to enact possible scenarios they may en-counter in real life during therapy. The main aim of this work is to describe an interactive life-like facial display (FACE) and a supporting therapeutic protocol that will enable us to verify if the system can help children with autism to learn, identify, interpret, and use emotional information and extend these skills in a socially appropriate, flexible, and adaptive context. The therapeutic setup consists of a specially equipped room in which the subject, under the supervision of a therapist, can interact with FACE. The an-droid display and associated control system has automatic facial tracking, expression recognition, and eye tracking. The treatment scheme is based on a series of therapist-guided sessions in which a patient communicates with FACE through an interactive console. Preliminary data regarding the exposure to FACE of two children are reported. Index Terms—Autism, biomimetics, recognition of emotional ex-pressions, robot-based treatment method, social attention. I