Real-time and embedded systems

Neural signals are everywhere just like mobile phones. We propose to use neural signals to control mobile phones for hands-free, silent and effortless human-mobile interaction. Until recently, devices for detecting neural signals have been costly, bulky and fragile. We present the design, implemen-tation and evaluation of the NeuroPhone system, which al-lows neural signals to drive mobile phone applications on the iPhone using cheap off-the-shelf wireless electroencephalo-graphy (EEG) headsets. We demonstrate a brain-controlled address book dialing app, which works on similar princi-ples to P300-speller brain-computer interfaces: the phone flashes a sequence of photos of contacts from the address book and a P300 brain potential is elicited when the flashed photo matches the person whom the user wishes to dial. EEG signals from the headset are transmitted wirelessly to an iPhone, which natively runs a lightweight classifier to dis-criminate P300 signals from noise. When a person’s contact-photo triggers a P300, his/her phone number is automati-cally dialed. NeuroPhone breaks new ground as a brain-mobile phone interface for ubiquitous pervasive computing. We discuss the challenges in making our initial prototype more practical, robust, and reliable as part of our on-going research