Human Machine Interface

How do we communicate with robot? Not only the one-way control, but also the two-ways feedback. In this photograph, we have a Baxter robotic arm with 3D-printed prosthetic hand on the left, holding the hand of an unimpaired subject on the right with ultra-thin, flexible and skin-mounted electronic tattoo to provide electromyography control signal and receive current stimulation feedback. Our research involves integrating temperature sensor, strain sensor, electromyography sensor and stimulation electrodes in one flexible and stretchable patch with optimal skin compliance to deliver sensorimotor control and feedback to patients with prosthesis. Upon flexing or extending the skeletal muscle in the forearm, the serpentine-structured gold electrode adhered to skin will pick up unique localpotential signals correspond to the hand gesture. This signal will be used for controlling the prosthesis through software classification. While increasing the griping force on the prosthesis, a pressure sensor on the fingertip will transform the pressure signal into stimulating current intensity and deliver to the control subject. A sensorimotor feedback loop, thus human machine interaction, is now enabled.Ope