Real Time Pain Detection Using Facial Action Units in Telehealth System

During the Covid-19 pandemic, to reduce staff exposure to ill people, minimize the impact of patient surges on facilities, and preserve personal protective equipment, the recommendations are made by the World Health Organization to change the way that health care is delivered. Several telehealth systems are utilized including live audio-video interaction or real-time telephone typically with a patient using a computer, smartphone, or tablet. During these appointments, the doctors need to know the pain levels of the patient to be able to prescribe the correct medicine and diagnose the disease proficiently. In this paper, a real-time 4- pain levels recognition based on facial expression during telehealth is proposed. Generally, the pain is measured via verbal communication, normally the patient’s self-report. However, if the patient has a disability and unable to communicate with others due to being impaired mentally or having breathing problems or the child self-reporting may not be a perfect way to measure the pain. The proposed system consists of two methods to detect pain from a patient’s facial expressions. The AAM_Based method detects the face and facial landmarks from each video frame using Active Appearance Model AAM, these landmarks are used to compute the facial features. The AU_Based method uses Facial Action Units AU which objectively describes facial muscle activations that are considered as Region of Interest. Support Vector Machine classifier is utilized to detect the levels of pain. A labeled dataset such as Biovid is used to train test, and the AAM_based method, while and UNBC is used for the second method. The findings show that it is possible to depend on facial expression to detect pain level 1 and level 4 very accurately, while it is very tricky to detect pain level 2, and 3 because the AUs for them are similar for most of the patients