Multi-modal Heart-Beat Estimation on an iPhone

Current generation smartphone video cameras and microphones enable photoplethysmography (PPG) and phonocardiography (PCG) acquisition. In this thesis, I utilized the iPhone microphone and camera to measure heart rate. We developed a heart rate measurement system using triple sensing mechanisms (finger and face color changes and heart sound measurement) all on the iPhone. The three proposed measurement systems each provide an independent heart rate estimate, as well as a combined estimation based on the fusion of the individual sensors.The proposed algorithm estimates the heart rate by (1) heart pulse analysis to compute the heart rate of the user using our version of the EMD algorithm which is used in advanced biomedical signal processing, (2) assessing the quality of the PPG and PCG waveforms using the Support Vector Machine (SVM) classifier,(3) concisely combining heart rate information from the three different modalities based on the assessed quality of the waveforms.M.A.S