PHAROS 2.0-A PHysical Assistant RObot System Improved

[EN] There are great physical and cognitive benefits for older adults who are engaged in active aging, a process that should involve daily exercise. In our previous work on the PHysical Assistant RObot System (PHAROS), we developed a system that proposed and monitored physical activities. The system used a social robot to analyse, by means of computer vision, the exercise a person was doing. Then, a recommender system analysed the exercise performed and indicated what exercise to perform next. However, the system needed certain improvements. On the one hand, the vision system captured the movement of the person and indicated whether the exercise had been done correctly or not. On the other hand, the recommender system was based purely on a ranking system that did not take into account temporal evolution and preferences. In this work, we propose an evolution of PHAROS, PHAROS 2.0, incorporating improvements in both of the previously mentioned aspects. In the motion capture aspect, we are now able to indicate the degree of completeness of each exercise, identifying the part that has not been done correctly, and a real-time performance correction. In this way, the recommender system receives a greater amount of information and so can more accurately indicate the exercise to be performed. In terms of the recommender system, an algorithm was developed to weigh the performance, temporal evolution and preferences, providing a more accurate recommendation, as well as expanding the recommendation to a batch of exercises, instead of just one.This work was partly supported by the FCT-Fundacao para a Ciencia e Tecnologia through the Post-Doc scholarship SFRH/BPD/102696/2014 and by the Spanish Government TIN2016-76515-R Grant supported with Feder funds.Martinez-Martin, E.; Araujo, A.; Cazorla, M. (2019). PHAROS 2.0-A PHysical Assistant RObot System Improved. Sensors. 19(20):1-18. https://doi.org/10.3390/s192045311181920World Alzheimer Report 2018—The State of the Art of Dementia Research: New Frontiershttps://www.alz.co.uk/research/WorldAlzheimerReport2018.pdfWorld Report on Disabilityhttps://www.who.int/disabilities/world_report/2011/report.pdfGlobal Action Plan for the Prevention and Control of NCDs 2013–2020https://apps.who.int/iris/bitstream/handle/10665/94384/9789241506236_eng.pdfManagement of Physical Health Conditions in Adults with Severe Mental Disorders: WHO Guidelineshttp://apps.who.int/iris/bitstream/handle/10665/275718/9789241550383-eng.pdfPaúl, C., Teixeira, L., & Ribeiro, O. (2017). Active Aging in Very Old Age and the Relevance of Psychological Aspects. Frontiers in Medicine, 4. doi:10.3389/fmed.2017.00181Caprara, M., Molina, M. Á., Schettini, R., Santacreu, M., Orosa, T., Mendoza-Núñez, V. M., … Fernández-Ballesteros, R. (2013). Active Aging Promotion: Results from theVital AgingProgram. Current Gerontology and Geriatrics Research, 2013, 1-14. doi:10.1155/2013/817813Exercises for Older Peoplehttps://www.nhs.uk/Tools/Documents/NHS_ExercisesForOlderPeople.pdfMura, G., & Carta, M. G. (2013). Physical Activity in Depressed Elderly. A Systematic Review. Clinical Practice & Epidemiology in Mental Health, 9(1), 125-135. doi:10.2174/1745017901309010125Unmet Needs: Improper Social Care Assessments for Older People in Englandhttps://www.hrw.org/sites/default/files/report_pdf/uk0119_web3.pdfStefano, M., Patrizia, P., Mario, A., Ferlini, G., Rizzello, R., & Rosati, G. (2014). Robotic Upper Limb Rehabilitation after Acute Stroke by NeReBot: Evaluation of Treatment Costs. BioMed Research International, 2014, 1-5. doi:10.1155/2014/265634Amadeohttps://tyromotion.com/en/produkte/amadeo/Lokomathttps://www.hocoma.com/solutions/lokomat/Riablohttp://www.syncrospain.com/rehabilitacion/G-EO SYSTEM—An Advanced Robotic Gait Trainerhttps://www.rehatechnology.com/en/products/g-eo-systemIREX—Immersive Rehabilitation EXercisehttp://www.gesturetekhealth.com/products/irexFitbithttps://www.fitbit.com/es/homeSergueeva, K., & Shaw, N. (2016). Wearable Technology in Hospitals: Overcoming Patient Concerns About Privacy. Lecture Notes in Computer Science, 446-456. doi:10.1007/978-3-319-39399-5_42Martinez-Martin, E., & Cazorla, M. (2019). Rehabilitation Technology: Assistance from Hospital to Home. Computational Intelligence and Neuroscience, 2019, 1-8. doi:10.1155/2019/1431509Toyrahttp://www.toyra.org/en/Jintronix Rehabilitation System (JRS)http://www.jintronix.com/Gadde, P., Kharrazi, H., Patel, H., & MacDorman, K. F. (2011). Toward Monitoring and Increasing Exercise Adherence in Older Adults by Robotic Intervention: A Proof of Concept Study. Journal of Robotics, 2011, 1-11. doi:10.1155/2011/438514Görer, B., Salah, A. A., & Akın, H. L. (2016). An autonomous robotic exercise tutor for elderly people. Autonomous Robots, 41(3), 657-678. doi:10.1007/s10514-016-9598-5ENRICHMEhttp://www.enrichme.eu/Baillie, L., Breazeal, C., Denman, P., Foster, M. E., Fischer, K., & Cauchard, J. R. (2019). The Challenges of Working on Social Robots that Collaborate with People. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3290607.3299022Canal, G., Escalera, S., & Angulo, C. (2016). A real-time Human-Robot Interaction system based on gestures for assistive scenarios. Computer Vision and Image Understanding, 149, 65-77. doi:10.1016/j.cviu.2016.03.004Makris, S., Karagiannis, P., Koukas, S., & Matthaiakis, A.-S. (2016). Augmented reality system for operator support in human–robot collaborative assembly. CIRP Annals, 65(1), 61-64. doi:10.1016/j.cirp.2016.04.038Tsarouchi, P., Makris, S., & Chryssolouris, G. (2016). Human–robot interaction review and challenges on task planning and programming. International Journal of Computer Integrated Manufacturing, 29(8), 916-931. doi:10.1080/0951192x.2015.1130251Tsarouchi, P., Athanasatos, A., Makris, S., Chatzigeorgiou, X., & Chryssolouris, G. (2016). High Level Robot Programming Using Body and Hand Gestures. Procedia CIRP, 55, 1-5. doi:10.1016/j.procir.2016.09.020Poppe, R. (2010). A survey on vision-based human action recognition. Image and Vision Computing, 28(6), 976-990. doi:10.1016/j.imavis.2009.11.014Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016). DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/cvpr.2016.533Guo, F., He, Y., & Guan, L. (2017). RGB-D camera pose estimation using deep neural network. 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP). doi:10.1109/globalsip.2017.8308674Schwarcz, S., & Pollard, T. (2018). 3D Human Pose Estimation from Deep Multi-View 2D Pose. 2018 24th International Conference on Pattern Recognition (ICPR). doi:10.1109/icpr.2018.8545631Cao, Z., Hidalgo Martinez, G., Simon, T., Wei, S.-E., & Sheikh, Y. A. (2019). OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1-1. doi:10.1109/tpami.2019.2929257Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017). Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/cvpr.2017.143Martinez-Martin, E., & Cazorla, M. (2019). A Socially Assistive Robot for Elderly Exercise Promotion. IEEE Access, 7, 75515-75529. doi:10.1109/access.2019.2921257He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/cvpr.2016.90Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735-1780. doi:10.1162/neco.1997.9.8.1735Example of the Glicko-2 Systemhttp://www.glicko.net/glicko/glicko2.pdfBethancourt, H. J., Rosenberg, D. E., Beatty, T., & Arterburn, D. E. (2014). Barriers to and Facilitators of Physical Activity Program Use Among Older Adults. Clinical Medicine & Research, 12(1-2), 10-20. doi:10.3121/cmr.2013.117