MODYS-video: 2D Human pose estimation data and Dyskinesia Impairment Scale scores from children and young adults with dyskinetic cerebral palsy

The dataset contains the 2D coordinates in pixels of body landmarks (wrists, ankles, shoulders, hips, knees and ankles) extracted from 188 videos of 34 children with dyskinetic cerebral palsy using DeepLabCut [1] and appertaining clinical scores of the Dyskinesia Impairment Scale (DIS) [2]. The videos were collected during the item “lying in rest” and “sitting in rest” of the DIS at three time points during a clinical trial on the effect of intrathecal baclofen [3]. Children had a mean age of 14y2m (SD 4.0), 26 were male. Their gross motor function classification system level ranged from IV-V and their manual ability classification system level from III-V. Original videos have length of 4-35 seconds with a resolution of 720x575 pixels and are sampled with 25 Hz. We added stick figures to complement the data for context and ease of understanding. They were created from the 2D coordinates that were extracted with a likelihood >0.8. Clinical scoring was performed by three trained experts (according to the DIS) on the original videos. Within the items “lying in rest” and “sitting in rest” the amplitude and duration of dystonia and choreoathetosis of the trunk, proximal right arm, proximal left arm, proximal right leg and proximal left leg are scored on a 0-4 ordinal scale and calculated towards a percentage score between 0-1. The dataset can be used in a machine learning approach to automatically assess dystonia and choreoathetosis of children with dyskinetic cerebral palsy using 2D coordinates of body points extracted from videos. References: 1. Mathis, A., et al., DeepLabCut: markerless pose estimation of user-defined body parts with deep learning. Nat Neurosci, 2018. 21(9): p. 1281-1289. 2. Monbaliu, E., et al., The dyskinesia Impairment Scale: a new instrument to measure dystonia and choreoathetosis in dyskinetic cerebral palsy. Dev Med Child Neurol, 2012. 54: p. 278-283. 3. Bonouvrie, L.A., et al., The Effect of Intrathecal Baclofen in Dyskinetic Cerebral Palsy: The IDYS Trial. Ann Neurol, 2019. 86: p. 79-90.Grants/Funding: The project is funded by the Netherlands Organization for Health Research and Development (ZonMW, Innovative medical device initiative (IMDI) project number 104022005). Support is provided by the Small-Scale Initiatives in Machine Learning (OpenSSI 2021) of the Netherlands eScience Center. Helga Haberfehlner is funded by the Postdoctoral Fellow Marie Skłodowska-Curie Actions - Seal of Excellence of the Research Foundation – Flanders (SoE fellowship_12ZZW22N)