4 years on: Evaluating the quality and effectiveness of Data Management Plans

Originally presented at eResearch Australasia Conference 18 October 2018 by Janice Chan. Extended abstracthttps://conference.eresearch.edu.au/2018/08/4-years-on-evaluating-the-quality-and-effectiveness-of-data-management-plans/IntroductionThe Data Management Planning (DMP) Tool at Curtin University was developed in 2014. Since its launch, Curtin staff and students have created over 4,800 Data Management Plans (DMPs). While the high number of DMPs created is encouraging, it may or may not have a direct correlation to improved data management practice. This presentation outlines the actions being taken at Curtin University to evaluate the effectiveness of DMPs, and how the analysis of DMP data is being used to improve provision of services to support research data management.DMPs at CurtinThe DMP Tool is embedded in the research life cycle at Curtin University. DMPs are mandatory for researchers requiring human and animal ethics approval. Higher Degree by Research students must submit a DMP on candidacy application. Researchers who require access to the Curtin research data storage facility (R drive) must also complete a DMP.DMP analysisIn 2018, 4 years since the launch of the DMP Tool, the Library analysed DMP data and gained some useful insights. The data answered questions such as which faculty produced the most DMPs? How many DMPs have been updated since creation? How much storage was actually used as opposed to storage requested? When are the peak times for DMP creation? This information has been useful for providing support services.Questions in the DMP Tool are mostly optional, and DMPs created are not reviewed except for DMPs submitted for ethics or candidacy applications. While the DMP data indicated that the majority of optional questions were not left blank, this in iteslf is not an indicator of quality metadata in DMPs, nor does it demonstrate that DMPs have improved research data management practice at Curtin. This requires further investigation.Evaluating the effectiveness of DMPsBased on the research question “Do DMPs improve research data management practice?” the Library collaborated with the School of Media, Creative Arts, and Social Inquiry at Curtin University to address this question through the work of a Masters student. Library staff are now working with the research student and her supervisor to develop the scope of the research project, methodology, and expected outputs.Survey questions have been developed with input from the Library and the Research Office. Invitations to complete the survey will be sent out to researchers who have completed at least one DMP, and will be sent from the Research Office in order to maximize response rate. Respondents can opt in to participate in focus groups to discuss the survey questions further with the researcher.The research project will be completed by the end of 2018, with an expected output of a Masters by Coursework thesis and a report outlining the findings and recommendations.