A proposal for benchmarking learning objects

This article proposes a methodology for benchmarking learning objects. It aims to deal with twoproblems related to e-learning: the validation of learning using this method and the return oninvestment of the process of development and use: effectiveness and efficiency.This paper describes a proposal for evaluating learning objects (LOs) through benchmarking, basedon the Learning Object Metadata Standard and on an adaptation of the main tools of the BENVICproject. The Benchmarking of Learning Objects (bLO) method aims to contemplate the properties ofLOs, their application and stakeholders, and proposes procedures and tools for evaluating LOs. Thismethod does not intend to be a definite or closed system. It defines a working baseline for evaluatingLOs, the first step for creating a more complex and more reliable evaluation system that is constantlyimproving.The paper introduces the guiding principles of the bLO system that provided the guidelines for thedevelopment of the tools. This system includes three main tools, two of which were fully developed,and a complement to improve the applicability of the method. It includes a profiling tool based on theLOM, the benchmarking indicator system, and proposes a competence map as a mechanism forcontinuous improvement. Additionally, a weighting system for efficiency and effectiveness wasdeveloped as a complement to the indicators matrix.The bLO was applied in two different contexts. To test the applicability of this method, three moduleson a Master Course in Construction were used. The information provided by this test was important toimprove the tools, in particular the indicators system. Later, the bLO method was used as anevaluation tool for some of the outcomes of the European Project entitled "E3: Electronically EnhancedEducation in Engineering". This project aimed to develop LOs that were exchanged and evaluatedamong the international partners.Finally, the paper introduces several areas for future work, aiming at improving the system andintegrating it with other systems