A Performance Evaluation Protocol for Graphics Recognition Systems

Abstract. This paper defines a computational protocol for evaluating the performance of raster to vector conversion systems. The graphical entities handled by this protocol are continuous and dashed lines, ares, and circles, and text regions. The protocol allows matches of the type one-to-one, one-to-many, and many-to-one between the ground truth and the recognition results. 1 Int roduct ion Systems which convert existing paper-based drawings into electronic format are in demand and a few have been developed. However, the performance of the pro-totypes and commercial systems is either unknown, or only reported in a limited way by the system developers. An evaluation for these systems, or their sub-systems, would contribute to the advancement of the field. Responding to this need, a dashed-line detection competition for developers of dashed-line detection algorithms was proposed and took place during the first International Workshop on Graphics Recognition at Penn State University, in 1995. A benchmark[l] wa