Re-evaluating colour constancy algorithms

This work is concerned with the evaluation of the relative performance of colour constancy algorithms. We highlight some problems with previous algorithm evaluation and define more appropriate testing procedures. We discuss how best to measure algorithm accuracy on a single image as well as suitable methods for summarising errors over a set of images. We also discuss how the relative performance of two or more algorithms should best be compared and we define an experimental framework for testing algorithms. We re-evaluate the performance of six colour constancy algorithms using the procedures we set out and show that this leads to a significant change in the conclusions we draw about relative algorithm performance as compared to previous work. c © 2006 Optical Society of America OCIS codes: 150.0150, 330.1690