Delayed reinforcement learning for adaptive image segmentation and feature extraction

Abstract—Object recognition is a multilevel process requiring a se-quence of algorithms at low, intermediate, and high levels. Generally, such systems are open loop with no feedback between levels and assuring their robustness is a key challenge in computer vision and pattern recognition research. A robust closed-loop system based on “delayed” reinforcement learning is introduced in this paper. The parameters of a multilevel system employed for model-based object recognition are learned. The method improves recognition results over time by using the output at the highest level as feedback for the learning system. It has been experimentally validated by learning the parameters of image segmentation and feature extraction and thereby recognizing 2-D objects. The approach systematically controls feedback in a multilevel vision system and shows promise in approaching a long-standing problem in the field of computer vision and pattern recognition. Index Terms—Adaptive feature extraction, adaptive image segmenta-tion, learning for multilevel vision, learning in computer vision, model-based recognition, multiscenario object recognition, recognition feedback. I