Assistive Clothing Pattern Recognition for Visually Impaired People

Abstract—Choosing clothes with complex patterns and colors is a challenging task for visually impaired people. Automatic cloth-ing pattern recognition is also a challenging research problem due to rotation, scaling, illumination, and especially large intraclass pattern variations. We have developed a camera-based prototype system that recognizes clothing patterns in four categories (plaid, striped, patternless, and irregular) and identifies 11 clothing col-ors. The system integrates a camera, a microphone, a computer, and a Bluetooth earpiece for audio description of clothing patterns and colors. A camera mounted upon a pair of sunglasses is used to capture clothing images. The clothing patterns and colors are described to blind users verbally. This system can be controlled by speech input through microphone. To recognize clothing pat-terns, we propose a novel Radon Signature descriptor and a schema to extract statistical properties from wavelet subbands to capture global features of clothing patterns. They are combined with local features to recognize complex clothing patterns. To evaluate the ef-fectiveness of the proposed approach, we used the CCNY Clothing Pattern dataset. Our approach achieves 92.55 % recognition accu-racy which significantly outperforms the state-of-the-art texture analysis methods on clothing pattern recognition. The prototype was also used by ten visually impaired participants. Most thought such a system would support more independence in their daily life but they also made suggestions for improvements. Index Terms—Assistive system, clothing pattern recognition, global and local image features, texture analysis, visually impaired people. I