Scene parsing with multiscale feature learning, purity trees, and optimal covers. arXiv preprint arXiv:1202.2160

Scene parsing, or semantic segmentation, consists in la-beling each pixel in an image with the category of the object it belongs to. It is a challenging task that involves the simul-taneous detection, segmentation and recognition of all the objects in the image. The scene parsing method proposed here starts by com-puting a tree of segments from a graph of pixel dissimilari-ties. Simultaneously, a set of dense feature vectors is com-puted which encodes regions of multiple sizes centered on each pixel. The feature extractor is a multiscale convolu-tional network trained from raw pixels. The feature vec-tors associated with the segments covered by each node in the tree are aggregated and fed to a classifier which pro-duces an estimate of the distribution of object categorie