Spatio-temporal pyramid matching for sports videos

In this paper, we address the problem of querying video shots based on content-based matching. Our proposed sys-tem automatically partitions a video stream into video shots that maintain continuous movements of objects. Finding video shots of the same category is not an easy task be-cause objects in a video shot change their locations over time. Our spatio-temporal pyramid matching (STPM) is the modified spatial pyramid matching (SPM) [12], which considers temporal information in conjunction with spatial locations to match objects in video shots. In addition, we model the mathematical condition in which temporal infor-mation contributes to match video shots. In order to im-prove the matching performance, dynamic features includ-ing movements of objects are considered in addition to static features such as edges of objects. In our experiments, sev-eral methods based on different feature sets and matching methods are compared, and our spatio-temporal pyramid matching performed better than existing methods in video matching for sports videos