ADAPTIVE REFERENCE FILTERING FOR BIDIRECTIONAL DISPARITY COMPENSATION WITH FOCUS MISMATCHES

In this paper, we consider compensation of focus mismatches for frames that are encoded with inter-view bi-prediction (B-frames) in multiview coding (MVC). We start with an analysis of a multiview system with focus mismatches, to demonstrate that a B-frame may suffer from different types of mismatches with respect to the frames from different views used as references. As compared to our previ-ous work for inter-view P-frames, filter estimation for B-frames has to consider not only the depth-dependency of focus mismatches, but also i) the possibility that the two predictors, from different direc-tions, exhibit different types of prediction mismatches, and ii) the effect of bi-predictive search on the generation of filtered references. We show that, designing filters only for the averaged bi-predictor could lead to a suboptimal solution when combined with conven-tional bi-predictive search schemes. Instead, we propose a filter de-sign approach that independently estimates depth-related filters for the two references used for prediction. Simulation results shows that for views coded with inter-view bi-prediction, the proposed method provides up to 0.7 dB gain over current H.264/AVC in the sequences we tested. Index Terms — multiview video coding, bi-prediction, focus mismatches, adaptive filtering, disparity compensation 1