MFQE 2.0: A New Approach for Multi-frame Quality Enhancement on Compressed Video

The past few years have witnessed great success in applying deep learning to enhance the quality of compressed image/video. The existing approaches mainly focus on enhancing the quality of a single frame, not considering the similarity between consecutive frames. Since heavy fluctuation exists across compressed video frames as investigated in this paper, frame similarity can be utilized for quality enhancement of low-quality frames given their neighboring high-quality frames. This task is Multi-Frame Quality Enhancement (MFQE). Accordingly, this paper proposes an MFQE approach for compressed video, as the first attempt in this direction. In our approach, we firstly develop a Bidirectional Long Short-Term Memory (BiLSTM) based detector to locate Peak Quality Frames (PQFs) in compressed video. Then, a novel Multi-Frame Convolutional Neural Network (MF-CNN) is designed to enhance the quality of compressed video, in which the non-PQF and its nearest two PQFs are the input. In MF-CNN, motion between the non-PQF and PQFs is compensated by a motion compensation subnet. Subsequently, a quality enhancement subnet fuses the non-PQF and compensated PQFs, and then reduces the compression artifacts of the non-PQF. Also, PQF quality is enhanced in the same way. Finally, experiments validate the effectiveness and generalization ability of our MFQE approach in advancing the state-of-the-art quality enhancement of compressed video. The code is available at https://github.com/RyanXingQL/MFQEv2.0.git.Comment: Accepted to TPAMI in September, 2019. v6 updates: correct units in Fig. 11; correct author info; delete bio photos. arXiv admin note: text overlap with arXiv:1803.0468

Analyzing the prices of the most expensive sheet iron all over the world: Modeling, prediction and regime change

The private car license plates issued in Shanghai are bestowed the title of "the most expensive sheet iron all over the world", more expensive than gold. A citizen has to bid in an monthly auction to obtain a license plate for his new private car. We perform statistical analysis to investigate the influence of the minimal price $P_{\min}$ of the bidding winners, the quota $N_{\rm{quota}}$ of private car license plates, the number $N_{\rm{bidder}}$ of bidders, as well as two external shocks including the legality debate of the auction in 2004 and the auction regime reform in January 2008 on the average price $P_{\rm{mean}}$ of all bidding winners. It is found that the legality debate of the auction had marginal transient impact on the average price in a short time period. In contrast, the change of the auction rules has significant permanent influence on the average price, which reduces the price by about 3020 yuan Renminbi. It means that the average price exhibits nonlinear behaviors with a regime change. The evolution of the average price is independent of the number $N_{\rm{bidder}}$ of bidders in both regimes. In the early regime before January 2008, the average price $P_{\rm{mean}}$ was influenced only by the minimal price $P_{\min}$ in the preceding month with a positive correlation. In the current regime since January 2008, the average price is positively correlated with the minimal price and the quota in the preceding month and negatively correlated with the quota in the same month. We test the predictive power of the two models using 2-year and 3-year moving windows and find that the latter outperforms the former. It seems that the auction market becomes more efficient after the auction reform since the prediction error increases.Comment: 10 pages including 5 figures and 4 table