Neural Video Recovery for Cloud Gaming

Cloud gaming is a multi-billion dollar industry. A client in cloud gaming sends its movement to the game server on the Internet, which renders and transmits the resulting video back. In order to provide a good gaming experience, a latency below 80 ms is required. This means that video rendering, encoding, transmission, decoding, and display have to finish within that time frame, which is especially challenging to achieve due to server overload, network congestion, and losses. In this paper, we propose a new method for recovering lost or corrupted video frames in cloud gaming. Unlike traditional video frame recovery, our approach uses game states to significantly enhance recovery accuracy and utilizes partially decoded frames to recover lost portions. We develop a holistic system that consists of (i) efficiently extracting game states, (ii) modifying H.264 video decoder to generate a mask to indicate which portions of video frames need recovery, and (iii) designing a novel neural network to recover either complete or partial video frames. Our approach is extensively evaluated using iPhone 12 and laptop implementations, and we demonstrate the utility of game states in the game video recovery and the effectiveness of our overall design

A mode switching based transient ride‐through phase‐locked loop

Abstract In the case of grid voltage quality problems, the traditional phase‐locked loop (PLL) is hard to detect the accurate grid frequency and phase during the transient response, which will be detrimental to the transient synchronous stability of grid‐connected inverters. This paper proposes a mode switching based transient ride‐through PLL (TRT‐PLL), aiming to improve the transient phase‐locking performance through detection technique and mode switching. The TRT‐PLL incorporates a hybrid filter (HF), a dual‐speed detection module, and a state switch into the traditional synchronous reference frame PLL (SRF‐PLL) structure. The theoretical analysis and paradigm design of TRT‐PLL is presented in detail. Digital simulations and physical experiments are carried out for the comparisons with other existed PLL techniques. The results demonstrate that the satisfied transient performance of the TRT‐PLL has significant advantages, especially in the event of phase jumps