/cdn.vox-cdn.com/uploads/chorus_asset/file/25415361/Adobe_VideogigaGAN_hed_hero.jpg?fit=%2C&ssl=1)
VideoGigaGAN: Adobe’s Breakthrough in Upscaling Blurry Videos
The Next Level of AI Upscaling
Adobe researchers have made significant strides in the field of video super resolution with their latest generative AI model called VideoGigaGAN. This innovative technology allows for the upscaling of blurry videos up to eight times their original resolution, all while maintaining fine-grained details without any visual artifacts. Unlike previous methods, VideoGigaGAN provides exceptional results without introducing the typical “AI weirdness” associated with video upscaling.
The Challenges of Upscaling Videos
While Generative Adversarial Networks (GANs) have proven effective in upscaling still images, dealing with video footage poses additional challenges. Previous attempts often resulted in flickering and other unwanted artifacts, while alternative methods sacrificed sharpness and detail. Bridging this gap, VideoGigaGAN combines the high image and video quality of GAN models with remarkable suppression of flickering and distortion across multiple frames. Adobe has showcased its remarkable work in full resolution through various examples, which clearly demonstrate the effectiveness of VideoGigaGAN. (examples here)
Surpassing Artificiality, Embracing Complexity
Adobe’s demo clips reveal the remarkable capabilities of VideoGigaGAN. Although certain details generated by the AI, such as skin texture and creases, may seem entirely artificial, one cannot deny their impressively natural appearance. This breakthrough in video resolution enhancement challenges the notion of “what is a photo,” bringing the debate to the realm of video.
Exploring Future Implementation
While Adobe’s VideoGigaGAN is currently available as a research preview, its potential integration into Adobe’s Creative Cloud software, such as Premiere Pro, remains uncertain. Adobe has previously introduced another innovative experiment aimed at enhancing the quality of low-resolution GIFs and video footage, called Project Res-Up. In this field of video super resolution, Adobe faces competition from major players like Microsoft and Nvidia, who have also developed their unique VSR upscaling technologies.
