Gigapixel AI has successfully upgraded the old footage created in 1896 to 4K resolution of 60fps.
Specifically, Gigapixel AI, created by DAIN and Topaz Labs, incorporates an exclusive AI-based interpolation algorithm to "analyze, detect details, structure to complete images". This algorithm, created by Topaz, is supposed to teach AI to sharpen and clarify images even when they are zoomed in at 600%.
DAIN, meanwhile, will create another algorithm that will fill in pixels, as well as create similar frames to "fill" the main frame, speeding up to 60fps. Basically, this is similar to the motion smoothing feature on current 4K TV models.
The film chosen to recover is the Arrival of a Train at La Ciotat, 50 seconds in size, was born in 1896 with very low image quality, low resolution due to the limited technology of movie recording at that time. This work has been impressive when it premiered, even the audience ran away or dodged to the side when seeing the image of the train approaching.
The revival of old footage to 4K has been a prime example of resolution upgrade technology, which has been an essential part of entertainment since 1998, when high-definition TVs appeared on the market.
High-definition TVs used to be HD (720 x 480 pixels), which means the total number of pixels displayed at the same time is about 345,600. Next, they gradually upgraded to Full HD (1,920 × 1,080 pixels), or 2,073,600 pixels. 4K movies with a resolution of 3,840 x 2,160 pixels now reach 8,294,400 pixels.
Thus, to help an HD resolution video can fill 4K frames without affecting the image quality, the number of pixels needed to add about 6 million. Want to do this, the software will perform the interpolation operation: estimate each pixel will display based on what the pixels around them. This is also the way most TV manufacturers are applying to their products.
Basically, the interpolation process is based on the speculation of the machine, so the accuracy may not be high. To improve, experts have put AI in for optimal, by integrating deep learning programs with artificial neural networks. For example, Gigapixel AI can use AI to analyze and map frames in the clip, then insert additional frames, finally output the Arrival of a Train at La Ciotat video at 4K resolution.
Of course, the recovery was only successful at a basic level. Arrival of a Train at La Ciotat looks great when displayed on YouTube, but there are still many drawbacks to showing on a true 4K display. When looking at the details of the scene, everything like backdrops, transitions and many other things will not be seamless, "said Chris Schodt, Engadget's video producer.