Step 1: Read this article.
Step 2: Turn on your computer.
Step 3: Download and install.
Hello everyone, good start! I am a horse who has been working for four days to open a position.
The Spring Festival holiday is finally over, the hometown blizzard New Year can not go out, idle is also idle, it is better to soak in the B station to relive the childhood animation. Work or something, has long been left behind (A, no.
Even if you watch cartoons, you are learning open source knowledge. In order to prove that I do not give up the hard work of learning during the holidays, I will share with you the research results of seven days at home today.
01
Three pop-up models with restored picture quality
I think back then, the memory of "Black Cat Sheriff" is full of flickering, shaking, speckled film visuals, full of an ancient taste. Nowadays, watching old cartoons at Station B can turn into high definition in a second.
Behind the technology that makes old anime images hd stands a super-resolution model of universal anime images, Real-CUGAN. This project is a model of the animation and comic quality of station B officially developed for repairing station B, and has now been open sourced.
Real-CUGAN, full name Real Cascade U-Nets for Anime Image Super Resolution. It is understood that Real-CUGAN supports 2x/3x/4x super resolution, of which the 2x model supports 4 kinds of noise reduction intensity and conservative repair, and the 3 times/4 times model supports 2 kinds of noise reduction intensity and conservative repair.
In addition, the training code used by Real-CUGAN is derived from a million-level anime data RealESRGAN, and its structure is compatible with the previous explosive super-sub-model Waiuf2x. Both of these super-resolution models have been open sourced, and both have been popular throughout the network.
So, where did they come from?
One day, a Japanese technical house was brushing papers to study, and he was thinking about whether he could reduce the noise and enlarge an image so that the unclear illustration picture became clear. So, he artificially artificially intelligent neural network operations, reduced a bunch of GAL pictures, and then placed the original pictures together, so that waifu to learn how to enlarge and stretch. Thus waiuf2x was born.
Simply put, Waiuf2x is a two-dimensional image lossless enlargement software that provides a variety of functions such as noise reduction, amplification, noise reduction and amplification. However, with the expansion of the scope of application, not only secondary pictures, other pictures and 4K wallpapers can be used.
Unlike Waiuf2x, RealESRGAN's R&D lineup is luxurious. Tencent has a research institute that can be called Tencent PCG's "Scout" and "Special Forces", and they have always stood at the forefront of Tencent's exploration and challenge of cutting-edge technologies related to intelligent media, which is Tencent ARC Lab.
In September 2021, the team published an image super-resolution model called RealESRGAN, which can effectively eliminate ringing and overshoot artifacts in low-resolution images, while also restoring detail more realistically. This is not the first, in fact, RealESRGAN is a complete and in-depth study of its predecessor ESRGAN, so that it can more accurately repair images.
However, some people may wonder that the three popular super-score models are excellent, but which one should be learned to use? Or is there a model that can become a set of all three?
02
Recommend a super-resolution model that integrates the masters
Today, we will introduce you to a program that is open source on Gipete and has obtained 525 stars and a Gitee index of 17%. It integrates Waifu2x, Real-ESRGAN, Real-CUGAN, as well as numerous models such as SRMD, Anime4K, RIFE, CAIN, DAIN and ACNet., and provides magnification and noise reduction (super resolution) and video reframe (interframe) for images, GIFs and videos.
This model is the Waifu2x-Extension-GUI.
Open Source Licenses:
Project Author:
aaronfeng
Project Description:
This is a very easy to use picture enlargement and noise reduction tool, with the help of deep convolutional neural network can enlarge the picture or GIF map to the size you want, and will not blur, but will become clearer and clearer, but also support the optimization of GIF gifs and video frame/interpolation.
Project Address:
https://gitee.com/aaronfeng0711/Waifu2x-Extension-GUI
Model features:
1. Automated processing of multiple media: Support for processing pictures at the same time, realize the automatic processing of GIF &APNG and video.
2. Full image style support: Built-in a variety of algorithms, whether it is two-dimensional anime or your daily photos & videos, can be clear processed.
3. Video interpolation (framing): After super-resolution video, the video is automatically interpolated to improve video fluency.
4. Video screen analysis: Intelligently analyze the video screen to speed up video processing and improve video quality.
5.Powerful compatibility: Built-in multiple engines, compatible with almost all modern Windows PCs.
6. Flexible multi-threading settings: While providing complete settings for each engine, you can also freely adjust the number of threads to make full use of all the performance of the PC.
7. Multi-GPU support: All built-in engines can support multi-graphics cards, making full use of all the performance of your PC.
8.Numerous custom settings: You can achieve an automated workflow by adjusting many custom settings within the software.
9. Smart Settings: This software can automatically adjust some software settings according to your PC hardware information and the information you want to process files.
10.Easy to use graphical user interface.
Built-in algorithm code:
内置超分辨率算法:
Waifu2x / SRMD / RealSR / Real-ESRGAN/ Real-CUGAN / Anime4K / ACNet
内置超分辨率引擎:
Waifu2x-caffe / Waifu2x-converter / Waifu2x-ncnn-vulkan
SRMD-ncnn-vulkan / RealSR-ncnn-vulkan / Anime4KCPP / SRMD-CUDA
RealESRGAN-NCNN-Vulkan / Real-CUGAN
内置插帧算法:
RIFE / CAIN / DAIN
内置插帧引擎:
rife-ncnn-vulkan / cain-ncnn-vulkan / dain-ncnn-vulkan Operation legend:
Demo Demo:
2D Anime:
GIF GIF:
Before
After
Action download URL:
https://pan.baidu.com/s/1TO4a_N2QP1lfxWEbVUYVww?pwd=8jjg, if you are interested, you can also go directly to the author's warehouse https://gitee.com/aaronfeng0711/Waifu2x-Extension-GUI, download and use it.