Whereas the content details, which we want to keep when translating an image into another style, can be adaptively refined on high-frequency components. This is achieved by optimizing the fact that illumination and color manipulation, which relates to the style of an image, is contained in the low-frequency component of an image.
It is faster than all these approaches on 480p image translations! And yes, it is not eight times faster, but 80 times faster on average! But how is that possible? How can they be so much more efficient and still produce amazing and high-quality results? They could translate 4K images in not even a tenth of a second using a single regular GPU. Look at how much less time it took LPTN to produce the image translations where most approaches cannot even do it as this amount of definition is just too computationally demanding. Here, you can see their technique below called LPTN, which stands for Laplacian Pyramid Translation Network. These are the most amazing results of this paper: Please look at their paper or try their code if you are not convinced! Of course, the images here were taken from their paper, so it might not look that high-quality here. This task is also known as 'image-to-image translation', and all the results you see here were produced in 4K. In this work, they showed their results on season translation, night and day translations, and photo retouching, which you've been looking at just above. Indeed, compared to most approaches, they translate high-definition 4K images, and this is done in real-time. This new paper is completely transparent towards this as it attacks exactly this problem. What you have not seen yet is the time it takes to produce these results and the actual resolutions of the produced pictures. (top) Summer to winter translation and (bottom) day to night translation. Here, an even more challenging task could be something like this, where an image is transformed into another season or time of the day. Many of you must have seen other kinds of image transformations like this, where an image is changed to follow the style of a certain artist. You've all seen these kinds of pictures where a person's face is "toonified" into an anime character. 6 min read Watch the video and support me on YouTube!.
0 kommentar(er)
