This review is a year-end series that highlights 10 amazing AI projects in photo and video in 2020.
Even though many people are practicing social distancing in 2020, nothing could stop the progress of technology, especially artificial intelligence. Clearly, AI is changing almost all aspects of our lives. More and more AI projects and ideas are coming out and AI has been evolving faster than you can imagine.
In year 2020, we have seen a lot of AI products and projects that have a great impact on our work and lives. Among them, AI projects in photo and video are bringing amazing applications that entertain us in many ways. Hence, in this full-year review about AI projects, we will highlight 10 amazing AI projects and tools in photography and video.
Also read: Top 10 AI Image Diff Checkers Review 2021.
Top 10 Amazing AI Projects in Photo & Video
- 1.Face Depixelizer PULSE
- 2. DeepFaceDrawing: Generate Face from Sketches
- 3. Toonify-Turn Face to Cute Disney Character
- 4. Restore Old Vintage Photos with the AI Project
- 5. OpenAI’s Image GPT Model: Predict the End of Your Image
- 6. White-Box Cartoonization-Turn your image & video into a cartoon
- 7. Latest Video Inpainting using STTN
- 8. Deoldify-Bring Back Missing Colors in B&W Images & Videos
- 9. Unscreen – Say Goodbye to Green Screen
- 10. Is Mosaic Safe? This AI Project Can Remove Text Mosaic
Top 10 Amazing AI Projects in Photo & Video
1.Face Depixelizer PULSE
This AI face depixelizer is an AI project launched on June 20 this year, which is available on Github. It is amazing to see how the new algorithm transforms pixelated and blurry face photos into clear and lifelike ones. There are lot of tweets about this AI that entertained us in an interesting way.
Read the previous news about PULSE here: This AI Remove Pixelation from Pixelated Faces.
2. DeepFaceDrawing: Generate Face from Sketches
Previously, we have covered an amazing AI tool aiportraits.online to turn photo into line drawing. But AI is beyond your imagination. In 2020, generating face from a rough freehand sketch has been possible via deep image-to-image translation techniques. DeepFaceDrawing, the AI project available on GitHub, makes it possible for those with no training experience to get high-quality face images from incomplete sketches. The algorithms are smart enough to assemble the eyes, nose, mouth and other facial element from an incomplete sketch.
3. Toonify-Turn Face to Cute Disney Character
Ever wonder how you would look like in Disney world? Toonify can transport you into an animated world of Disney characters using deep learning and Generative Adversarial Networks. Developed by Justin Pinkney and Doron Adler, Toonify allows you to turn yourself into a cartoon-style character as if made by Pixar and Dreamworks.
4. Restore Old Vintage Photos with the AI Project
Restoring old damaged photos used to be time-consuming. Traditional method using supervised learning always fail to bring back our memories. To change the game filed, researchers who published the paper titled Old Photo Restoration via Deep Latent Space Translation created a novel triplet domain translation network, which leverages real photos along with massive synthetic image pairs.
To access AI applications for vintage photo restoration, you can refer to this review: Top 10 AI Photo Restoration Software and AI-Powered Tools Review in 2021
5. OpenAI’s Image GPT Model: Predict the End of Your Image
Predicting text helps us increase efficiency in communication. The case is true when you write an e-mail via Gmail. But predicting what is coming next in images is another mind-blowing thing. OpenAI, an AI research lab, uses Image GPT model to generate the rest of an image automatically. GPT, or generative pre-trained transformer, was employed to predict and generate text. But now, this architecture can help generate pixel values and images
6. White-Box Cartoonization-Turn your image & video into a cartoon
According to an AI paper “Learning to Cartoonize Using White-box Cartoon Representations”, researchers use a Generative Adversarial Network (GAN) framework to turn your image into cartoons.
The open source architecture is now applied in this AI cartoonizer app online, which is a demo project. With the AI cartoonizer, you can turn any photos or home videos into cute cartoons.
7. Latest Video Inpainting using STTN
In our popular post Top 10 Inpaint Alternatives in 2021 to Remove Object from Photo Review, many readers have learned how to get rid of unwanted object from images. But if you think removing your ex from an image seamlessly is the limit of AI, then look at this AI for video inpainting. An AI project from the paper Learning Joint Spatial-Temporal Transformations for Video Inpainting aims to use a joint Spatial-Temporal Transformer Network (STTN) for video inpainting. It helps fill up the missing pixels behind an object in a clip without much blurriness and artifacts.
8. Deoldify-Bring Back Missing Colors in B&W Images & Videos
Available on Google Colab, a simplified version of Deoldify Colab Notebook allows you to instantly turn a classic black and white video into a modern footage. Apart from videos, DeOldify lies behind many AI tools that add colors to grayscale photos, including MyHeritage. Check out this: Top 15 AI Photo Colorizers to Colorize Black and White Photos 2021
9. Unscreen – Say Goodbye to Green Screen
When AI comes into play, you can say goodbye to traditional video-making using green screen. Unscreen is a video background removal tool that allows you to get rid of video background in one click. This AI is a boon for e-commerce professionals and individuals. There is no need for chroma keying and green screens. Click here for more alternatives to Unscreen: Top 15 Tools to Remove Green Screen 2021.
10. Is Mosaic Safe? This AI Project Can Remove Text Mosaic
Removing text mosaic from photos can be easily made with this amazing yet a bit terrifying AI, Depix. This AI project on GitHub uses algorithms to remove mosaic or pixelization from text, like text password. Next time when you want to censor your password with a black box, remember AI is making progress. A better way out is to totally cut out that secret parts.
The top 10 AI projects in this post are mainly changing our mindset in images & videos. But AI is becoming ubiquitous. In 2020, we see many headlines about auto-piloting, AI writing, AI music, AI bots and more.
AI is making improvements, but this is like the two sides of a coin. Behind the breakthroughs lie some ethical issues and biases we should never overlook. For example, removing text mosaic involves privacy issues that concern everyone. Yet, nothing can stop the trend of AI. In 2021, more and more amazing AI projects, ideas, tools are expected to come out. For latest AI projects and tools, follow TopTen.AI on YouTube Channel.