Adobe calls these tools “Sneaks,” and they allow users to make complex edits with simple touches, such as transferring effects across the entire video, realistically controlling lighting, and improving speech pronunciation in audio clips.
Among these tools, Project Frame Forward stands out, enabling editors to add or remove elements from a video without the need for “Masks,” which is a laborious process in video editing.
Adobe provided a practical example of this, removing a woman from the first frame of the video and replacing her with a natural background identical to the scene, with this modification being automatically applied to all subsequent frames. Additionally, users can add new elements to the video using AI-powered text commands.
As for Project Light Touch, it focuses on images, allowing for the reshaping of light sources, direction, and spread within the image. This tool can transform the lighting to appear as if the lamps were lit during the original shooting, or simulate a moving light rotating around people and objects, creating realistic cinematic effects.
The tool also allows changing the color and color temperature of the lighting to create a warm atmosphere or more vibrant colors.
In the field of audio, Adobe presented Project Clean Take, which allows for editing the pronunciation of words or the tone of the voice using artificial intelligence, without the need for re-recording.
For example, the speaker can be made to sound happier or more curious, or entire words can be replaced while maintaining the original voice identity. The system can also separate background noise into independent layers, making it easier to improve sound clarity without losing natural recording elements.
Other tools presented at the conference include:
Project Surface Swap: To instantly change the texture of any surface.
Project Turn Style: To rotate objects within images as if they were three-dimensional.
Project New Depths: To transform images into three-dimensional scenes that can be edited with realistic depth, partially hiding added elements behind existing objects.
Although these tools are still in the experimental stage and not available for general use, some or all of them may become official features within Adobe’s various applications in the future, as happened previously with tools such as “Distraction Removal” and “Harmonize” in Photoshop. (aitnews)
