Adobe Max: From Flexible Textile Displays to Insane Video Editing – All of Adobe’s New AI Tech

0

Adobe MAX 2023 is one of the those events that produced so much news, it will be analysed for months. Adobe promotes the event as the world’s largest creativity conference with new tools that make creating content easier. At the core of these tools is generative AI – Adobe Firefly.

We’ll look at the general announcements from the conference in another story but for now, let’s look at what Adobe engineers are planning to rollout in the very near future. Some of these innovations are just extraordinary. I covered a couple of mind-blowing innovations during my weekly Sky News technology segment on Sunday and you can see that clip below.

Watch Djuro Sen explain Adobe MAX innovations on Sky News Weekend Edition

Keep reading for more detail about the 11 inventions that featured in the “Sneaks” showcase.

ADOBE SNEAKS – 2023 PROJECTS

Project Primrose3D & Design

Project Primrose, Adobe says, blurs the line between technology and fashion. In the live demo on stage the crowd was blown away as the dress changed patterns in real time. Flexible textile displays have enormous potential. A ‘live’ creative canvas that can be worn opens up a massive range of possibilities.

The interactive dress on show was displaying content created with Adobe Firefly, After Effects, Stock, and Illustrator.

Project Stardust – Photos

Project Stardust is an object-aware editor that moves or removes objects just by clicking on them. Users can easily select, edit and delete complex elements in any image – enabling them to select persons in a photograph, move them to a different place in the composition and fill in the background where they were previously standing.

Watch Project Stardust demo

Users can also change elements like the colour of a person’s clothing and the position in which they’re standing – treating any image like a file with layers.

Project See Through – Photos

Project See Through is an AI-powered tool that makes it simple to remove reflections from photos. Glass reflections can absolutely ruin your images so it’s best to use a polarising filter when you take the shot. But most people just use a phone so this application is a lifesaver!

Adobe makes reflection removal a snap

Removing reflections using existing software is possible but it can lead to poor results. From what we saw on stage, See Through does a great job and it’s simple.

Project Fast Fill – Video

Project Fast Fill is incredible. By simply typing a prompt in the editor you can change the area selected. In the example below the program created a tie and mapped it to the person’s shirt. This isn’t a big deal for still images but for video .. it’s amazing. This is Adobe starting to flex its AI muscles and it’s going to change everything.

Project Fast Fill offers an early look at what human-prompted generative AI could enable inside Adobe video editing tools including Premiere Pro and After Effects.

Project Scene Change – Video

Project Scene Change makes it easy for video editors to composite a subject and scene, from two separate videos captured with different camera trajectories, into a scene with synchronised camera motion.

Point cloud data is used to make a composition of separate videos

Think about it. You can be anywhere you want and it doesn’t matter if you get the motion or angles wrong.

Project Res Up – Video

Project Res Up is a tool that easily converts video from low-to-high resolution using innovative diffusion-based upsampling technology.

There are many programs that ‘up res’ from lower source video but the results are all over the place. Again, this appears to simplify the whole process with promising results.

Project Dub Dub Dub – Audio

Project Dub Dub Dub is one of those programs that really appears to be magic. It automates the video dubbing process from one language to another. This is usually expensive and time consuming. But Adobe’s shown it can be done at the push of a button.

Thanks to Project Dub Dub Dub’s AI capabilities, a recording or audio track of a video can be automatically translated to all supported languages while preserving the voice of the original speaker, temporally aligned with the original dialogue and ready to publish.

Project Poseable3D & Design

Project Poseable represents a breakthrough in AI-based image generation models, making it easy for the image generator to seamlessly interact with large 3D objects, including poses from photos of real people.

The prototype is integrated with Project Poseable which can create a 3D rendering from text input, take depth and perspective into consideration, and re-align the object. While creating 3D scenes with traditional skeletal systems is technically complex and time-consuming, Project Poseable offers a painless and simple alternative.

Project Neo3D & Design

Project Neo enables creators to incorporate 3D shapes in their 2D designs – all without requiring technical expertise in 3D creation tools.

Today, creators of 2D designs such as infographics, posters, or logos are often limited in their ability to incorporate 3D elements given the complexity of those workflows, which can require years of experience.

Project Neo enables creators to embrace simplified 3D design within 2D tools and methods.

Project Glyph Ease3D & Design

Project Glyph Ease makes customised lettering more accessible by streamlining the tedious design process of glyphs – the specific design and shape elements of each letter character.

Beginning with a hand-drawn letter shape, Project Glyph uses AI to automatically generate an entire set of glyphs matching the input lettering style. Users can then easily edit the generated glyphs in Illustrator.

Project Draw & Delight 3D & Design

Project Draw & Delight can transform a pathetic, simple sketch into a professional drawing worthy of publication. Using generative AI tools, Project Draw & Delight can make anything on paper look good.

Once you’ve improved the scribble using AI, you can experiment with colour palettes, style variations and different backgrounds.

Image Matrix Tech will continue to dive into the Adobe MAX pot of gold over the coming weeks, breaking down the updates and protypes that will make the life of creatives much easier.

NO COMMENTS

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Exit mobile version