From the course: DALL-E: the Creative Process and the Art of Prompting

Altering images with in-painting: Part 2 - DALL-E Tutorial

From the course: DALL-E: the Creative Process and the Art of Prompting

Altering images with in-painting: Part 2

- [Instructor] Now that we have the basics of inpainting down, let's explore how we can use its functionality for other key uses. For example, we've discussed the mutant hands problem and I showed you this image earlier with the double thumb. Well, thanks to a quick pass with inpainting and entering the prompt rabbit fur, that extra thumb is now history and it looks pretty good. And you could also do this with text. So for example, notice the gibberish that is all too common with AI. You can see here on the box for this robot and this old vintage motel sign. However, unlike Photoshop and using Content Aware Fill, DALL-E can detect the font, color, and style and replicate it when fixing one or more of the letters, you know, almost perfectly. So let me just show you how I did it here. Take, for instance, this robot box and motel sign. I mean, clearly they're misspelled. But with a quick selection with the eraser tool and then entering nothing more than BO and OW into the prompt, DALL-E was able to replicate and insert the new letters and it matched the style and the surrounding fonts perfectly. I mean, look at even the owl's claws, how it replicated those with that retro neon. It's so cool. All right, now, altering realism. This is one of my favorite ways to use inpainting, where you take realistic images and then alter them slightly to either improve the realism or take them into the realm of the surreal. For example, here's a highly stylized Scottish landscape with a castle. Now, I can erase this part of the castle using the eraser tool and typing in the prompt a tall castle tower, and DALL-E will deliver just that. There you have it. It looks actually, it's a pretty cool castle there. But I could also, let's say I wanted to replace it entirely. So I could select it. And now entering storm clouds, you can see it removed the castle entirely. Now, if I'm feeling a little crazy, perhaps I want to add a UFO to the scene and type in the prompt a UFO with glowing lights. And there you go. Boom, DALL-E handles it no problem. I mean, you could continue editing this for as long as you'd like making it more real or even surreal, as I've shown here. Now, inpainting with digital photos, this is where it gets incredibly fun because you don't have to start with an AI image. With DALL-E, you can upload digital images, including photos. So let's put that to the test. I'm going to upload into DALL-E this image of San Francisco and I'm going to use the eraser tool to erase this skyscraper. Now, from here I can describe all sorts of new skyscrapers or perhaps even one under construction and DALL-E will understand that this is not only a realistic digital photo of a city skyline, but also the time of day and the direction of light. So when it generates these new inpainted towers, they look quite integrated into the environment, as you can see here with this image of a skyscraper under construction. And here are a few more examples of just a modern glass skyscraper. Again, it matches the lighting almost perfectly. And that's the beauty of DALL-E. Its image analysis abilities are exceptionally good. So in conclusion, inpainting is an incredibly powerful tool for customizing your AI generations to match that vision in your head. And I think we've demonstrated that your first generation is simply the starting point. Now, I'd encourage you to continue to experiment with inpainting on all sorts of genres and styles because at the end of the day, that's the best way to learn. All right, up next, we're going to take a look at tips and tricks for highly photorealistic people and portraits. See you there.

Contents