Painting during the journey: a comprehensive guide

In today’s digital landscape, the integration of AI with creative tools has reshaped the boundaries of possibilities. A notable advancement in this area is Midjourney’s Inpainting tool. Aimed at digital artists, graphic designers, or even those with a keen interest in technology, this guide provides a detailed overview and step-by-step explanation of Midjourney’s latest tool.

Understanding painting

Inpainting is like the digital version of art restoration. Imagine an old painting with scratches or faded spots; traditionally, an artist carefully filled in these imperfections, making them blend seamlessly with the surrounding details. In the digital world, inpainting now does the same for images or videos. It is a technique that fills missing or defective parts with details that match the environment. So if you have a photo with an unwanted object, inpainting can “paint over” that object, making it look like it was never there.

It’s like digital reconstructive surgery for damaged artwork. Now, with Midjourney’s inpainting tool in the mix, this restoration reaches a whole new level of precision.

Why the tool is a GameChanger

Midjourney’s Inpainting Tool has really taken the creative output for the infamous image generator to the next level. Before its introduction, artists and digital creators faced limited options when looking for changes to an image. The most common routes involved tinkering with different clues, asking Midjourney to generate more image variations, or diving into tedious manual edits using platforms like Photoshop or other editing tools.

With the Inpainting Tool, Midjourney has now bridged the gap between AI-driven adjustments and manual adjustments. This tool allows users to seamlessly target specific areas in an image for changes, all without compromising the originality or aesthetics of the entire piece. The ease and precision this tool offers make it an undeniable game changer in the world of AI-generated imagery.

How to paint

In Midjourney, the attribute designated for inpainting is labeled ‘Vary Region’. Using Vary Region, users can select certain parts of their canvas for the bot to modify. By default, Midjourney autonomously determines the most suitable method to tackle these chosen areas. Still, there is an option called ‘remix’ which, when enabled, allows users to guide the change process using a different or custom prompt. This provides a level of customization and flexibility in the image editing workflow. It is important to note that the Vary(Region) function is supported by Midjourney model versions V5.0, V5.1 and V5.2.

1. Enable Remix mode: Use the /settings command.
2. Generate an image: Start with the /imagine command. An example prompt might be “pasture path lithography.”
3. Luxury: Use the U buttons to improve the resolution of the image.
4. Enter the editing interface: Click the Vary (Region) button.
5. Choose areas for change: Use the freehand or rectangular selection tools (bottom left of the editor) to select the image parts you want to change. The size of your selection can affect the final result: larger areas can result in more noticeable changes, while smaller areas can yield subtle edits.
6. Give instructions: Customize the initial prompt to specify the desired changes. For best results, it is important to be clear in your instructions.
7. Submit for processing: Click the Submit button. The image is then processed by the Midjourney Bot and you can return to your Discord chat in the meantime.

Once an image has been scaled up, the “Vary Region” button will become visible. Clicking on it activates a pop-up window, allowing the paint-in process to begin. According to Midjourney’s official documentation, the following tab will appear on your screen:

Inpainting can be used to remove unwanted items in an image or change specific parts of the image as desired. It works by intelligently filling in the selected area with relevant and cohesive content from the surrounding areas of the image. For example, if there’s an unwanted subject in a scenic landscape, inpainting can seamlessly erase that subject, leaving a flawless panorama. What’s even more impressive is the tool’s ability to change subjects without affecting the rest of the image. So if you want to change the color of a dress or character details within a photo, inpainting adjusts only the desired object, leaving the rest of the artwork untouched. This creates a natural and cohesive look after processing, preserving the original essence of the image.

The Vary Region Editor in Midjourney offers a range of tools, including undo, freehand drawing, rectangle selection, and inpainting prompt, along with window customization options. For optimal inpainting results, it is recommended to focus on 20-50% of the image, although minor edits can also make an impact. This versatile tool can modify emotions, introduce elements and even change someone’s outfit.

Potential challenges

It’s important to keep in mind that while inpainting is a robust tool, it can occasionally fall short of expectations. There may be instances where this doesn’t match the lighting or overall context of a particular image.

It can sometimes produce unexpected or peculiar results, requiring several attempts before the desired result is achieved. Moreover, there is a learning curve associated with Inpainting. New users may find that the tool does not always interpret the desired changes intuitively. Factors such as the size, shape, and positioning of the chosen area can all affect the output of the tool, sometimes requiring adjustments and iterations.

Artists and makers around the world have been continuously sharing their unique findings and experiments using the new inpainting tool since the recent announcement. Below we see another great example of the tool recreating an entire character based on the creator’s prompt.

Inpainting is undoubtedly powerful and can dramatically change the context and composition of images. Like any tool, it takes practice and an understanding of its idiosyncrasies to master. This guide provides a comprehensive understanding of how to use the Inpainting feature in Midjourney. But like all software tools, true mastery comes from practice and experimentation.