Are you familiar with Stable Diffusion and its ability to expand images in all directions? This technique, known as outpainting, allows for creating a cohesive background outside the image frame. This article will provide a step-by-step guide on achieving this using the AUTOMATIC1111 GUI. Additionally, we will introduce other painting models that can serve as alternative options.<\/p>\n

Step-By-Step Guide<\/h2>\n

To prepare your image, start by centering it and adjusting its size to landscape orientation using a technique called\u00a0\u201coutpainting.\u201d<\/strong>\u00a0This is the first step in the process.<\/p>\n

Upload Image to AUTOMATIC1111<\/h3>\n

If the image was created using the AUTOMATIC1111 GUI, the prompts and other parameters used for its generation can be found in the metadata of the PNG file.<\/p>\n

To access this information in the AUTOMATIC1111 GUI, go to the PNG Info tab and drag the image from your local storage to the canvas area. The generation parameters should appear on the right-hand side of the screen.<\/p>\n

To send the image and parameters for outpainting, click the\u00a0\u201cSend to img2img\u201d\u00a0<\/strong>button. The appearance and prompt will then appear in the img2img sub-tab of the img2img tab.<\/p>\n

If your starting image was not created using the AUTOMATIC1111 GUI, simply proceed to the img2img tab and upload the image to the canvas area. You must write a prompt that accurately describes the image and style.<\/p>\n

Alternatively, you can use the\u00a0\u201cInterrogate CLIP\u201d\u00a0<\/strong>feature to generate a prompt automatically, but the quality of the prompt may not be optimal in some cases.<\/p>\n

The image was created using the AUTOMATIC1111 GUI<\/em><\/p>\n

Adjust Parameters for Outpainting<\/h3>\n

To get started with outpainting, it\u2019s essential to choose an appropriate model. For consistency in style, it\u2019s best to use the same model to generate the original image. For instance, if you used the F222 model to generate your image, you should use the same model for outpainting.<\/p>\n

If you used the v1.4 or v1.5 base models, or you\u2019re working with a photograph, you could also use the v1 inpainting model. This is supposed to give better results, although I\u2019ve succeeded without using it.<\/p>\n

If you used PNG Info, the image size should have been automatically set correctly. However, for custom images, it\u2019s essential to set the shorter side to the native resolution of the model (e.g., 512 px for v1 models), and adjust the longer side accordingly to maintain the aspect ratio.<\/p>\n

Set the resize mode to crop and resize to ensure the aspect ratio doesn\u2019t change.<\/p>\n

To get different results each time, set the seed to -1.<\/p>\n

The denoising strength can be adjusted to achieve different effects, and you may have fun playing around with this parameter. For now, let\u2019s set it to 0.6.<\/p>\n

You can use your standard text-to-image settings for the rest of the settings. For completeness, here\u2019s what I use:<\/p>\n

\n
• Sampling method: DPM++ 2M Karras<\/li>\n
• Sampling steps: 30<\/li>\n
• Batch size: 4<\/li>\n<\/ul>\n

  Enable Outpainting Script<\/h3>\n

  To access the outpainting options, locate the Script drop-down menu. Two options are available:\u00a0(1) outpainting mk2 and (2) poor man\u2019s outpainting.<\/strong>\u00a0The first option, outpainting mk2, is not very effective, so choosing the second option, poor man\u2019s outpainting, is recommended.<\/p>\n

  When using poor man\u2019s outpainting, it\u2019s suggested to expand the pixels to 128 and select \u201cfill\u201d for masked content. This will use the image\u2019s average color to fill in the expanded area before outpainting.<\/p>\n

  For optimal results, it\u2019s best to outpaint one direction at a time. For example, you can choose the right outpaint direction for a particular image.<\/p>\n

  Once you\u2019ve selected it, click \u201cGenerate\u201d to create your new image. You can regenerate as many times as necessary until you find an image you like.<\/p>\n

  To adjust the amount of change in the image, you can increase or decrease the denoising strength. Increasing the strength will result in more changes, while reducing it will result in fewer changes. It\u2019s as simple as that!<\/p>\n

  Center an Image<\/h2>\n

  To center your character in the image, you can first center the image itself. This will ensure that the enlarged pixels appear visually consistent with the rest of the image. Once you have centered the image, you can send it to img2img for further processing by hitting the \u201cSend\u201d button under the resulting canvas. This will allow you to iterate the process and make any necessary adjustments.<\/p>\n

  Convert to Landscape Size<\/h2>\n

  To transform a portrait-sized image into a landscape orientation, we can repeatedly extend its left and right sides. This alteration can significantly alter the viewer\u2019s perception of the image. By doing so, the image no longer depicts a close-up of the subject but instead showcases a larger background. This change in composition creates a striking contrast and can significantly impact the image\u2019s overall appearance.<\/p>\n

  Fix Details With Inpainting<\/h2>\n

  It is not necessary to worry too much about the details of the extended part of the image because you can always use the\u00a0\u201cinpainting\u201d<\/strong>\u00a0technique to regenerate any areas later. In the following steps, I will explain how to regenerate the entire right-hand side of the image.<\/p>\n

  To start, click on\u00a0\u201cSend to Inpainting\u201d<\/strong>\u00a0to transfer the newly generated image to the inpainting tab. Then, select the \u201cInpaint\u201d tab and use the paintbrush tool to create a mask on the area you want to regenerate.<\/p>\n

  You can use the inpainting technique to regenerate any areas<\/em><\/p>\n

  Here are some settings that you can use for the inpainting process:<\/p>\n

  \n
  • Mask mode:<\/strong>\u00a0\u201cInpaint masked\u201d<\/li>\n
  • Inpaint area:\u00a0<\/strong>\u201cOnly masked\u201d<\/li>\n
  • Only masked padding, pixels:<\/strong>\u00a036-72 (you can adjust this as needed)<\/li>\n
  • Script:<\/strong>\u00a0None (remember to turn off the outpainting script!)<\/li>\n
  • Denoising strength:<\/strong>\u00a00.6-0.9 (you may need to adjust this based on the result)<\/li>\n
  • Batch size:<\/strong>\u00a02-4 (you can generate multiple images at a time for comparison)<\/li>\n
  • Seed:<\/strong>\u00a0-1 (random)<\/li>\n
  • Masked content:\u00a0<\/strong>original or fill (fill will use the average color under the mask as the initial value)<\/li>\n<\/ul>\n

    Outpainting Complex Scenes<\/h2>\n

    The Stable Diffusion method is effective for simple backgrounds but may encounter difficulties with more complex scenes. This is because the method only considers a small area of the image next to the outpainted area, which is insufficient for extending a complex scene that requires long-range information to be considered.<\/p>\n

    While the Stable Diffusion method is unsuitable for this task, the MAT (Mask-Aware Transformer) is an excellent inpainting\/outpainting method that is available. It is a GAN (Generative Adversarial Network) model that is specifically designed to account for long-range information when creating missing parts of an image.<\/p>\n

    MAT Outpainting<\/h3>\n

    MAT outpainting is an efficient method that produces superior results compared to other approaches. To use MAT outpainting, visit the Stable Diffusion Mat Outpainting website. The user interface only supports generating square images, which can be cropped to landscape size for a larger image.<\/p>\n

    Scale is a parameter that adjusts the size of the uploaded image before the outpainting process.<\/p>\n

    Example:<\/strong>\u00a0The scale was set to 1 and the output size to 768, resulting in the outpainting of a 512\u00d7768 image to a final size of 768\u00d7768 by extending the left and right sides.<\/p>\n

    Conclusion<\/h2>\n

    Outpainting is a powerful technique for extending images and creating seamless image backgrounds. Understanding the basic principles of outpainting, selecting the appropriate algorithm, and optimizing parameters such as scale and output size makes it possible to produce high-quality, outpainted images quickly and easily.<\/p>\n

    Whether you are a professional photographer, graphic designer, or hobbyist, outpainting can help you achieve your creative goals and take your image editing skills to the next level. So why not try it and see the stunning results for yourself?<\/p>\n","protected":false},"excerpt":{"rendered":"

    Are you familiar with Stable Diffusion and its ability to expand images in all directions? This technique, known as outpainting, allows for creating a cohesive background outside the image frame.<\/p>\n

    Continue readingow-to-use-outpainting<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,18],"tags":[],"class_list":["post-820","post","type-post","status-publish","format-standard","hentry","category-guide","category-news"],"_links":{"self":[{"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/posts\/820","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/comments?post=820"}],"version-history":[{"count":1,"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/posts\/820\/revisions"}],"predecessor-version":[{"id":821,"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/posts\/820\/revisions\/821"}],"wp:attachment":[{"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/media?parent=820"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/categories?post=820"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.opendream.ai\/wp-json\/wp\/v2\/tags?post=820"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}