Unlock Realistic AI-Generated Images with FaceGen in One Click

Unlock Realistic AI-Generated Images with FaceGen in Stable Diffusion Web UI. Easily create stunning, personalized images from a single photo using the new FaceGen AI feature. Detailed tutorial on installation and usage.

September 7, 2024

party-gif

Unlock the power of AI-generated images with a single click! Discover how to seamlessly integrate the cutting-edge FaceGen AI technology into the Stable Diffusion web UI, allowing you to create stunning, personalized visuals in no time. This blog post provides a step-by-step guide to effortlessly set up and utilize this game-changing tool, empowering you to unleash your creative potential.

How to Install Instant ID in Stable Diffusion WebUI

To install Instant ID in the Stable Diffusion WebUI, follow these steps:

  1. Install the Stable Diffusion WebUI first, if you haven't done so already. You can use the one-click installer if you're a Patreon supporter, or follow the step-by-step guide in the creator's previous video.

  2. Launch the WebUI and go to the "Extensions" section.

  3. Install the "Control Net" extension by clicking on "Available", then "Load from" and searching for "sd-webui-control-net". Click "Install" and then "Installed" to confirm the installation.

  4. If the extension is already installed, make sure it's up-to-date by clicking the "Check for updates" button and then "Apply and restart UI".

  5. Close the WebUI and the command prompt window.

  6. Download the "control_instant.py" and "ip_adapter.py" files from the creator's Hugging Face repository.

  7. Inside the Stable Diffusion WebUI, go to the "Models" > "Control Net" folder and paste the two downloaded files.

  8. Relaunch the WebUI user.bat file, and Instant ID is now ready to use.

  9. To use Instant ID, click the arrow to expand the "Control Net" section. Enable the checkbox, select "Instant ID" as the Control Type, and choose the appropriate pre-processor and model options.

  10. Adjust the Control Weight as desired, then generate your image using the Stable Diffusion XL model and a prompt of your choice.

Remember to decrease the CFG scale to 3-5 when using Instant ID, and consider using a Stable Diffusion XL Turbo model for faster generation times.

One-Click Installation for Patreon Supporters

For Patreon supporters, the one-click installer is the easiest way to install Instant ID within the Stable Diffusion web UI. Simply download the one-click installer, drag and drop it into the Stable Diffusion web UI folder, and double-click to automatically install everything.

This streamlined process eliminates the need for manual steps, making the setup process quick and hassle-free. Once the installation is complete, you can start using Instant ID within the Stable Diffusion web UI immediately.

Manual Installation Process

To manually install Instant ID within the Stable Diffusion Web UI, follow these steps:

  1. Launch the Stable Diffusion Web UI by running the webui.bat file.
  2. Go to the "Extensions" section and install the "Control Net" extension:
    • Click on "Available" and search for "Control Net".
    • Scroll down until you see the "sd-webui-control-net" extension with the most stars, then click "Install".
    • Once installed, click on "Installed" to verify the extension is loaded.
    • Click the "Check for updates" button and then "Apply and restart UI" to ensure the extension is up-to-date.
  3. Close the Stable Diffusion Web UI and the Command Prompt window.
  4. Download the "control_instant.py" and "ip_adapter.py" files from the provided link.
  5. Inside the Stable Diffusion Web UI folder, navigate to the "models/control_net" directory.
  6. Paste the downloaded "control_instant.py" and "ip_adapter.py" files into the "control_net" directory.
  7. Relaunch the Stable Diffusion Web UI by running the webui.bat file.
  8. In the Stable Diffusion Web UI, click the arrow to expand the "Control Net" section.
  9. To use Instant ID, follow these steps:
    • Upload the face image you want to use as the reference.
    • Enable the "Use control net" checkbox.
    • Select "Instant ID" as the "Control Type".
    • Select "Instant ID Face Embedding" as the "Pre-Processor".
    • Select the "IP Adapter" model.
    • Adjust the "Control Weight" as desired (higher values result in more realistic images).
    • Upload a second image to use as the pose reference.
    • Enable the "Use control net" checkbox for the second control net unit.
    • Select "Instant ID" as the "Control Type".
    • Select "Instant ID Keypoints" as the "Pre-Processor".
    • Select the "Control Instant ID SD XL" model.
    • Adjust the "Control Weight" as desired.
  10. Make sure to select a Stable Diffusion XL model that is compatible with Instant ID.
  11. Adjust the prompt, negative prompt, CFG scale, and other parameters as needed.
  12. Click "Generate" to create the new image.

Using Instant ID in Stable Diffusion WebUI

To use Instant ID within the Stable Diffusion WebUI, follow these steps:

  1. Install the Stable Diffusion WebUI if you haven't done so already. You can use the one-click installer for a quick setup or follow the step-by-step guide in the creator's previous video.

  2. Install the Control Net extension. Go to the Extensions tab, click "Load from" and search for "sd-webui-controlnet". Install the extension and make sure it's up-to-date.

  3. Download the "control_instant" and "ip_adapter" files from the creator's Hugging Face repository and paste them into the "models/control_net" folder within the Stable Diffusion WebUI directory.

  4. Relaunch the WebUI and the Instant ID feature will be available. To use it:

    • Upload the face image you want to clone.
    • Enable the checkbox and select "Instant ID" as the Control Type.
    • For the Pre-Processor, choose "Instant ID Face Embedding" and select the "IP Adapter" model.
    • Adjust the Control Weight as desired, with higher values resulting in a more realistic clone.
    • Add a second Control Net unit, select "Instant ID" as the Control Type, choose "Instant ID Pose Keypoints" as the Pre-Processor, and select the "Control Instant ID SDXL" model.
    • Decrease the Control Weight for the second unit slightly.
    • Select the appropriate Stable Diffusion XL model, set the prompt, and generate the image.

Remember to use a resolution of at least 1024x1024 and keep the CFG scale between 3-5 when using Instant ID. You can also experiment with Stable Diffusion XL Turbo models for faster generation times.

Optimizing Generation with Stable Diffusion Excel Turbo Models

To speed up the image generation process and achieve faster results, you can utilize Stable Diffusion Excel Turbo models. These models are based on the Stable Diffusion Excel architecture but are optimized for faster generation by using a lower number of sampling steps.

Whereas a normal Stable Diffusion Excel model may require 20 or 30 sampling steps, the Stable Diffusion Excel Turbo models can achieve similar results with only 5 to 10 sampling steps. This significantly reduces the generation time, making the process much faster.

To find and use these Stable Diffusion Excel Turbo models, follow these steps:

  1. Go to the Civitai website (https://www.civitai.com/) and click on the "Filters" button.
  2. Scroll down and select the "Stable Diffusion Excel Turbo" filter to display all the available models based on this architecture.
  3. Choose a Stable Diffusion Excel Turbo model that suits your needs, such as the "Dream Shaper Excel Turbo" model.
  4. Download the selected model and place it in the models/stable-diffusion folder within your Stable Diffusion web UI directory.
  5. In the web UI, click the refresh icon to update the list of available models, then select the Stable Diffusion Excel Turbo model you just added.
  6. When generating images, you'll notice that the number of sampling steps is significantly reduced, typically between 5 and 10, resulting in much faster generation times.

By utilizing these optimized Stable Diffusion Excel Turbo models, you can significantly speed up your image generation process without sacrificing the quality of the results.

Conclusion

The integration of Instant ID into the Stable Diffusion web UI is a significant development, allowing users to generate new images of individuals using only a single reference image. This feature streamlines the image generation process, making it more accessible and efficient for users.

The step-by-step instructions provided in the transcript cover both the one-click installer option for Patreon supporters and the manual installation process. The detailed walkthrough ensures that users can easily set up and utilize the Instant ID functionality within the Stable Diffusion web UI.

The ability to combine Instant ID with other Stable Diffusion models, such as the Juggernaut Excel V8 and the Stable Diffusion Excel Turbo models, further enhances the versatility and performance of the image generation capabilities. Users can experiment with different models and settings to achieve their desired results.

Overall, the integration of Instant ID into the Stable Diffusion web UI represents a significant advancement in the field of AI-powered image generation, providing users with a powerful and user-friendly tool to create unique and realistic images from a single reference image.

FAQ