[FLUX] HALLOWEEN2024 Twisty Clown LoRa Training


Updated:

Training a LoRa on any model could be challenging sometimes but in the case of Flux model is easier than SDXL or SD 1.5, especially if you have some guidelines.

Here's my experience creating a "Twisty The Clown" LoRa on-site training feature.

First thing first

Tensor.art Account

Set up an account on Tensor.art and ensure it has a minimum of 300 credits.

Dataset Guidelines


For optimal results, it is advisable to include between 10 o 20 images in your dataset. The majority of these should be close-up photographs, complemented by a few mid-range shots and at least one full-body image. Additionally, incorporating side profile images alongside front-facing ones will enhance the dataset's diversity.

To ensure efficient training and high-quality outcomes, the recommended image size is 512x512 pixels

Here is my dataset that I've used for this LoRa.

Guidelines for Captioning Photos for LoRA

Tensor.art automatically put captions on your images but consider adding:

  • Unique Trigger Word: Begin each caption with a distinctive trigger word that identifies the dataset.

Also consider this on your captions.

1. Descriptive Tags: Include tags for all elements you wish to vary in the generated images. For instance, if you intend to modify attributes like hair color and length, ensure these are detailed in every photo caption.

2. Consistent Elements: Any aspect not explicitly described and that remains consistent across all photos in the dataset will automatically be associated with the trigger word

Parameter Settings and Likeness Capture

Utilizing a collection of approximately 12 portrait photographs, a highly effective and adaptable likeness LoRA can be developed. The training employs default Flux settings, with modifications to enhance the accuracy.

Here is my Parameter Settings

First select Profesional Mode in the settings

Select the model Flux

And then change the parameters to this

Finally, here are the results!

The model link if you want to try it or download

https://tensor.art/models/786414177230229338?source_id=njy_rlzlnUKzpfYra33z-xQh

THANK YOU!

0

Comments