Blog

Finetuning FLUX

IconIconIcon
  1. Finetuned FLUX models are incredible, much higher quality than Stable Diffusion ones.

  1. To create your own avatars, first collect around 10-15 images, a mix of headshots and full body portraits. Your dataset should look something like this. All of the images should be 1024x1024.

  1. Rename these images to “a_photo_of_TOK_1.png, a_photo_of_TOK_2.png…”
  2. Then go to Replicate:

https://replicate.com/lucataco/ai-toolkit/train

  1. Create a new model
  1. Upload your images as a .zip file
  2. Add your Huggingface token

(if you don’t have one create it here: https://huggingface.co/settings/tokens, add READ permissions)

  1. Define resolution
  1. Before hitting Create training, go to Huggingface and accept the T&C’s on the model page. https://huggingface.co/black-forest-labs/FLUX.1-dev
  2. Wait for training (around 30 mins).
  3. Once training is finished download the weights.
  4. Upload it into a new Huggingface model repo (make it public)
  1. It should look like this:
  1. Go to this replicate page: https://replicate.com/lucataco/flux-dev-lora
  2. Change hf lora:
  1. Make sure you add “TOK” to your prompt.

Share this post
IconIconIconIcon

Not ready yet? No problem, you can read some of our content first.

We answer the questions that you've been thinking about but were too afraid to ask.

How to avoid the traps of sounding like everyone else while using AI tools.
Gabor Soter

Unleash the Power of AI Writing Today!

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.