What models can we use for img2img today?

I'd like to fine tune a model that does img2img with a text prompt to guide the output. I think img2img-turbo might be the closest to what I'm after, though by default it uses a fixed prompt which can be made variable with some tweaking of the training code.

At the moment I only have access to 24GB VRAM which limits my options. What I'm after is training a model to make specific text-based modifications to images, and I have plenty of before to after images plus the modification text prompts to train on. Worst case, I can try to see if reducing the image size during training makes it possible with my setup.

Are there any other options available today?

6 points · 1 comments · view on lemmy.world

1 Comments

Even_Adder@lemmy.dbzer0.com · 2 pts · 1y

I found this guide on how to make an inpainting model out of any model. Though it's pretty out of date.