Helpful Resources
I’ll add more here as I remember them. Feel free to add more in the comments.
- AUTOMATIC1111’s Stable Diffusion WebUI is the software nearly everybody uses
- System requirements wise, for a while I used it on a 1050Ti with 4GBs of VRAM. I wouldn’t recommend going any lower than that. An RX580 with 8GB VRAM does wonders at a similar secondhand price point (if there isn’t any crypto hype going around where you are)
- Using https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111 can provide a really nice speed boost if configured correctly.
- Civitai has a really good selection of models, loras, and other resources
Models
Models are basically the brains of Stable Diffusion. They are the data SD uses to learn what your prompts mean.
The built-in models that come with Stable Diffusion are really bad for porn. Don’t use them. In fact don’t use them at all unless you’re training your own models, there are better SFW models.
Here are some of my personal favourites:
Anime
- MeinaHentai is a great model to start with. Compared to other models it’s really easy to prompt
- AOM3 also does really well, though it might be a little more difficult to guide
For all of those, I recommend installing https://github.com/DominikDoom/a1111-sd-webui-tagcomplete, as they heavily rely on danbooru tags.
- Berry Mix (Pre-mixed version here) can also work pretty well, depending on what you want to do. AFAIK it uses rule34 tags instead of danbooru, so it probably won’t work all too well with prompts used for the above ones
Realistic
- Uber Realistic Porn Merge is the only realistic model I know of that does hardcore stuff. It’s unfortunate problem is that it’s REALLY DAMN HARD TO USE
VAEs
VAEs are mostly used for finetuning colors, sharpness, what have you. Some models come with a VAE builtin, but for ones that don’t, it’s recommended to have one on hand.
- “Anything VAE”, “Orangemix VAE”, and “NAI Leak VAE” are the same exact thing under different names. If you already have one on hand, don’t bother with the others. Most VAEs are renamed versions or modifications of this one.
- Waifu Diffusion’s kl-f8-anime2 is also a pretty good one. It doesn’t require Waifu Diffusion.
- The one that comes with Stable Diffusion is the only one that seems to work for realistic stuff.
LoRAs
LoRAs teach models about concepts (characters, clothing, environments, style, …) they might not know about. There are a LOT of them, so feel free to browse Civitai to find ones you might want.
LoRAs tend to be specific for families of models, or at the very least styles (using anime LoRAs on realistic models tend to be a bad idea), but there are a fair few that will work across the board.
Locon and LyCORIS are newer formats of LoRAs. Not sure on the technical differences between them, but they will not work out of the box and need an extension such as https://github.com/KohakuBlueleaf/a1111-sd-webui-lycoris to get working
Textual Inversions / Embeddings and Hypernetworks
These are mostly obsoleted by LoRAs. There are a few embeddings such as Deep Negative and EasyNegative that are still quite useful, but in most cases you’ll want to use LoRAs instead.
deleted by creator
ROCm is flaky in regular consumer GPUs at the best of times. I’m surprised you could even get that far on a steam deck.
Try the command line arg
--opt-sdp-attention
. You might also want to try out--medvram
or--lowvram
(4GBs is considered low when it comes to AI). although I have a feeling it’s just because of the custom nature of the deck’s APU.Your best bet would be to search for builds of ROCm, PyTorch and Torchvision that are specifically made for the deck, if such things even exist.
Can confirm on ROCm sucking donkey balls. Even with directml it’s a struggle.
On 5700xt, tried both forks by isqqytiger or whatever his name is and vladmandic for directml on Windows and a1111 for ROcm on Linux.