Stable Diffusion and its derivatives by far.

I have always thought that our digital world should service humanity, meaning I want software that augments my human abilities, I extract value from it vs how things are now where services only exist to monetize human activities.

For example: I want an AI mind that helps me discover and use information while factoring in my personal biases, morals and needs.

I know that reeks of idealism but it is what it is.

Meanwhile, we have stable diffusion which hits close to the mark. One of my hobbies is drawing and painting. I don't have a lot of time to commit to it so I try to be sure of the concept before I work on it. I find this to limit my creativity a lot, I get stymied on an idea "is this worth 40 hours of precious free time?"

With SD I am able to quickly iterate on concepts. Of course, its not giving me exactly what I have in mind but it gets close enough that I either renew inspiration or I see my concept in a new light and move on.

The fact that I can self host, tune and even retrain SD gives is super attractive. I sincerely hope more open source models like SD get released so I can build an personal AI ecosystem that meets my needs.

Can you share any pointers to resources like step-by-step guides for self-hosting SD?

Also curious, what sort of hardware are you using for SD?

Thanks in advance!

I've played around with many SD frameworks but I typically use: https://github.com/AUTOMATIC1111/stable-diffusion-webui since it has a lot of features and usually works well but it does have quirks/bugs that can be irritating. I use this webui on google colab (check "online services" in readme)

I have a M1 Max and have mostly avoided running SD on my machine since many SD implementations are built for windows or linux, supporting apple silicon had been less of a priority. Many of these frameworks will work on an M1 but i find using colab is simpler with similar performance.

However, since apple has released[1] Core-ML support SD models I have been trying some native apps like Mochi-diffusion[2] they seem to work well but are not yet as feature rich as the older webuis

1: https://github.com/apple/ml-stable-diffusion 2: https://github.com/godly-devotion/mochi-diffusion