One missing feature that could be implemented in places like the Automatic1111 webUI, would be a "color threshold" or even a "color loss" function. I should be able to specify that for a particular region of the image, that a particular set of colors should not be generated, or I should be able to bias or prefer certain colors on certain parts of the image.

I actually wrote a jupyter notebook based off of another notebook that showed that color loss was possible. My jupyter notebook extended the idea by allowing to specify the region and the particular color that the color loss would operate on.

I'm surprised that despite how much tooling currently exists, tooling for specifying colors is not really common or well known. I figured that controlnet would have something for this by now, but here we are...