ControlNet++ Improving Conditional Controls with Efficient Consistency Feedback To enhance the controllability of text-to-image diffusion models, existing efforts like ControlNet incorporated ...

Today’s paper proposes ControlNet++, a new approach to improve the controllability of text-to-image diffusion models when using image-based conditional controls (for example segmentation masks or ...

We design a new architecture that can support 10+ control types in condition text-to-image generation and can generate high resolution images visually comparable with midjourney. The network is based ...