KerasCV Stable Diffusion in Diffusers 🧨🤗

DreamBooth model for the drawbayc monkey concept trained by nielsgl on the nielsgl/bayc-tiny dataset, images from this Kaggle dataset . It can be used by modifying the instance_prompt : a drawing of drawbayc monkey

Description

The pipeline contained in this repository was created using a modified version of this Space for StableDiffusionV2 from KerasCV. The purpose is to convert the KerasCV Stable Diffusion weights in a way that is compatible with Diffusers . This allows users to fine-tune using KerasCV and use the fine-tuned weights in Diffusers taking advantage of its nifty features (like schedulers , fast attention , etc.). This model was created as part of the Keras DreamBooth Sprint 🔥. Visit the organisation page for instructions on how to take part!

Examples

A drawing of drawbayc monkey dressed as an astronaut

A drawing of drawbayc monkey dressed as the pope

Usage

from diffusers import StableDiffusionPipeline

pipeline = StableDiffusionPipeline.from_pretrained('nielsgl/dreambooth-bored-ape')
image = pipeline().images[0]
image

Training hyperparameters

The following hyperparameters were used during training: