You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Adds "Upcast cross attention layer to float32" option in Stable Diffusion settings. This allows for generating images using SD 2.1 models without --no-half or xFormers. In order to make upcasting cross attention layer optimizations possible it is necessary to indent several sections of code in sd_hijack_optimizations.py so that a context manager can be used to disable autocast. Also, even though Stable Diffusion (and Diffusers) only upcast q and k, unfortunately my findings were that most of the cross attention layer optimizations could not function unless v is upcast also. |
3 years ago | |
|---|---|---|
| .. | ||
| api | 3 years ago | |
| codeformer | 3 years ago | |
| hypernetworks | 3 years ago | |
| textual_inversion | 3 years ago | |
| call_queue.py | 3 years ago | |
| codeformer_model.py | 3 years ago | |
| deepbooru.py | 3 years ago | |
| deepbooru_model.py | 3 years ago | |
| devices.py | 3 years ago | |
| errors.py | 3 years ago | |
| esrgan_model.py | 3 years ago | |
| esrgan_model_arch.py | 3 years ago | |
| extensions.py | 3 years ago | |
| extra_networks.py | 3 years ago | |
| extra_networks_hypernet.py | 3 years ago | |
| extras.py | 3 years ago | |
| face_restoration.py | 3 years ago | |
| generation_parameters_copypaste.py | 3 years ago | |
| gfpgan_model.py | 3 years ago | |
| hashes.py | 3 years ago | |
| images.py | 3 years ago | |
| img2img.py | 3 years ago | |
| import_hook.py | 3 years ago | |
| interrogate.py | 3 years ago | |
| localization.py | 3 years ago | |
| lowvram.py | 3 years ago | |
| masking.py | 3 years ago | |
| memmon.py | 3 years ago | |
| modelloader.py | 3 years ago | |
| ngrok.py | 3 years ago | |
| paths.py | 3 years ago | |
| postprocessing.py | 3 years ago | |
| processing.py | 3 years ago | |
| progress.py | 3 years ago | |
| prompt_parser.py | 3 years ago | |
| realesrgan_model.py | 3 years ago | |
| safe.py | 3 years ago | |
| script_callbacks.py | 3 years ago | |
| script_loading.py | 3 years ago | |
| scripts.py | 3 years ago | |
| scripts_postprocessing.py | 3 years ago | |
| sd_disable_initialization.py | 3 years ago | |
| sd_hijack.py | 3 years ago | |
| sd_hijack_checkpoint.py | 3 years ago | |
| sd_hijack_clip.py | 3 years ago | |
| sd_hijack_clip_old.py | 3 years ago | |
| sd_hijack_inpainting.py | 3 years ago | |
| sd_hijack_open_clip.py | 3 years ago | |
| sd_hijack_optimizations.py | 3 years ago | |
| sd_hijack_unet.py | 3 years ago | |
| sd_hijack_utils.py | 3 years ago | |
| sd_hijack_xlmr.py | 3 years ago | |
| sd_models.py | 3 years ago | |
| sd_samplers.py | 3 years ago | |
| sd_vae.py | 3 years ago | |
| sd_vae_approx.py | 3 years ago | |
| shared.py | 3 years ago | |
| styles.py | 3 years ago | |
| sub_quadratic_attention.py | 3 years ago | |
| txt2img.py | 3 years ago | |
| ui.py | 3 years ago | |
| ui_common.py | 3 years ago | |
| ui_components.py | 3 years ago | |
| ui_extensions.py | 3 years ago | |
| ui_extra_networks.py | 3 years ago | |
| ui_extra_networks_hypernets.py | 3 years ago | |
| ui_extra_networks_textual_inversion.py | 3 years ago | |
| ui_postprocessing.py | 3 years ago | |
| ui_tempdir.py | 3 years ago | |
| upscaler.py | 3 years ago | |
| xlmr.py | 3 years ago | |