40ff6db532
extra networks UI
...
rework of hypernets: rather than via settings, hypernets are added directly to prompt as <hypernet:name:weight>
3 years ago
a4a5475cfa
Variable dropout rate
...
Implements variable dropout rate from #4549
Fixes hypernetwork multiplier being able to modified during training, also fixes user-errors by setting multiplier value to lower values for training.
Changes function name to match torch.nn.module standard
Fixes RNG reset issue when generating previews by restoring RNG state
3 years ago
5f1dfbbc95
implement train api
3 years ago
20194fd975
We have duplicate linear now
3 years ago
f361e804eb
Re enable linear
3 years ago
462e6ba667
Disable unavailable or duplicate options
3 years ago
de096d0ce7
Weight initialization and More activation func
...
add weight init
add weight init option in create_hypernetwork
fstringify hypernet info
save weight initialization info for further debugging
fill bias with zero for He/Xavier
initialize LayerNorm with Normal
fix loading weight_init
3 years ago
dcb45dfecf
Merge branch 'master' of upstream
3 years ago
0e8ca8e7af
add dropout
3 years ago
51e3dc9cca
Sanitize hypernet name input.
3 years ago
0c5522ea21
Merge branch 'master' into training-help-text
3 years ago
6b38c2c19c
Merge branch 'AUTOMATIC1111:master' into master
3 years ago
930b4c64f7
allow float sizes for hypernet's layer_structure
3 years ago
6f98e89486
update
3 years ago
166be3919b
allow overwrite old hn
3 years ago
3770b8d2fa
enable to write layer structure of hn himself
3 years ago
42fbda83bb
layer options moves into create hnet ui
3 years ago
6be32b31d1
reports that training with medvram is possible.
3 years ago
d4ea5f4d86
add an option to unload models during hypernetwork training to save VRAM
3 years ago
6d09b8d1df
produce error when training with medvram/lowvram enabled
3 years ago
d682444ecc
add option to select hypernetwork modules when creating
3 years ago
b0583be088
more renames
3 years ago
873efeed49
rename hypernetwork dir to hypernetworks to prevent clash with an old filename that people who use zip instead of git clone will have
3 years ago
AUTOMATIC
aria1th
Vladimir Mandic
discus0434
timntorres
discus0434
DepFA