229 Commits (master)

Author SHA1 Message Date
Muhammad Rizqi Nur 05e2e40537 Merge branch 'master' into gradient-clipping 3 years ago
AUTOMATIC1111 810e6a407d
Merge pull request #3858 from R-N/log-csv
Fix log off by 1 #3847
3 years ago
Muhammad Rizqi Nur 9ceef81f77 Fix log off by 1 3 years ago
Muhammad Rizqi Nur 16451ca573 Learning rate sched syntax support for grad clipping 3 years ago
Muhammad Rizqi Nur 1618df41ba Gradient clipping for textual embedding 3 years ago
FlameLaw a0a7024c67
Fix random dataset shuffle on TI 3 years ago
DepFA 737eb28fac typo: cmd_opts.embedding_dir to cmd_opts.embeddings_dir 3 years ago
timntorres f4e1464217 Implement PR #3625 but for embeddings. 3 years ago
timntorres 4875a6c217 Implement PR #3309 but for embeddings. 3 years ago
timntorres c2dc9bfa89 Implement PR #3189 but for embeddings. 3 years ago
AUTOMATIC cbb857b675 enable creating embedding with --medvram 3 years ago
captin411 df0c5ea29d update default weights 3 years ago
captin411 54f0c14824 download better face detection module dynamically 3 years ago
captin411 db8ed5fe5c Focal crop UI elements 3 years ago
captin411 6629446a2f Merge branch 'master' into focal-point-cropping 3 years ago
captin411 3e6c2420c1 improve debug markers, fix algo weighting 3 years ago
Melan 18f86e41f6 Removed two unused imports 3 years ago
captin411 1be5933ba2
auto cropping now works with non square crops 3 years ago
AUTOMATIC f49c08ea56 prevent error spam when processing images without txt files for captions 3 years ago
AUTOMATIC1111 5e9afa5c8a
Merge branch 'master' into fix/train-preprocess-keep-ratio 3 years ago
DepFA 306e2ff6ab Update image_embedding.py 3 years ago
DepFA d0ea471b0c Use opts in textual_inversion image_embedding.py for dynamic fonts 3 years ago
AUTOMATIC 7d6b388d71 Merge branch 'ae' 3 years ago
AUTOMATIC1111 0c5522ea21
Merge branch 'master' into training-help-text 3 years ago
guaneec b69c37d25e Allow datasets with only 1 image in TI 3 years ago
Melan 8f59129847 Some changes to the tensorboard code and hypernetwork support 3 years ago
Melan a6d593a6b5 Fixed a typo in a variable 3 years ago
Milly 85dd62c4c7 train: ui: added `Split image threshold` and `Split image overlap ratio` to preprocess 3 years ago
Milly 9681419e42 train: fixed preprocess image ratio 3 years ago
Melan 29e74d6e71 Add support for Tensorboard for training embeddings 3 years ago
captin411 0ddaf8d202
improve face detection a lot 3 years ago
DepFA 858462f719
do caption copy for both flips 3 years ago
captin411 59ed744383
face detection algo, configurability, reusability
Try to move the crop in the direction of a face if it is present

More internal configuration options for choosing weights of each of the algorithm's findings

Move logic into its module
3 years ago
DepFA 9b65c4ecf4
pass preprocess_txt_action param 3 years ago
DepFA fbcce66601
add existing caption file handling 3 years ago
DepFA c3835ec85c
pass overwrite old flag 3 years ago
DepFA 0087079c2d
allow overwrite old embedding 3 years ago
captin411 41e3877be2
fix entropy point calculation 3 years ago
captin411 abeec4b630
Add auto focal point cropping to Preprocess images
This algorithm plots a bunch of points of interest on the source
image and averages their locations to find a center.

Most points come from OpenCV.  One point comes from an
entropy model. OpenCV points account for 50% of the weight and the
entropy based point is the other 50%.

The center of all weighted points is calculated and a bounding box
is drawn as close to centered over that point as possible.
3 years ago
MalumaDev 1997ccff13
Merge branch 'master' into test_resolve_conflicts 3 years ago
DepFA 62edfae257 print list of embeddings on reload 3 years ago
MalumaDev ae0fdad64a
Merge branch 'master' into test_resolve_conflicts 3 years ago
MalumaDev 9324cdaa31 ui fix, re organization of the code 3 years ago
AUTOMATIC 0c5fa9a681 do not reload embeddings from disk when doing textual inversion 3 years ago
MalumaDev 97ceaa23d0
Merge branch 'master' into test_resolve_conflicts 3 years ago
DepFA b6e3b96dab Change vector size footer label 3 years ago
DepFA ddf6899df0 generalise to popular lossless formats 3 years ago
DepFA 9a1dcd78ed add webp for embed load 3 years ago
DepFA 939f16529a only save 1 image per embedding 3 years ago
DepFA 9e846083b7 add vector size to embed text 3 years ago
MalumaDev 7b7561f6e4
Merge branch 'master' into test_resolve_conflicts 3 years ago
AUTOMATIC1111 ea8aa1701a
Merge branch 'master' into master 3 years ago
AUTOMATIC c7a86f7fe9 add option to use batch size for training 3 years ago
Melan 4d19f3b7d4 Raise an assertion error if no training images have been found. 3 years ago
AUTOMATIC 03d62538ae remove duplicate code for log loss, add step, make it read from options rather than gradio input 3 years ago
AUTOMATIC 326fe7d44b Merge remote-tracking branch 'Melanpan/master' 3 years ago
AUTOMATIC c344ba3b32 add option to read generation params for learning previews from txt2img 3 years ago
MalumaDev bb57f30c2d init 3 years ago
Melan 8636b50aea Add learn_rate to csv and removed a left-over debug statement 3 years ago
Melan 1cfc2a1898 Save a csv containing the loss while training 3 years ago
Greg Fuller f776254b12 [2/?] [wip] ignore OPT_INCLUDE_RANKS for training filenames 3 years ago
AUTOMATIC 698d303b04 deepbooru: added option to use spaces or underscores
deepbooru: added option to quote (\) in tags
deepbooru/BLIP: write caption to file instead of image filename
deepbooru/BLIP: now possible to use both for captions
deepbooru: process is stopped even if an exception occurs
3 years ago
AUTOMATIC c3c8eef9fd train: change filename processing to be more simple and configurable
train: make it possible to make text files with prompts
train: rework scheduler so that there's less repeating code in textual inversion and hypernets
train: move epochs setting to options
3 years ago
AUTOMATIC1111 cc5803603b
Merge pull request #2037 from AUTOMATIC1111/embed-embeddings-in-images
Add option to store TI embeddings in png chunks, and load from same.
3 years ago
DepFA 10a2de644f
formatting 3 years ago
DepFA 50be33e953
formatting 3 years ago
JC_Array f53f703aeb resolved conflicts, moved settings under interrogate section, settings only show if deepbooru flag is enabled 3 years ago
JC-Array 963d986396
Merge branch 'AUTOMATIC1111:master' into deepdanbooru_pre_process 3 years ago
AUTOMATIC 6be32b31d1 reports that training with medvram is possible. 3 years ago
DepFA 66ec505975
add file based test 3 years ago
DepFA 7e6a6e00ad
Add files via upload 3 years ago
DepFA 5f3317376b
spacing 3 years ago
DepFA 91d7ee0d09
update imports 3 years ago
DepFA aa75d5cfe8
correct conflict resolution typo 3 years ago
AUTOMATIC d6fcc6b87b apply lr schedule to hypernets 3 years ago
DepFA db71290d26
remove old caption method 3 years ago
DepFA 61788c0538
shift embedding logic out of textual_inversion 3 years ago
AUTOMATIC1111 419e539fe3
Merge branch 'learning_rate-scheduling' into learnschedule 3 years ago
DepFA c080f52cea
move embedding logic to separate file 3 years ago
AUTOMATIC d4ea5f4d86 add an option to unload models during hypernetwork training to save VRAM 3 years ago
AUTOMATIC 6d09b8d1df produce error when training with medvram/lowvram enabled 3 years ago
AUTOMATIC1111 4f96ffd0b5
Merge pull request #2201 from alg-wiki/textual__inversion
Textual Inversion: Preprocess and Training will only pick-up image files instead
3 years ago
DepFA 1eaad95533
Merge branch 'master' into embed-embeddings-in-images 3 years ago
AUTOMATIC 530103b586 fixes related to merge 3 years ago
alg-wiki 8bacbca0a1
Removed my local edits to checkpoint image generation 3 years ago
alg-wiki b2368a3bce
Switched to exception handling 3 years ago
AUTOMATIC 5de806184f Merge branch 'master' into hypernetwork-training 3 years ago
DepFA 7aa8fcac1e
use simple lcg in xor 3 years ago
JC_Array bb932dbf9f added alpha sort and threshold variables to create process method in preprocessing 3 years ago
JC-Array 47f5e216da
Merge branch 'deepdanbooru_pre_process' into master 3 years ago
DepFA e0fbe6d27e
colour depth conversion fix 3 years ago
DepFA 767202a4c3
add dependency 3 years ago
DepFA 315d5a8ed9
update data dis[play style 3 years ago
alg-wiki 907a88b2d0 Added .webp .bmp 3 years ago
Fampai 2536ecbb17 Refactored learning rate code 3 years ago
alg-wiki f0ab972f85
Merge branch 'master' into textual__inversion 3 years ago
alg-wiki bc3e183b73
Textual Inversion: Preprocess and Training will only pick-up image files 3 years ago
DepFA df6d0d9286
convert back to rgb as some hosts add alpha 3 years ago
DepFA 707a431100
add pixel data footer 3 years ago
DepFA ce2d7f7eac
Merge branch 'master' into embed-embeddings-in-images 3 years ago
alg-wiki 7a20f914ed Custom Width and Height 3 years ago
alg-wiki 6ad3a53e36 Fixed progress bar output for epoch 3 years ago
alg-wiki ea00c1624b Textual Inversion: Added custom training image size and number of repeats per input image in a single epoch 3 years ago
alg-wiki 04c745ea4f
Custom Width and Height 3 years ago
alg-wiki 4ee7519fc2
Fixed progress bar output for epoch 3 years ago
alg-wiki 3110f895b2
Textual Inversion: Added custom training image size and number of repeats per input image in a single epoch 3 years ago
JC_Array 1f92336be7 refactored the deepbooru module to improve speed on running multiple interogations in a row. Added the option to generate deepbooru tags for textual inversion preproccessing. 3 years ago
DepFA e2c2925eb4
remove braces from steps 3 years ago
DepFA d6a599ef9b
change caption method 3 years ago
DepFA 01fd9cf0d2
change source of step count 3 years ago
DepFA 96f1e6be59
source checkpoint hash from current checkpoint 3 years ago
DepFA 6684610510
correct case on embeddingFromB64 3 years ago
DepFA d0184b8f76
change json tensor key name 3 years ago
DepFA 5d12ec82d3
add encoder and decoder classes 3 years ago
DepFA 969bd8256e
add alternate checkpoint hash source 3 years ago
DepFA 03694e1f99
add embedding load and save from b64 json 3 years ago
DepFA 5841990b0d
Update textual_inversion.py 3 years ago
AUTOMATIC 12c4d5c6b5 hypernetwork training mk1 3 years ago
Raphael Stoeckli 4288e53fc2 removed unused import, fixed typo 3 years ago
Raphael Stoeckli 2499fb4e19 Add sanitizer for captions in Textual inversion 3 years ago
AUTOMATIC 5ef0baf5ea add support for gelbooru tags in filenames for textual inversion 3 years ago
AUTOMATIC 2865ef4b9a fix broken date in TI 3 years ago
AUTOMATIC 6785331e22 keep textual inversion dataset latents in CPU memory to save a bit of VRAM 3 years ago
AUTOMATIC c7543d4940 preprocessing for textual inversion added 3 years ago
AUTOMATIC a1cde7e646 disabled SD model download after multiple complaints 3 years ago
AUTOMATIC 4ec4af6e0b add checkpoint info to saved embeddings 3 years ago
AUTOMATIC 71fe7fa49f fix using aaaa-100 embedding when the prompt has aaaa-10000 and you have both aaaa-100 and aaaa-10000 in the directory with embeddings. 3 years ago
AUTOMATIC 88ec0cf557 fix for incorrect embedding token length calculation (will break seeds that use embeddings, you're welcome!)
add option to input initialization text for embeddings
3 years ago
AUTOMATIC 820f1dc96b initial support for training textual inversion 3 years ago