Skip to content

Commit 465c1d6

Browse files
committed
Add a note about xformers in README
1 parent 83fc29d commit 465c1d6

File tree

3 files changed

+9
-0
lines changed

3 files changed

+9
-0
lines changed

examples/dreambooth/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -407,3 +407,6 @@ accelerate launch train_dreambooth_inpaint.py \
407407
--num_class_images=200 \
408408
--max_train_steps=800
409409
```
410+
411+
### Training with xformers:
412+
You can enable memory efficient attention by [installing xFormers](https://github.com/facebookresearch/xformers#installing-xformers) and padding the `--enable_xformers_memory_efficient_attention` argument to the script. This is not available with the Flax/JAX implementation.

examples/text_to_image/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -160,3 +160,6 @@ python train_text_to_image_flax.py \
160160
--max_grad_norm=1 \
161161
--output_dir="sd-pokemon-model"
162162
```
163+
164+
### Training with xformers:
165+
You can enable memory efficient attention by [installing xFormers](https://github.com/facebookresearch/xformers#installing-xformers) and padding the `--enable_xformers_memory_efficient_attention` argument to the script. This is not available with the Flax/JAX implementation.

examples/textual_inversion/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,3 +124,6 @@ python textual_inversion_flax.py \
124124
--output_dir="textual_inversion_cat"
125125
```
126126
It should be at least 70% faster than the PyTorch script with the same configuration.
127+
128+
### Training with xformers:
129+
You can enable memory efficient attention by [installing xFormers](https://github.com/facebookresearch/xformers#installing-xformers) and padding the `--enable_xformers_memory_efficient_attention` argument to the script. This is not available with the Flax/JAX implementation.

0 commit comments

Comments
 (0)