Merge branch 'main' of https://huggingface.co/hotshotco/Hotshot-XL into main
Browse files
README.md
CHANGED
@@ -13,27 +13,27 @@ Hotshot-XL is an AI text-to-GIF model trained to work alongside [Stable Diffusio
|
|
13 |
|
14 |
Hotshot-XL can generate GIFs with any fine-tuned SDXL model. This means two things:
|
15 |
1. You’ll be able to make GIFs with any existing or newly fine-tuned SDXL model you may want to use.
|
16 |
-
2. If you'd like to make GIFs of personalized subjects, you can load your own SDXL based LORAs, and not have to worry about fine-tuning Hotshot-XL. This is awesome because it’s usually much easier to find suitable images for training data than it is to find videos. It also hopefully fits into everyone's existing LORA usage/workflows :) See more [here](https://github.com/
|
17 |
|
18 |
-
Hotshot-XL is compatible with SDXL ControlNet to make GIFs in the composition/layout you’d like. See [here](https://github.com/hotshotco/
|
19 |
|
20 |
Hotshot-XL was trained to generate 1 second GIFs at 8 FPS.
|
21 |
|
22 |
-
Hotshot-XL was trained on various aspect ratios. For best results with the base Hotshot-XL model, we recommend using it with an SDXL model that has been fine-tuned with 512x512 images. You can find an SDXL model we fine-tuned for 512x512 resolutions [here](https://github.com/
|
23 |
|
24 |
|
25 |
|
26 |
![image/gif](https://cdn-uploads.huggingface.co/production/uploads/637a6daf7ce76c3b83497ea2/XXgnk14nIasPdkvkPlDzn.gif)
|
27 |
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/637a6daf7ce76c3b83497ea2/6OknWOlsl9Zs_esGtPTlZ.jpeg)
|
28 |
|
29 |
-
Source code is available at https://github.com/hotshotco/
|
30 |
|
31 |
# Model Description
|
32 |
- **Developed by**: Natural Synthetics Inc.
|
33 |
- **Model type**: Diffusion-based text-to-GIF generative model
|
34 |
-
- **License**: CreativeML Open RAIL++-M License
|
35 |
- **Model Description**: This is a model that can be used to generate and modify GIFs based on text prompts. It is a Latent Diffusion Model that uses two fixed, pretrained text encoders (OpenCLIP-ViT/G and CLIP-ViT/L).
|
36 |
-
- **Resources for more information**: Check out our [GitHub Repository](https://github.com/hotshotco/
|
37 |
|
38 |
|
39 |
# Limitations and Bias
|
|
|
13 |
|
14 |
Hotshot-XL can generate GIFs with any fine-tuned SDXL model. This means two things:
|
15 |
1. You’ll be able to make GIFs with any existing or newly fine-tuned SDXL model you may want to use.
|
16 |
+
2. If you'd like to make GIFs of personalized subjects, you can load your own SDXL based LORAs, and not have to worry about fine-tuning Hotshot-XL. This is awesome because it’s usually much easier to find suitable images for training data than it is to find videos. It also hopefully fits into everyone's existing LORA usage/workflows :) See more [here](https://github.com/hotshotco/Hotshot-XL/blob/main/README.md#text-to-gif-with-personalized-loras).
|
17 |
|
18 |
+
Hotshot-XL is compatible with SDXL ControlNet to make GIFs in the composition/layout you’d like. See [here](https://github.com/hotshotco/Hotshot-XL/blob/main/README.md#text-to-gif-with-controlnet) for more info.
|
19 |
|
20 |
Hotshot-XL was trained to generate 1 second GIFs at 8 FPS.
|
21 |
|
22 |
+
Hotshot-XL was trained on various aspect ratios. For best results with the base Hotshot-XL model, we recommend using it with an SDXL model that has been fine-tuned with 512x512 images. You can find an SDXL model we fine-tuned for 512x512 resolutions [here](https://github.com/hotshotco/Hotshot-XL/blob/main/README.md#text-to-gif-with-personalized-loras).
|
23 |
|
24 |
|
25 |
|
26 |
![image/gif](https://cdn-uploads.huggingface.co/production/uploads/637a6daf7ce76c3b83497ea2/XXgnk14nIasPdkvkPlDzn.gif)
|
27 |
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/637a6daf7ce76c3b83497ea2/6OknWOlsl9Zs_esGtPTlZ.jpeg)
|
28 |
|
29 |
+
Source code is available at https://github.com/hotshotco/Hotshot-XL.
|
30 |
|
31 |
# Model Description
|
32 |
- **Developed by**: Natural Synthetics Inc.
|
33 |
- **Model type**: Diffusion-based text-to-GIF generative model
|
34 |
+
- **License**: [CreativeML Open RAIL++-M License](https://huggingface.co/hotshotco/Hotshot-XL/raw/main/LICENSE.md)
|
35 |
- **Model Description**: This is a model that can be used to generate and modify GIFs based on text prompts. It is a Latent Diffusion Model that uses two fixed, pretrained text encoders (OpenCLIP-ViT/G and CLIP-ViT/L).
|
36 |
+
- **Resources for more information**: Check out our [GitHub Repository](https://github.com/hotshotco/Hotshot-XL).
|
37 |
|
38 |
|
39 |
# Limitations and Bias
|