gpustack commited on
Commit
3507f81
·
verified ·
1 Parent(s): 50c43f6

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.sft filter=lfs diff=lfs merge=lfs -text
37
+ schnell_grid.png filter=lfs diff=lfs merge=lfs -text
38
+ schnell_grid.jpeg filter=lfs diff=lfs merge=lfs -text
39
+ *.gguf filter=lfs diff=lfs merge=lfs -text
FLUX.1-schnell-FP16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d99fb2f75e85fd832e789065dea22156198d6b6c7027baa78341ffda09b39a6a
3
+ size 34265610176
FLUX.1-schnell-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf090d2550e691e88417c3d1ed52c510ca6ad64559cf0d87548c119dea3ee774
3
+ size 10042162944
FLUX.1-schnell-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a43a16049ac530882d0f442308332d8c60527dc4ebb1820769816b700466165
3
+ size 18467709952
README.md ADDED
@@ -0,0 +1,91 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ tags:
6
+ - text-to-image
7
+ - image-generation
8
+ - flux
9
+ ---
10
+
11
+ # FLUX.1-schnell-GGUF
12
+
13
+ !!! Experimental supported by [gpustack/llama-box v0.0.77+](https://github.com/gpustack/llama-box) only !!!
14
+
15
+ **Model creator**: [Black Forest Labs](https://huggingface.co/black-forest-labs)<br/>
16
+ **Original model**: [FLUX.1-schnell](https://huggingface.co/black-forest-labs/FLUX.1-schnell)<br/>
17
+ **GGUF quantization**: based on stable-diffusion.cpp [ac54e](https://github.com/leejet/stable-diffusion.cpp/commit/ac54e0076052a196b7df961eb1f792c9ff4d7f22) that patched by llama-box.
18
+
19
+ ---
20
+
21
+ ![FLUX.1 [schnell] Grid](./schnell_grid.jpeg)
22
+
23
+ `FLUX.1 [schnell]` is a 12 billion parameter rectified flow transformer capable of generating images from text descriptions.
24
+ For more information, please read our [blog post](https://blackforestlabs.ai/announcing-black-forest-labs/).
25
+
26
+ # Key Features
27
+ 1. Cutting-edge output quality and competitive prompt following, matching the performance of closed source alternatives.
28
+ 2. Trained using latent adversarial diffusion distillation, `FLUX.1 [schnell]` can generate high-quality images in only 1 to 4 steps.
29
+ 3. Released under the `apache-2.0` licence, the model can be used for personal, scientific, and commercial purposes.
30
+
31
+ # Usage
32
+ We provide a reference implementation of `FLUX.1 [schnell]`, as well as sampling code, in a dedicated [github repository](https://github.com/black-forest-labs/flux).
33
+ Developers and creatives looking to build on top of `FLUX.1 [schnell]` are encouraged to use this as a starting point.
34
+
35
+ ## API Endpoints
36
+ The FLUX.1 models are also available via API from the following sources
37
+ - [bfl.ml](https://docs.bfl.ml/) (currently `FLUX.1 [pro]`)
38
+ - [replicate.com](https://replicate.com/collections/flux)
39
+ - [fal.ai](https://fal.ai/models/fal-ai/flux/schnell)
40
+ - [mystic.ai](https://www.mystic.ai/black-forest-labs/flux1-schnell)
41
+
42
+ ## ComfyUI
43
+ `FLUX.1 [schnell]` is also available in [Comfy UI](https://github.com/comfyanonymous/ComfyUI) for local inference with a node-based workflow.
44
+
45
+ ## Diffusers
46
+ To use `FLUX.1 [schnell]` with the 🧨 diffusers python library, first install or upgrade diffusers
47
+
48
+ ```shell
49
+ pip install -U diffusers
50
+ ```
51
+
52
+ Then you can use `FluxPipeline` to run the model
53
+
54
+ ```python
55
+ import torch
56
+ from diffusers import FluxPipeline
57
+
58
+ pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-schnell", torch_dtype=torch.bfloat16)
59
+ pipe.enable_model_cpu_offload() #save some VRAM by offloading the model to CPU. Remove this if you have enough GPU power
60
+
61
+ prompt = "A cat holding a sign that says hello world"
62
+ image = pipe(
63
+ prompt,
64
+ guidance_scale=0.0,
65
+ num_inference_steps=4,
66
+ max_sequence_length=256,
67
+ generator=torch.Generator("cpu").manual_seed(0)
68
+ ).images[0]
69
+ image.save("flux-schnell.png")
70
+ ```
71
+
72
+ To learn more check out the [diffusers](https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux) documentation
73
+
74
+ ---
75
+ # Limitations
76
+ - This model is not intended or able to provide factual information.
77
+ - As a statistical model this checkpoint might amplify existing societal biases.
78
+ - The model may fail to generate output that matches the prompts.
79
+ - Prompt following is heavily influenced by the prompting-style.
80
+
81
+ # Out-of-Scope Use
82
+ The model and its derivatives may not be used
83
+
84
+ - In any way that violates any applicable national, federal, state, local or international law or regulation.
85
+ - For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
86
+ - To generate or disseminate verifiably false information and/or content with the purpose of harming others.
87
+ - To generate or disseminate personal identifiable information that can be used to harm an individual.
88
+ - To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
89
+ - To create non-consensual nudity or illegal pornographic content.
90
+ - For fully automated decision making that adversely impacts an individual's legal rights or otherwise creates or modifies a binding, enforceable obligation.
91
+ - Generating or facilitating large-scale disinformation campaigns.
schnell_grid.jpeg ADDED

Git LFS Details

  • SHA256: 5bff488da88933a529825e4fd72e10c3824e22508dc1d6f36b49850fa517ac44
  • Pointer size: 132 Bytes
  • Size of remote file: 1.67 MB