Disty0 commited on
Commit
258f386
1 Parent(s): 04f3bdd

Upload 18 files

Browse files
LICENSE ADDED
@@ -0,0 +1,152 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Fair AI Public License 1.0-SD
2
+
3
+ Published by the [Freedom of Development Project](https://freedevproject.org).
4
+
5
+ *This "SD variant" license contains a [Prohibited Uses](#prohibited-uses)
6
+ section designed to be compatible with Stable Diffusion's license. Because of
7
+ that section, this is not a free software license. Unless you are releasing a
8
+ derivative of a Stable Diffusion model, it is not recommended that you use this
9
+ license.*
10
+
11
+ *This license comes with special requirements if you intend to allow users
12
+ to access this software over a network. See [Notices](#notices) for more
13
+ information.*
14
+
15
+ ## Purpose
16
+ This license gives everyone as much permission to work with this software as
17
+ possible, while protecting contributors from liability, protecting the
18
+ freedom of end users, and reducing harm.
19
+
20
+ ## Definitions
21
+ In this license, "model" refers to machine learning model weights, biases,
22
+ parameters, optimizer states, and any byproducts of a training or pretraining
23
+ process, whether in the form of checkpoints or any other form.
24
+
25
+ The term "derived model" refers to any model based on this model.
26
+
27
+ The term "software" also refers to any model along with documentation or
28
+ other resources provided with the software.
29
+
30
+ The term "source code" refers to the preferred form of making modifications
31
+ to software. It also includes any models, if applicable, but it does not
32
+ include any datasets used to train a model.
33
+
34
+ To "modify" also means to perform any training on a model or to combine a
35
+ model with another model.
36
+
37
+ ## Acceptance
38
+ In order to receive this license, you must agree to its rules. The rules of
39
+ this license are both obligations under that agreement and conditions to your
40
+ license. You must not do anything with this software that triggers a rule that
41
+ you cannot or will not follow. If you do not agree, then you cannot use this
42
+ software in any way.
43
+
44
+ ## Copyright
45
+ Each contributor licenses you to do everything with this software that would
46
+ otherwise infringe that contributor's copyright in it.
47
+
48
+ ## Freedom
49
+ Neither this software nor any work that is combined with this software will be
50
+ considered a technological protection measure under the WIPO Copyright Treaty
51
+ or any similar law. Reverse engineering of this software and of any work that
52
+ is combined with this software is always allowed.
53
+
54
+ ## Notices
55
+ You must ensure that everyone who gets a copy of any part of this software from
56
+ you, with or without changes, also gets the text of this license along with
57
+ the corresponding source code.
58
+
59
+ If you modify this software and allow users to interact with it through a
60
+ computer network, you must ensure they have a reasonable way to receive the
61
+ corresponding source code from you, whether that is via a download link or a
62
+ prominent written offer. As a special case, if you are only allowing users to
63
+ interact with a derived model, then you may choose to provide a download link
64
+ or written offer only for the derived model.
65
+
66
+ This software, all source code, and all modifications must be provided under
67
+ this license or another license that allows everything this license allows.
68
+ Note that this does not give you permission to change the license for this
69
+ software.
70
+
71
+ ## Excuse
72
+ If anyone notifies you in writing that you have not complied with
73
+ [Notices](#notices), you can keep your license by taking all practical steps
74
+ to comply within 30 days after the notice. If you do not do so, your license
75
+ ends immediately.
76
+
77
+ ## Output
78
+ The output of this software is not covered by this license, and no contributor
79
+ claims any rights to it.
80
+
81
+ ## Patent
82
+ Each contributor licenses you to do everything with this software that would
83
+ otherwise infringe any patent claims they can license or become able to license.
84
+
85
+ ## Reliability
86
+ No contributor can revoke this license.
87
+
88
+ ## Alternatives
89
+ You can also use any non-model parts of this software under the terms of the
90
+ GNU AGPL 3.0, or any later version of that license. If you do,
91
+ [No Harm](#no-harm) and [No Liability](#no-liability) still apply.
92
+
93
+ ## Revisions
94
+ The Freedom of Development Project may publish revised or new versions of the
95
+ Fair AI Public License. Those new versions will be similar in spirit to this
96
+ license.
97
+
98
+ Unless a contributor specifies otherwise, you have the option of following the
99
+ terms of any later version of this license. Your choice to follow a later
100
+ version of the license will not impose additional obligations on any
101
+ contributor. Even if you do choose to follow a later version, the restrictions
102
+ of [Prohibited Uses](#prohibited-uses) will still apply.
103
+
104
+ ## Survival
105
+ The provisions of [No Harm](#no-harm) and [No Liability](#no-liability) survive
106
+ the end of your license.
107
+
108
+ ## No Harm
109
+ You agree that no contributor's conduct in the creation of this software has
110
+ caused you any harm. As far as the law allows, you give up your right to pursue
111
+ any kind of legal claim against any contributor for actions related the
112
+ creation of this software, even if those actions broke a previous agreement.
113
+
114
+ Additionally, you agree not to use this model for harmful purposes, as listed
115
+ in [Prohibited Uses](#prohibited-uses). These restrictions do not apply to
116
+ non-model parts of this software.
117
+
118
+ ## No Liability
119
+ ***As far as the law allows, this software comes as is, without any warranty or
120
+ condition, and no contributor will be liable to anyone for any damages related
121
+ to this software or this license, under any kind of legal claim.***
122
+
123
+ ## Prohibited Uses
124
+ You may not use this model or any derived model for the following:
125
+
126
+ - In any way that violates any applicable national, federal, state, local or
127
+ international law or regulation;
128
+ - For the purpose of exploiting, harming or attempting to exploit or harm
129
+ minors in any way;
130
+ - To generate or disseminate verifiably false information and/or content with
131
+ the purpose of harming others;
132
+ - To generate or disseminate personal identifiable information that can be used
133
+ to harm an individual;
134
+ - To defame, disparage or otherwise harass others;
135
+ - For fully automated decision making that adversely impacts an individual’s
136
+ legal rights or otherwise creates or modifies a binding, enforceable obligation;
137
+ - For any use intended to or which has the effect of discriminating against or
138
+ harming individuals or groups based on online or offline social behavior or
139
+ known or predicted personal or personality characteristics;
140
+ - To exploit any of the vulnerabilities of a specific group of persons based on
141
+ their age, social, physical or mental characteristics, in order to materially
142
+ distort the behavior of a person pertaining to that group in a manner that
143
+ causes or is likely to cause that person or another person physical or
144
+ psychological harm;
145
+ - For any use intended to or which has the effect of discriminating against
146
+ individuals or groups based on legally protected characteristics or categories;
147
+ - To provide medical advice and medical results interpretation;
148
+ - To generate or disseminate information for the purpose to be used for
149
+ administration of justice, law enforcement, immigration or asylum processes,
150
+ such as predicting an individual will commit fraud/crime commitment (e.g. by
151
+ text profiling, drawing causal relationships between assertions made in
152
+ documents, indiscriminate and arbitrarily-targeted use).
LICENSE_INHERIT ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ STABILITY AI NON-COMMERCIAL RESEARCH COMMUNITY LICENSE AGREEMENT
2
+ Dated: November 28, 2023
3
+
4
+ By using or distributing any portion or element of the Models, Software, Software Products or Derivative Works, you agree to be bound by this Agreement.
5
+
6
+ "Agreement" means this Stable Non-Commercial Research Community License Agreement.
7
+
8
+ “AUP” means the Stability AI Acceptable Use Policy available at https://stability.ai/use-policy, as may be updated from time to time.
9
+
10
+ "Derivative Work(s)” means (a) any derivative work of the Software Products as recognized by U.S. copyright laws and (b) any modifications to a Model, and any other model created which is based on or derived from the Model or the Model’s output. For clarity, Derivative Works do not include the output of any Model.
11
+
12
+ “Documentation” means any specifications, manuals, documentation, and other written information provided by Stability AI related to the Software.
13
+
14
+ "Licensee" or "you" means you, or your employer or any other person or entity (if you are entering into this Agreement on such person or entity's behalf), of the age required under applicable laws, rules or regulations to provide legal consent and that has legal authority to bind your employer or such other person or entity if you are entering in this Agreement on their behalf.
15
+
16
+ “Model(s)" means, collectively, Stability AI’s proprietary models and algorithms, including machine-learning models, trained model weights and other elements of the foregoing, made available under this Agreement.
17
+
18
+ “Non-Commercial Uses” means exercising any of the rights granted herein for the purpose of research or non-commercial purposes. Non-Commercial Uses does not include any production use of the Software Products or any Derivative Works.
19
+
20
+ "Stability AI" or "we" means Stability AI Ltd. and its affiliates.
21
+
22
+
23
+ "Software" means Stability AI’s proprietary software made available under this Agreement.
24
+
25
+ “Software Products” means the Models, Software and Documentation, individually or in any combination.
26
+
27
+
28
+
29
+ 1. License Rights and Redistribution.
30
+ a. Subject to your compliance with this Agreement, the AUP (which is hereby incorporated herein by reference), and the Documentation, Stability AI grants you a non-exclusive, worldwide, non-transferable, non-sublicensable, revocable, royalty free and limited license under Stability AI’s intellectual property or other rights owned or controlled by Stability AI embodied in the Software Products to use, reproduce, distribute, and create Derivative Works of, the Software Products, in each case for Non-Commercial Uses only.
31
+ b. You may not use the Software Products or Derivative Works to enable third parties to use the Software Products or Derivative Works as part of your hosted service or via your APIs, whether you are adding substantial additional functionality thereto or not. Merely distributing the Software Products or Derivative Works for download online without offering any related service (ex. by distributing the Models on HuggingFace) is not a violation of this subsection. If you wish to use the Software Products or any Derivative Works for commercial or production use or you wish to make the Software Products or any Derivative Works available to third parties via your hosted service or your APIs, contact Stability AI at https://stability.ai/contact.
32
+ c. If you distribute or make the Software Products, or any Derivative Works thereof, available to a third party, the Software Products, Derivative Works, or any portion thereof, respectively, will remain subject to this Agreement and you must (i) provide a copy of this Agreement to such third party, and (ii) retain the following attribution notice within a "Notice" text file distributed as a part of such copies: "This Stability AI Model is licensed under the Stability AI Non-Commercial Research Community License, Copyright (c) Stability AI Ltd. All Rights Reserved.” If you create a Derivative Work of a Software Product, you may add your own attribution notices to the Notice file included with the Software Product, provided that you clearly indicate which attributions apply to the Software Product and you must state in the NOTICE file that you changed the Software Product and how it was modified.
33
+ 2. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE SOFTWARE PRODUCTS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE SOFTWARE PRODUCTS, DERIVATIVE WORKS OR ANY OUTPUT OR RESULTS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE SOFTWARE PRODUCTS, DERIVATIVE WORKS AND ANY OUTPUT AND RESULTS.
34
+ 3. Limitation of Liability. IN NO EVENT WILL STABILITY AI OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY DIRECT, INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF STABILITY AI OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
35
+ 4. Intellectual Property.
36
+ a. No trademark licenses are granted under this Agreement, and in connection with the Software Products or Derivative Works, neither Stability AI nor Licensee may use any name or mark owned by or associated with the other or any of its affiliates, except as required for reasonable and customary use in describing and redistributing the Software Products or Derivative Works.
37
+ b. Subject to Stability AI’s ownership of the Software Products and Derivative Works made by or for Stability AI, with respect to any Derivative Works that are made by you, as between you and Stability AI, you are and will be the owner of such Derivative Works
38
+ c. If you institute litigation or other proceedings against Stability AI (including a cross-claim or counterclaim in a lawsuit) alleging that the Software Products, Derivative Works or associated outputs or results, or any portion of any of the foregoing, constitutes infringement of intellectual property or other rights owned or licensable by you, then any licenses granted to you under this Agreement shall terminate as of the date such litigation or claim is filed or instituted. You will indemnify and hold harmless Stability AI from and against any claim by any third party arising out of or related to your use or distribution of the Software Products or Derivative Works in violation of this Agreement.
39
+ 5. Term and Termination. The term of this Agreement will commence upon your acceptance of this Agreement or access to the Software Products and will continue in full force and effect until terminated in accordance with the terms and conditions herein. Stability AI may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of any Software Products or Derivative Works. Sections 2-4 shall survive the termination of this Agreement.
40
+
41
+ 6. Governing Law. This Agreement will be governed by and construed in accordance with the laws of the United States and the State of California without regard to choice of law
42
+ principles.
feature_extractor/preprocessor_config.json ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "crop_size": {
3
+ "height": 224,
4
+ "width": 224
5
+ },
6
+ "do_center_crop": true,
7
+ "do_convert_rgb": true,
8
+ "do_normalize": true,
9
+ "do_rescale": true,
10
+ "do_resize": true,
11
+ "image_mean": [
12
+ 0.48145466,
13
+ 0.4578275,
14
+ 0.40821073
15
+ ],
16
+ "image_processor_type": "CLIPImageProcessor",
17
+ "image_std": [
18
+ 0.26862954,
19
+ 0.26130258,
20
+ 0.27577711
21
+ ],
22
+ "resample": 3,
23
+ "rescale_factor": 0.00392156862745098,
24
+ "size": {
25
+ "shortest_edge": 224
26
+ }
27
+ }
image_encoder/config.json ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "/home/disty/.cache/huggingface/hub/models--stabilityai--stable-cascade-prior/snapshots/7ca32c21c3b4d4e35bbb94fcfedfb4fa2259bd91/image_encoder",
3
+ "architectures": [
4
+ "CLIPVisionModelWithProjection"
5
+ ],
6
+ "attention_dropout": 0.0,
7
+ "dropout": 0.0,
8
+ "hidden_act": "quick_gelu",
9
+ "hidden_size": 1024,
10
+ "image_size": 224,
11
+ "initializer_factor": 1.0,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 4096,
14
+ "layer_norm_eps": 1e-05,
15
+ "model_type": "clip_vision_model",
16
+ "num_attention_heads": 16,
17
+ "num_channels": 3,
18
+ "num_hidden_layers": 24,
19
+ "patch_size": 14,
20
+ "projection_dim": 768,
21
+ "torch_dtype": "float16",
22
+ "transformers_version": "4.38.0"
23
+ }
image_encoder/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0dd0c1777bb75e2e9b7aa29b799b3ee8ebaaaa731e2c471a9ec589f12542cce7
3
+ size 607980096
model_index.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "StableCascadePriorPipeline",
3
+ "_diffusers_version": "0.28.0.dev0",
4
+ "_name_or_path": "Disty0/sotediffusion-wuerstchen3-alpha2",
5
+ "feature_extractor": [
6
+ "transformers",
7
+ "CLIPImageProcessor"
8
+ ],
9
+ "image_encoder": [
10
+ "transformers",
11
+ "CLIPVisionModelWithProjection"
12
+ ],
13
+ "prior": [
14
+ "diffusers",
15
+ "StableCascadeUNet"
16
+ ],
17
+ "resolution_multiple": 42.67,
18
+ "scheduler": [
19
+ "diffusers",
20
+ "DDPMWuerstchenScheduler"
21
+ ],
22
+ "text_encoder": [
23
+ "transformers",
24
+ "CLIPTextModelWithProjection"
25
+ ],
26
+ "tokenizer": [
27
+ "transformers",
28
+ "CLIPTokenizerFast"
29
+ ]
30
+ }
prior/config.json ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "StableCascadeUNet",
3
+ "_diffusers_version": "0.28.0.dev0",
4
+ "block_out_channels": [
5
+ 2048,
6
+ 2048
7
+ ],
8
+ "block_types_per_layer": [
9
+ [
10
+ "SDCascadeResBlock",
11
+ "SDCascadeTimestepBlock",
12
+ "SDCascadeAttnBlock"
13
+ ],
14
+ [
15
+ "SDCascadeResBlock",
16
+ "SDCascadeTimestepBlock",
17
+ "SDCascadeAttnBlock"
18
+ ]
19
+ ],
20
+ "clip_image_in_channels": 768,
21
+ "clip_seq": 4,
22
+ "clip_text_in_channels": 1280,
23
+ "clip_text_pooled_in_channels": 1280,
24
+ "conditioning_dim": 2048,
25
+ "down_blocks_repeat_mappers": [
26
+ 1,
27
+ 1
28
+ ],
29
+ "down_num_layers_per_block": [
30
+ 8,
31
+ 24
32
+ ],
33
+ "dropout": [
34
+ 0.1,
35
+ 0.1
36
+ ],
37
+ "effnet_in_channels": null,
38
+ "in_channels": 16,
39
+ "kernel_size": 3,
40
+ "num_attention_heads": [
41
+ 32,
42
+ 32
43
+ ],
44
+ "out_channels": 16,
45
+ "patch_size": 1,
46
+ "pixel_mapper_in_channels": null,
47
+ "self_attn": true,
48
+ "switch_level": [
49
+ false
50
+ ],
51
+ "timestep_conditioning_type": [
52
+ "sca",
53
+ "crp"
54
+ ],
55
+ "timestep_ratio_embedding_dim": 64,
56
+ "up_blocks_repeat_mappers": [
57
+ 1,
58
+ 1
59
+ ],
60
+ "up_num_layers_per_block": [
61
+ 24,
62
+ 8
63
+ ]
64
+ }
prior/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aefcd04046b225ac91e3bfa80c4c29e34b7dbc25d96711073297854e91f64ea7
3
+ size 7178376264
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "DDPMWuerstchenScheduler",
3
+ "_diffusers_version": "0.28.0.dev0",
4
+ "s": 0.008,
5
+ "scaler": 1.0
6
+ }
sotediffusion-wr3_3b-alpha2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:394f93a86f687509c1db77b84421488448599d10ad17cbf7de23bb1539014353
3
+ size 7178349784
sotediffusion-wr3_3b-alpha2_text_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e800ba63ee61cd17aa45b50c04536bd8c49b29f1c84491f0c39ef90c523fed0
3
+ size 1389382144
text_encoder/config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "CLIPTextModelWithProjection"
4
+ ],
5
+ "attention_dropout": 0.0,
6
+ "bos_token_id": 0,
7
+ "dropout": 0.0,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_size": 1280,
11
+ "initializer_factor": 1.0,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 5120,
14
+ "layer_norm_eps": 1e-05,
15
+ "max_position_embeddings": 77,
16
+ "model_type": "clip_text_model",
17
+ "num_attention_heads": 20,
18
+ "num_hidden_layers": 32,
19
+ "pad_token_id": 1,
20
+ "projection_dim": 1280,
21
+ "torch_dtype": "float16",
22
+ "transformers_version": "4.38.0",
23
+ "vocab_size": 49408
24
+ }
text_encoder/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:060524e86c6ed7d1bdef57bdb1ed8f7157fc28b06faa4000d967b358e185e37f
3
+ size 1389382176
tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|startoftext|>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|endoftext|>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "<|endoftext|>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<|endoftext|>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "49406": {
5
+ "content": "<|startoftext|>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "49407": {
13
+ "content": "<|endoftext|>",
14
+ "lstrip": false,
15
+ "normalized": false,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ }
20
+ },
21
+ "bos_token": "<|startoftext|>",
22
+ "clean_up_tokenization_spaces": true,
23
+ "do_lower_case": true,
24
+ "eos_token": "<|endoftext|>",
25
+ "errors": "replace",
26
+ "model_max_length": 77,
27
+ "pad_token": "<|endoftext|>",
28
+ "tokenizer_class": "CLIPTokenizer",
29
+ "unk_token": "<|endoftext|>"
30
+ }
tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff