Niansuh commited on
Commit
495ef01
1 Parent(s): 931ae96

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: google/t5-v1_1-xxl
3
+ library_name: gguf
4
+ license: apache-2.0
5
+ quantized_by: city96
6
+ language: en
7
+ ---
8
+
9
+ This is a GGUF conversion of Google's T5 v1.1 XXL encoder model.
10
+
11
+ The weights can be used with [`./llama-embedding`](https://github.com/ggerganov/llama.cpp/tree/master/examples/embedding) or with the [ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF) custom node together with image generation models.
12
+
13
+ This is a **non imatrix** quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use **Q5_K_M or larger** for the best results, although smaller models may also still provide decent results in resource constrained scenarios.