Transformers
GGUF
llama
doberst commited on
Commit
fc5a297
·
verified ·
1 Parent(s): 0b414d3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -12,6 +12,8 @@ inference: false
12
 
13
  This model has been fine-tuned to implement a general-purpose extraction function that takes a custom key as input parameter, and generates a python dictionary consisting of that custom key with the value consisting of a list of the values associated with that key in the text.
14
 
 
 
15
  The intent of SLIMs is to forge a middle-ground between traditional encoder-based classifiers and open-ended API-based LLMs.
16
 
17
 
 
12
 
13
  This model has been fine-tuned to implement a general-purpose extraction function that takes a custom key as input parameter, and generates a python dictionary consisting of that custom key with the value consisting of a list of the values associated with that key in the text.
14
 
15
+ The size of the self-contained GGUF model binary is less than 700 MB, which is small enough to run locally on a CPU with reasonable inference speed, and has been designed to balance solid quality with fast loading and inference on a local machine.
16
+
17
  The intent of SLIMs is to forge a middle-ground between traditional encoder-based classifiers and open-ended API-based LLMs.
18
 
19