LLukas22 commited on
Commit
1dcb204
1 Parent(s): ef4ba42

Update README_TEMPLATE.md

Browse files
Files changed (1) hide show
  1. README_TEMPLATE.md +5 -64
README_TEMPLATE.md CHANGED
@@ -1,77 +1,18 @@
1
  ---
2
- license: bigscience-bloom-rail-1.0
3
  language:
4
- - ak
5
- - ar
6
- - as
7
- - bm
8
- - bn
9
- - ca
10
- - code
11
  - en
12
- - es
13
- - eu
14
- - fon
15
- - fr
16
- - gu
17
- - hi
18
- - id
19
- - ig
20
- - ki
21
- - kn
22
- - lg
23
- - ln
24
- - ml
25
- - mr
26
- - ne
27
- - nso
28
- - ny
29
- - or
30
- - pa
31
- - pt
32
- - rn
33
- - rw
34
- - sn
35
- - st
36
- - sw
37
- - ta
38
- - te
39
- - tn
40
- - ts
41
- - tum
42
- - tw
43
- - ur
44
- - vi
45
- - wo
46
- - xh
47
- - yo
48
- - zh
49
- - zu
50
- programming_language:
51
- - C
52
- - C++
53
- - C#
54
- - Go
55
- - Java
56
- - JavaScript
57
- - Lua
58
- - PHP
59
- - Python
60
- - Ruby
61
- - Rust
62
- - Scala
63
- - TypeScript
64
  tags:
65
  - llm-rs
66
  - ggml
67
  pipeline_tag: text-generation
68
  ---
69
 
70
- # GGML covnerted Models of [BigScience](https://huggingface.co/bigscience)'s Bloom models
71
 
72
  ## Description
73
 
74
- BLOOM is an autoregressive Large Language Model (LLM), trained to continue text from a prompt on vast amounts of text data using industrial-scale computational resources. As such, it is able to output coherent text in 46 languages and 13 programming languages that is hardly distinguishable from text written by humans. BLOOM can also be instructed to perform text tasks it hasn't been explicitly trained for, by casting them as text generation tasks.
75
 
76
 
77
  ## Converted Models
@@ -89,7 +30,7 @@ Via pip: `pip install llm-rs`
89
  from llm_rs import AutoModel
90
 
91
  #Load the model, define any model you like from the list above as the `model_file`
92
- model = AutoModel.from_pretrained("rustformers/bloom-ggml",model_file="bloom-3b-q4_0-ggjt.bin")
93
 
94
  #Generate
95
  print(model.generate("The meaning of life is"))
@@ -106,5 +47,5 @@ cargo build --release
106
 
107
  #### Run inference
108
  ```
109
- cargo run --release -- bloom infer -m path/to/model.bin -p "Tell me how cool the Rust programming language is:"
110
  ```
 
1
  ---
2
+ license: cc-by-sa-4.0
3
  language:
 
 
 
 
 
 
 
4
  - en
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  tags:
6
  - llm-rs
7
  - ggml
8
  pipeline_tag: text-generation
9
  ---
10
 
11
+ # GGML converted version of [StabilityAI](https://huggingface.co/stabilityai)'s StableLM models
12
 
13
  ## Description
14
 
15
+ `StableLM-Base-Alpha` is a suite of 3B and 7B parameter decoder-only language models pre-trained on a diverse collection of English and Code datasets with a sequence length of 4096 to push beyond the context window limitations of existing open-source language models.
16
 
17
 
18
  ## Converted Models
 
30
  from llm_rs import AutoModel
31
 
32
  #Load the model, define any model you like from the list above as the `model_file`
33
+ model = AutoModel.from_pretrained("rustformers/stablelm-ggml",model_file="stablelm-base-alpha-3b-q4_0-ggjt.bin")
34
 
35
  #Generate
36
  print(model.generate("The meaning of life is"))
 
47
 
48
  #### Run inference
49
  ```
50
+ cargo run --release -- gptneox infer -m path/to/model.bin -p "Tell me how cool the Rust programming language is:"
51
  ```