yujiepan commited on
Commit
9798f35
1 Parent(s): e33e4e8

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ # yujiepan/starcoder-tiny-random
3
+
4
+ This model is **randomly initialized**, using the config from [bigcode/starcoderbase-7b](https://huggingface.co/bigcode/starcoderbase-7b/tree/main) but with the following modifications:
5
+
6
+ ```json
7
+ {
8
+ "n_embd": 32,
9
+ "n_head": 8,
10
+ "n_inner": 128,
11
+ "n_layer": 1,
12
+ }
13
+ ```