seeklhy commited on
Commit
5ea4631
1 Parent(s): 61a2535

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - sql
4
+ - code
5
+ tags:
6
+ - SQL generation
7
+ - Text-to-SQL
8
+ - text2sql
9
+ license: "apache-2.0"
10
+ ---
11
+
12
+ # CodeS-3B
13
+
14
+ CodeS is a series of Code LLMs specifically optimized for SQL generation.
15
+
16
+ The CodeS encompasses 1B, 3B, 7B, and 15B scales. CodeS-1B, 3B, and 7B are incrementally pre-trained on the top of StarCoderBase-1B, 3B, and 7B and support the max length of 8,192. Meanwhile, CodeS-15B, derived from StarCoder-15B, accommodates sequences of up to 6,144 tokens.
17
+
18
+ We have demonstrated that CodeS achieves new state-of-the-art performance on two challenging Text-to-SQL benchmarks: Spider and Bird.
19
+
20
+ For more details about how to use CodeS, please refer to our GitHub page: https://github.com/RUCKBReasoning/codes.
21
+
22
+ (This is the repository of CodeS-3B.)
23
+