danielpark
commited on
Commit
•
05078ae
1
Parent(s):
2d6c63f
Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,10 @@ I'm interested in companies based outside of South Korea that can provide resour
|
|
13 |
Please note that companies with Korean employees, offices in South Korea, or a specific focus on AI-related businesses in South Korea, as well as those engaged in hiring within South Korea, are not eligible. These exclusions will be clearly outlined and confirmed through the drafting and signing of a legally binding contract.
|
14 |
|
15 |
# The project is currently in progress. Please refrain from using weights and datasets.
|
16 |
-
- We are currently conducting experiments using various techniques such as max sequence length, rope scaling, attention sinks, and flash attention 2.
|
|
|
|
|
|
|
17 |
- For `GORANI`, it is intended for research purposes, and for the Korean language model, `KORANI`, it can be used under a commercial use license.
|
18 |
|
19 |
## Status: 19.7k check point weights open, waiting for the results on the LLM leaderboard.
|
@@ -37,6 +40,7 @@ Please note that companies with Korean employees, offices in South Korea, or a s
|
|
37 |
- Model: [danielpark/gorani-100k-llama2-13b-instruct](https://huggingface.co/danielpark/gorani-100k-llama2-13b-instruct)
|
38 |
- Dataset: [danielpark/gorani-100k](https://huggingface.co/danielpark/gorani-100k)
|
39 |
- **License**: This model is licensed under the Meta's [LLaMA2 license](https://github.com/facebookresearch/llama/blob/main/LICENSE). You may not use it commercially, and you must adhere to the licenses of the included datasets. Therefore, we currently adopt the strictest and most restrictive license. Please refrain from using it for commercial purposes under any circumstances until an official license is issued.
|
|
|
40 |
## Template
|
41 |
I use llama2-13b with LFM, but I have used it without a default system message. If a system message is specified in some datasets, I use that content.
|
42 |
```
|
|
|
13 |
Please note that companies with Korean employees, offices in South Korea, or a specific focus on AI-related businesses in South Korea, as well as those engaged in hiring within South Korea, are not eligible. These exclusions will be clearly outlined and confirmed through the drafting and signing of a legally binding contract.
|
14 |
|
15 |
# The project is currently in progress. Please refrain from using weights and datasets.
|
16 |
+
- We are currently conducting experiments using various techniques such as max sequence length, rope scaling, attention sinks, and flash attention 2.
|
17 |
+
- Please do not use the current model weights as they are not useful.
|
18 |
+
- In respect of the licensing of the dataset used for training, we have adopted a non-commercial use (CC-BY-NC-4.0) license.
|
19 |
+
- Once the training is complete, we will provide information about the datasets used along with the official release.
|
20 |
- For `GORANI`, it is intended for research purposes, and for the Korean language model, `KORANI`, it can be used under a commercial use license.
|
21 |
|
22 |
## Status: 19.7k check point weights open, waiting for the results on the LLM leaderboard.
|
|
|
40 |
- Model: [danielpark/gorani-100k-llama2-13b-instruct](https://huggingface.co/danielpark/gorani-100k-llama2-13b-instruct)
|
41 |
- Dataset: [danielpark/gorani-100k](https://huggingface.co/danielpark/gorani-100k)
|
42 |
- **License**: This model is licensed under the Meta's [LLaMA2 license](https://github.com/facebookresearch/llama/blob/main/LICENSE). You may not use it commercially, and you must adhere to the licenses of the included datasets. Therefore, we currently adopt the strictest and most restrictive license. Please refrain from using it for commercial purposes under any circumstances until an official license is issued.
|
43 |
+
|
44 |
## Template
|
45 |
I use llama2-13b with LFM, but I have used it without a default system message. If a system message is specified in some datasets, I use that content.
|
46 |
```
|