CyberNative
commited on
Commit
·
ec9a6fe
1
Parent(s):
6b78b29
Update README.md
Browse files
README.md
CHANGED
@@ -1,18 +1,17 @@
|
|
1 |
---
|
2 |
license: llama2
|
3 |
---
|
4 |
-
|
5 |
-
!!! THIS IS A PLACEHOLDER !!!
|
6 |
!!! MODEL COMMING SOON !!!
|
7 |
|
8 |
# CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
|
9 |
|
10 |
Base cybersecurity model for future fine-tuning, it is not reccomended to use on it's own.
|
11 |
-
- **CyberBase is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on
|
12 |
-
- **sequence_len
|
13 |
-
- **lora_r
|
14 |
-
- **lora_alpha
|
15 |
-
- **num_epochs
|
16 |
|
17 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
18 |
|
|
|
1 |
---
|
2 |
license: llama2
|
3 |
---
|
4 |
+
!!! **THIS IS A PLACEHOLDER** !!!
|
|
|
5 |
!!! MODEL COMMING SOON !!!
|
6 |
|
7 |
# CyberBase 8k - (llama-2-13b - lmsys/vicuna-13b-v1.5-16k)
|
8 |
|
9 |
Base cybersecurity model for future fine-tuning, it is not reccomended to use on it's own.
|
10 |
+
- **CyberBase** is a [lmsys/vicuna-13b-v1.5-16k](https://huggingface.co/lmsys/vicuna-13b-v1.5-16k) QLORA fine-tuned on [CyberNative/github_cybersecurity_READMEs](https://huggingface.co/datasets/CyberNative/github_cybersecurity_READMEs)
|
11 |
+
- **sequence_len:** 8192
|
12 |
+
- **lora_r:** 128
|
13 |
+
- **lora_alpha:** 16
|
14 |
+
- **num_epochs:** 2
|
15 |
|
16 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
17 |
|