Yesimm commited on
Commit
af385de
·
verified ·
1 Parent(s): 949a0e2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -11
README.md CHANGED
@@ -9,16 +9,16 @@ tags:
9
  - AceGPT-7B-Chat
10
  ---
11
  # InfectA-Chat
12
- <!--To prevent adversial effects of infectious diseases, clear and accessible communication, tracking infectious diseases regularly is crucial. InfectA-Chat is a generative model specifically designed to address this need. Built upon the powerful AceGPT-7B-Chat pre-trained model, InfectA-Chat is fine-tuned to track infectious diseases outbreaks in the infectious diseases domain. This makes it a valuable tool for facilitating communication in both Arabic and English, potentially bridging language barriers and fostering a deeper understanding of infectious diseases.-->
13
 
14
  # Model Details
15
- <!--In the fight against infectious diseases in the Middle East, clear and effective communication is paramount. We're excited to announce the release of InfectA-Chat, a generative text model fine-tuned on the AceGPT-7B-Chat model. Designed specifically for the Arabic and English languages, InfectA-Chat excels at following instructions related to infectious disease topics. Notably, our models outperform existing Arabic and state-of-the-art LLMs on Q&A task involving infectious disease instructions while competing with GPT-4. This advancement has the potential to significantly improve communication and disease tracking efforts in the specific region.-->
16
 
17
- - **Developed by:** [Korea Institute of Science and Technology]
18
- - **Language(s) (NLP):** [Arabic, English]
19
- - **License:** [Creative Commons Attribution 2.0]
20
- - **Finetuned from model [optional]:** [AceGPT-7B-Chat]
21
- - **Repository:** [KISTI-AI/InfectA-Chat]
22
 
23
  # Training Details
24
 
@@ -26,16 +26,16 @@ tags:
26
  InfectA-Chat was instruction fine-tuned with 55,400 infectious diseases-related instruction-following data.
27
 
28
  ## Training Procedure
29
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
30
 
31
  ## Training Hyperparameters
32
 
33
- - **Training regime:** [fp32] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
34
 
35
  # Evaluation
36
 
37
  ## Evaluation Results on Infectious Diseases-related Instruction-Following Dataset
38
- <!-- Experiments on infectious diseases-related instruction-following data and Arabic MMLU benchmark dataset. ‘STEM’, ‘Humanities’, ‘Social Sciences’, ‘Others’ belong to Arabic MMLU. -->
39
 
40
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6516795fb84fb7bc6cc34fd9/CQnUnZUWNqlJIM2F77mde.png)
41
 
@@ -45,4 +45,4 @@ InfectA-Chat was instruction fine-tuned with 55,400 infectious diseases-related
45
 
46
  ## Evaluation Results on Arabic MMLU Benchmark Dataset
47
 
48
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6516795fb84fb7bc6cc34fd9/duwgP2pRuPGqd5o-wCNuy.png)
 
9
  - AceGPT-7B-Chat
10
  ---
11
  # InfectA-Chat
12
+ To prevent adversial effects of infectious diseases, clear and accessible communication, tracking infectious diseases regularly is crucial. InfectA-Chat is a generative model specifically designed to address this need. Built upon the powerful AceGPT-7B-Chat pre-trained model, InfectA-Chat is fine-tuned to track infectious diseases outbreaks in the infectious diseases domain. This makes it a valuable tool for facilitating communication in both Arabic and English, potentially bridging language barriers and fostering a deeper understanding of infectious diseases.
13
 
14
  # Model Details
15
+ In the fight against infectious diseases in the Middle East, clear and effective communication is paramount. We're excited to announce the release of InfectA-Chat, a generative text model fine-tuned on the AceGPT-7B-Chat model. Designed specifically for the Arabic and English languages, InfectA-Chat excels at following instructions related to infectious disease topics. Notably, our models outperform existing Arabic and state-of-the-art LLMs on Q&A task involving infectious disease instructions while competing with GPT-4. This advancement has the potential to significantly improve communication and disease tracking efforts in the specific region.
16
 
17
+ - **Developed by:** Korea Institute of Science and Technology
18
+ - **Language(s) (NLP):** Arabic, English
19
+ - **License:** Creative Commons Attribution 2.0
20
+ - **Finetuned from model [optional]:** AceGPT-7B-Chat
21
+ - **Repository:** KISTI-AI/InfectA-Chat
22
 
23
  # Training Details
24
 
 
26
  InfectA-Chat was instruction fine-tuned with 55,400 infectious diseases-related instruction-following data.
27
 
28
  ## Training Procedure
29
+ This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure.
30
 
31
  ## Training Hyperparameters
32
 
33
+ - **Training regime:** fp32 <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
34
 
35
  # Evaluation
36
 
37
  ## Evaluation Results on Infectious Diseases-related Instruction-Following Dataset
38
+ Experiments on infectious diseases-related instruction-following data and Arabic MMLU benchmark dataset. ‘STEM’, ‘Humanities’, ‘Social Sciences’, ‘Others’ belong to Arabic MMLU.
39
 
40
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6516795fb84fb7bc6cc34fd9/CQnUnZUWNqlJIM2F77mde.png)
41
 
 
45
 
46
  ## Evaluation Results on Arabic MMLU Benchmark Dataset
47
 
48
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6516795fb84fb7bc6cc34fd9/ZbNQ83BkyngiSewxXvik_.png)