primasr commited on
Commit
09868df
1 Parent(s): 91a58c9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ms
4
+ datasets:
5
+ - squad_v2
6
+ metrics:
7
+ - exact_match
8
+ - f1
9
+ ---
10
+
11
+ # Overview
12
+ This model is an experiment I and my friend did as a researcher internship at the National University of Singapore (NUS). We finetuned the model to our datasets in Finance and Healthcare domain, in the Malay Language.
13
+
14
+ # Details
15
+ - Finetuned from the base model by [timpal0l](https://huggingface.co/timpal0l/mdeberta-v3-base-squad2)
16
+ - The base datasets from [SQuAD2.0](https://rajpurkar.github.io/SQuAD-explorer/)
17
+ - Our [datasets](https://ids.nus.edu.sg/microsites/nzsg-nlp/datahub.html) in Finance and Healthcare domain
18
+
19
+ # Finetuned Detail
20
+ ```py
21
+ from transformers import TrainingArguments
22
+
23
+ training_args = TrainingArguments(
24
+ output_dir='test_trainer',
25
+ evaluation_strategy='epoch',
26
+ num_train_epochs=20,
27
+ optim='adamw_torch',
28
+ report_to='all',
29
+ logging_steps=1,
30
+ )
31
+ ```
32
+
33
+ # How to use the Model
34
+ ```py
35
+ from transformers import AutoModelForQuestionAnswering, AutoTokenizer, pipeline
36
+
37
+ model_name = "primasr/indobert-for-eqa-finetuned"
38
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
39
+ model = AutoModelForQuestionAnswering.from_pretrained(model_name)
40
+ nlp = pipeline("question-answering", model=model, tokenizer=tokenizer)
41
+ ```