Upload TFDistilBertForQuestionAnswering

#1
by Priya1118 - opened
Files changed (3) hide show
  1. README.md +18 -35
  2. config.json +1 -1
  3. tf_model.h5 +1 -1
README.md CHANGED
@@ -1,53 +1,37 @@
1
  ---
2
- datasets:
3
- - squad
4
  license: apache-2.0
5
- tags:
6
  - generated_from_keras_callback
7
- metrics:
8
- - f1
9
- model-index:
10
  - name: transformers-qa
11
- results:
12
- - task:
13
- name: "Question Answering"
14
- type: question-answering
15
- dataset:
16
- type: squad
17
- name: SQuAD
18
- args: en
19
- metrics:
20
- []
21
- widget:
22
- - context: "Keras is an API designed for human beings, not machines. Keras follows best practices for reducing cognitive load: it offers consistent & simple APIs, it minimizes the number of user actions required for common use cases, and it provides clear and actionable feedback upon user error."
23
  ---
 
24
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
25
  probably proofread and complete it, then remove this comment. -->
26
 
27
- # Question Answering with Hugging Face Transformers and Keras 🤗❤️
28
 
29
- This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on SQuAD dataset.
30
  It achieves the following results on the evaluation set:
31
- - Train Loss: 0.9300
32
- - Validation Loss: 1.1437
33
- - Epoch: 1
34
 
35
  ## Model description
36
 
37
- Question answering model based on distilbert-base-cased, trained with 🤗Transformers + ❤️Keras.
38
 
39
  ## Intended uses & limitations
40
 
41
- This model is trained for Question Answering tutorial for Keras.io.
42
 
43
  ## Training and evaluation data
44
 
45
- It is trained on [SQuAD](https://huggingface.co/datasets/squad) question answering dataset. ⁉️
46
 
47
  ## Training procedure
48
 
49
- Find the notebook in Keras Examples [here](https://keras.io/examples/nlp/question_answering/). ❤️
50
-
51
  ### Training hyperparameters
52
 
53
  The following hyperparameters were used during training:
@@ -58,13 +42,12 @@ The following hyperparameters were used during training:
58
 
59
  | Train Loss | Validation Loss | Epoch |
60
  |:----------:|:---------------:|:-----:|
61
- | 1.5145 | 1.1500 | 0 |
62
- | 0.9300 | 1.1437 | 1 |
63
-
64
 
65
  ### Framework versions
66
 
67
- - Transformers 4.16.0.dev0
68
- - TensorFlow 2.6.0
69
- - Datasets 1.16.2.dev0
70
- - Tokenizers 0.10.3
 
1
  ---
 
 
2
  license: apache-2.0
3
+ tags:
4
  - generated_from_keras_callback
5
+ model-index:
 
 
6
  - name: transformers-qa
7
+ results: []
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
+
10
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
11
  probably proofread and complete it, then remove this comment. -->
12
 
13
+ # transformers-qa
14
 
15
+ This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 1.5145
18
+ - Validation Loss: 1.1443
19
+ - Epoch: 0
20
 
21
  ## Model description
22
 
23
+ More information needed
24
 
25
  ## Intended uses & limitations
26
 
27
+ More information needed
28
 
29
  ## Training and evaluation data
30
 
31
+ More information needed
32
 
33
  ## Training procedure
34
 
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
 
42
 
43
  | Train Loss | Validation Loss | Epoch |
44
  |:----------:|:---------------:|:-----:|
45
+ | 1.5145 | 1.1443 | 0 |
46
+
 
47
 
48
  ### Framework versions
49
 
50
+ - Transformers 4.28.0.dev0
51
+ - TensorFlow 2.5.0
52
+ - Datasets 2.10.1
53
+ - Tokenizers 0.13.2
config.json CHANGED
@@ -19,6 +19,6 @@
19
  "seq_classif_dropout": 0.2,
20
  "sinusoidal_pos_embds": false,
21
  "tie_weights_": true,
22
- "transformers_version": "4.16.0.dev0",
23
  "vocab_size": 28996
24
  }
 
19
  "seq_classif_dropout": 0.2,
20
  "sinusoidal_pos_embds": false,
21
  "tie_weights_": true,
22
+ "transformers_version": "4.28.0.dev0",
23
  "vocab_size": 28996
24
  }
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d9a2797dee03f701b3d03f25de05f9144946933237ec2791e176babc0d288e6a
3
  size 260895816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6a05b6707bef5613a0937cea126e57f275da738f266c791ac92c4b5815135b1
3
  size 260895816