tjasad/prompt_fine_tuned_boolq

README.md

@@ -1,8 +1,9 @@
 ---
 license: apache-2.0
-base_model: distilbert/distilbert-base-uncased
+library_name: peft
 tags:
 - generated_from_trainer
+base_model: distilbert/distilbert-base-uncased
 metrics:
 - accuracy
 model-index:
@@ -17,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6685
-- Accuracy: 0.7778
+- Loss: 0.6702
+- Accuracy: 0.8333
 
 ## Model description
 
@@ -49,13 +50,14 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 12   | 0.6783          | 0.7778   |
-| No log        | 2.0   | 24   | 0.6685          | 0.7778   |
+| No log        | 1.0   | 12   | 0.6804          | 0.8333   |
+| No log        | 2.0   | 24   | 0.6702          | 0.8333   |
 
 
 ### Framework versions
 
+- PEFT 0.10.0
 - Transformers 4.40.1
 - Pytorch 2.2.1+cu121
 - Datasets 2.19.0
-- Tokenizers 0.19.1
+- Tokenizers 0.19.1

adapter_config.json

@@ -0,0 +1,17 @@
+{
+  "auto_mapping": null,
+  "base_model_name_or_path": "distilbert/distilbert-base-uncased",
+  "inference_mode": true,
+  "num_attention_heads": 12,
+  "num_layers": 6,
+  "num_transformer_submodules": 1,
+  "num_virtual_tokens": 4,
+  "peft_type": "PROMPT_TUNING",
+  "prompt_tuning_init": "RANDOM",
+  "prompt_tuning_init_text": null,
+  "revision": null,
+  "task_type": "SEQ_CLS",
+  "token_dim": 768,
+  "tokenizer_kwargs": null,
+  "tokenizer_name_or_path": "distilbert/distilbert-base-uncased"
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e7ad405660ad2023ae83b6741b4f0fc0d938b4d36583fe6c7d52e56a3163837
+size 2381288

runs/May02_08-40-08_65e05a84f558/events.out.tfevents.1714639240.65e05a84f558.205.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b64b9ebe8f8e9c39529c55a502c6818d45ab82561c1c6f89c0a8bf57e44b1ab
+size 88

runs/May02_08-41-59_65e05a84f558/events.out.tfevents.1714639333.65e05a84f558.205.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e205e16fc84f899a2f3a554d1384e53e38ba9fac695ec71382a121ebcc9e4fe
+size 5696

tokenizer.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:91f1def9b9391fdabe028cd3f3fcc4efd34e5d1f08c3bf2de513ebb5911a1854
+oid sha256:4e09bc048e215b6c9512d0445ce5e94894a86ea69198fd64daab7910a772ea66
 size 711649

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0323cde6e58819fdbe4a91f2860b457db5eff032df2f58e5026ef98f6b7323e3
+oid sha256:1aea3257525c41fa154d6d8337138aa00712698be1730faa700304bf3a909c48
 size 4984