End of training

README.md

@@ -1,6 +1,12 @@
 ---
-license: mit
 base_model: FacebookAI/xlm-roberta-large
+library_name: peft
+license: mit
+metrics:
+- precision
+- recall
+- f1
+- accuracy
 tags:
 - generated_from_trainer
 model-index:
@@ -14,6 +20,12 @@ should probably proofread and complete it, then remove this comment. -->
 # xlm-roberta-large-finetuned-ner
 
 This model is a fine-tuned version of [FacebookAI/xlm-roberta-large](https://huggingface.co/FacebookAI/xlm-roberta-large) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.2867
+- Precision: 0.6163
+- Recall: 0.7379
+- F1: 0.6716
+- Accuracy: 0.8883
 
 ## Model description
 
@@ -40,9 +52,19 @@ The following hyperparameters were used during training:
 - lr_scheduler_type: linear
 - num_epochs: 3
 
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
+|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
+| 0.4493        | 1.0   | 4667  | 0.3927          | 0.5157    | 0.6138 | 0.5605 | 0.8482   |
+| 0.3428        | 2.0   | 9334  | 0.3049          | 0.5957    | 0.7215 | 0.6526 | 0.8799   |
+| 0.3306        | 3.0   | 14001 | 0.2867          | 0.6163    | 0.7379 | 0.6716 | 0.8883   |
+
+
 ### Framework versions
 
-- Transformers 4.41.2
-- Pytorch 2.3.0+cu121
+- PEFT 0.11.1
+- Transformers 4.42.3
+- Pytorch 2.1.2
 - Datasets 2.20.0
-- Tokenizers 0.19.1
+- Tokenizers 0.19.1

adapter_config.json

@@ -0,0 +1,32 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "FacebookAI/xlm-roberta-large",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 16,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": [
+    "classifier",
+    "score"
+  ],
+  "peft_type": "LORA",
+  "r": 8,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "query",
+    "value"
+  ],
+  "task_type": "TOKEN_CLS",
+  "use_dora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:526bff66eb2679a559b8a51b46b0081101899b535bf9ee714d9b183e2a7f74c9
+size 3245876

runs/Jul12_07-39-34_ee30a6211a12/events.out.tfevents.1720770020.ee30a6211a12.34.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:714d459d86bcac0c72840cdc70d14b3c33b23d07da00571101686a3ca76b4fc4
+size 5821

runs/Jul12_07-40-44_ee30a6211a12/events.out.tfevents.1720770055.ee30a6211a12.34.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90653cfbe4f9df9a0a25e990074502756058f984c64c43ab9d460b68bed96fdf
+size 5818

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4b3d93018b2d6a7cb836813c0b4bc608630606f2963cc3ef8078af4aa242ae5e
-size 5112
+oid sha256:cf7ea53ac963056c404e9f7f98c9127d14267bdb2ef072d868736667034c0093
+size 5176