Commit
β’
db0751c
1
Parent(s):
f311688
update model card README.md
Browse files
README.md
ADDED
@@ -0,0 +1,68 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
datasets:
|
6 |
+
- common_voice
|
7 |
+
model-index:
|
8 |
+
- name: ''
|
9 |
+
results: []
|
10 |
+
---
|
11 |
+
|
12 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
13 |
+
should probably proofread and complete it, then remove this comment. -->
|
14 |
+
|
15 |
+
#
|
16 |
+
|
17 |
+
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the common_voice dataset.
|
18 |
+
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 0.5476
|
20 |
+
- Wer: 0.4059
|
21 |
+
|
22 |
+
## Model description
|
23 |
+
|
24 |
+
More information needed
|
25 |
+
|
26 |
+
## Intended uses & limitations
|
27 |
+
|
28 |
+
More information needed
|
29 |
+
|
30 |
+
## Training and evaluation data
|
31 |
+
|
32 |
+
More information needed
|
33 |
+
|
34 |
+
## Training procedure
|
35 |
+
|
36 |
+
### Training hyperparameters
|
37 |
+
|
38 |
+
The following hyperparameters were used during training:
|
39 |
+
- learning_rate: 0.0003
|
40 |
+
- train_batch_size: 32
|
41 |
+
- eval_batch_size: 8
|
42 |
+
- seed: 42
|
43 |
+
- gradient_accumulation_steps: 2
|
44 |
+
- total_train_batch_size: 64
|
45 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
46 |
+
- lr_scheduler_type: linear
|
47 |
+
- lr_scheduler_warmup_steps: 500
|
48 |
+
- num_epochs: 40.0
|
49 |
+
- mixed_precision_training: Native AMP
|
50 |
+
|
51 |
+
### Training results
|
52 |
+
|
53 |
+
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
54 |
+
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
55 |
+
| No log | 6.35 | 400 | 0.9380 | 0.7902 |
|
56 |
+
| 3.2674 | 12.7 | 800 | 0.5794 | 0.5309 |
|
57 |
+
| 0.7531 | 19.05 | 1200 | 0.5749 | 0.4815 |
|
58 |
+
| 0.5382 | 25.4 | 1600 | 0.5530 | 0.4447 |
|
59 |
+
| 0.4293 | 31.75 | 2000 | 0.5709 | 0.4237 |
|
60 |
+
| 0.4293 | 38.1 | 2400 | 0.5476 | 0.4059 |
|
61 |
+
|
62 |
+
|
63 |
+
### Framework versions
|
64 |
+
|
65 |
+
- Transformers 4.17.0.dev0
|
66 |
+
- Pytorch 1.10.1+cu102
|
67 |
+
- Datasets 1.18.3
|
68 |
+
- Tokenizers 0.11.0
|
wandb/run-20220204_121013-1s9mhb6h/files/output.log
CHANGED
@@ -2839,3 +2839,30 @@ Configuration saved in ./preprocessor_config.json
|
|
2839 |
Saving model checkpoint to ./
|
2840 |
Configuration saved in ./config.json
|
2841 |
Model weights saved in ./pytorch_model.bin
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2839 |
Saving model checkpoint to ./
|
2840 |
Configuration saved in ./config.json
|
2841 |
Model weights saved in ./pytorch_model.bin
|
2842 |
+
Configuration saved in ./preprocessor_config.json
|
2843 |
+
|
2844 |
+
|
2845 |
+
|
2846 |
+
|
2847 |
+
|
2848 |
+
|
2849 |
+
|
2850 |
+
|
2851 |
+
|
2852 |
+
|
2853 |
+
|
2854 |
+
|
2855 |
+
|
2856 |
+
|
2857 |
+
|
2858 |
+
|
2859 |
+
|
2860 |
+
|
2861 |
+
|
2862 |
+
|
2863 |
+
Upload file pytorch_model.bin: 100%|βββββββββββββββββββββββββββββββββββββββββββββββββββββββ| 1.17G/1.18G [00:40<00:00, 31.9MB/s]
|
2864 |
+
02/04/2022 15:03:59 - WARNING - huggingface_hub.repository - To https://huggingface.co/ayameRushia/wav2vec2-large-xls-r-300m-mn
|
2865 |
+
Upload file pytorch_model.bin: 100%|βββββββββββββββββββββββββββββββββββββββββββββββββββββββ| 1.17G/1.18G [00:40<00:00, 31.9MB/s]To https://huggingface.co/ayameRushia/wav2vec2-large-xls-r-300m-mn
|
2866 |
+
8eaa216..f311688 main -> main
|
2867 |
+
Upload file pytorch_model.bin: 100%|βββββββββββββββββββββββββββββββββββββββββββββββββββββββ| 1.18G/1.18G [00:41<00:00, 30.4MB/s]
|
2868 |
+
Dropping the following result as it does not have all the necessary fields:
|
wandb/run-20220204_121013-1s9mhb6h/logs/debug-internal.log
CHANGED
@@ -5801,3 +5801,35 @@
|
|
5801 |
2022-02-04 15:03:03,074 DEBUG HandlerThread:508894 [handler.py:handle_request():130] handle_request: stop_status
|
5802 |
2022-02-04 15:03:03,074 DEBUG SenderThread:508894 [sender.py:send_request():248] send_request: stop_status
|
5803 |
2022-02-04 15:03:15,174 DEBUG SenderThread:508894 [sender.py:send():234] send: stats
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5801 |
2022-02-04 15:03:03,074 DEBUG HandlerThread:508894 [handler.py:handle_request():130] handle_request: stop_status
|
5802 |
2022-02-04 15:03:03,074 DEBUG SenderThread:508894 [sender.py:send_request():248] send_request: stop_status
|
5803 |
2022-02-04 15:03:15,174 DEBUG SenderThread:508894 [sender.py:send():234] send: stats
|
5804 |
+
2022-02-04 15:03:18,325 DEBUG HandlerThread:508894 [handler.py:handle_request():130] handle_request: stop_status
|
5805 |
+
2022-02-04 15:03:18,325 DEBUG SenderThread:508894 [sender.py:send_request():248] send_request: stop_status
|
5806 |
+
2022-02-04 15:03:19,941 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5807 |
+
2022-02-04 15:03:21,942 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5808 |
+
2022-02-04 15:03:23,943 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5809 |
+
2022-02-04 15:03:25,944 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5810 |
+
2022-02-04 15:03:27,945 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5811 |
+
2022-02-04 15:03:29,947 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5812 |
+
2022-02-04 15:03:31,948 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5813 |
+
2022-02-04 15:03:33,502 DEBUG HandlerThread:508894 [handler.py:handle_request():130] handle_request: stop_status
|
5814 |
+
2022-02-04 15:03:33,502 DEBUG SenderThread:508894 [sender.py:send_request():248] send_request: stop_status
|
5815 |
+
2022-02-04 15:03:33,949 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5816 |
+
2022-02-04 15:03:35,951 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5817 |
+
2022-02-04 15:03:37,952 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5818 |
+
2022-02-04 15:03:39,953 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5819 |
+
2022-02-04 15:03:41,955 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5820 |
+
2022-02-04 15:03:43,957 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5821 |
+
2022-02-04 15:03:45,404 DEBUG SenderThread:508894 [sender.py:send():234] send: stats
|
5822 |
+
2022-02-04 15:03:45,958 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5823 |
+
2022-02-04 15:03:47,960 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5824 |
+
2022-02-04 15:03:48,657 DEBUG HandlerThread:508894 [handler.py:handle_request():130] handle_request: stop_status
|
5825 |
+
2022-02-04 15:03:48,657 DEBUG SenderThread:508894 [sender.py:send_request():248] send_request: stop_status
|
5826 |
+
2022-02-04 15:03:49,961 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5827 |
+
2022-02-04 15:03:51,963 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5828 |
+
2022-02-04 15:03:53,965 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5829 |
+
2022-02-04 15:03:55,967 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5830 |
+
2022-02-04 15:03:57,969 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5831 |
+
2022-02-04 15:03:59,971 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5832 |
+
2022-02-04 15:04:01,972 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
5833 |
+
2022-02-04 15:04:03,894 DEBUG HandlerThread:508894 [handler.py:handle_request():130] handle_request: stop_status
|
5834 |
+
2022-02-04 15:04:03,895 DEBUG SenderThread:508894 [sender.py:send_request():248] send_request: stop_status
|
5835 |
+
2022-02-04 15:04:03,974 INFO Thread-8 :508894 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/wav2vec2-large-xls-r-300m-mn/wandb/run-20220204_121013-1s9mhb6h/files/output.log
|
wandb/run-20220204_121013-1s9mhb6h/run-1s9mhb6h.wandb
CHANGED
Binary files a/wandb/run-20220204_121013-1s9mhb6h/run-1s9mhb6h.wandb and b/wandb/run-20220204_121013-1s9mhb6h/run-1s9mhb6h.wandb differ
|
|