azmn-posicao-fin

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [neuralmind/bert-base-portuguese-cased](https://huggingface.co/neuralmind/bert-base-portuguese-cased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0500
-- Accuracy: 0.7415
-- F1: 0.6919
-- Recall: 0.7472
-- Precision: 0.6838
+- Loss: 0.0460
+- Accuracy: 0.8367
+- F1: 0.7871
+- Recall: 0.8194
+- Precision: 0.7687
 
 ## Model description
 
@@ -51,22 +51,29 @@ The following hyperparameters were used during training:
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 150
-- num_epochs: 15
+- num_epochs: 19
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Recall | Precision |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:---------:|
-| 0.0667        | 1.0   | 18   | 0.0661          | 0.5536   | 0.4531 | 0.4520 | 0.4571    |
-| 0.0624        | 2.0   | 36   | 0.0646          | 0.6696   | 0.5743 | 0.5752 | 0.5736    |
-| 0.0625        | 3.0   | 54   | 0.0628          | 0.7321   | 0.6510 | 0.6510 | 0.6510    |
-| 0.0612        | 4.0   | 72   | 0.0603          | 0.7411   | 0.6733 | 0.6795 | 0.6687    |
-| 0.0566        | 5.0   | 90   | 0.0568          | 0.7768   | 0.7184 | 0.7260 | 0.7125    |
-| 0.0544        | 6.0   | 108  | 0.0530          | 0.7589   | 0.7216 | 0.7588 | 0.7119    |
-| 0.0488        | 7.0   | 126  | 0.0497          | 0.8214   | 0.7812 | 0.8010 | 0.7688    |
-| 0.0398        | 8.0   | 144  | 0.0498          | 0.7946   | 0.7629 | 0.8054 | 0.75      |
-| 0.0276        | 9.0   | 162  | 0.0540          | 0.8125   | 0.7681 | 0.7838 | 0.7575    |
-| 0.0184        | 10.0  | 180  | 0.0674          | 0.7679   | 0.7156 | 0.7312 | 0.7065    |
+| 0.0801        | 1.0   | 18   | 0.0769          | 0.7411   | 0.4256 | 0.5    | 0.3705    |
+| 0.0691        | 2.0   | 36   | 0.0709          | 0.75     | 0.4612 | 0.5172 | 0.8739    |
+| 0.0647        | 3.0   | 54   | 0.0661          | 0.75     | 0.4612 | 0.5172 | 0.8739    |
+| 0.0644        | 4.0   | 72   | 0.0648          | 0.6518   | 0.5774 | 0.5856 | 0.5753    |
+| 0.0621        | 5.0   | 90   | 0.0632          | 0.7054   | 0.6424 | 0.6554 | 0.6367    |
+| 0.0621        | 6.0   | 108  | 0.0627          | 0.7232   | 0.6265 | 0.6226 | 0.6319    |
+| 0.0586        | 7.0   | 126  | 0.0595          | 0.75     | 0.6937 | 0.7079 | 0.6857    |
+| 0.0547        | 8.0   | 144  | 0.0582          | 0.7768   | 0.7338 | 0.7597 | 0.7223    |
+| 0.0509        | 9.0   | 162  | 0.0554          | 0.7768   | 0.7338 | 0.7597 | 0.7223    |
+| 0.0462        | 10.0  | 180  | 0.0557          | 0.75     | 0.7091 | 0.7416 | 0.6998    |
+| 0.0437        | 11.0  | 198  | 0.0532          | 0.7768   | 0.7382 | 0.7709 | 0.7264    |
+| 0.0415        | 12.0  | 216  | 0.0515          | 0.7857   | 0.7466 | 0.7769 | 0.7341    |
+| 0.0356        | 13.0  | 234  | 0.0545          | 0.8036   | 0.7547 | 0.7665 | 0.7461    |
+| 0.0301        | 14.0  | 252  | 0.0543          | 0.8214   | 0.7770 | 0.7898 | 0.7675    |
+| 0.0262        | 15.0  | 270  | 0.0541          | 0.8036   | 0.7594 | 0.7777 | 0.7481    |
+| 0.0248        | 16.0  | 288  | 0.0583          | 0.8125   | 0.7584 | 0.7613 | 0.7557    |
+| 0.0232        | 17.0  | 306  | 0.0593          | 0.8125   | 0.7635 | 0.7725 | 0.7562    |
 
 
 ### Framework versions

config.json

@@ -3,11 +3,11 @@
   "architectures": [
     "BertForSequenceClassification"
   ],
-  "attention_probs_dropout_prob": 0.05,
+  "attention_probs_dropout_prob": 0.07,
   "classifier_dropout": null,
   "directionality": "bidi",
   "hidden_act": "gelu",
-  "hidden_dropout_prob": 0.05,
+  "hidden_dropout_prob": 0.07,
   "hidden_size": 768,
   "id2label": {
     "0": "0",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5b622937cd59df9fe36e8b0f298d053fea72fc441b0270f4e2ebb6ae0aa5dba4
+oid sha256:62321d9a4491e7119b0983a5c7ad590b2c8dc75d8c89cfc06d6875ab69313ffb
 size 435722224

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:68e6cecf2b97b2265fb08f71185bfda74485c7a75952fda0c05a1291dcda8568
+oid sha256:e7272e0fdc42df5fbdb5e3cdd4ee077095b566d6801ac1559b7146fdfff4bcba
 size 5368

wandb/debug-internal.log

@@ -1,53 +1,43 @@
-{"time":"2024-12-12T00:13:10.430874697Z","level":"INFO","msg":"using version","core version":"0.19.0"}
-{"time":"2024-12-12T00:13:10.430902983Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241212_001310-hiitv1j3/logs/debug-core.log"}
-{"time":"2024-12-12T00:13:10.533716472Z","level":"INFO","msg":"created new stream","id":"hiitv1j3"}
-{"time":"2024-12-12T00:13:10.533750202Z","level":"INFO","msg":"stream: started","id":"hiitv1j3"}
-{"time":"2024-12-12T00:13:10.533785266Z","level":"INFO","msg":"writer: Do: started","stream_id":"hiitv1j3"}
-{"time":"2024-12-12T00:13:10.533801485Z","level":"INFO","msg":"sender: started","stream_id":"hiitv1j3"}
-{"time":"2024-12-12T00:13:10.533854634Z","level":"INFO","msg":"handler: started","stream_id":"hiitv1j3"}
-{"time":"2024-12-12T00:13:12.366471466Z","level":"INFO","msg":"Starting system monitor"}
-{"time":"2024-12-12T00:13:12.849349549Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:13:12.849377903Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:13:12.84938263Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:13:12.84938636Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:13:13.000080747Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:13:13.041405563Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:13:13.157896168Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:13:13.162529529Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:12.140250435Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:12.145680833Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:12.640025857Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:12.644499229Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:12.645545943Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:12.651305789Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:12.732077418Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:12.736787202Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:12.739545581Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:12.744606494Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.393781268Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.401598267Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.403616404Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.408799754Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.42157668Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.426163968Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.426987128Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.431262826Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.431901415Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.436376054Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.437159398Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.44097705Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.442084797Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.446183044Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.446655073Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.451373362Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.451923415Z","level":"INFO","msg":"Pausing system monitor"}
-{"time":"2024-12-12T00:15:14.456687874Z","level":"INFO","msg":"Resuming system monitor"}
-{"time":"2024-12-12T00:15:14.458832191Z","level":"INFO","msg":"Stopping system monitor"}
-{"time":"2024-12-12T00:15:14.459388875Z","level":"INFO","msg":"Stopped system monitor"}
-{"time":"2024-12-12T00:15:14.683699245Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
-{"time":"2024-12-12T00:15:14.738940691Z","level":"INFO","msg":"handler: operation stats","stats":{}}
-{"time":"2024-12-12T00:15:15.752911267Z","level":"INFO","msg":"stream: closing","id":"hiitv1j3"}
-{"time":"2024-12-12T00:15:15.752941075Z","level":"INFO","msg":"handler: closed","stream_id":"hiitv1j3"}
-{"time":"2024-12-12T00:15:15.752966684Z","level":"INFO","msg":"writer: Close: closed","stream_id":"hiitv1j3"}
-{"time":"2024-12-12T00:15:15.753004251Z","level":"INFO","msg":"sender: closed","stream_id":"hiitv1j3"}
-{"time":"2024-12-12T00:15:15.75304367Z","level":"INFO","msg":"stream: closed","id":"hiitv1j3"}
+{"time":"2024-12-12T01:56:09.139880384Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-12T01:56:09.139899774Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241212_015609-avictioo/logs/debug-core.log"}
+{"time":"2024-12-12T01:56:09.242521075Z","level":"INFO","msg":"created new stream","id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242556763Z","level":"INFO","msg":"stream: started","id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242589972Z","level":"INFO","msg":"writer: Do: started","stream_id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242603199Z","level":"INFO","msg":"sender: started","stream_id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242724569Z","level":"INFO","msg":"handler: started","stream_id":"avictioo"}
+{"time":"2024-12-12T01:56:10.459259928Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-12T01:56:10.942972743Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:10.943018423Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T01:56:10.943025495Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:18.078640335Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T01:56:18.270786743Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:41.164201522Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T01:56:41.322300255Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:48.559769389Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:40.670051298Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:03:40.6755442Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:41.741846657Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:03:46.457531666Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:47.497036163Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:03:55.070636717Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:55.110799716Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:01.355306831Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:01.422016547Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:02.951075699Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:02.954652415Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:06.048869636Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:07.645834166Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:07.651868639Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:07.653596306Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:07.658067883Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:07.670163111Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:10.824316257Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:10.826489771Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-12T02:04:10.827092344Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-12T02:04:11.142390703Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-12T02:04:11.206051251Z","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2024-12-12T02:04:12.220326425Z","level":"INFO","msg":"stream: closing","id":"avictioo"}
+{"time":"2024-12-12T02:04:12.22034956Z","level":"INFO","msg":"handler: closed","stream_id":"avictioo"}
+{"time":"2024-12-12T02:04:12.22035947Z","level":"INFO","msg":"writer: Close: closed","stream_id":"avictioo"}
+{"time":"2024-12-12T02:04:12.220379214Z","level":"INFO","msg":"sender: closed","stream_id":"avictioo"}
+{"time":"2024-12-12T02:04:12.22043941Z","level":"INFO","msg":"stream: closed","id":"avictioo"}

wandb/debug.log

@@ -1,91 +1,76 @@
-2024-12-12 00:13:10,420 INFO    MainThread:205 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
-2024-12-12 00:13:10,420 INFO    MainThread:205 [wandb_setup.py:_flush():68] Configure stats pid to 205
-2024-12-12 00:13:10,420 INFO    MainThread:205 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
-2024-12-12 00:13:10,420 INFO    MainThread:205 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
-2024-12-12 00:13:10,420 INFO    MainThread:205 [wandb_setup.py:_flush():68] Loading settings from environment variables
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241212_001310-hiitv1j3/logs/debug.log
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241212_001310-hiitv1j3/logs/debug-internal.log
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7e35531aabf0>
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:init():639] calling init triggers
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Configure stats pid to 1468
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241212_015609-avictioo/logs/debug.log
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241212_015609-avictioo/logs/debug-internal.log
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x79bb96df63b0>
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():639] calling init triggers
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
 config: {}
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:init():688] starting backend
-2024-12-12 00:13:10,421 INFO    MainThread:205 [wandb_init.py:init():692] sending inform_init request
-2024-12-12 00:13:10,428 INFO    MainThread:205 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
-2024-12-12 00:13:10,428 INFO    MainThread:205 [wandb_init.py:init():705] backend started and connected
-2024-12-12 00:13:10,438 INFO    MainThread:205 [wandb_run.py:_label_probe_notebook():1327] probe notebook
-2024-12-12 00:13:12,154 INFO    MainThread:205 [wandb_init.py:init():798] updated telemetry
-2024-12-12 00:13:12,155 INFO    MainThread:205 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
-2024-12-12 00:13:12,362 INFO    MainThread:205 [wandb_init.py:init():882] starting run threads in backend
-2024-12-12 00:13:12,809 INFO    MainThread:205 [wandb_run.py:_console_start():2443] atexit reg
-2024-12-12 00:13:12,809 INFO    MainThread:205 [wandb_run.py:_redirect():2293] redirect: wrap_raw
-2024-12-12 00:13:12,809 INFO    MainThread:205 [wandb_run.py:_redirect():2358] Wrapping output streams.
-2024-12-12 00:13:12,809 INFO    MainThread:205 [wandb_run.py:_redirect():2383] Redirects installed.
-2024-12-12 00:13:12,811 INFO    MainThread:205 [wandb_init.py:init():925] run started, returning control to user process
-2024-12-12 00:13:12,815 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:13:12,815 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:13:12,820 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:13:12,820 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:13:12,820 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:13:12,829 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:13:12,999 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:13:12,999 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:13:13,005 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:13:13,157 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:13:13,157 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:13:13,162 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:13:13,574 INFO    MainThread:205 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'neuralmind/bert-base-portuguese-cased', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 768, 'num_hidden_layers': 12, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.05, 'attention_probs_dropout_prob': 0.05, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 64, 'per_device_eval_batch_size': 64, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 15, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 150, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec12_00-13-13_59171548ab11', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 102, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 51, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-bertimbau_tunado-com_foca_loss_centropy', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
-2024-12-12 00:13:13,577 INFO    MainThread:205 [wandb_config.py:__setitem__():154] config set model/num_parameters = 108924674 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7e33843d3160>>
-2024-12-12 00:13:13,578 INFO    MainThread:205 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 108924674 None
-2024-12-12 00:15:12,139 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:12,139 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:12,145 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:12,639 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:12,639 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:12,644 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:12,644 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:12,644 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:12,650 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:12,731 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:12,731 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:12,736 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:12,738 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:12,739 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:12,744 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,393 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,393 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,401 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,402 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,403 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,408 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,421 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,421 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,425 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,426 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,426 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,431 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,431 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,431 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,435 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,436 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,436 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,440 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,441 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,441 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,445 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,446 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,446 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,451 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,451 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,451 INFO    MainThread:205 [wandb_init.py:_pause_backend():439] pausing backend
-2024-12-12 00:15:14,456 INFO    MainThread:205 [wandb_init.py:_resume_backend():444] resuming backend
-2024-12-12 00:15:14,457 INFO    MainThread:205 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/hiitv1j3
-2024-12-12 00:15:14,457 INFO    MainThread:205 [jupyter.py:save_history():459] not saving jupyter history
-2024-12-12 00:15:14,457 INFO    MainThread:205 [jupyter.py:save_ipynb():387] not saving jupyter notebook
-2024-12-12 00:15:14,457 INFO    MainThread:205 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
-2024-12-12 00:15:14,457 INFO    MainThread:205 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
-2024-12-12 00:15:14,458 INFO    MainThread:205 [wandb_run.py:_restore():2390] restore
-2024-12-12 00:15:14,458 INFO    MainThread:205 [wandb_run.py:_restore():2396] restore done
-2024-12-12 00:15:15,741 INFO    MainThread:205 [wandb_run.py:_footer_history_summary_info():3951] rendering history
-2024-12-12 00:15:15,742 INFO    MainThread:205 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
-2024-12-12 00:15:15,749 INFO    MainThread:205 [wandb_run.py:_footer_sync_info():3912] logging synced files
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():688] starting backend
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():692] sending inform_init request
+2024-12-12 01:56:09,138 INFO    MainThread:1468 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-12 01:56:09,138 INFO    MainThread:1468 [wandb_init.py:init():705] backend started and connected
+2024-12-12 01:56:09,145 INFO    MainThread:1468 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-12 01:56:10,307 INFO    MainThread:1468 [wandb_init.py:init():798] updated telemetry
+2024-12-12 01:56:10,308 INFO    MainThread:1468 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-12 01:56:10,454 INFO    MainThread:1468 [wandb_init.py:init():882] starting run threads in backend
+2024-12-12 01:56:10,902 INFO    MainThread:1468 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-12 01:56:10,902 INFO    MainThread:1468 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-12 01:56:10,902 INFO    MainThread:1468 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-12 01:56:10,903 INFO    MainThread:1468 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-12 01:56:10,905 INFO    MainThread:1468 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-12 01:56:10,908 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:10,908 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:10,913 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:10,913 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:10,914 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:18,077 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:18,270 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:18,270 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:41,163 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:41,321 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:41,322 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:48,559 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:48,971 INFO    MainThread:1468 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'neuralmind/bert-base-portuguese-cased', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 768, 'num_hidden_layers': 12, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.07, 'attention_probs_dropout_prob': 0.07, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 64, 'per_device_eval_batch_size': 64, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 19, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 150, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec12_01-56-41_4f84ece6c072', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 102, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 51, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-bertimbau_tunado-maisattentiondropout', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-12 01:56:48,974 INFO    MainThread:1468 [wandb_config.py:__setitem__():154] config set model/num_parameters = 108924674 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x79bbc7981b10>>
+2024-12-12 01:56:48,975 INFO    MainThread:1468 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 108924674 None
+2024-12-12 02:03:40,669 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:40,669 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:03:40,675 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:03:41,702 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:41,702 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:03:46,456 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:03:47,496 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:47,496 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:03:55,070 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:03:55,073 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:55,073 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:01,354 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:01,421 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:01,421 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:02,950 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:02,954 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:02,954 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:06,048 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:07,645 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:07,645 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:07,651 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:07,653 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:07,653 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:07,657 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:07,669 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:07,670 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:10,823 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:10,824 INFO    MainThread:1468 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/avictioo
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [jupyter.py:save_history():459] not saving jupyter history
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_run.py:_restore():2390] restore
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_run.py:_restore():2396] restore done
+2024-12-12 02:04:12,209 INFO    MainThread:1468 [wandb_run.py:_footer_history_summary_info():3951] rendering history
+2024-12-12 02:04:12,210 INFO    MainThread:1468 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
+2024-12-12 02:04:12,217 INFO    MainThread:1468 [wandb_run.py:_footer_sync_info():3912] logging synced files

wandb/run-20241212_015609-avictioo/files/config.yaml

@@ -0,0 +1,568 @@
+_attn_implementation_autoset:
+    value: true
+_name_or_path:
+    value: neuralmind/bert-base-portuguese-cased
+_wandb:
+    value:
+        cli_version: 0.19.0
+        m:
+            - "1": train/grad_norm
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/global_step
+              "6":
+                - 3
+              "7": []
+            - "1": train/epoch
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/samples_per_second
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/steps_per_second
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/accuracy
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/recall
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/loss
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/f1
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/precision
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/loss
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": train/learning_rate
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+            - "1": eval/runtime
+              "5": 2
+              "6":
+                - 1
+                - 3
+              "7": []
+        python_version: 3.10.12
+        t:
+            "1":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "2":
+                - 1
+                - 2
+                - 3
+                - 5
+                - 11
+                - 12
+                - 41
+                - 49
+                - 51
+                - 53
+                - 55
+                - 71
+                - 98
+                - 100
+                - 105
+            "3":
+                - 2
+                - 7
+                - 13
+                - 19
+                - 23
+                - 55
+                - 62
+                - 66
+            "4": 3.10.12
+            "5": 0.19.0
+            "6": 4.47.0
+            "8":
+                - 1
+                - 5
+                - 12
+            "9":
+                "1": transformers_trainer
+            "12": 0.19.0
+            "13": linux-x86_64
+accelerator_config:
+    value:
+        dispatch_batches: null
+        even_batches: true
+        gradient_accumulation_kwargs: null
+        non_blocking: false
+        split_batches: false
+        use_seedable_sampler: true
+adafactor:
+    value: false
+adam_beta1:
+    value: 0.9
+adam_beta2:
+    value: 0.999
+adam_epsilon:
+    value: 1e-08
+add_cross_attention:
+    value: false
+architectures:
+    value:
+        - BertForMaskedLM
+attention_probs_dropout_prob:
+    value: 0.07
+auto_find_batch_size:
+    value: false
+average_tokens_across_devices:
+    value: false
+bad_words_ids:
+    value: null
+batch_eval_metrics:
+    value: false
+begin_suppress_tokens:
+    value: null
+bf16:
+    value: false
+bf16_full_eval:
+    value: false
+bos_token_id:
+    value: null
+chunk_size_feed_forward:
+    value: 0
+classifier_dropout:
+    value: null
+cross_attention_hidden_size:
+    value: null
+data_seed:
+    value: null
+dataloader_drop_last:
+    value: false
+dataloader_num_workers:
+    value: 0
+dataloader_persistent_workers:
+    value: false
+dataloader_pin_memory:
+    value: true
+dataloader_prefetch_factor:
+    value: null
+ddp_backend:
+    value: null
+ddp_broadcast_buffers:
+    value: null
+ddp_bucket_cap_mb:
+    value: null
+ddp_find_unused_parameters:
+    value: null
+ddp_timeout:
+    value: 1800
+debug:
+    value: []
+decoder_start_token_id:
+    value: null
+deepspeed:
+    value: null
+directionality:
+    value: bidi
+disable_tqdm:
+    value: false
+dispatch_batches:
+    value: null
+diversity_penalty:
+    value: 0
+do_eval:
+    value: true
+do_predict:
+    value: false
+do_sample:
+    value: false
+do_train:
+    value: false
+early_stopping:
+    value: false
+encoder_no_repeat_ngram_size:
+    value: 0
+eos_token_id:
+    value: null
+eval_accumulation_steps:
+    value: null
+eval_delay:
+    value: 0
+eval_do_concat_batches:
+    value: true
+eval_on_start:
+    value: false
+eval_steps:
+    value: 51
+eval_strategy:
+    value: epoch
+eval_use_gather_object:
+    value: false
+evaluation_strategy:
+    value: null
+exponential_decay_length_penalty:
+    value: null
+finetuning_task:
+    value: null
+forced_bos_token_id:
+    value: null
+forced_eos_token_id:
+    value: null
+fp16:
+    value: false
+fp16_backend:
+    value: auto
+fp16_full_eval:
+    value: false
+fp16_opt_level:
+    value: O1
+fsdp:
+    value: []
+fsdp_config:
+    value:
+        min_num_params: 0
+        xla: false
+        xla_fsdp_grad_ckpt: false
+        xla_fsdp_v2: false
+fsdp_min_num_params:
+    value: 0
+fsdp_transformer_layer_cls_to_wrap:
+    value: null
+full_determinism:
+    value: false
+gradient_accumulation_steps:
+    value: 1
+gradient_checkpointing:
+    value: false
+gradient_checkpointing_kwargs:
+    value: null
+greater_is_better:
+    value: true
+group_by_length:
+    value: false
+half_precision_backend:
+    value: auto
+hidden_act:
+    value: gelu
+hidden_dropout_prob:
+    value: 0.07
+hidden_size:
+    value: 768
+hub_always_push:
+    value: false
+hub_model_id:
+    value: null
+hub_private_repo:
+    value: null
+hub_strategy:
+    value: every_save
+hub_token:
+    value: <HUB_TOKEN>
+id2label:
+    value:
+        "0": "0"
+        "1": "1"
+ignore_data_skip:
+    value: false
+include_for_metrics:
+    value: []
+include_inputs_for_metrics:
+    value: false
+include_num_input_tokens_seen:
+    value: false
+include_tokens_per_second:
+    value: false
+initializer_range:
+    value: 0.02
+intermediate_size:
+    value: 3072
+is_decoder:
+    value: false
+is_encoder_decoder:
+    value: false
+jit_mode_eval:
+    value: false
+label_names:
+    value: null
+label_smoothing_factor:
+    value: 0
+label2id:
+    value:
+        "0": 0
+        "1": 1
+layer_norm_eps:
+    value: 1e-12
+learning_rate:
+    value: 1e-05
+length_column_name:
+    value: length
+length_penalty:
+    value: 1
+load_best_model_at_end:
+    value: true
+local_rank:
+    value: 0
+log_level:
+    value: passive
+log_level_replica:
+    value: warning
+log_on_each_node:
+    value: true
+logging_dir:
+    value: ./runs/Dec12_01-56-41_4f84ece6c072
+logging_first_step:
+    value: false
+logging_nan_inf_filter:
+    value: true
+logging_steps:
+    value: 10
+logging_strategy:
+    value: steps
+lr_scheduler_type:
+    value: linear
+max_grad_norm:
+    value: 1
+max_length:
+    value: 20
+max_position_embeddings:
+    value: 512
+max_steps:
+    value: -1
+metric_for_best_model:
+    value: f1
+min_length:
+    value: 0
+model/num_parameters:
+    value: 108924674
+model_type:
+    value: bert
+mp_parameters:
+    value: ""
+neftune_noise_alpha:
+    value: null
+no_cuda:
+    value: false
+no_repeat_ngram_size:
+    value: 0
+num_attention_heads:
+    value: 12
+num_beam_groups:
+    value: 1
+num_beams:
+    value: 1
+num_hidden_layers:
+    value: 12
+num_return_sequences:
+    value: 1
+num_train_epochs:
+    value: 19
+optim:
+    value: adamw_torch
+optim_args:
+    value: null
+optim_target_modules:
+    value: null
+output_attentions:
+    value: false
+output_dir:
+    value: .
+output_hidden_states:
+    value: false
+output_past:
+    value: true
+output_scores:
+    value: false
+overwrite_output_dir:
+    value: false
+pad_token_id:
+    value: 0
+past_index:
+    value: -1
+per_device_eval_batch_size:
+    value: 64
+per_device_train_batch_size:
+    value: 64
+per_gpu_eval_batch_size:
+    value: null
+per_gpu_train_batch_size:
+    value: null
+pooler_fc_size:
+    value: 768
+pooler_num_attention_heads:
+    value: 12
+pooler_num_fc_layers:
+    value: 3
+pooler_size_per_head:
+    value: 128
+pooler_type:
+    value: first_token_transform
+position_embedding_type:
+    value: absolute
+prediction_loss_only:
+    value: false
+prefix:
+    value: null
+problem_type:
+    value: null
+push_to_hub:
+    value: false
+push_to_hub_model_id:
+    value: null
+push_to_hub_organization:
+    value: null
+push_to_hub_token:
+    value: <PUSH_TO_HUB_TOKEN>
+ray_scope:
+    value: last
+remove_invalid_values:
+    value: false
+remove_unused_columns:
+    value: true
+repetition_penalty:
+    value: 1
+report_to:
+    value:
+        - wandb
+restore_callback_states_from_checkpoint:
+    value: false
+resume_from_checkpoint:
+    value: null
+return_dict:
+    value: true
+return_dict_in_generate:
+    value: false
+run_name:
+    value: m2-bertimbau_tunado-maisattentiondropout
+save_on_each_node:
+    value: false
+save_only_model:
+    value: false
+save_safetensors:
+    value: true
+save_steps:
+    value: 102
+save_strategy:
+    value: epoch
+save_total_limit:
+    value: 1
+seed:
+    value: 5151
+sep_token_id:
+    value: null
+skip_memory_metrics:
+    value: true
+split_batches:
+    value: null
+suppress_tokens:
+    value: null
+task_specific_params:
+    value: null
+temperature:
+    value: 1
+tf_legacy_loss:
+    value: false
+tf32:
+    value: null
+tie_encoder_decoder:
+    value: false
+tie_word_embeddings:
+    value: true
+tokenizer_class:
+    value: null
+top_k:
+    value: 50
+top_p:
+    value: 1
+torch_compile:
+    value: false
+torch_compile_backend:
+    value: null
+torch_compile_mode:
+    value: null
+torch_dtype:
+    value: null
+torch_empty_cache_steps:
+    value: null
+torchdynamo:
+    value: null
+torchscript:
+    value: false
+tpu_metrics_debug:
+    value: false
+tpu_num_cores:
+    value: null
+transformers_version:
+    value: 4.47.0
+type_vocab_size:
+    value: 2
+typical_p:
+    value: 1
+use_bfloat16:
+    value: false
+use_cache:
+    value: true
+use_cpu:
+    value: false
+use_ipex:
+    value: false
+use_legacy_prediction_loop:
+    value: false
+use_liger_kernel:
+    value: false
+use_mps_device:
+    value: false
+vocab_size:
+    value: 29794
+warmup_ratio:
+    value: 0
+warmup_steps:
+    value: 150
+weight_decay:
+    value: 0.02

wandb/run-20241212_015609-avictioo/files/output.log

@@ -0,0 +1,10 @@
+/usr/local/lib/python3.10/dist-packages/sklearn/metrics/_classification.py:1531: UndefinedMetricWarning: Precision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
+  _warn_prf(average, modifier, f"{metric.capitalize()} is", len(result))
+              precision    recall  f1-score   support
+
+           0       0.93      0.85      0.89       114
+           1       0.60      0.79      0.68        33
+
+    accuracy                           0.84       147
+   macro avg       0.77      0.82      0.79       147
+weighted avg       0.86      0.84      0.84       147

wandb/run-20241212_015609-avictioo/files/requirements.txt

@@ -0,0 +1,578 @@
+datasets==3.2.0
+dill==0.3.8
+transformers==4.47.0
+evaluate==0.4.3
+xxhash==3.5.0
+wandb==0.19.0
+fsspec==2024.9.0
+tokenizers==0.21.0
+accelerate==1.2.0
+multiprocess==0.70.16
+google-colab==1.0.0
+openpyxl==3.1.5
+tensorflow-hub==0.16.1
+jupyter-client==6.1.12
+osqp==0.6.7.post3
+nvidia-cuda-nvcc-cu12==12.6.85
+xyzservices==2024.9.0
+jellyfish==1.1.2
+matplotlib==3.8.0
+progressbar2==4.5.0
+pydata-google-auth==1.9.0
+multitasking==0.0.11
+babel==2.16.0
+pyasn1_modules==0.4.1
+cudf-cu12==24.10.1
+grpcio-status==1.62.3
+openai==1.54.5
+tornado==6.3.3
+cufflinks==0.17.3
+google-cloud-storage==2.8.0
+mkl==2025.0.1
+sphinxcontrib-devhelp==2.0.0
+yfinance==0.2.50
+google-cloud-functions==1.18.1
+aiohttp==3.11.9
+wordcloud==1.9.4
+Werkzeug==3.1.3
+sqlglot==25.1.0
+StrEnum==0.4.15
+langsmith==0.1.147
+gast==0.6.0
+requests-oauthlib==1.3.1
+google==2.0.3
+shellingham==1.5.4
+joblib==1.4.2
+mizani==0.13.0
+mpmath==1.3.0
+tensorflow-io-gcs-filesystem==0.37.1
+ml-dtypes==0.4.1
+rmm-cu12==24.10.0
+wheel==0.45.1
+decorator==4.4.2
+pydantic==2.10.3
+msgpack==1.1.0
+cymem==2.0.10
+blis==0.7.11
+pyzmq==24.0.1
+array_record==0.5.1
+kagglehub==0.3.4
+propcache==0.2.1
+pydantic_core==2.27.1
+threadpoolctl==3.5.0
+sympy==1.13.1
+CacheControl==0.14.1
+Pygments==2.18.0
+folium==0.18.0
+dopamine_rl==4.0.9
+pydotplus==2.0.2
+python-louvain==0.16
+catalogue==2.0.10
+gspread==6.0.2
+pyspark==3.5.3
+google-cloud-core==2.4.1
+firebase-admin==6.5.0
+jieba==0.42.1
+pymc==5.18.2
+jax-cuda12-pjrt==0.4.33
+geemap==0.35.1
+pyparsing==3.2.0
+soupsieve==2.6
+nbconvert==7.16.4
+tzdata==2024.2
+webcolors==24.11.1
+zipp==3.21.0
+peewee==3.17.8
+opentelemetry-api==1.28.2
+nvidia-cufft-cu12==11.3.0.4
+torchaudio==2.5.1+cu121
+dlib==19.24.2
+oauthlib==3.2.2
+optax==0.2.4
+py4j==0.10.9.7
+spacy==3.7.5
+clarabel==0.9.0
+parso==0.8.4
+umf==0.9.1
+pyerfa==2.0.1.5
+pyproj==3.7.0
+Pyomo==6.8.2
+namex==0.0.8
+webencodings==0.5.1
+platformdirs==4.3.6
+absl-py==1.4.0
+wasabi==1.1.3
+kaggle==1.6.17
+notebook_shim==0.2.4
+timm==1.0.12
+geopy==2.4.1
+sphinxcontrib-jsmath==1.0.1
+astunparse==1.6.3
+pycparser==2.22
+jupyterlab_widgets==3.0.13
+networkx==3.4.2
+google-api-core==2.19.2
+jsonpickle==4.0.0
+ipyevents==2.0.2
+miniKanren==1.0.3
+cmdstanpy==1.2.4
+attrs==24.2.0
+snowballstemmer==2.2.0
+pillow==11.0.0
+chardet==5.2.0
+PyYAML==6.0.2
+sniffio==1.3.1
+pytensor==2.26.4
+nx-cugraph-cu12==24.10.0
+graphviz==0.20.3
+requests==2.32.3
+backcall==0.2.0
+smmap==5.0.1
+docker-pycreds==0.4.0
+rsa==4.9
+google-auth==2.27.0
+toolz==0.12.1
+future==1.0.0
+tensorboard==2.17.1
+toml==0.10.2
+cmake==3.30.5
+langchain-core==0.3.21
+imagesize==1.4.1
+prettytable==3.12.0
+fastjsonschema==2.21.1
+h5netcdf==1.4.1
+gitdb==4.0.11
+google-ai-generativelanguage==0.6.10
+duckdb==1.1.3
+proto-plus==1.25.0
+inflect==7.4.0
+scipy==1.13.1
+weasel==0.4.1
+sklearn-pandas==2.2.0
+filelock==3.16.1
+chex==0.1.87
+moviepy==1.0.3
+async-timeout==4.0.3
+google-crc32c==1.6.0
+panel==1.5.4
+packaging==24.2
+frozenlist==1.5.0
+h5py==3.12.1
+cuda-python==12.2.1
+eerepr==0.0.4
+orjson==3.10.12
+requests-toolbelt==1.0.0
+pydot==3.0.3
+pandas-datareader==0.10.0
+pyasn1==0.6.1
+grpcio==1.68.1
+cons==0.4.6
+lightgbm==4.5.0
+polars==1.9.0
+pylibraft-cu12==24.10.0
+docstring_parser==0.16
+argon2-cffi-bindings==21.2.0
+PyOpenGL==3.1.7
+scs==3.2.7
+xarray-einstats==0.8.0
+jsonpointer==3.0.0
+SQLAlchemy==2.0.36
+peft==0.13.2
+jiter==0.8.0
+gensim==4.3.3
+ipyparallel==8.8.0
+yarl==1.18.3
+google-cloud-datastore==2.20.1
+PyDrive2==1.21.3
+google-cloud-bigquery==3.25.0
+docutils==0.21.2
+py-cpuinfo==9.0.0
+Markdown==3.7
+missingno==0.5.2
+Jinja2==3.1.4
+imgaug==0.4.0
+tf_keras==2.17.0
+prophet==1.1.6
+spacy-legacy==3.0.12
+greenlet==3.1.1
+more-itertools==10.5.0
+psycopg2==2.9.10
+nbformat==5.10.4
+astropy-iers-data==0.2024.12.2.0.35.34
+audioread==3.0.1
+google-auth-httplib2==0.2.0
+tables==3.10.1
+et_xmlfile==2.0.0
+pyOpenSSL==24.2.1
+termcolor==2.5.0
+importlib_resources==6.4.5
+terminado==0.18.1
+lazy_loader==0.4
+google-cloud-bigquery-connection==1.16.1
+optree==0.13.1
+urllib3==2.2.3
+tensorflow==2.17.1
+pyarrow==17.0.0
+six==1.16.0
+promise==2.3
+widgetsnbextension==3.6.10
+traittypes==0.2.1
+google-api-python-client==2.151.0
+kiwisolver==1.4.7
+tbb==2022.0.0
+sentry-sdk==2.19.0
+gspread-dataframe==3.3.1
+sphinxcontrib-serializinghtml==2.0.0
+cloudpickle==3.1.0
+ratelim==0.1.6
+natsort==8.4.0
+tcmlib==1.2.0
+click==8.1.7
+geographiclib==2.0
+tweepy==4.14.0
+Bottleneck==1.4.2
+Deprecated==1.2.15
+wcwidth==0.2.13
+statsmodels==0.14.4
+multipledispatch==1.0.0
+google-auth-oauthlib==1.2.1
+httplib2==0.22.0
+uritemplate==4.1.1
+tzlocal==5.2
+pygit2==1.16.0
+fastrlock==0.8.2
+cryptography==43.0.3
+charset-normalizer==3.4.0
+ply==3.11
+matplotlib-inline==0.1.7
+distro==1.9.0
+google-pasta==0.2.0
+eval_type_backport==0.2.0
+stanio==0.5.1
+pyviz_comms==3.0.3
+glob2==0.7
+sphinxcontrib-applehelp==2.0.0
+tqdm==4.66.6
+ipyfilechooser==0.6.0
+tifffile==2024.9.20
+ipytree==0.2.2
+regex==2024.9.11
+debugpy==1.8.0
+traitlets==5.7.1
+patsy==1.0.1
+blinker==1.9.0
+fastai==2.7.18
+xarray==2024.10.0
+plotnine==0.14.3
+httpcore==1.0.7
+ipython==7.34.0
+proglog==0.1.10
+MarkupSafe==3.0.2
+orbax-checkpoint==0.6.4
+python-utils==3.9.1
+nvidia-cusparse-cu12==12.5.4.2
+partd==1.4.2
+branca==0.8.0
+psutil==5.9.5
+intel-openmp==2025.0.3
+tensorflow-datasets==4.9.7
+frozendict==2.4.6
+nvidia-cudnn-cu12==9.6.0.74
+langchain-text-splitters==0.3.2
+libclang==18.1.1
+xgboost==2.1.3
+tensorboard-data-server==0.7.2
+pandocfilters==1.5.1
+en-core-web-sm==3.7.1
+huggingface-hub==0.26.3
+fastprogress==1.0.3
+protobuf==4.25.5
+cvxopt==1.3.2
+vega-datasets==0.9.0
+pickleshare==0.7.5
+nvidia-nvjitlink-cu12==12.6.85
+h11==0.14.0
+srsly==2.4.8
+pyperclip==1.9.0
+logical-unification==0.4.6
+sphinxcontrib-htmlhelp==2.1.0
+language_data==1.3.0
+flax==0.8.5
+nest-asyncio==1.6.0
+tabulate==0.9.0
+opt_einsum==3.4.0
+bigframes==1.27.0
+scooby==0.10.0
+websocket-client==1.8.0
+earthengine-api==1.2.0
+ipykernel==5.5.6
+grpc-google-iam-v1==0.13.1
+rpy2==3.4.2
+gdown==5.2.0
+googledrivedownloader==0.4
+scikit-image==0.24.0
+bleach==6.2.0
+entrypoints==0.4
+shapely==2.0.6
+portpicker==1.5.2
+jupyter-leaflet==0.19.2
+pandas-gbq==0.24.0
+google-cloud-bigquery-storage==2.27.0
+notebook==6.5.5
+alabaster==1.0.0
+argon2-cffi==23.1.0
+pycocotools==2.0.8
+tensorflow-metadata==1.13.1
+bqplot==0.12.43
+annotated-types==0.7.0
+albumentations==1.4.20
+nibabel==5.3.2
+typing_extensions==4.12.2
+colorcet==3.1.0
+datascience==0.17.6
+soxr==0.5.0.post1
+libcudf-cu12==24.10.1
+imageio-ffmpeg==0.5.1
+cupy-cuda12x==12.2.0
+pexpect==4.9.0
+gin-config==0.5.0
+einops==0.8.0
+plotly==5.24.1
+immutabledict==4.2.1
+qdldl==0.1.7.post4
+colorlover==0.3.0
+html5lib==1.1
+confection==0.1.5
+pytest==8.3.4
+google-cloud-iam==2.16.1
+importlib_metadata==8.5.0
+google-generativeai==0.8.3
+fastcore==1.7.22
+httpx==0.28.0
+pylibcugraph-cu12==24.10.0
+etuples==0.3.9
+pylibcudf-cu12==24.10.1
+contourpy==1.3.1
+astropy==6.1.7
+tomli==2.2.1
+GitPython==3.1.43
+mistune==3.0.2
+sphinxcontrib-qthelp==2.0.0
+nbclassic==1.1.0
+httpimport==1.4.0
+pygame==2.6.1
+music21==9.3.0
+spacy-loggers==1.0.5
+setproctitle==1.3.4
+bokeh==3.6.2
+python-dateutil==2.8.2
+librosa==0.10.2.post1
+multidict==6.1.0
+opencv-contrib-python==4.10.0.84
+flatbuffers==24.3.25
+referencing==0.35.1
+python-box==7.2.0
+autograd==1.7.0
+langchain==0.3.9
+intel-cmplr-lib-ur==2025.0.3
+jupyter-console==6.1.0
+nvidia-curand-cu12==10.3.7.77
+imbalanced-learn==0.12.4
+opencv-python-headless==4.10.0.84
+uc-micro-py==1.0.3
+exceptiongroup==1.2.2
+nvidia-cuda-cupti-cu12==12.6.80
+ipywidgets==7.7.1
+sentence-transformers==3.2.1
+scikit-learn==1.5.2
+lxml==5.3.0
+imutils==0.5.4
+humanize==4.11.0
+wrapt==1.17.0
+pytz==2024.2
+nvidia-cuda-runtime-cu12==12.6.77
+seaborn==0.13.2
+pandas-stubs==2.2.2.240909
+idna==3.10
+ipython-sql==0.5.0
+GDAL==3.6.4
+rpds-py==0.22.3
+python-slugify==8.0.4
+fastdownload==0.0.7
+gcsfs==2024.10.0
+types-pytz==2024.2.0.20241003
+langcodes==3.5.0
+blosc2==2.7.1
+tenacity==9.0.0
+arviz==0.20.0
+opentelemetry-sdk==1.28.2
+markdown-it-py==3.0.0
+sqlparse==0.5.2
+Cython==3.0.11
+gym==0.25.2
+torchvision==0.20.1+cu121
+text-unidecode==1.3
+jsonpatch==1.33
+atpublic==4.1.0
+llvmlite==0.43.0
+marisa-trie==1.2.1
+torch==2.5.1+cu121
+pandas==2.2.2
+Send2Trash==1.8.3
+imageio==2.36.1
+mlxtend==0.23.3
+pathlib==1.0.1
+aiosignal==1.3.1
+nltk==3.9.1
+opencv-python==4.10.0.84
+pynvjitlink-cu12==0.4.0
+nbclient==0.10.1
+cvxpy==1.5.4
+tensorflow-probability==0.24.0
+defusedxml==0.7.1
+google-cloud-translate==3.17.0
+albucore==0.0.19
+google-cloud-firestore==2.19.0
+dm-tree==0.1.8
+google-cloud-language==2.15.1
+geopandas==1.0.1
+holidays==0.62
+Flask==3.0.3
+tinycss2==1.4.0
+locket==1.0.0
+dask==2024.10.0
+itsdangerous==2.2.0
+google-resumable-media==2.7.2
+iniconfig==2.0.0
+param==2.1.1
+jax==0.4.33
+jsonschema==4.23.0
+nvidia-cusolver-cu12==11.7.1.2
+fonttools==4.55.1
+hyperopt==0.2.7
+textblob==0.17.1
+jupyter_core==5.7.2
+pyarrow-hotfix==0.6
+cachetools==5.5.0
+PyDrive==1.3.1
+safetensors==0.4.5
+PySocks==1.7.1
+pymystem3==0.2.0
+murmurhash==1.0.11
+ipyleaflet==0.19.2
+yellowbrick==1.5
+cycler==0.12.1
+google-cloud-aiplatform==1.73.0
+ipython-genutils==0.2.0
+simple-parsing==0.1.6
+diffusers==0.31.0
+holoviews==1.20.0
+cloudpathlib==0.20.0
+ndindex==1.9.2
+torchsummary==1.5.1
+altair==4.2.2
+pluggy==1.5.0
+community==1.0.0b1
+pyshp==2.3.1
+geocoder==1.38.1
+typer==0.15.0
+thinc==8.2.5
+shap==0.46.0
+anyio==3.7.1
+gym-notices==0.0.8
+oauth2client==4.1.3
+aiohappyeyeballs==2.4.4
+google-cloud-bigtable==2.27.0
+xlrd==2.0.1
+soundfile==0.12.1
+slicer==0.0.8
+keras==3.5.0
+nvtx==0.2.10
+tensorstore==0.1.69
+jax-cuda12-plugin==0.4.33
+google-cloud-resource-manager==1.13.1
+nvidia-cublas-cu12==12.6.4.1
+numexpr==2.10.2
+numba==0.60.0
+jupyter-server==1.24.0
+etils==1.11.0
+sentencepiece==0.2.0
+google-cloud-pubsub==2.27.1
+typeguard==4.4.1
+nvidia-nccl-cu12==2.23.4
+colour==0.1.5
+PyJWT==2.10.1
+mdurl==0.1.2
+matplotlib-venn==1.1.1
+easydict==1.13
+preshed==3.0.9
+db-dtypes==1.3.1
+pooch==1.8.2
+ecos==2.0.14
+googleapis-common-protos==1.66.0
+editdistance==0.8.1
+prometheus_client==0.21.1
+jsonschema-specifications==2024.10.1
+mdit-py-plugins==0.4.2
+numpy==1.26.4
+parsy==2.1
+prompt_toolkit==3.0.48
+rich==13.9.4
+certifi==2024.8.30
+ptyprocess==0.7.0
+cffi==1.17.1
+Sphinx==8.1.3
+linkify-it-py==2.0.3
+stringzilla==3.11.0
+smart-open==7.0.5
+bigquery-magics==0.4.0
+beautifulsoup4==4.12.3
+ibis-framework==9.2.0
+pyogrio==0.10.0
+opentelemetry-semantic-conventions==0.49b2
+tf-slim==1.1.0
+jaxlib==0.4.33
+jupyterlab_pygments==0.3.0
+python-apt==0.0.0
+requirements-parser==0.9.0
+types-setuptools==75.6.0.20241126
+setuptools==75.1.0
+pip==24.1.2
+PyGObject==3.42.1
+httplib2==0.20.2
+SecretStorage==3.3.1
+distro==1.7.0
+importlib-metadata==4.6.4
+lazr.uri==1.0.6
+six==1.16.0
+launchpadlib==1.10.16
+more-itertools==8.10.0
+cryptography==3.4.8
+jeepney==0.7.1
+PyJWT==2.3.0
+wadllib==1.3.6
+lazr.restfulclient==0.14.4
+python-apt==2.4.0+ubuntu4
+pyparsing==2.4.7
+zipp==1.0.0
+blinker==1.4
+oauthlib==3.2.0
+dbus-python==1.2.18
+keyring==23.5.0
+autocommand==2.2.2
+platformdirs==4.2.2
+typeguard==4.3.0
+importlib_resources==6.4.0
+wheel==0.43.0
+more-itertools==10.3.0
+tomli==2.0.1
+jaraco.collections==5.1.0
+packaging==24.1
+typing_extensions==4.12.2
+importlib_metadata==8.0.0
+zipp==3.19.2
+jaraco.context==5.3.0
+backports.tarfile==1.2.0
+jaraco.text==3.12.1
+inflect==7.3.1
+jaraco.functools==4.0.1

wandb/run-20241212_015609-avictioo/files/wandb-metadata.json

@@ -0,0 +1,38 @@
+{
+  "os": "Linux-6.1.85+-x86_64-with-glibc2.35",
+  "python": "CPython 3.10.12",
+  "startedAt": "2024-12-12T01:56:09.138671Z",
+  "program": "bertimbau-focal_loss-sempeso-final.ipynb",
+  "email": "adrianobf@gmail.com",
+  "root": "/content",
+  "host": "4f84ece6c072",
+  "username": "root",
+  "executable": "/usr/bin/python3",
+  "colab": "https://colab.research.google.com/notebook#fileId=1uFlBgj5T8z5THNbBGAUfynio4xSRwjPm",
+  "cpu_count": 6,
+  "cpu_count_logical": 12,
+  "gpu": "NVIDIA A100-SXM4-40GB",
+  "gpu_count": 1,
+  "disk": {
+    "/": {
+      "total": "120942624768",
+      "used": "36171300864"
+    }
+  },
+  "memory": {
+    "total": "89632796672"
+  },
+  "cpu": {
+    "count": 6,
+    "countLogical": 12
+  },
+  "gpu_nvidia": [
+    {
+      "name": "NVIDIA A100-SXM4-40GB",
+      "memoryTotal": "42949672960",
+      "cudaCores": 6912,
+      "architecture": "Ampere"
+    }
+  ],
+  "cudaVersion": "12.2"
+}

wandb/run-20241212_015609-avictioo/files/wandb-summary.json

@@ -0,0 +1 @@
+{"train/epoch":17,"eval/precision":0.7686717352415027,"train/learning_rate":2.1875000000000002e-06,"total_flos":5.00516160611328e+15,"train/grad_norm":0.2191317230463028,"eval/f1":0.7870593915982618,"eval/recall":0.819377990430622,"_step":49,"train/loss":0.0232,"train_samples_per_second":51.667,"eval/samples_per_second":142.233,"_runtime":416.36840234,"train/global_step":306,"_wandb":{"runtime":418},"eval/steps_per_second":2.903,"eval/accuracy":0.8367346938775511,"train_steps_per_second":0.831,"eval/runtime":1.0335,"_timestamp":1.7339690274944422e+09,"eval/loss":0.046015046536922455,"train_loss":0.049632026673921574,"train_runtime":411.4969}

wandb/run-20241212_015609-avictioo/logs/debug-core.log

@@ -0,0 +1,9 @@
+{"time":"2024-12-12T01:56:08.874917091Z","level":"INFO","msg":"started logging, with flags","port-filename":"/tmp/tmp8ssilbou/port-1468.txt","pid":1468,"debug":false,"disable-analytics":false}
+{"time":"2024-12-12T01:56:08.87494958Z","level":"INFO","msg":"FeatureState","shutdownOnParentExitEnabled":false}
+{"time":"2024-12-12T01:56:08.879439112Z","level":"INFO","msg":"Will exit if parent process dies.","ppid":1468}
+{"time":"2024-12-12T01:56:08.879450629Z","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":36409,"Zone":""}}
+{"time":"2024-12-12T01:56:09.063003012Z","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:32988"}
+{"time":"2024-12-12T01:56:09.139740036Z","level":"INFO","msg":"handleInformInit: received","streamId":"avictioo","id":"127.0.0.1:32988"}
+{"time":"2024-12-12T01:56:09.242564044Z","level":"INFO","msg":"handleInformInit: stream started","streamId":"avictioo","id":"127.0.0.1:32988"}
+{"time":"2024-12-12T02:04:12.220273163Z","level":"INFO","msg":"handleInformFinish: finish message received","streamId":"avictioo","id":"127.0.0.1:32988"}
+{"time":"2024-12-12T02:04:12.220447183Z","level":"INFO","msg":"handleInformFinish: stream closed","streamId":"avictioo","id":"127.0.0.1:32988"}

wandb/run-20241212_015609-avictioo/logs/debug-internal.log

@@ -0,0 +1,43 @@
+{"time":"2024-12-12T01:56:09.139880384Z","level":"INFO","msg":"using version","core version":"0.19.0"}
+{"time":"2024-12-12T01:56:09.139899774Z","level":"INFO","msg":"created symlink","path":"/content/wandb/run-20241212_015609-avictioo/logs/debug-core.log"}
+{"time":"2024-12-12T01:56:09.242521075Z","level":"INFO","msg":"created new stream","id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242556763Z","level":"INFO","msg":"stream: started","id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242589972Z","level":"INFO","msg":"writer: Do: started","stream_id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242603199Z","level":"INFO","msg":"sender: started","stream_id":"avictioo"}
+{"time":"2024-12-12T01:56:09.242724569Z","level":"INFO","msg":"handler: started","stream_id":"avictioo"}
+{"time":"2024-12-12T01:56:10.459259928Z","level":"INFO","msg":"Starting system monitor"}
+{"time":"2024-12-12T01:56:10.942972743Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:10.943018423Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T01:56:10.943025495Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:18.078640335Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T01:56:18.270786743Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:41.164201522Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T01:56:41.322300255Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T01:56:48.559769389Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:40.670051298Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:03:40.6755442Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:41.741846657Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:03:46.457531666Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:47.497036163Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:03:55.070636717Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:03:55.110799716Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:01.355306831Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:01.422016547Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:02.951075699Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:02.954652415Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:06.048869636Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:07.645834166Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:07.651868639Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:07.653596306Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:07.658067883Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:07.670163111Z","level":"INFO","msg":"Pausing system monitor"}
+{"time":"2024-12-12T02:04:10.824316257Z","level":"INFO","msg":"Resuming system monitor"}
+{"time":"2024-12-12T02:04:10.826489771Z","level":"INFO","msg":"Stopping system monitor"}
+{"time":"2024-12-12T02:04:10.827092344Z","level":"INFO","msg":"Stopped system monitor"}
+{"time":"2024-12-12T02:04:11.142390703Z","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
+{"time":"2024-12-12T02:04:11.206051251Z","level":"INFO","msg":"handler: operation stats","stats":{}}
+{"time":"2024-12-12T02:04:12.220326425Z","level":"INFO","msg":"stream: closing","id":"avictioo"}
+{"time":"2024-12-12T02:04:12.22034956Z","level":"INFO","msg":"handler: closed","stream_id":"avictioo"}
+{"time":"2024-12-12T02:04:12.22035947Z","level":"INFO","msg":"writer: Close: closed","stream_id":"avictioo"}
+{"time":"2024-12-12T02:04:12.220379214Z","level":"INFO","msg":"sender: closed","stream_id":"avictioo"}
+{"time":"2024-12-12T02:04:12.22043941Z","level":"INFO","msg":"stream: closed","id":"avictioo"}

wandb/run-20241212_015609-avictioo/logs/debug.log

@@ -0,0 +1,76 @@
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Current SDK version is 0.19.0
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Configure stats pid to 1468
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Loading settings from /content/wandb/settings
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_setup.py:_flush():68] Loading settings from environment variables
+2024-12-12 01:56:09,130 INFO    MainThread:1468 [wandb_init.py:_log_setup():528] Logging user logs to /content/wandb/run-20241212_015609-avictioo/logs/debug.log
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:_log_setup():529] Logging internal logs to /content/wandb/run-20241212_015609-avictioo/logs/debug-internal.log
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:_jupyter_setup():474] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x79bb96df63b0>
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():639] calling init triggers
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():645] wandb.init called with sweep_config: {}
+config: {}
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():688] starting backend
+2024-12-12 01:56:09,131 INFO    MainThread:1468 [wandb_init.py:init():692] sending inform_init request
+2024-12-12 01:56:09,138 INFO    MainThread:1468 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2024-12-12 01:56:09,138 INFO    MainThread:1468 [wandb_init.py:init():705] backend started and connected
+2024-12-12 01:56:09,145 INFO    MainThread:1468 [wandb_run.py:_label_probe_notebook():1327] probe notebook
+2024-12-12 01:56:10,307 INFO    MainThread:1468 [wandb_init.py:init():798] updated telemetry
+2024-12-12 01:56:10,308 INFO    MainThread:1468 [wandb_init.py:init():830] communicating run to backend with 90.0 second timeout
+2024-12-12 01:56:10,454 INFO    MainThread:1468 [wandb_init.py:init():882] starting run threads in backend
+2024-12-12 01:56:10,902 INFO    MainThread:1468 [wandb_run.py:_console_start():2443] atexit reg
+2024-12-12 01:56:10,902 INFO    MainThread:1468 [wandb_run.py:_redirect():2293] redirect: wrap_raw
+2024-12-12 01:56:10,902 INFO    MainThread:1468 [wandb_run.py:_redirect():2358] Wrapping output streams.
+2024-12-12 01:56:10,903 INFO    MainThread:1468 [wandb_run.py:_redirect():2383] Redirects installed.
+2024-12-12 01:56:10,905 INFO    MainThread:1468 [wandb_init.py:init():925] run started, returning control to user process
+2024-12-12 01:56:10,908 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:10,908 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:10,913 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:10,913 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:10,914 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:18,077 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:18,270 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:18,270 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:41,163 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:41,321 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 01:56:41,322 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 01:56:48,559 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 01:56:48,971 INFO    MainThread:1468 [wandb_run.py:_config_callback():1375] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['BertForMaskedLM'], 'finetuning_task': None, 'id2label': {0: '0', 1: '1'}, 'label2id': {'0': 0, '1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'neuralmind/bert-base-portuguese-cased', '_attn_implementation_autoset': True, 'transformers_version': '4.47.0', 'directionality': 'bidi', 'model_type': 'bert', 'output_past': True, 'pooler_fc_size': 768, 'pooler_num_attention_heads': 12, 'pooler_num_fc_layers': 3, 'pooler_size_per_head': 128, 'pooler_type': 'first_token_transform', 'vocab_size': 29794, 'hidden_size': 768, 'num_hidden_layers': 12, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.07, 'attention_probs_dropout_prob': 0.07, 'max_position_embeddings': 512, 'type_vocab_size': 2, 'initializer_range': 0.02, 'layer_norm_eps': 1e-12, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '.', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 64, 'per_device_eval_batch_size': 64, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 1e-05, 'weight_decay': 0.02, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 19, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 150, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Dec12_01-56-41_4f84ece6c072', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 102, 'save_total_limit': 1, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 5151, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 51, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': 'm2-bertimbau_tunado-maisattentiondropout', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'f1', 'greater_is_better': True, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False}
+2024-12-12 01:56:48,974 INFO    MainThread:1468 [wandb_config.py:__setitem__():154] config set model/num_parameters = 108924674 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x79bbc7981b10>>
+2024-12-12 01:56:48,975 INFO    MainThread:1468 [wandb_run.py:_config_callback():1375] config_cb model/num_parameters 108924674 None
+2024-12-12 02:03:40,669 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:40,669 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:03:40,675 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:03:41,702 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:41,702 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:03:46,456 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:03:47,496 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:47,496 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:03:55,070 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:03:55,073 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:03:55,073 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:01,354 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:01,421 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:01,421 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:02,950 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:02,954 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:02,954 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:06,048 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:07,645 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:07,645 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:07,651 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:07,653 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:07,653 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:07,657 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:07,669 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:07,670 INFO    MainThread:1468 [wandb_init.py:_pause_backend():439] pausing backend
+2024-12-12 02:04:10,823 INFO    MainThread:1468 [wandb_init.py:_resume_backend():444] resuming backend
+2024-12-12 02:04:10,824 INFO    MainThread:1468 [wandb_run.py:_finish():2169] finishing run adrianobf/AzMina-M2/avictioo
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [jupyter.py:save_history():459] not saving jupyter history
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [jupyter.py:save_ipynb():387] not saving jupyter notebook
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_init.py:_jupyter_teardown():456] cleaning up jupyter logic
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_run.py:_atexit_cleanup():2408] got exitcode: 0
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_run.py:_restore():2390] restore
+2024-12-12 02:04:10,825 INFO    MainThread:1468 [wandb_run.py:_restore():2396] restore done
+2024-12-12 02:04:12,209 INFO    MainThread:1468 [wandb_run.py:_footer_history_summary_info():3951] rendering history
+2024-12-12 02:04:12,210 INFO    MainThread:1468 [wandb_run.py:_footer_history_summary_info():3983] rendering summary
+2024-12-12 02:04:12,217 INFO    MainThread:1468 [wandb_run.py:_footer_sync_info():3912] logging synced files