nerugm-base-0 / README.md

End of training

bc0c299 verified 5 months ago

49.5 kB

	---
	language:
	- id
	license: mit
	base_model: indolem/indobert-base-uncased
	tags:
	- generated_from_trainer
	model-index:
	- name: nerugm-base-0
	results: []
	---

	<!-- This model card has been generated automatically according to the information the Trainer had access to. You
	should probably proofread and complete it, then remove this comment. -->

	# nerugm-base-0

	This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
	It achieves the following results on the evaluation set:
	- Loss: 0.3575
	- Location Precision: 0.8553
	- Location Recall: 0.9420
	- Location F1: 0.8966
	- Location Number: 69
	- Organization Precision: 0.6935
	- Organization Recall: 0.7414
	- Organization F1: 0.7167
	- Organization Number: 58
	- Person Precision: 0.8910
	- Person Recall: 0.9145
	- Person F1: 0.9026
	- Person Number: 152
	- Quantity Precision: 0.8125
	- Quantity Recall: 0.8667
	- Quantity F1: 0.8387
	- Quantity Number: 30
	- Time Precision: 0.7812
	- Time Recall: 0.8621
	- Time F1: 0.8197
	- Time Number: 29
	- Overall Precision: 0.8324
	- Overall Recall: 0.8817
	- Overall F1: 0.8563
	- Overall Accuracy: 0.9639

	## Model description

	More information needed

	## Intended uses & limitations

	More information needed

	## Training and evaluation data

	More information needed

	## Training procedure

	### Training hyperparameters

	The following hyperparameters were used during training:
	- learning_rate: 5e-05
	- train_batch_size: 16
	- eval_batch_size: 64
	- seed: 42
	- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
	- lr_scheduler_type: linear
	- num_epochs: 100.0

	### Training results

	\| Training Loss \| Epoch \| Step \| Validation Loss \| Location Precision \| Location Recall \| Location F1 \| Location Number \| Organization Precision \| Organization Recall \| Organization F1 \| Organization Number \| Person Precision \| Person Recall \| Person F1 \| Person Number \| Quantity Precision \| Quantity Recall \| Quantity F1 \| Quantity Number \| Time Precision \| Time Recall \| Time F1 \| Time Number \| Overall Precision \| Overall Recall \| Overall F1 \| Overall Accuracy \|
	\|:-------------:\|:-----:\|:-----:\|:---------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:----------------------:\|:-------------------:\|:---------------:\|:-------------------:\|:----------------:\|:-------------:\|:---------:\|:-------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:--------------:\|:-----------:\|:-------:\|:-----------:\|:-----------------:\|:--------------:\|:----------:\|:----------------:\|
	\| 0.3599 \| 1.0 \| 106 \| 0.1317 \| 0.7922 \| 0.8841 \| 0.8356 \| 69 \| 0.4921 \| 0.5345 \| 0.5124 \| 58 \| 0.8214 \| 0.9079 \| 0.8625 \| 152 \| 0.6364 \| 0.7 \| 0.6667 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.7426 \| 0.8195 \| 0.7792 \| 0.9570 \|
	\| 0.1201 \| 2.0 \| 212 \| 0.1442 \| 0.75 \| 0.8696 \| 0.8054 \| 69 \| 0.6528 \| 0.8103 \| 0.7231 \| 58 \| 0.8537 \| 0.9211 \| 0.8861 \| 152 \| 0.525 \| 0.7 \| 0.6 \| 30 \| 0.6857 \| 0.8276 \| 0.75 \| 29 \| 0.7468 \| 0.8639 \| 0.8011 \| 0.9580 \|
	\| 0.0789 \| 3.0 \| 318 \| 0.1576 \| 0.7294 \| 0.8986 \| 0.8052 \| 69 \| 0.64 \| 0.8276 \| 0.7218 \| 58 \| 0.7989 \| 0.9145 \| 0.8528 \| 152 \| 0.7714 \| 0.9 \| 0.8308 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.7569 \| 0.8935 \| 0.8195 \| 0.9547 \|
	\| 0.0497 \| 4.0 \| 424 \| 0.1576 \| 0.7722 \| 0.8841 \| 0.8243 \| 69 \| 0.7 \| 0.8448 \| 0.7656 \| 58 \| 0.8704 \| 0.9276 \| 0.8981 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.6857 \| 0.8276 \| 0.75 \| 29 \| 0.7921 \| 0.8905 \| 0.8384 \| 0.9629 \|
	\| 0.0304 \| 5.0 \| 530 \| 0.1808 \| 0.8356 \| 0.8841 \| 0.8592 \| 69 \| 0.6393 \| 0.6724 \| 0.6555 \| 58 \| 0.8491 \| 0.8882 \| 0.8682 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.8621 \| 0.8621 \| 0.8621 \| 29 \| 0.8034 \| 0.8462 \| 0.8242 \| 0.9603 \|
	\| 0.0258 \| 6.0 \| 636 \| 0.1898 \| 0.7590 \| 0.9130 \| 0.8289 \| 69 \| 0.5968 \| 0.6379 \| 0.6167 \| 58 \| 0.8726 \| 0.9013 \| 0.8867 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.7832 \| 0.8550 \| 0.8175 \| 0.9590 \|
	\| 0.0151 \| 7.0 \| 742 \| 0.2270 \| 0.7778 \| 0.9130 \| 0.84 \| 69 \| 0.6607 \| 0.6379 \| 0.6491 \| 58 \| 0.8519 \| 0.9079 \| 0.8790 \| 152 \| 0.7941 \| 0.9 \| 0.8438 \| 30 \| 0.6944 \| 0.8621 \| 0.7692 \| 29 \| 0.7859 \| 0.8580 \| 0.8204 \| 0.9588 \|
	\| 0.0124 \| 8.0 \| 848 \| 0.2596 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.6267 \| 0.8103 \| 0.7068 \| 58 \| 0.8466 \| 0.9079 \| 0.8762 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.7842 \| 0.8817 \| 0.8301 \| 0.9570 \|
	\| 0.0088 \| 9.0 \| 954 \| 0.2630 \| 0.8077 \| 0.9130 \| 0.8571 \| 69 \| 0.6812 \| 0.8103 \| 0.7402 \| 58 \| 0.8107 \| 0.9013 \| 0.8536 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8065 \| 0.8621 \| 0.8333 \| 29 \| 0.7842 \| 0.8817 \| 0.8301 \| 0.9562 \|
	\| 0.0083 \| 10.0 \| 1060 \| 0.2329 \| 0.7975 \| 0.9130 \| 0.8514 \| 69 \| 0.6753 \| 0.8966 \| 0.7704 \| 58 \| 0.8773 \| 0.9408 \| 0.9079 \| 152 \| 0.7059 \| 0.8 \| 0.7500 \| 30 \| 0.8 \| 0.8276 \| 0.8136 \| 29 \| 0.7990 \| 0.9053 \| 0.8488 \| 0.9631 \|
	\| 0.0088 \| 11.0 \| 1166 \| 0.2398 \| 0.8077 \| 0.9130 \| 0.8571 \| 69 \| 0.6769 \| 0.7586 \| 0.7154 \| 58 \| 0.8333 \| 0.9211 \| 0.875 \| 152 \| 0.7353 \| 0.8333 \| 0.7812 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.7884 \| 0.8817 \| 0.8324 \| 0.9611 \|
	\| 0.007 \| 12.0 \| 1272 \| 0.2358 \| 0.7722 \| 0.8841 \| 0.8243 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.8701 \| 0.8816 \| 0.8758 \| 152 \| 0.7576 \| 0.8333 \| 0.7937 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8139 \| 0.8669 \| 0.8395 \| 0.9624 \|
	\| 0.0061 \| 13.0 \| 1378 \| 0.2447 \| 0.8333 \| 0.8696 \| 0.8511 \| 69 \| 0.6889 \| 0.5345 \| 0.6019 \| 58 \| 0.8790 \| 0.9079 \| 0.8932 \| 152 \| 0.7429 \| 0.8667 \| 0.8 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8289 \| 0.8314 \| 0.8301 \| 0.9613 \|
	\| 0.0073 \| 14.0 \| 1484 \| 0.2386 \| 0.8158 \| 0.8986 \| 0.8552 \| 69 \| 0.7258 \| 0.7759 \| 0.7500 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.7714 \| 0.9 \| 0.8308 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8283 \| 0.8846 \| 0.8555 \| 0.9641 \|
	\| 0.0046 \| 15.0 \| 1590 \| 0.2387 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.6857 \| 0.8276 \| 0.75 \| 58 \| 0.8968 \| 0.9145 \| 0.9055 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8251 \| 0.8935 \| 0.8580 \| 0.9652 \|
	\| 0.003 \| 16.0 \| 1696 \| 0.2643 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.6731 \| 0.6034 \| 0.6364 \| 58 \| 0.9073 \| 0.9013 \| 0.9043 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8333 \| 0.8621 \| 0.8475 \| 29 \| 0.8338 \| 0.8462 \| 0.8399 \| 0.9611 \|
	\| 0.0027 \| 17.0 \| 1802 \| 0.2792 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6806 \| 0.8448 \| 0.7538 \| 58 \| 0.8590 \| 0.8816 \| 0.8701 \| 152 \| 0.7941 \| 0.9 \| 0.8438 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8070 \| 0.8905 \| 0.8467 \| 0.9613 \|
	\| 0.0037 \| 18.0 \| 1908 \| 0.2727 \| 0.7619 \| 0.9275 \| 0.8366 \| 69 \| 0.6769 \| 0.7586 \| 0.7154 \| 58 \| 0.8696 \| 0.9211 \| 0.8946 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8027 \| 0.8905 \| 0.8443 \| 0.9621 \|
	\| 0.0046 \| 19.0 \| 2014 \| 0.2459 \| 0.7848 \| 0.8986 \| 0.8378 \| 69 \| 0.6818 \| 0.7759 \| 0.7258 \| 58 \| 0.9038 \| 0.9276 \| 0.9156 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8621 \| 0.8621 \| 0.8621 \| 29 \| 0.8264 \| 0.8876 \| 0.8559 \| 0.9636 \|
	\| 0.0048 \| 20.0 \| 2120 \| 0.2616 \| 0.7590 \| 0.9130 \| 0.8289 \| 69 \| 0.6923 \| 0.7759 \| 0.7317 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.8027 \| 0.8905 \| 0.8443 \| 0.9613 \|
	\| 0.0047 \| 21.0 \| 2226 \| 0.2413 \| 0.8025 \| 0.9420 \| 0.8667 \| 69 \| 0.6866 \| 0.7931 \| 0.736 \| 58 \| 0.8790 \| 0.9079 \| 0.8932 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.75 \| 0.9310 \| 0.8308 \| 29 \| 0.8075 \| 0.8935 \| 0.8483 \| 0.9647 \|
	\| 0.0041 \| 22.0 \| 2332 \| 0.2954 \| 0.7805 \| 0.9275 \| 0.8477 \| 69 \| 0.6667 \| 0.8276 \| 0.7385 \| 58 \| 0.8861 \| 0.9211 \| 0.9032 \| 152 \| 0.7353 \| 0.8333 \| 0.7812 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.7953 \| 0.8964 \| 0.8428 \| 0.9621 \|
	\| 0.0034 \| 23.0 \| 2438 \| 0.2645 \| 0.7949 \| 0.8986 \| 0.8435 \| 69 \| 0.7 \| 0.8448 \| 0.7656 \| 58 \| 0.8931 \| 0.9342 \| 0.9132 \| 152 \| 0.8065 \| 0.8333 \| 0.8197 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.8150 \| 0.8994 \| 0.8551 \| 0.9662 \|
	\| 0.0021 \| 24.0 \| 2544 \| 0.2715 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.7246 \| 0.8621 \| 0.7874 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.8276 \| 0.8 \| 0.8136 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8256 \| 0.8964 \| 0.8596 \| 0.9654 \|
	\| 0.0022 \| 25.0 \| 2650 \| 0.2671 \| 0.8158 \| 0.8986 \| 0.8552 \| 69 \| 0.7258 \| 0.7759 \| 0.7500 \| 58 \| 0.9026 \| 0.9145 \| 0.9085 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8319 \| 0.8787 \| 0.8547 \| 0.9639 \|
	\| 0.0021 \| 26.0 \| 2756 \| 0.3094 \| 0.7529 \| 0.9275 \| 0.8312 \| 69 \| 0.6970 \| 0.7931 \| 0.7419 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8333 \| 0.8333 \| 0.8333 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8130 \| 0.8876 \| 0.8487 \| 0.9624 \|
	\| 0.0033 \| 27.0 \| 2862 \| 0.2711 \| 0.7821 \| 0.8841 \| 0.8299 \| 69 \| 0.7302 \| 0.7931 \| 0.7603 \| 58 \| 0.8882 \| 0.9408 \| 0.9137 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8207 \| 0.8935 \| 0.8555 \| 0.9652 \|
	\| 0.003 \| 28.0 \| 2968 \| 0.2883 \| 0.7683 \| 0.9130 \| 0.8344 \| 69 \| 0.7385 \| 0.8276 \| 0.7805 \| 58 \| 0.8987 \| 0.9342 \| 0.9161 \| 152 \| 0.7353 \| 0.8333 \| 0.7812 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8172 \| 0.8994 \| 0.8563 \| 0.9644 \|
	\| 0.0021 \| 29.0 \| 3074 \| 0.2531 \| 0.8077 \| 0.9130 \| 0.8571 \| 69 \| 0.6923 \| 0.7759 \| 0.7317 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8237 \| 0.8846 \| 0.8531 \| 0.9652 \|
	\| 0.0016 \| 30.0 \| 3180 \| 0.2924 \| 0.7590 \| 0.9130 \| 0.8289 \| 69 \| 0.6491 \| 0.6379 \| 0.6435 \| 58 \| 0.8827 \| 0.9408 \| 0.9108 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8016 \| 0.8728 \| 0.8357 \| 0.9626 \|
	\| 0.0048 \| 31.0 \| 3286 \| 0.2868 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6562 \| 0.7241 \| 0.6885 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8081 \| 0.8846 \| 0.8446 \| 0.9626 \|
	\| 0.0032 \| 32.0 \| 3392 \| 0.2836 \| 0.7722 \| 0.8841 \| 0.8243 \| 69 \| 0.6618 \| 0.7759 \| 0.7143 \| 58 \| 0.875 \| 0.9211 \| 0.8974 \| 152 \| 0.7222 \| 0.8667 \| 0.7879 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.7884 \| 0.8817 \| 0.8324 \| 0.9606 \|
	\| 0.004 \| 33.0 \| 3498 \| 0.2565 \| 0.8267 \| 0.8986 \| 0.8611 \| 69 \| 0.7288 \| 0.7414 \| 0.7350 \| 58 \| 0.8797 \| 0.9145 \| 0.8968 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8245 \| 0.8757 \| 0.8494 \| 0.9657 \|
	\| 0.0016 \| 34.0 \| 3604 \| 0.2747 \| 0.7619 \| 0.9275 \| 0.8366 \| 69 \| 0.6897 \| 0.6897 \| 0.6897 \| 58 \| 0.8712 \| 0.9342 \| 0.9016 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8076 \| 0.8817 \| 0.8430 \| 0.9652 \|
	\| 0.0018 \| 35.0 \| 3710 \| 0.2639 \| 0.8 \| 0.9275 \| 0.8591 \| 69 \| 0.7077 \| 0.7931 \| 0.7480 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8261 \| 0.8994 \| 0.8612 \| 0.9659 \|
	\| 0.0032 \| 36.0 \| 3816 \| 0.2596 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.7119 \| 0.7241 \| 0.7179 \| 58 \| 0.9045 \| 0.9342 \| 0.9191 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8357 \| 0.8876 \| 0.8608 \| 0.9654 \|
	\| 0.0024 \| 37.0 \| 3922 \| 0.2782 \| 0.8421 \| 0.9275 \| 0.8828 \| 69 \| 0.7167 \| 0.7414 \| 0.7288 \| 58 \| 0.8875 \| 0.9342 \| 0.9103 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.8333 \| 0.8621 \| 0.8475 \| 29 \| 0.8333 \| 0.8876 \| 0.8596 \| 0.9670 \|
	\| 0.002 \| 38.0 \| 4028 \| 0.2880 \| 0.8 \| 0.9275 \| 0.8591 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.9026 \| 0.9145 \| 0.9085 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8287 \| 0.8876 \| 0.8571 \| 0.9665 \|
	\| 0.0027 \| 39.0 \| 4134 \| 0.2859 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6571 \| 0.7931 \| 0.7188 \| 58 \| 0.8598 \| 0.9276 \| 0.8924 \| 152 \| 0.8 \| 0.8 \| 0.8000 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8032 \| 0.8935 \| 0.8459 \| 0.9647 \|
	\| 0.0028 \| 40.0 \| 4240 \| 0.2777 \| 0.8101 \| 0.9275 \| 0.8649 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.8938 \| 0.9408 \| 0.9167 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8288 \| 0.9024 \| 0.8640 \| 0.9675 \|
	\| 0.0013 \| 41.0 \| 4346 \| 0.2742 \| 0.7683 \| 0.9130 \| 0.8344 \| 69 \| 0.7188 \| 0.7931 \| 0.7541 \| 58 \| 0.8827 \| 0.9408 \| 0.9108 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8182 \| 0.9310 \| 0.8710 \| 29 \| 0.8177 \| 0.9024 \| 0.8579 \| 0.9667 \|
	\| 0.0035 \| 42.0 \| 4452 \| 0.2879 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.7302 \| 0.7931 \| 0.7603 \| 58 \| 0.8720 \| 0.9408 \| 0.9051 \| 152 \| 0.7576 \| 0.8333 \| 0.7937 \| 30 \| 0.7941 \| 0.9310 \| 0.8571 \| 29 \| 0.8248 \| 0.9053 \| 0.8632 \| 0.9675 \|
	\| 0.0014 \| 43.0 \| 4558 \| 0.2880 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.7121 \| 0.8103 \| 0.7581 \| 58 \| 0.8383 \| 0.9211 \| 0.8777 \| 152 \| 0.75 \| 0.8 \| 0.7742 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8027 \| 0.8905 \| 0.8443 \| 0.9652 \|
	\| 0.002 \| 44.0 \| 4664 \| 0.2945 \| 0.8101 \| 0.9275 \| 0.8649 \| 69 \| 0.7286 \| 0.8793 \| 0.7969 \| 58 \| 0.8987 \| 0.9342 \| 0.9161 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8280 \| 0.9112 \| 0.8676 \| 0.9662 \|
	\| 0.003 \| 45.0 \| 4770 \| 0.2898 \| 0.7529 \| 0.9275 \| 0.8312 \| 69 \| 0.7049 \| 0.7414 \| 0.7227 \| 58 \| 0.9038 \| 0.9276 \| 0.9156 \| 152 \| 0.8065 \| 0.8333 \| 0.8197 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8237 \| 0.8846 \| 0.8531 \| 0.9647 \|
	\| 0.0029 \| 46.0 \| 4876 \| 0.3106 \| 0.7647 \| 0.9420 \| 0.8442 \| 69 \| 0.7429 \| 0.8966 \| 0.8125 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.8163 \| 0.9201 \| 0.8651 \| 0.9654 \|
	\| 0.0033 \| 47.0 \| 4982 \| 0.2665 \| 0.8841 \| 0.8841 \| 0.8841 \| 69 \| 0.7255 \| 0.6379 \| 0.6789 \| 58 \| 0.9156 \| 0.9276 \| 0.9216 \| 152 \| 0.8387 \| 0.8667 \| 0.8525 \| 30 \| 0.8621 \| 0.8621 \| 0.8621 \| 29 \| 0.8683 \| 0.8580 \| 0.8631 \| 0.9639 \|
	\| 0.0027 \| 48.0 \| 5088 \| 0.3205 \| 0.7529 \| 0.9275 \| 0.8312 \| 69 \| 0.6806 \| 0.8448 \| 0.7538 \| 58 \| 0.8797 \| 0.9145 \| 0.8968 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8 \| 0.8994 \| 0.8468 \| 0.9606 \|
	\| 0.0014 \| 49.0 \| 5194 \| 0.2800 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6970 \| 0.7931 \| 0.7419 \| 58 \| 0.8931 \| 0.9342 \| 0.9132 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8288 \| 0.9024 \| 0.8640 \| 0.9657 \|
	\| 0.0005 \| 50.0 \| 5300 \| 0.3062 \| 0.8 \| 0.9275 \| 0.8591 \| 69 \| 0.6761 \| 0.8276 \| 0.7442 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8177 \| 0.9024 \| 0.8579 \| 0.9634 \|
	\| 0.0009 \| 51.0 \| 5406 \| 0.3094 \| 0.7922 \| 0.8841 \| 0.8356 \| 69 \| 0.6716 \| 0.7759 \| 0.7200 \| 58 \| 0.875 \| 0.9211 \| 0.8974 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8076 \| 0.8817 \| 0.8430 \| 0.9616 \|
	\| 0.0007 \| 52.0 \| 5512 \| 0.2927 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.7049 \| 0.7414 \| 0.7227 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8278 \| 0.8817 \| 0.8539 \| 0.9652 \|
	\| 0.0005 \| 53.0 \| 5618 \| 0.3106 \| 0.8026 \| 0.8841 \| 0.8414 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8812 \| 0.9276 \| 0.9038 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8227 \| 0.8787 \| 0.8498 \| 0.9639 \|
	\| 0.0006 \| 54.0 \| 5724 \| 0.3165 \| 0.8133 \| 0.8841 \| 0.8472 \| 69 \| 0.7241 \| 0.7241 \| 0.7241 \| 58 \| 0.8875 \| 0.9342 \| 0.9103 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8319 \| 0.8787 \| 0.8547 \| 0.9649 \|
	\| 0.0008 \| 55.0 \| 5830 \| 0.2877 \| 0.8857 \| 0.8986 \| 0.8921 \| 69 \| 0.7551 \| 0.6379 \| 0.6916 \| 58 \| 0.8917 \| 0.9211 \| 0.9061 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8580 \| 0.8580 \| 0.8580 \| 0.9677 \|
	\| 0.0013 \| 56.0 \| 5936 \| 0.2934 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.7018 \| 0.6897 \| 0.6957 \| 58 \| 0.8981 \| 0.9276 \| 0.9126 \| 152 \| 0.8387 \| 0.8667 \| 0.8525 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8418 \| 0.8817 \| 0.8613 \| 0.9647 \|
	\| 0.0003 \| 57.0 \| 6042 \| 0.3164 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.7018 \| 0.6897 \| 0.6957 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8324 \| 0.8817 \| 0.8563 \| 0.9639 \|
	\| 0.0004 \| 58.0 \| 6148 \| 0.3298 \| 0.8333 \| 0.9420 \| 0.8844 \| 69 \| 0.6825 \| 0.7414 \| 0.7107 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8269 \| 0.8905 \| 0.8575 \| 0.9629 \|
	\| 0.0006 \| 59.0 \| 6254 \| 0.3475 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.6545 \| 0.6207 \| 0.6372 \| 58 \| 0.8931 \| 0.9342 \| 0.9132 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8310 \| 0.8728 \| 0.8514 \| 0.9618 \|
	\| 0.0009 \| 60.0 \| 6360 \| 0.3446 \| 0.8228 \| 0.9420 \| 0.8784 \| 69 \| 0.7541 \| 0.7931 \| 0.7731 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8375 \| 0.8994 \| 0.8673 \| 0.9647 \|
	\| 0.0005 \| 61.0 \| 6466 \| 0.3662 \| 0.8025 \| 0.9420 \| 0.8667 \| 69 \| 0.6716 \| 0.7759 \| 0.7200 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8140 \| 0.8935 \| 0.8519 \| 0.9611 \|
	\| 0.002 \| 62.0 \| 6572 \| 0.3188 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.7031 \| 0.7759 \| 0.7377 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.7576 \| 0.8333 \| 0.7937 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8320 \| 0.8935 \| 0.8616 \| 0.9665 \|
	\| 0.0005 \| 63.0 \| 6678 \| 0.3222 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.7302 \| 0.7931 \| 0.7603 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8065 \| 0.8333 \| 0.8197 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8408 \| 0.8905 \| 0.8649 \| 0.9670 \|
	\| 0.0003 \| 64.0 \| 6784 \| 0.3288 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.7231 \| 0.8103 \| 0.7642 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8297 \| 0.8935 \| 0.8604 \| 0.9662 \|
	\| 0.0003 \| 65.0 \| 6890 \| 0.3331 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.8659 \| 0.9342 \| 0.8987 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8266 \| 0.9024 \| 0.8628 \| 0.9662 \|
	\| 0.0003 \| 66.0 \| 6996 \| 0.3162 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.6981 \| 0.6379 \| 0.6667 \| 58 \| 0.8974 \| 0.9211 \| 0.9091 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8415 \| 0.8639 \| 0.8526 \| 0.9662 \|
	\| 0.0024 \| 67.0 \| 7102 \| 0.3060 \| 0.8182 \| 0.9130 \| 0.8630 \| 69 \| 0.7143 \| 0.7759 \| 0.7438 \| 58 \| 0.9085 \| 0.9145 \| 0.9115 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8347 \| 0.8817 \| 0.8576 \| 0.9672 \|
	\| 0.002 \| 68.0 \| 7208 \| 0.3085 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.74 \| 0.6379 \| 0.6852 \| 58 \| 0.9038 \| 0.9276 \| 0.9156 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8477 \| 0.8728 \| 0.8601 \| 0.9652 \|
	\| 0.0014 \| 69.0 \| 7314 \| 0.3034 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.6522 \| 0.7759 \| 0.7087 \| 58 \| 0.8642 \| 0.9211 \| 0.8917 \| 152 \| 0.8485 \| 0.9333 \| 0.8889 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8150 \| 0.8994 \| 0.8551 \| 0.9649 \|
	\| 0.0006 \| 70.0 \| 7420 \| 0.3125 \| 0.8421 \| 0.9275 \| 0.8828 \| 69 \| 0.6667 \| 0.7931 \| 0.7244 \| 58 \| 0.8589 \| 0.9211 \| 0.8889 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7576 \| 0.8621 \| 0.8065 \| 29 \| 0.8070 \| 0.8905 \| 0.8467 \| 0.9647 \|
	\| 0.0009 \| 71.0 \| 7526 \| 0.3197 \| 0.84 \| 0.9130 \| 0.8750 \| 69 \| 0.6765 \| 0.7931 \| 0.7302 \| 58 \| 0.8650 \| 0.9276 \| 0.8952 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.7419 \| 0.7931 \| 0.7667 \| 29 \| 0.8059 \| 0.8846 \| 0.8434 \| 0.9639 \|
	\| 0.0009 \| 72.0 \| 7632 \| 0.3207 \| 0.8421 \| 0.9275 \| 0.8828 \| 69 \| 0.6923 \| 0.7759 \| 0.7317 \| 58 \| 0.8820 \| 0.9342 \| 0.9073 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.75 \| 0.8276 \| 0.7869 \| 29 \| 0.8179 \| 0.8905 \| 0.8527 \| 0.9647 \|
	\| 0.0006 \| 73.0 \| 7738 \| 0.3206 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.6719 \| 0.7414 \| 0.7049 \| 58 \| 0.8917 \| 0.9211 \| 0.9061 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8209 \| 0.8817 \| 0.8502 \| 0.9647 \|
	\| 0.0004 \| 74.0 \| 7844 \| 0.3209 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.6875 \| 0.7586 \| 0.7213 \| 58 \| 0.8903 \| 0.9079 \| 0.8990 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8227 \| 0.8787 \| 0.8498 \| 0.9641 \|
	\| 0.0003 \| 75.0 \| 7950 \| 0.3219 \| 0.875 \| 0.9130 \| 0.8936 \| 69 \| 0.6615 \| 0.7414 \| 0.6992 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8245 \| 0.8757 \| 0.8494 \| 0.9636 \|
	\| 0.0003 \| 76.0 \| 8056 \| 0.3356 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.6575 \| 0.8276 \| 0.7328 \| 58 \| 0.8812 \| 0.9276 \| 0.9038 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8107 \| 0.8994 \| 0.8527 \| 0.9631 \|
	\| 0.0002 \| 77.0 \| 8162 \| 0.3265 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8301 \| 0.8817 \| 0.8551 \| 0.9657 \|
	\| 0.0002 \| 78.0 \| 8268 \| 0.3292 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6875 \| 0.7586 \| 0.7213 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8237 \| 0.8846 \| 0.8531 \| 0.9649 \|
	\| 0.0003 \| 79.0 \| 8374 \| 0.3334 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6769 \| 0.7586 \| 0.7154 \| 58 \| 0.8688 \| 0.9145 \| 0.8910 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8187 \| 0.8817 \| 0.8490 \| 0.9647 \|
	\| 0.0006 \| 80.0 \| 8480 \| 0.3393 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6721 \| 0.7069 \| 0.6891 \| 58 \| 0.8968 \| 0.9145 \| 0.9055 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8362 \| 0.8757 \| 0.8555 \| 0.9647 \|
	\| 0.0002 \| 81.0 \| 8586 \| 0.3537 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6875 \| 0.7586 \| 0.7213 \| 58 \| 0.8903 \| 0.9079 \| 0.8990 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8273 \| 0.8787 \| 0.8522 \| 0.9644 \|
	\| 0.0003 \| 82.0 \| 8692 \| 0.3606 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7321 \| 0.7069 \| 0.7193 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8348 \| 0.8669 \| 0.8505 \| 0.9639 \|
	\| 0.0006 \| 83.0 \| 8798 \| 0.3577 \| 0.8784 \| 0.9420 \| 0.9091 \| 69 \| 0.6923 \| 0.6207 \| 0.6545 \| 58 \| 0.8968 \| 0.9145 \| 0.9055 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8406 \| 0.8580 \| 0.8492 \| 0.9641 \|
	\| 0.001 \| 84.0 \| 8904 \| 0.3674 \| 0.8667 \| 0.9420 \| 0.9028 \| 69 \| 0.6727 \| 0.6379 \| 0.6549 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8286 \| 0.8580 \| 0.8430 \| 0.9618 \|
	\| 0.0006 \| 85.0 \| 9010 \| 0.3639 \| 0.8784 \| 0.9420 \| 0.9091 \| 69 \| 0.6909 \| 0.6552 \| 0.6726 \| 58 \| 0.8790 \| 0.9079 \| 0.8932 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8343 \| 0.8639 \| 0.8488 \| 0.9616 \|
	\| 0.0004 \| 86.0 \| 9116 \| 0.3683 \| 0.875 \| 0.9130 \| 0.8936 \| 69 \| 0.74 \| 0.6379 \| 0.6852 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8455 \| 0.8580 \| 0.8517 \| 0.9634 \|
	\| 0.0005 \| 87.0 \| 9222 \| 0.3531 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7170 \| 0.6552 \| 0.6847 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8362 \| 0.8609 \| 0.8484 \| 0.9626 \|
	\| 0.0002 \| 88.0 \| 9328 \| 0.3533 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.7308 \| 0.6552 \| 0.6909 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8410 \| 0.8609 \| 0.8509 \| 0.9634 \|
	\| 0.0002 \| 89.0 \| 9434 \| 0.3525 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.7321 \| 0.7069 \| 0.7193 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8371 \| 0.8669 \| 0.8517 \| 0.9636 \|
	\| 0.0002 \| 90.0 \| 9540 \| 0.3583 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7241 \| 0.7241 \| 0.7241 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8385 \| 0.8757 \| 0.8567 \| 0.9634 \|
	\| 0.0002 \| 91.0 \| 9646 \| 0.3626 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.7288 \| 0.7414 \| 0.7350 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8366 \| 0.8787 \| 0.8571 \| 0.9631 \|
	\| 0.0005 \| 92.0 \| 9752 \| 0.3608 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.7368 \| 0.7241 \| 0.7304 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8376 \| 0.8698 \| 0.8534 \| 0.9634 \|
	\| 0.0002 \| 93.0 \| 9858 \| 0.3571 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7167 \| 0.7414 \| 0.7288 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8366 \| 0.8787 \| 0.8571 \| 0.9634 \|
	\| 0.0002 \| 94.0 \| 9964 \| 0.3574 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7167 \| 0.7414 \| 0.7288 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8366 \| 0.8787 \| 0.8571 \| 0.9634 \|
	\| 0.0004 \| 95.0 \| 10070 \| 0.3578 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8343 \| 0.8787 \| 0.8559 \| 0.9641 \|
	\| 0.0003 \| 96.0 \| 10176 \| 0.3588 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8315 \| 0.8757 \| 0.8530 \| 0.9639 \|
	\| 0.0004 \| 97.0 \| 10282 \| 0.3566 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8319 \| 0.8787 \| 0.8547 \| 0.9639 \|
	\| 0.0003 \| 98.0 \| 10388 \| 0.3576 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6825 \| 0.7414 \| 0.7107 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8296 \| 0.8787 \| 0.8534 \| 0.9636 \|
	\| 0.0004 \| 99.0 \| 10494 \| 0.3574 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8324 \| 0.8817 \| 0.8563 \| 0.9639 \|
	\| 0.0002 \| 100.0 \| 10600 \| 0.3575 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8324 \| 0.8817 \| 0.8563 \| 0.9639 \|


	### Framework versions

	- Transformers 4.39.3
	- Pytorch 2.3.0+cu121
	- Datasets 2.19.1
	- Tokenizers 0.15.2

	---
	language:
	- id
	license: mit
	base_model: indolem/indobert-base-uncased
	tags:
	- generated_from_trainer
	model-index:
	- name: nerugm-base-0
	results: []
	---

	<!-- This model card has been generated automatically according to the information the Trainer had access to. You
	should probably proofread and complete it, then remove this comment. -->

	# nerugm-base-0

	This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co/indolem/indobert-base-uncased) on an unknown dataset.
	It achieves the following results on the evaluation set:
	- Loss: 0.3575
	- Location Precision: 0.8553
	- Location Recall: 0.9420
	- Location F1: 0.8966
	- Location Number: 69
	- Organization Precision: 0.6935
	- Organization Recall: 0.7414
	- Organization F1: 0.7167
	- Organization Number: 58
	- Person Precision: 0.8910
	- Person Recall: 0.9145
	- Person F1: 0.9026
	- Person Number: 152
	- Quantity Precision: 0.8125
	- Quantity Recall: 0.8667
	- Quantity F1: 0.8387
	- Quantity Number: 30
	- Time Precision: 0.7812
	- Time Recall: 0.8621
	- Time F1: 0.8197
	- Time Number: 29
	- Overall Precision: 0.8324
	- Overall Recall: 0.8817
	- Overall F1: 0.8563
	- Overall Accuracy: 0.9639

	## Model description

	More information needed

	## Intended uses & limitations

	More information needed

	## Training and evaluation data

	More information needed

	## Training procedure

	### Training hyperparameters

	The following hyperparameters were used during training:
	- learning_rate: 5e-05
	- train_batch_size: 16
	- eval_batch_size: 64
	- seed: 42
	- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
	- lr_scheduler_type: linear
	- num_epochs: 100.0

	### Training results

	\| Training Loss \| Epoch \| Step \| Validation Loss \| Location Precision \| Location Recall \| Location F1 \| Location Number \| Organization Precision \| Organization Recall \| Organization F1 \| Organization Number \| Person Precision \| Person Recall \| Person F1 \| Person Number \| Quantity Precision \| Quantity Recall \| Quantity F1 \| Quantity Number \| Time Precision \| Time Recall \| Time F1 \| Time Number \| Overall Precision \| Overall Recall \| Overall F1 \| Overall Accuracy \|
	\|:-------------:\|:-----:\|:-----:\|:---------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:----------------------:\|:-------------------:\|:---------------:\|:-------------------:\|:----------------:\|:-------------:\|:---------:\|:-------------:\|:------------------:\|:---------------:\|:-----------:\|:---------------:\|:--------------:\|:-----------:\|:-------:\|:-----------:\|:-----------------:\|:--------------:\|:----------:\|:----------------:\|
	\| 0.3599 \| 1.0 \| 106 \| 0.1317 \| 0.7922 \| 0.8841 \| 0.8356 \| 69 \| 0.4921 \| 0.5345 \| 0.5124 \| 58 \| 0.8214 \| 0.9079 \| 0.8625 \| 152 \| 0.6364 \| 0.7 \| 0.6667 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.7426 \| 0.8195 \| 0.7792 \| 0.9570 \|
	\| 0.1201 \| 2.0 \| 212 \| 0.1442 \| 0.75 \| 0.8696 \| 0.8054 \| 69 \| 0.6528 \| 0.8103 \| 0.7231 \| 58 \| 0.8537 \| 0.9211 \| 0.8861 \| 152 \| 0.525 \| 0.7 \| 0.6 \| 30 \| 0.6857 \| 0.8276 \| 0.75 \| 29 \| 0.7468 \| 0.8639 \| 0.8011 \| 0.9580 \|
	\| 0.0789 \| 3.0 \| 318 \| 0.1576 \| 0.7294 \| 0.8986 \| 0.8052 \| 69 \| 0.64 \| 0.8276 \| 0.7218 \| 58 \| 0.7989 \| 0.9145 \| 0.8528 \| 152 \| 0.7714 \| 0.9 \| 0.8308 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.7569 \| 0.8935 \| 0.8195 \| 0.9547 \|
	\| 0.0497 \| 4.0 \| 424 \| 0.1576 \| 0.7722 \| 0.8841 \| 0.8243 \| 69 \| 0.7 \| 0.8448 \| 0.7656 \| 58 \| 0.8704 \| 0.9276 \| 0.8981 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.6857 \| 0.8276 \| 0.75 \| 29 \| 0.7921 \| 0.8905 \| 0.8384 \| 0.9629 \|
	\| 0.0304 \| 5.0 \| 530 \| 0.1808 \| 0.8356 \| 0.8841 \| 0.8592 \| 69 \| 0.6393 \| 0.6724 \| 0.6555 \| 58 \| 0.8491 \| 0.8882 \| 0.8682 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.8621 \| 0.8621 \| 0.8621 \| 29 \| 0.8034 \| 0.8462 \| 0.8242 \| 0.9603 \|
	\| 0.0258 \| 6.0 \| 636 \| 0.1898 \| 0.7590 \| 0.9130 \| 0.8289 \| 69 \| 0.5968 \| 0.6379 \| 0.6167 \| 58 \| 0.8726 \| 0.9013 \| 0.8867 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.7832 \| 0.8550 \| 0.8175 \| 0.9590 \|
	\| 0.0151 \| 7.0 \| 742 \| 0.2270 \| 0.7778 \| 0.9130 \| 0.84 \| 69 \| 0.6607 \| 0.6379 \| 0.6491 \| 58 \| 0.8519 \| 0.9079 \| 0.8790 \| 152 \| 0.7941 \| 0.9 \| 0.8438 \| 30 \| 0.6944 \| 0.8621 \| 0.7692 \| 29 \| 0.7859 \| 0.8580 \| 0.8204 \| 0.9588 \|
	\| 0.0124 \| 8.0 \| 848 \| 0.2596 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.6267 \| 0.8103 \| 0.7068 \| 58 \| 0.8466 \| 0.9079 \| 0.8762 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.7842 \| 0.8817 \| 0.8301 \| 0.9570 \|
	\| 0.0088 \| 9.0 \| 954 \| 0.2630 \| 0.8077 \| 0.9130 \| 0.8571 \| 69 \| 0.6812 \| 0.8103 \| 0.7402 \| 58 \| 0.8107 \| 0.9013 \| 0.8536 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8065 \| 0.8621 \| 0.8333 \| 29 \| 0.7842 \| 0.8817 \| 0.8301 \| 0.9562 \|
	\| 0.0083 \| 10.0 \| 1060 \| 0.2329 \| 0.7975 \| 0.9130 \| 0.8514 \| 69 \| 0.6753 \| 0.8966 \| 0.7704 \| 58 \| 0.8773 \| 0.9408 \| 0.9079 \| 152 \| 0.7059 \| 0.8 \| 0.7500 \| 30 \| 0.8 \| 0.8276 \| 0.8136 \| 29 \| 0.7990 \| 0.9053 \| 0.8488 \| 0.9631 \|
	\| 0.0088 \| 11.0 \| 1166 \| 0.2398 \| 0.8077 \| 0.9130 \| 0.8571 \| 69 \| 0.6769 \| 0.7586 \| 0.7154 \| 58 \| 0.8333 \| 0.9211 \| 0.875 \| 152 \| 0.7353 \| 0.8333 \| 0.7812 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.7884 \| 0.8817 \| 0.8324 \| 0.9611 \|
	\| 0.007 \| 12.0 \| 1272 \| 0.2358 \| 0.7722 \| 0.8841 \| 0.8243 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.8701 \| 0.8816 \| 0.8758 \| 152 \| 0.7576 \| 0.8333 \| 0.7937 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8139 \| 0.8669 \| 0.8395 \| 0.9624 \|
	\| 0.0061 \| 13.0 \| 1378 \| 0.2447 \| 0.8333 \| 0.8696 \| 0.8511 \| 69 \| 0.6889 \| 0.5345 \| 0.6019 \| 58 \| 0.8790 \| 0.9079 \| 0.8932 \| 152 \| 0.7429 \| 0.8667 \| 0.8 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8289 \| 0.8314 \| 0.8301 \| 0.9613 \|
	\| 0.0073 \| 14.0 \| 1484 \| 0.2386 \| 0.8158 \| 0.8986 \| 0.8552 \| 69 \| 0.7258 \| 0.7759 \| 0.7500 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.7714 \| 0.9 \| 0.8308 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8283 \| 0.8846 \| 0.8555 \| 0.9641 \|
	\| 0.0046 \| 15.0 \| 1590 \| 0.2387 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.6857 \| 0.8276 \| 0.75 \| 58 \| 0.8968 \| 0.9145 \| 0.9055 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8251 \| 0.8935 \| 0.8580 \| 0.9652 \|
	\| 0.003 \| 16.0 \| 1696 \| 0.2643 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.6731 \| 0.6034 \| 0.6364 \| 58 \| 0.9073 \| 0.9013 \| 0.9043 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8333 \| 0.8621 \| 0.8475 \| 29 \| 0.8338 \| 0.8462 \| 0.8399 \| 0.9611 \|
	\| 0.0027 \| 17.0 \| 1802 \| 0.2792 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6806 \| 0.8448 \| 0.7538 \| 58 \| 0.8590 \| 0.8816 \| 0.8701 \| 152 \| 0.7941 \| 0.9 \| 0.8438 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8070 \| 0.8905 \| 0.8467 \| 0.9613 \|
	\| 0.0037 \| 18.0 \| 1908 \| 0.2727 \| 0.7619 \| 0.9275 \| 0.8366 \| 69 \| 0.6769 \| 0.7586 \| 0.7154 \| 58 \| 0.8696 \| 0.9211 \| 0.8946 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8027 \| 0.8905 \| 0.8443 \| 0.9621 \|
	\| 0.0046 \| 19.0 \| 2014 \| 0.2459 \| 0.7848 \| 0.8986 \| 0.8378 \| 69 \| 0.6818 \| 0.7759 \| 0.7258 \| 58 \| 0.9038 \| 0.9276 \| 0.9156 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.8621 \| 0.8621 \| 0.8621 \| 29 \| 0.8264 \| 0.8876 \| 0.8559 \| 0.9636 \|
	\| 0.0048 \| 20.0 \| 2120 \| 0.2616 \| 0.7590 \| 0.9130 \| 0.8289 \| 69 \| 0.6923 \| 0.7759 \| 0.7317 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8182 \| 0.9 \| 0.8571 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.8027 \| 0.8905 \| 0.8443 \| 0.9613 \|
	\| 0.0047 \| 21.0 \| 2226 \| 0.2413 \| 0.8025 \| 0.9420 \| 0.8667 \| 69 \| 0.6866 \| 0.7931 \| 0.736 \| 58 \| 0.8790 \| 0.9079 \| 0.8932 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.75 \| 0.9310 \| 0.8308 \| 29 \| 0.8075 \| 0.8935 \| 0.8483 \| 0.9647 \|
	\| 0.0041 \| 22.0 \| 2332 \| 0.2954 \| 0.7805 \| 0.9275 \| 0.8477 \| 69 \| 0.6667 \| 0.8276 \| 0.7385 \| 58 \| 0.8861 \| 0.9211 \| 0.9032 \| 152 \| 0.7353 \| 0.8333 \| 0.7812 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.7953 \| 0.8964 \| 0.8428 \| 0.9621 \|
	\| 0.0034 \| 23.0 \| 2438 \| 0.2645 \| 0.7949 \| 0.8986 \| 0.8435 \| 69 \| 0.7 \| 0.8448 \| 0.7656 \| 58 \| 0.8931 \| 0.9342 \| 0.9132 \| 152 \| 0.8065 \| 0.8333 \| 0.8197 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.8150 \| 0.8994 \| 0.8551 \| 0.9662 \|
	\| 0.0021 \| 24.0 \| 2544 \| 0.2715 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.7246 \| 0.8621 \| 0.7874 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.8276 \| 0.8 \| 0.8136 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8256 \| 0.8964 \| 0.8596 \| 0.9654 \|
	\| 0.0022 \| 25.0 \| 2650 \| 0.2671 \| 0.8158 \| 0.8986 \| 0.8552 \| 69 \| 0.7258 \| 0.7759 \| 0.7500 \| 58 \| 0.9026 \| 0.9145 \| 0.9085 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8319 \| 0.8787 \| 0.8547 \| 0.9639 \|
	\| 0.0021 \| 26.0 \| 2756 \| 0.3094 \| 0.7529 \| 0.9275 \| 0.8312 \| 69 \| 0.6970 \| 0.7931 \| 0.7419 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8333 \| 0.8333 \| 0.8333 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8130 \| 0.8876 \| 0.8487 \| 0.9624 \|
	\| 0.0033 \| 27.0 \| 2862 \| 0.2711 \| 0.7821 \| 0.8841 \| 0.8299 \| 69 \| 0.7302 \| 0.7931 \| 0.7603 \| 58 \| 0.8882 \| 0.9408 \| 0.9137 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8207 \| 0.8935 \| 0.8555 \| 0.9652 \|
	\| 0.003 \| 28.0 \| 2968 \| 0.2883 \| 0.7683 \| 0.9130 \| 0.8344 \| 69 \| 0.7385 \| 0.8276 \| 0.7805 \| 58 \| 0.8987 \| 0.9342 \| 0.9161 \| 152 \| 0.7353 \| 0.8333 \| 0.7812 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8172 \| 0.8994 \| 0.8563 \| 0.9644 \|
	\| 0.0021 \| 29.0 \| 3074 \| 0.2531 \| 0.8077 \| 0.9130 \| 0.8571 \| 69 \| 0.6923 \| 0.7759 \| 0.7317 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8237 \| 0.8846 \| 0.8531 \| 0.9652 \|
	\| 0.0016 \| 30.0 \| 3180 \| 0.2924 \| 0.7590 \| 0.9130 \| 0.8289 \| 69 \| 0.6491 \| 0.6379 \| 0.6435 \| 58 \| 0.8827 \| 0.9408 \| 0.9108 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8016 \| 0.8728 \| 0.8357 \| 0.9626 \|
	\| 0.0048 \| 31.0 \| 3286 \| 0.2868 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6562 \| 0.7241 \| 0.6885 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8081 \| 0.8846 \| 0.8446 \| 0.9626 \|
	\| 0.0032 \| 32.0 \| 3392 \| 0.2836 \| 0.7722 \| 0.8841 \| 0.8243 \| 69 \| 0.6618 \| 0.7759 \| 0.7143 \| 58 \| 0.875 \| 0.9211 \| 0.8974 \| 152 \| 0.7222 \| 0.8667 \| 0.7879 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.7884 \| 0.8817 \| 0.8324 \| 0.9606 \|
	\| 0.004 \| 33.0 \| 3498 \| 0.2565 \| 0.8267 \| 0.8986 \| 0.8611 \| 69 \| 0.7288 \| 0.7414 \| 0.7350 \| 58 \| 0.8797 \| 0.9145 \| 0.8968 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8245 \| 0.8757 \| 0.8494 \| 0.9657 \|
	\| 0.0016 \| 34.0 \| 3604 \| 0.2747 \| 0.7619 \| 0.9275 \| 0.8366 \| 69 \| 0.6897 \| 0.6897 \| 0.6897 \| 58 \| 0.8712 \| 0.9342 \| 0.9016 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8076 \| 0.8817 \| 0.8430 \| 0.9652 \|
	\| 0.0018 \| 35.0 \| 3710 \| 0.2639 \| 0.8 \| 0.9275 \| 0.8591 \| 69 \| 0.7077 \| 0.7931 \| 0.7480 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8261 \| 0.8994 \| 0.8612 \| 0.9659 \|
	\| 0.0032 \| 36.0 \| 3816 \| 0.2596 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.7119 \| 0.7241 \| 0.7179 \| 58 \| 0.9045 \| 0.9342 \| 0.9191 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7647 \| 0.8966 \| 0.8254 \| 29 \| 0.8357 \| 0.8876 \| 0.8608 \| 0.9654 \|
	\| 0.0024 \| 37.0 \| 3922 \| 0.2782 \| 0.8421 \| 0.9275 \| 0.8828 \| 69 \| 0.7167 \| 0.7414 \| 0.7288 \| 58 \| 0.8875 \| 0.9342 \| 0.9103 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.8333 \| 0.8621 \| 0.8475 \| 29 \| 0.8333 \| 0.8876 \| 0.8596 \| 0.9670 \|
	\| 0.002 \| 38.0 \| 4028 \| 0.2880 \| 0.8 \| 0.9275 \| 0.8591 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.9026 \| 0.9145 \| 0.9085 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8287 \| 0.8876 \| 0.8571 \| 0.9665 \|
	\| 0.0027 \| 39.0 \| 4134 \| 0.2859 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6571 \| 0.7931 \| 0.7188 \| 58 \| 0.8598 \| 0.9276 \| 0.8924 \| 152 \| 0.8 \| 0.8 \| 0.8000 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8032 \| 0.8935 \| 0.8459 \| 0.9647 \|
	\| 0.0028 \| 40.0 \| 4240 \| 0.2777 \| 0.8101 \| 0.9275 \| 0.8649 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.8938 \| 0.9408 \| 0.9167 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8288 \| 0.9024 \| 0.8640 \| 0.9675 \|
	\| 0.0013 \| 41.0 \| 4346 \| 0.2742 \| 0.7683 \| 0.9130 \| 0.8344 \| 69 \| 0.7188 \| 0.7931 \| 0.7541 \| 58 \| 0.8827 \| 0.9408 \| 0.9108 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8182 \| 0.9310 \| 0.8710 \| 29 \| 0.8177 \| 0.9024 \| 0.8579 \| 0.9667 \|
	\| 0.0035 \| 42.0 \| 4452 \| 0.2879 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.7302 \| 0.7931 \| 0.7603 \| 58 \| 0.8720 \| 0.9408 \| 0.9051 \| 152 \| 0.7576 \| 0.8333 \| 0.7937 \| 30 \| 0.7941 \| 0.9310 \| 0.8571 \| 29 \| 0.8248 \| 0.9053 \| 0.8632 \| 0.9675 \|
	\| 0.0014 \| 43.0 \| 4558 \| 0.2880 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.7121 \| 0.8103 \| 0.7581 \| 58 \| 0.8383 \| 0.9211 \| 0.8777 \| 152 \| 0.75 \| 0.8 \| 0.7742 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8027 \| 0.8905 \| 0.8443 \| 0.9652 \|
	\| 0.002 \| 44.0 \| 4664 \| 0.2945 \| 0.8101 \| 0.9275 \| 0.8649 \| 69 \| 0.7286 \| 0.8793 \| 0.7969 \| 58 \| 0.8987 \| 0.9342 \| 0.9161 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8280 \| 0.9112 \| 0.8676 \| 0.9662 \|
	\| 0.003 \| 45.0 \| 4770 \| 0.2898 \| 0.7529 \| 0.9275 \| 0.8312 \| 69 \| 0.7049 \| 0.7414 \| 0.7227 \| 58 \| 0.9038 \| 0.9276 \| 0.9156 \| 152 \| 0.8065 \| 0.8333 \| 0.8197 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8237 \| 0.8846 \| 0.8531 \| 0.9647 \|
	\| 0.0029 \| 46.0 \| 4876 \| 0.3106 \| 0.7647 \| 0.9420 \| 0.8442 \| 69 \| 0.7429 \| 0.8966 \| 0.8125 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.7429 \| 0.8966 \| 0.8125 \| 29 \| 0.8163 \| 0.9201 \| 0.8651 \| 0.9654 \|
	\| 0.0033 \| 47.0 \| 4982 \| 0.2665 \| 0.8841 \| 0.8841 \| 0.8841 \| 69 \| 0.7255 \| 0.6379 \| 0.6789 \| 58 \| 0.9156 \| 0.9276 \| 0.9216 \| 152 \| 0.8387 \| 0.8667 \| 0.8525 \| 30 \| 0.8621 \| 0.8621 \| 0.8621 \| 29 \| 0.8683 \| 0.8580 \| 0.8631 \| 0.9639 \|
	\| 0.0027 \| 48.0 \| 5088 \| 0.3205 \| 0.7529 \| 0.9275 \| 0.8312 \| 69 \| 0.6806 \| 0.8448 \| 0.7538 \| 58 \| 0.8797 \| 0.9145 \| 0.8968 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8 \| 0.8994 \| 0.8468 \| 0.9606 \|
	\| 0.0014 \| 49.0 \| 5194 \| 0.2800 \| 0.8125 \| 0.9420 \| 0.8725 \| 69 \| 0.6970 \| 0.7931 \| 0.7419 \| 58 \| 0.8931 \| 0.9342 \| 0.9132 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8288 \| 0.9024 \| 0.8640 \| 0.9657 \|
	\| 0.0005 \| 50.0 \| 5300 \| 0.3062 \| 0.8 \| 0.9275 \| 0.8591 \| 69 \| 0.6761 \| 0.8276 \| 0.7442 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8177 \| 0.9024 \| 0.8579 \| 0.9634 \|
	\| 0.0009 \| 51.0 \| 5406 \| 0.3094 \| 0.7922 \| 0.8841 \| 0.8356 \| 69 \| 0.6716 \| 0.7759 \| 0.7200 \| 58 \| 0.875 \| 0.9211 \| 0.8974 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8076 \| 0.8817 \| 0.8430 \| 0.9616 \|
	\| 0.0007 \| 52.0 \| 5512 \| 0.2927 \| 0.8052 \| 0.8986 \| 0.8493 \| 69 \| 0.7049 \| 0.7414 \| 0.7227 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8278 \| 0.8817 \| 0.8539 \| 0.9652 \|
	\| 0.0005 \| 53.0 \| 5618 \| 0.3106 \| 0.8026 \| 0.8841 \| 0.8414 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8812 \| 0.9276 \| 0.9038 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8227 \| 0.8787 \| 0.8498 \| 0.9639 \|
	\| 0.0006 \| 54.0 \| 5724 \| 0.3165 \| 0.8133 \| 0.8841 \| 0.8472 \| 69 \| 0.7241 \| 0.7241 \| 0.7241 \| 58 \| 0.8875 \| 0.9342 \| 0.9103 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8319 \| 0.8787 \| 0.8547 \| 0.9649 \|
	\| 0.0008 \| 55.0 \| 5830 \| 0.2877 \| 0.8857 \| 0.8986 \| 0.8921 \| 69 \| 0.7551 \| 0.6379 \| 0.6916 \| 58 \| 0.8917 \| 0.9211 \| 0.9061 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.8667 \| 0.8966 \| 0.8814 \| 29 \| 0.8580 \| 0.8580 \| 0.8580 \| 0.9677 \|
	\| 0.0013 \| 56.0 \| 5936 \| 0.2934 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.7018 \| 0.6897 \| 0.6957 \| 58 \| 0.8981 \| 0.9276 \| 0.9126 \| 152 \| 0.8387 \| 0.8667 \| 0.8525 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8418 \| 0.8817 \| 0.8613 \| 0.9647 \|
	\| 0.0003 \| 57.0 \| 6042 \| 0.3164 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.7018 \| 0.6897 \| 0.6957 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8324 \| 0.8817 \| 0.8563 \| 0.9639 \|
	\| 0.0004 \| 58.0 \| 6148 \| 0.3298 \| 0.8333 \| 0.9420 \| 0.8844 \| 69 \| 0.6825 \| 0.7414 \| 0.7107 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8269 \| 0.8905 \| 0.8575 \| 0.9629 \|
	\| 0.0006 \| 59.0 \| 6254 \| 0.3475 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.6545 \| 0.6207 \| 0.6372 \| 58 \| 0.8931 \| 0.9342 \| 0.9132 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8310 \| 0.8728 \| 0.8514 \| 0.9618 \|
	\| 0.0009 \| 60.0 \| 6360 \| 0.3446 \| 0.8228 \| 0.9420 \| 0.8784 \| 69 \| 0.7541 \| 0.7931 \| 0.7731 \| 58 \| 0.8924 \| 0.9276 \| 0.9097 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8375 \| 0.8994 \| 0.8673 \| 0.9647 \|
	\| 0.0005 \| 61.0 \| 6466 \| 0.3662 \| 0.8025 \| 0.9420 \| 0.8667 \| 69 \| 0.6716 \| 0.7759 \| 0.7200 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8140 \| 0.8935 \| 0.8519 \| 0.9611 \|
	\| 0.002 \| 62.0 \| 6572 \| 0.3188 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.7031 \| 0.7759 \| 0.7377 \| 58 \| 0.8868 \| 0.9276 \| 0.9068 \| 152 \| 0.7576 \| 0.8333 \| 0.7937 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8320 \| 0.8935 \| 0.8616 \| 0.9665 \|
	\| 0.0005 \| 63.0 \| 6678 \| 0.3222 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.7302 \| 0.7931 \| 0.7603 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8065 \| 0.8333 \| 0.8197 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8408 \| 0.8905 \| 0.8649 \| 0.9670 \|
	\| 0.0003 \| 64.0 \| 6784 \| 0.3288 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.7231 \| 0.8103 \| 0.7642 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8297 \| 0.8935 \| 0.8604 \| 0.9662 \|
	\| 0.0003 \| 65.0 \| 6890 \| 0.3331 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.7344 \| 0.8103 \| 0.7705 \| 58 \| 0.8659 \| 0.9342 \| 0.8987 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8266 \| 0.9024 \| 0.8628 \| 0.9662 \|
	\| 0.0003 \| 66.0 \| 6996 \| 0.3162 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.6981 \| 0.6379 \| 0.6667 \| 58 \| 0.8974 \| 0.9211 \| 0.9091 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.8387 \| 0.8966 \| 0.8667 \| 29 \| 0.8415 \| 0.8639 \| 0.8526 \| 0.9662 \|
	\| 0.0024 \| 67.0 \| 7102 \| 0.3060 \| 0.8182 \| 0.9130 \| 0.8630 \| 69 \| 0.7143 \| 0.7759 \| 0.7438 \| 58 \| 0.9085 \| 0.9145 \| 0.9115 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8347 \| 0.8817 \| 0.8576 \| 0.9672 \|
	\| 0.002 \| 68.0 \| 7208 \| 0.3085 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.74 \| 0.6379 \| 0.6852 \| 58 \| 0.9038 \| 0.9276 \| 0.9156 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7879 \| 0.8966 \| 0.8387 \| 29 \| 0.8477 \| 0.8728 \| 0.8601 \| 0.9652 \|
	\| 0.0014 \| 69.0 \| 7314 \| 0.3034 \| 0.8442 \| 0.9420 \| 0.8904 \| 69 \| 0.6522 \| 0.7759 \| 0.7087 \| 58 \| 0.8642 \| 0.9211 \| 0.8917 \| 152 \| 0.8485 \| 0.9333 \| 0.8889 \| 30 \| 0.8125 \| 0.8966 \| 0.8525 \| 29 \| 0.8150 \| 0.8994 \| 0.8551 \| 0.9649 \|
	\| 0.0006 \| 70.0 \| 7420 \| 0.3125 \| 0.8421 \| 0.9275 \| 0.8828 \| 69 \| 0.6667 \| 0.7931 \| 0.7244 \| 58 \| 0.8589 \| 0.9211 \| 0.8889 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7576 \| 0.8621 \| 0.8065 \| 29 \| 0.8070 \| 0.8905 \| 0.8467 \| 0.9647 \|
	\| 0.0009 \| 71.0 \| 7526 \| 0.3197 \| 0.84 \| 0.9130 \| 0.8750 \| 69 \| 0.6765 \| 0.7931 \| 0.7302 \| 58 \| 0.8650 \| 0.9276 \| 0.8952 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.7419 \| 0.7931 \| 0.7667 \| 29 \| 0.8059 \| 0.8846 \| 0.8434 \| 0.9639 \|
	\| 0.0009 \| 72.0 \| 7632 \| 0.3207 \| 0.8421 \| 0.9275 \| 0.8828 \| 69 \| 0.6923 \| 0.7759 \| 0.7317 \| 58 \| 0.8820 \| 0.9342 \| 0.9073 \| 152 \| 0.7647 \| 0.8667 \| 0.8125 \| 30 \| 0.75 \| 0.8276 \| 0.7869 \| 29 \| 0.8179 \| 0.8905 \| 0.8527 \| 0.9647 \|
	\| 0.0006 \| 73.0 \| 7738 \| 0.3206 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.6719 \| 0.7414 \| 0.7049 \| 58 \| 0.8917 \| 0.9211 \| 0.9061 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8209 \| 0.8817 \| 0.8502 \| 0.9647 \|
	\| 0.0004 \| 74.0 \| 7844 \| 0.3209 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.6875 \| 0.7586 \| 0.7213 \| 58 \| 0.8903 \| 0.9079 \| 0.8990 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8227 \| 0.8787 \| 0.8498 \| 0.9641 \|
	\| 0.0003 \| 75.0 \| 7950 \| 0.3219 \| 0.875 \| 0.9130 \| 0.8936 \| 69 \| 0.6615 \| 0.7414 \| 0.6992 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8245 \| 0.8757 \| 0.8494 \| 0.9636 \|
	\| 0.0003 \| 76.0 \| 8056 \| 0.3356 \| 0.8312 \| 0.9275 \| 0.8767 \| 69 \| 0.6575 \| 0.8276 \| 0.7328 \| 58 \| 0.8812 \| 0.9276 \| 0.9038 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8107 \| 0.8994 \| 0.8527 \| 0.9631 \|
	\| 0.0002 \| 77.0 \| 8162 \| 0.3265 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8301 \| 0.8817 \| 0.8551 \| 0.9657 \|
	\| 0.0002 \| 78.0 \| 8268 \| 0.3292 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6875 \| 0.7586 \| 0.7213 \| 58 \| 0.8805 \| 0.9211 \| 0.9003 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8237 \| 0.8846 \| 0.8531 \| 0.9649 \|
	\| 0.0003 \| 79.0 \| 8374 \| 0.3334 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6769 \| 0.7586 \| 0.7154 \| 58 \| 0.8688 \| 0.9145 \| 0.8910 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8187 \| 0.8817 \| 0.8490 \| 0.9647 \|
	\| 0.0006 \| 80.0 \| 8480 \| 0.3393 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6721 \| 0.7069 \| 0.6891 \| 58 \| 0.8968 \| 0.9145 \| 0.9055 \| 152 \| 0.8438 \| 0.9 \| 0.8710 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8362 \| 0.8757 \| 0.8555 \| 0.9647 \|
	\| 0.0002 \| 81.0 \| 8586 \| 0.3537 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6875 \| 0.7586 \| 0.7213 \| 58 \| 0.8903 \| 0.9079 \| 0.8990 \| 152 \| 0.7879 \| 0.8667 \| 0.8254 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8273 \| 0.8787 \| 0.8522 \| 0.9644 \|
	\| 0.0003 \| 82.0 \| 8692 \| 0.3606 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7321 \| 0.7069 \| 0.7193 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8348 \| 0.8669 \| 0.8505 \| 0.9639 \|
	\| 0.0006 \| 83.0 \| 8798 \| 0.3577 \| 0.8784 \| 0.9420 \| 0.9091 \| 69 \| 0.6923 \| 0.6207 \| 0.6545 \| 58 \| 0.8968 \| 0.9145 \| 0.9055 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8406 \| 0.8580 \| 0.8492 \| 0.9641 \|
	\| 0.001 \| 84.0 \| 8904 \| 0.3674 \| 0.8667 \| 0.9420 \| 0.9028 \| 69 \| 0.6727 \| 0.6379 \| 0.6549 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.7812 \| 0.8333 \| 0.8065 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8286 \| 0.8580 \| 0.8430 \| 0.9618 \|
	\| 0.0006 \| 85.0 \| 9010 \| 0.3639 \| 0.8784 \| 0.9420 \| 0.9091 \| 69 \| 0.6909 \| 0.6552 \| 0.6726 \| 58 \| 0.8790 \| 0.9079 \| 0.8932 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8343 \| 0.8639 \| 0.8488 \| 0.9616 \|
	\| 0.0004 \| 86.0 \| 9116 \| 0.3683 \| 0.875 \| 0.9130 \| 0.8936 \| 69 \| 0.74 \| 0.6379 \| 0.6852 \| 58 \| 0.8854 \| 0.9145 \| 0.8997 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8455 \| 0.8580 \| 0.8517 \| 0.9634 \|
	\| 0.0005 \| 87.0 \| 9222 \| 0.3531 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7170 \| 0.6552 \| 0.6847 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8362 \| 0.8609 \| 0.8484 \| 0.9626 \|
	\| 0.0002 \| 88.0 \| 9328 \| 0.3533 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.7308 \| 0.6552 \| 0.6909 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8410 \| 0.8609 \| 0.8509 \| 0.9634 \|
	\| 0.0002 \| 89.0 \| 9434 \| 0.3525 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.7321 \| 0.7069 \| 0.7193 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8371 \| 0.8669 \| 0.8517 \| 0.9636 \|
	\| 0.0002 \| 90.0 \| 9540 \| 0.3583 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7241 \| 0.7241 \| 0.7241 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8385 \| 0.8757 \| 0.8567 \| 0.9634 \|
	\| 0.0002 \| 91.0 \| 9646 \| 0.3626 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.7288 \| 0.7414 \| 0.7350 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8366 \| 0.8787 \| 0.8571 \| 0.9631 \|
	\| 0.0005 \| 92.0 \| 9752 \| 0.3608 \| 0.8514 \| 0.9130 \| 0.8811 \| 69 \| 0.7368 \| 0.7241 \| 0.7304 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8376 \| 0.8698 \| 0.8534 \| 0.9634 \|
	\| 0.0002 \| 93.0 \| 9858 \| 0.3571 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7167 \| 0.7414 \| 0.7288 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8366 \| 0.8787 \| 0.8571 \| 0.9634 \|
	\| 0.0002 \| 94.0 \| 9964 \| 0.3574 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.7167 \| 0.7414 \| 0.7288 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8366 \| 0.8787 \| 0.8571 \| 0.9634 \|
	\| 0.0004 \| 95.0 \| 10070 \| 0.3578 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8343 \| 0.8787 \| 0.8559 \| 0.9641 \|
	\| 0.0003 \| 96.0 \| 10176 \| 0.3588 \| 0.8649 \| 0.9275 \| 0.8951 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8846 \| 0.9079 \| 0.8961 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8315 \| 0.8757 \| 0.8530 \| 0.9639 \|
	\| 0.0004 \| 97.0 \| 10282 \| 0.3566 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8319 \| 0.8787 \| 0.8547 \| 0.9639 \|
	\| 0.0003 \| 98.0 \| 10388 \| 0.3576 \| 0.8533 \| 0.9275 \| 0.8889 \| 69 \| 0.6825 \| 0.7414 \| 0.7107 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8296 \| 0.8787 \| 0.8534 \| 0.9636 \|
	\| 0.0004 \| 99.0 \| 10494 \| 0.3574 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8324 \| 0.8817 \| 0.8563 \| 0.9639 \|
	\| 0.0002 \| 100.0 \| 10600 \| 0.3575 \| 0.8553 \| 0.9420 \| 0.8966 \| 69 \| 0.6935 \| 0.7414 \| 0.7167 \| 58 \| 0.8910 \| 0.9145 \| 0.9026 \| 152 \| 0.8125 \| 0.8667 \| 0.8387 \| 30 \| 0.7812 \| 0.8621 \| 0.8197 \| 29 \| 0.8324 \| 0.8817 \| 0.8563 \| 0.9639 \|


	### Framework versions

	- Transformers 4.39.3
	- Pytorch 2.3.0+cu121
	- Datasets 2.19.1
	- Tokenizers 0.15.2