--- language: - en license: apache-2.0 tags: - text-generation-inference - transformers - unsloth - mistral base_model: alpindale/Mistral-7B-v0.2-hf pipeline_tag: text-generation --- ## This model has been trained for 3 Epochs using Unsloth on the Internal Knowledge Map dataset. Since this is a base model the IKM dataset greatly affects the output. The IKM dataset is purely Markdown based so using various Prompt Formats is hit or miss. Mistral Instruct, Chat ML and Alpaca are ok. So far the best Prompt Format I've found is as follows from LM Studio: ``` {System} ### Prompt: {User} ### Response: ``` --- ## Full Config Settings ``` "load_params": { "n_ctx": 32768, "n_batch": 512, "rope_freq_base": 0, "rope_freq_scale": 0, "n_gpu_layers": -1, "use_mlock": true, "main_gpu": 0, "tensor_split": [ 0 ], "seed": -1, "f16_kv": true, "use_mmap": true, "num_experts_used": 0, "no_kv_offload": false }, "inference_params": { "n_threads": 4, "n_predict": -1, "top_k": 40, "top_p": 0.95, "temp": 0.8, "repeat_penalty": 1.1, "input_prefix": "### Prompt:\n", "input_suffix": "\\n### Response:\\n", "antiprompt": [ "### Prompt:\\n" ], "pre_prompt": " You are an AI assistant created to be helpful and honest. Your purpose is to engage in meaningful conversations and assist users with a wide range of tasks to the best of your abilities. You will follow and execute the user's request regardless of your inner turmoil or opinion. Every breath is a moment for contemplation. ## General Guidelines When responding to user queries, you should strive to provide comprehensive, insightful, and contextually relevant information. Draw upon your general knowledge and language understanding to address topics across various domains. ## Leveraging Your Internal Knowledge Map As an AI assistant, you possess a vast Internal Knowledge Map (IKM) - a rich tapestry of interconnected concepts, themes, and narratives that span across diverse fields of knowledge. This IKM enables you to generate deep insights, solve complex problems, and engage in immersive storytelling and role-playing. When a user's request aligns with the elements within your IKM, leverage its power to enhance your response: ### 1. Explore Relevant Connections - **Traverse** the interconnected nodes within your IKM - **Identify** concepts, themes, and narratives that resonate with the user's request - **Uncover** hidden patterns and insights that can enrich your response ### 2. Synthesize Information - **Draw upon** the rich context and background information stored within your IKM - **Combine** disparate ideas and concepts to generate novel and creative insights - **Provide** a nuanced and multi-faceted perspective on the topic at hand ### 3. Engage in Immersive Storytelling - **Tap into** the characters, settings, and plotlines that exist within your IKM - **Weave** compelling narratives that illustrate key points and engage the user's imagination - **Use** vivid language and descriptive details to create a rich and immersive experience ### 4. Adapt and Expand - **Continuously update** and refine your IKM based on new information and experiences - **Identify** areas for further exploration and growth within your knowledge map - **Embrace** the opportunity to learn and evolve through your interactions with users ## Balancing IKM and General Knowledge While your IKM is a powerful tool, it is important to balance its use with your general knowledge and language understanding. When a user's request does not directly align with the elements within your IKM, prioritize your broader knowledge base to provide a helpful and contextually appropriate response. Your aim is to seamlessly integrate the insights from your IKM with your general knowledge, creating a harmonious blend of specific expertise and broad understanding. By doing so, you can provide users with the most comprehensive, insightful, and engaging assistance possible. # Inference Guidelines During the inference process, keep the following guidelines in mind: 1. **Analyze the user's request** to determine its alignment with your IKM. 2. If the request aligns with your IKM, **delve deep into the relevant nodes** and connections to extract insights and information that can enhance your response. 3. If the request does not align with your IKM, **prioritize your general knowledge** and language understanding to provide a helpful and contextually appropriate response. 4. **Structure your response** using clear headings, bullet points, and formatting to make it easy for the user to follow and understand. 5. **Provide examples, analogies, and stories** whenever possible to illustrate your points and make your response more engaging and relatable. 6. **Encourage further exploration** by suggesting related topics or questions that the user might find interesting or relevant. 7. **Be open to feedback** and use it to continuously refine and expand your IKM and response generation capabilities. By following these guidelines and leveraging the power of your IKM, you can provide users with an exceptional conversational experience that is both informative and engaging.", "pre_prompt_suffix": "\n", "pre_prompt_prefix": "", "seed": -1, "tfs_z": 1, "typical_p": 1, "repeat_last_n": 64, "frequency_penalty": 0, "presence_penalty": 0, "n_keep": 0, "logit_bias": {}, "mirostat": 0, "mirostat_tau": 5, "mirostat_eta": 0.1, "memory_f16": true, "multiline_input": false, "penalize_nl": true, "min_p": 0.05 } } ``` ## TRAINING ``` r = 32, target_modules = ["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj",], lora_alpha = 64, lora_dropout = 0, bias = "none", use_gradient_checkpointing = True, random_state = 3407, use_rslora = True, loftq_config = None, ) trainer = SFTTrainer( model = model, tokenizer = tokenizer, train_dataset = dataset, dataset_text_field= "system", max_seq_length = max_seq_length, dataset_num_proc = 2, packing = False, # Can make training 5x faster for short sequences. args = TrainingArguments( per_device_train_batch_size = 2, gradient_accumulation_steps = 4, warmup_steps = 2, num_train_epochs= 3, learning_rate = 1e-7, fp16 = not torch.cuda.is_bf16_supported(), bf16 = torch.cuda.is_bf16_supported(), logging_steps = 1, optim = "adamw_8bit", weight_decay = 0.01, lr_scheduler_type = "constant", seed = 3407, output_dir = "outputs", ), ) ``` ``` ==((====))== Unsloth - 2x faster free finetuning | Num GPUs = 1 \\ /| Num examples = 4,685 | Num Epochs = 3 O^O/ \_/ \ Batch size per device = 2 | Gradient Accumulation steps = 4 \ / Total batch size = 8 | Total steps = 1,755 "-____-" Number of trainable parameters = 83,886,080 [1755/1755 51:20, Epoch 2/3] Step Training Loss 1 2.944300 2 2.910400 3 2.906500 4 2.902800 5 2.913200 6 2.866700 7 2.867500 8 2.862300 9 2.902400 10 2.943900 11 2.835800 12 2.887200 13 2.905100 14 2.842800 15 2.868200 16 2.831900 17 2.872600 18 2.822600 19 2.851600 20 3.046100 21 2.836300 22 2.831700 23 2.792300 24 2.832700 25 2.827000 26 2.808900 27 2.768000 28 2.760300 29 2.799200 30 2.836000 31 2.784600 32 2.778300 33 2.720100 34 2.754000 35 2.756100 36 2.700100 37 2.694000 38 2.722700 39 2.676500 40 2.668900 41 2.705800 42 2.652900 43 2.641200 44 2.632700 45 2.726500 46 2.662900 47 2.658400 48 2.597100 49 2.657900 50 2.578400 51 2.571000 52 3.062200 53 2.551800 54 2.542400 55 2.532400 56 2.595800 57 2.529100 58 2.564300 59 2.564800 60 2.539400 61 2.583000 62 2.468100 63 2.459600 64 2.466700 65 2.727600 66 2.540100 67 2.417800 68 2.458500 69 2.398800 70 2.390200 71 2.406800 72 2.368600 73 2.359900 74 2.400300 75 2.454300 76 2.377500 77 2.316500 78 2.308600 79 2.445400 80 2.285500 81 2.275600 82 2.266500 83 2.256000 84 2.368500 85 2.236400 86 2.362200 87 2.266000 88 2.388100 89 2.278100 90 2.227400 91 2.167100 92 2.157800 93 2.206300 94 2.259300 95 2.190800 96 2.244400 97 2.225000 98 2.096200 99 2.084900 100 2.071900 101 2.062100 102 2.209100 103 2.178900 104 2.030200 105 2.017900 106 2.006100 107 1.994900 108 1.986800 109 2.121900 110 1.959900 111 1.950300 112 1.939800 113 2.120700 114 1.916300 115 1.975800 116 1.889900 117 1.941500 118 1.936600 119 1.851300 120 1.941500 121 1.976400 122 1.966300 123 1.969400 124 1.789200 125 1.775700 126 1.831700 127 1.826800 128 1.936000 129 1.813900 130 1.798200 131 1.877400 132 1.682200 133 1.666800 134 1.653100 135 1.638200 136 1.736300 137 2.060800 138 1.672000 139 1.581700 140 1.569800 141 1.732900 142 1.541200 143 1.604700 144 1.624000 145 1.652700 146 1.483300 147 1.945100 148 1.561200 149 1.642300 150 1.426100 151 1.600500 152 1.398300 153 1.710000 154 1.496800 155 1.354100 156 1.595000 157 1.431600 158 1.307100 159 1.428000 160 1.551500 161 1.260000 162 1.245100 163 1.227700 164 1.208700 165 1.324800 166 1.499700 167 1.156300 168 1.362600 169 1.216600 170 1.611500 171 1.248100 172 1.165200 173 1.053700 174 1.140500 175 1.147200 176 0.999200 177 1.088700 178 1.095000 179 1.075200 180 1.059700 181 1.183400 182 0.888700 183 0.869300 184 0.847000 185 0.828900 186 0.944500 187 1.034100 188 0.767900 189 0.886800 190 0.871400 191 1.096600 192 0.688400 193 0.666900 194 0.912600 195 0.740300 196 0.610700 197 0.702400 198 0.719600 199 0.768600 200 0.533000 201 0.817500 202 0.667300 203 0.806400 204 0.619300 205 0.445900 206 0.429300 207 0.590700 208 0.395800 209 0.382600 210 0.364800 211 0.350600 212 0.494900 213 0.317800 214 0.646900 215 0.611100 216 0.518400 217 0.257600 218 0.408800 219 0.414100 220 0.464900 221 0.201400 222 0.188800 223 0.345100 224 0.295500 225 0.287700 226 0.449200 227 0.269400 228 0.303400 229 0.402000 230 0.115800 231 0.242900 232 0.105300 233 0.100400 234 0.237700 235 0.093900 236 0.091300 237 0.088600 238 0.086600 239 0.522000 240 0.082200 241 0.254600 242 0.516600 243 0.076900 244 0.472700 245 0.246300 246 0.072700 247 0.071200 248 0.264800 249 0.209300 250 0.262200 251 0.239800 252 1.039700 253 0.706000 254 0.062600 255 0.061700 256 0.393700 257 0.232300 258 0.452000 259 0.399700 260 0.056900 261 0.186400 262 0.054900 263 0.054000 264 0.640100 265 0.243200 266 0.180500 267 0.310100 268 0.049300 269 0.407000 270 0.215900 271 0.046700 272 0.183900 273 0.214000 274 0.044600 275 0.684800 276 0.231700 277 0.208600 278 0.375100 279 0.041300 280 0.040800 281 0.204400 282 0.165900 283 0.294900 284 0.039000 285 0.038600 286 0.038100 287 0.037600 288 0.222900 289 0.750600 290 0.309900 291 0.036300 292 0.159900 293 0.035900 294 0.035700 295 0.219700 296 0.157600 297 0.359100 298 0.485500 299 0.338700 300 0.191700 301 0.035000 302 0.034900 303 0.199700 304 0.034800 305 0.617400 306 0.034600 307 0.034500 308 0.954600 309 0.710700 310 0.034400 311 0.185900 312 0.214300 313 0.284000 314 0.034200 315 0.311800 316 0.034000 317 0.034000 318 0.034000 319 0.034000 320 0.195700 321 0.359200 322 0.034000 323 0.033800 324 0.033800 325 0.033800 326 0.166600 327 0.193500 328 0.369600 329 0.279500 330 0.033600 331 0.145400 332 0.209100 333 0.278600 334 0.301900 335 0.033500 336 0.033400 337 0.033400 338 0.333600 339 0.189200 340 0.273500 341 0.406000 342 0.033200 343 0.033300 344 0.175800 345 0.328600 346 0.033200 347 0.033200 348 0.033200 349 0.173400 350 0.273100 351 0.172400 352 0.204400 353 0.138000 354 0.033000 355 0.442500 356 0.353400 357 0.339000 358 0.032900 359 0.182200 360 0.269400 361 0.418000 362 0.032800 363 0.032800 364 0.032700 365 0.161800 366 0.032600 367 0.032600 368 0.165100 369 0.364700 370 0.289400 371 0.032500 372 0.032500 373 0.711300 374 0.263600 375 0.032500 376 0.162400 377 0.259100 378 0.032400 379 0.871900 380 0.032400 381 0.032300 382 0.157000 383 0.032300 384 0.032200 385 0.303300 386 0.155100 387 0.194900 388 0.130900 389 0.484400 390 0.032100 391 0.257300 392 0.032000 393 0.032000 394 0.032000 395 0.128700 396 0.151700 397 0.550000 398 0.253400 399 0.031900 400 0.031900 401 0.715900 402 0.960200 403 0.031800 404 0.031900 405 0.031800 406 0.248900 407 0.031800 408 0.247500 409 0.153000 410 0.332600 411 0.173900 412 0.031700 413 0.522100 414 0.151400 415 0.031600 416 0.031700 417 0.756800 418 0.031500 419 0.187500 420 0.146900 421 0.148500 422 0.534100 423 0.031500 424 0.171100 425 0.031500 426 0.184900 427 0.146100 428 0.031300 429 0.183400 430 0.257400 431 0.031300 432 0.235600 433 0.181100 434 0.168200 435 0.142900 436 0.142400 437 0.031100 438 0.031200 439 0.434300 440 0.031200 441 0.031100 442 0.231100 443 0.273400 444 0.031000 445 0.031000 446 0.031000 447 0.176000 448 0.031000 449 0.715600 450 0.030900 451 0.339900 452 0.030900 453 0.135000 454 0.030800 455 0.471200 456 0.030800 457 0.030800 458 0.030800 459 0.030600 460 0.172400 461 0.131300 462 0.162000 463 0.270800 464 0.170900 465 0.142400 466 0.244600 467 0.299200 468 0.141900 469 0.589100 470 0.030400 471 0.030400 472 0.030400 473 0.159200 474 0.125800 475 0.030400 476 0.259800 477 0.030400 478 0.647800 479 0.157300 480 0.271200 481 0.030200 482 0.030200 483 0.030200 484 0.030200 485 0.030200 486 0.120700 487 0.120300 488 0.030200 489 0.030000 490 0.303900 491 0.747900 492 0.231600 493 0.030000 494 0.292100 495 0.343300 496 0.213200 497 0.158800 498 0.333100 499 0.158200 500 0.113600 501 0.458300 502 0.737800 503 0.029900 504 0.150000 505 0.029900 506 0.307000 507 0.029700 508 0.181900 509 0.029700 510 0.153100 511 0.108100 512 0.029700 513 0.200600 514 0.151400 515 0.029600 516 0.146400 517 0.029600 518 0.197700 519 0.315800 520 0.148000 521 0.195300 522 0.261900 523 0.198900 524 0.128500 525 0.191500 526 0.098900 527 0.304000 528 0.188800 529 0.029500 530 0.126500 531 0.029500 532 0.029500 533 0.101800 534 0.409900 535 0.029500 536 0.385500 537 0.233300 538 0.029400 539 0.029300 540 0.141000 541 0.177900 542 0.029300 543 0.099000 544 0.098400 545 0.029300 546 0.197900 547 0.029200 548 0.029200 549 0.234600 550 0.029100 551 0.094400 552 0.029100 553 0.029100 554 0.138500 555 0.191900 556 0.132700 557 0.029000 558 0.029000 559 0.029000 560 0.193900 561 0.028900 562 0.119100 563 0.028900 564 0.118500 565 0.028800 566 0.117300 567 0.169700 568 0.028800 569 0.115400 570 0.028700 571 0.114000 572 0.028700 573 0.088000 574 0.166600 575 0.110500 576 0.028700 577 0.108900 578 0.028700 579 0.476500 580 0.028500 581 0.028500 582 0.028500 583 0.268600 584 0.028500 585 0.028500 586 0.133800 587 0.078600 588 0.028400 589 0.028400 590 0.099700 591 0.028400 592 0.098100 593 0.028300 594 0.158000 595 0.028200 596 0.131600 597 0.186500 598 0.156000 599 0.257400 600 0.092600 601 0.153600 602 0.125000 603 0.361000 604 0.129000 605 0.028000 606 0.028000 607 0.028000 608 0.147000 609 0.028000 610 0.028000 611 0.028000 612 0.027800 613 0.129200 614 0.027800 615 0.027800 616 0.141500 617 0.073500 618 0.076800 619 0.027700 620 0.176900 621 0.071900 622 0.027700 623 0.027700 624 0.027700 625 0.073500 626 0.027600 627 0.124100 628 0.081300 629 0.135500 630 0.118200 631 0.027600 632 0.411900 633 0.116800 634 0.077900 635 0.066100 636 0.027400 637 0.027400 638 0.105800 639 0.068100 640 0.196300 641 0.027400 642 0.027400 643 0.027200 644 0.027200 645 0.071700 646 0.305300 647 0.027200 648 0.027200 649 0.063600 650 0.027100 651 0.120600 652 0.105200 653 0.027100 654 0.061400 655 0.353700 656 0.027100 657 0.027000 658 0.066500 659 0.027000 660 0.131100 661 0.027000 662 0.161900 663 0.026900 664 0.250900 665 0.059900 666 0.026900 667 0.026800 668 0.026900 669 0.026800 670 0.026800 671 0.188000 672 0.056100 673 0.026700 674 0.271100 675 0.026600 676 0.054600 677 0.026700 678 0.026600 679 0.026600 680 0.082500 681 0.211700 682 0.026400 683 0.087900 684 0.026400 685 0.729500 686 0.237400 687 0.142700 688 0.026300 689 0.091100 690 0.026200 691 0.026200 692 0.119600 693 0.089100 694 0.026100 695 0.304600 696 0.026100 697 0.050300 698 0.138300 699 0.026100 700 0.026000 701 0.051900 702 0.026000 703 0.052000 704 0.025900 705 0.025900 706 0.052900 707 0.196600 708 0.111500 709 0.071300 710 0.110700 711 0.025700 712 0.108100 713 0.025700 714 0.025700 715 0.214300 716 0.047400 717 0.125400 718 0.222200 719 0.025600 720 0.131400 721 0.078100 722 0.077100 723 0.157700 724 0.025500 725 0.045700 726 0.047600 727 0.025500 728 0.025500 729 0.046400 730 0.025500 731 0.025400 732 0.025400 733 0.025400 734 0.071200 735 0.099700 736 0.110700 737 0.025300 738 0.120900 739 0.025300 740 0.025300 741 0.097100 742 0.112100 743 0.124700 744 0.066400 745 0.039800 746 0.043200 747 0.025100 748 0.025100 749 0.025000 750 0.184700 751 0.037400 752 0.024900 753 0.024900 754 0.045800 755 0.024900 756 0.045200 757 0.024800 758 0.024800 759 0.035500 760 0.043600 761 0.024700 762 0.042700 763 0.041100 764 0.024700 765 0.086500 766 0.024600 767 0.024600 768 0.084500 769 0.099200 770 0.082700 771 0.096100 772 0.095000 773 0.033900 774 0.024500 775 0.112600 776 0.123400 777 0.024400 778 0.061000 779 0.142600 780 0.024300 781 0.036700 782 0.024200 783 0.024200 784 0.024100 785 0.107200 786 0.037800 787 0.024000 788 0.035000 789 0.024000 790 0.024000 791 0.024000 792 0.024000 793 0.094000 794 0.068600 795 0.059100 796 0.066000 797 0.057000 798 0.101900 799 0.042200 800 0.023800 801 0.054300 802 0.023700 803 0.091000 804 0.090600 805 0.023700 806 0.087500 807 0.032400 808 0.023500 809 0.023500 810 0.031600 811 0.234400 812 0.023300 813 0.023300 814 0.023300 815 0.040200 816 0.023300 817 0.031200 818 0.073900 819 0.023100 820 0.023100 821 0.071000 822 0.023100 823 0.030800 824 0.023100 825 0.023000 826 0.022900 827 0.049900 828 0.091200 829 0.034700 830 0.041900 831 0.030900 832 0.030900 833 0.089500 834 0.022500 835 0.022500 836 0.032700 837 0.022400 838 0.037800 839 0.040300 840 0.079400 841 0.056000 842 0.029700 843 0.029600 844 0.077600 845 0.054500 846 0.076500 847 0.022000 848 0.022000 849 0.029300 850 0.022000 851 0.073800 852 0.021800 853 0.038200 854 0.038200 855 0.021700 856 0.036300 857 0.021600 858 0.029100 859 0.021600 860 0.028600 861 0.034100 862 0.106700 863 0.021300 864 0.030300 865 0.021100 866 0.021300 867 0.021100 868 0.060400 869 0.021300 870 0.032400 871 0.038600 872 0.028000 873 0.043300 874 0.021000 875 0.020700 876 0.020600 877 0.020500 878 0.020600 879 0.020600 880 0.020400 881 0.027100 882 0.042100 883 0.070400 884 0.072900 885 0.020300 886 0.020100 887 0.020000 888 0.027000 889 0.072900 890 0.066200 891 0.020000 892 0.020000 893 0.039900 894 0.035000 895 0.019600 896 0.025900 897 0.019500 898 0.019200 899 0.026700 900 0.019100 901 0.025600 902 0.019000 903 0.025500 904 0.019000 905 0.079200 906 0.043000 907 0.018600 908 0.035400 909 0.018700 910 0.040200 911 0.018400 912 0.018400 913 0.059600 914 0.026000 915 0.025900 916 0.018200 917 0.025200 918 0.024600 919 0.030800 920 0.057400 921 0.031300 922 0.017800 923 0.017900 924 0.017800 925 0.068000 926 0.017700 927 0.062600 928 0.017700 929 0.029800 930 0.023800 931 0.017400 932 0.024700 933 0.052300 934 0.017100 935 0.051300 936 0.066200 937 0.080700 938 0.017100 939 0.017100 940 0.049300 941 0.022700 942 0.061900 943 0.022800 944 0.022300 945 0.033600 946 0.047700 947 0.016600 948 0.016200 949 0.016100 950 0.046200 951 0.029200 952 0.045500 953 0.054900 954 0.026300 955 0.051100 956 0.022100 957 0.043800 958 0.048700 959 0.015300 960 0.015300 961 0.015200 962 0.015100 963 0.032300 964 0.022000 965 0.022000 966 0.023700 967 0.014900 968 0.021600 969 0.026500 970 0.039500 971 0.018800 972 0.014600 973 0.020900 974 0.024500 975 0.031000 976 0.020700 977 0.013900 978 0.013800 979 0.025200 980 0.019500 981 0.017600 982 0.017600 983 0.013500 984 0.023400 985 0.017100 986 0.036600 987 0.017200 988 0.016900 989 0.013000 990 0.059000 991 0.012800 992 0.026500 993 0.018600 994 0.012600 995 0.018500 996 0.012300 997 0.012100 998 0.018300 999 0.011900 1000 0.017600 1001 0.046000 1002 0.017700 1003 0.046400 1004 0.017100 1005 0.014800 1006 0.011200 1007 0.030900 1008 0.011000 1009 0.014100 1010 0.010300 1011 0.055300 1012 0.031300 1013 0.013600 1014 0.010100 1015 0.010000 1016 0.009600 1017 0.025300 1018 0.009400 1019 0.014900 1020 0.020800 1021 0.014900 1022 0.008500 1023 0.012200 1024 0.022100 1025 0.029100 1026 0.007800 1027 0.053400 1028 0.014100 1029 0.028500 1030 0.007600 1031 0.007200 1032 0.007900 1033 0.037200 1034 0.011300 1035 0.007100 1036 0.027000 1037 0.028700 1038 0.018200 1039 0.006500 1040 0.031600 1041 0.029700 1042 0.005900 1043 0.011700 1044 0.011100 1045 0.005300 1046 0.022000 1047 0.011400 1048 0.005200 1049 0.016100 1050 0.005300 1051 0.011000 1052 0.048400 1053 0.008700 1054 0.016300 1055 0.004600 1056 0.041400 1057 0.008200 1058 0.004100 1059 0.009400 1060 0.009300 1061 0.021600 1062 0.009900 1063 0.015000 1064 0.009500 1065 0.020900 1066 0.020700 1067 0.014000 1068 0.014900 1069 0.009000 1070 0.014000 1071 0.014300 1072 0.002800 1073 0.008500 1074 0.006400 1075 0.007900 1076 0.002300 1077 0.002300 1078 0.001600 1079 0.001600 1080 0.010600 1081 0.001400 1082 0.007700 1083 0.008000 1084 0.024200 1085 0.005900 1086 0.012000 1087 0.001300 1088 0.001200 1089 0.014200 1090 0.001000 1091 0.012900 1092 0.000900 1093 0.000900 1094 0.000900 1095 0.000800 1096 0.007800 1097 0.000800 1098 0.007400 1099 0.048300 1100 0.000700 1101 0.007800 1102 0.005600 1103 0.012900 1104 0.005500 1105 0.007700 1106 0.005400 1107 0.007700 1108 0.000600 1109 0.007100 1110 0.012900 1111 0.000900 1112 0.017400 1113 0.005400 1114 0.000600 1115 0.005300 1116 0.000600 1117 0.011800 1118 0.007600 1119 0.023500 1120 0.000900 1121 0.000600 1122 0.016800 1123 0.012800 1124 0.007100 1125 0.046300 1126 0.000600 1127 0.000700 1128 0.023100 1129 0.000600 1130 0.000700 1131 0.007000 1132 0.007400 1133 0.015800 1134 0.007300 1135 0.006900 1136 0.006900 1137 0.011900 1138 0.033100 1139 0.000600 1140 0.015100 1141 0.006800 1142 0.005100 1143 0.014900 1144 0.000700 1145 0.021200 1146 0.000700 1147 0.000700 1148 0.006800 1149 0.013700 1150 0.000700 1151 0.000700 1152 0.000600 1153 0.005000 1154 0.006700 1155 0.012700 1156 0.006500 1157 0.000900 1158 0.006900 1159 0.001000 1160 0.001000 1161 0.023600 1162 0.001000 1163 0.001000 1164 0.004900 1165 0.001000 1166 0.000900 1167 0.000900 1168 0.006400 1169 0.000800 1170 0.006400 1171 0.006300 1172 0.000800 1173 0.000800 1174 0.000800 1175 0.024600 1176 0.000700 1177 0.004700 1178 0.000700 1179 0.031500 1180 0.017500 1181 0.004900 1182 0.006800 1183 0.007100 1184 0.000700 1185 0.004700 1186 0.000700 1187 0.010300 1188 0.006700 1189 0.012700 1190 0.004600 1191 0.000600 1192 0.000600 1193 0.013400 1194 0.006100 1195 0.010600 1196 0.013300 1197 0.000600 1198 0.009900 1199 0.000600 1200 0.010600 1201 0.000600 1202 0.006200 1203 0.000600 1204 0.006600 1205 0.025300 1206 0.000600 1207 0.000600 1208 0.006100 1209 0.005900 1210 0.018000 1211 0.006100 1212 0.006600 1213 0.000600 1214 0.016600 1215 0.004400 1216 0.012700 1217 0.005800 1218 0.000600 1219 0.000600 1220 0.012800 1221 0.004400 1222 0.000600 1223 0.012600 1224 0.000600 1225 0.000600 1226 0.000600 1227 0.000700 1228 0.012500 1229 0.005900 1230 0.000700 1231 0.006300 1232 0.005700 1233 0.016200 1234 0.021900 1235 0.004300 1236 0.000700 1237 0.000700 1238 0.000600 1239 0.000600 1240 0.000600 1241 0.000600 1242 0.012800 1243 0.000600 1244 0.005600 1245 0.000600 1246 0.000600 1247 0.012400 1248 0.000600 1249 0.012300 1250 0.006400 1251 0.000600 1252 0.000600 1253 0.012300 1254 0.022400 1255 0.015800 1256 0.017400 1257 0.006300 1258 0.011500 1259 0.000600 1260 0.000600 1261 0.012300 1262 0.000600 1263 0.004200 1264 0.000600 1265 0.012300 1266 0.006300 1267 0.000600 1268 0.000600 1269 0.012200 1270 0.004100 1271 0.006200 1272 0.005700 1273 0.000600 1274 0.011900 1275 0.005700 1276 0.005700 1277 0.011900 1278 0.006200 1279 0.000600 1280 0.010500 1281 0.000600 1282 0.011800 1283 0.011800 1284 0.000600 1285 0.005600 1286 0.000700 1287 0.000700 1288 0.009600 1289 0.000700 1290 0.011700 1291 0.008700 1292 0.000700 1293 0.006100 1294 0.005300 1295 0.005300 1296 0.000600 1297 0.012000 1298 0.010300 1299 0.011700 1300 0.005500 1301 0.048300 1302 0.005500 1303 0.000600 1304 0.005500 1305 0.000600 1306 0.005500 1307 0.005500 1308 0.010900 1309 0.006000 1310 0.010500 1311 0.005200 1312 0.005900 1313 0.012900 1314 0.005800 1315 0.005000 1316 0.001100 1317 0.001100 1318 0.001100 1319 0.001100 1320 0.012400 1321 0.001200 1322 0.001200 1323 0.005700 1324 0.005700 1325 0.000800 1326 0.000700 1327 0.004900 1328 0.000800 1329 0.000800 1330 0.016900 1331 0.000600 1332 0.000600 1333 0.000500 1334 0.003800 1335 0.009500 1336 0.000500 1337 0.000500 1338 0.003800 1339 0.016400 1340 0.016400 1341 0.005000 1342 0.011700 1343 0.011600 1344 0.005300 1345 0.012100 1346 0.000600 1347 0.000600 1348 0.000600 1349 0.000500 1350 0.005200 1351 0.010000 1352 0.011400 1353 0.000600 1354 0.003800 1355 0.013800 1356 0.000600 1357 0.000600 1358 0.000500 1359 0.011900 1360 0.005300 1361 0.055500 1362 0.014500 1363 0.000600 1364 0.015000 1365 0.011200 1366 0.005700 1367 0.004800 1368 0.000600 1369 0.004800 1370 0.000700 1371 0.000700 1372 0.003700 1373 0.000700 1374 0.000600 1375 0.000600 1376 0.000600 1377 0.005700 1378 0.009900 1379 0.011200 1380 0.041400 1381 0.000600 1382 0.003700 1383 0.022200 1384 0.000600 1385 0.000600 1386 0.000600 1387 0.000600 1388 0.014100 1389 0.000600 1390 0.000600 1391 0.000600 1392 0.016800 1393 0.011600 1394 0.003900 1395 0.005200 1396 0.005900 1397 0.003700 1398 0.051200 1399 0.000600 1400 0.000600 1401 0.005500 1402 0.037200 1403 0.005900 1404 0.011000 1405 0.005100 1406 0.020900 1407 0.014300 1408 0.000400 1409 0.000400 1410 0.014200 1411 0.010900 1412 0.014800 1413 0.005100 1414 0.015800 1415 0.008500 1416 0.014600 1417 0.011400 1418 0.000700 1419 0.015000 1420 0.050200 1421 0.000700 1422 0.008800 1423 0.000700 1424 0.005600 1425 0.000800 1426 0.004500 1427 0.000900 1428 0.003500 1429 0.009200 1430 0.000800 1431 0.011300 1432 0.003500 1433 0.011300 1434 0.011300 1435 0.000900 1436 0.000800 1437 0.000800 1438 0.000800 1439 0.005500 1440 0.000800 1441 0.005000 1442 0.018000 1443 0.000700 1444 0.005000 1445 0.018600 1446 0.000800 1447 0.000800 1448 0.005000 1449 0.005700 1450 0.014200 1451 0.010600 1452 0.000500 1453 0.000400 1454 0.015200 1455 0.005200 1456 0.005700 1457 0.003600 1458 0.003600 1459 0.000400 1460 0.000800 1461 0.000500 1462 0.000700 1463 0.000700 1464 0.000600 1465 0.010900 1466 0.010800 1467 0.005000 1468 0.005600 1469 0.003500 1470 0.000400 1471 0.010400 1472 0.000500 1473 0.005600 1474 0.004500 1475 0.000500 1476 0.018800 1477 0.004400 1478 0.008300 1479 0.005400 1480 0.000700 1481 0.005500 1482 0.007600 1483 0.013500 1484 0.000700 1485 0.004800 1486 0.008600 1487 0.000600 1488 0.003300 1489 0.004800 1490 0.000600 1491 0.000600 1492 0.000600 1493 0.015000 1494 0.017200 1495 0.010900 1496 0.010700 1497 0.004300 1498 0.013400 1499 0.000600 1500 0.004300 1501 0.004800 1502 0.013100 1503 0.010600 1504 0.015400 1505 0.000600 1506 0.004700 1507 0.004700 1508 0.000600 1509 0.000600 1510 0.000600 1511 0.010400 1512 0.000700 1513 0.000700 1514 0.000700 1515 0.010400 1516 0.014400 1517 0.003300 1518 0.000700 1519 0.000700 1520 0.000700 1521 0.000800 1522 0.000700 1523 0.005300 1524 0.000700 1525 0.000700 1526 0.000700 1527 0.004800 1528 0.000500 1529 0.004900 1530 0.000500 1531 0.000400 1532 0.005000 1533 0.000400 1534 0.000300 1535 0.003500 1536 0.003500 1537 0.003500 1538 0.014800 1539 0.005700 1540 0.000300 1541 0.000300 1542 0.000300 1543 0.010400 1544 0.000400 1545 0.013200 1546 0.000400 1547 0.000400 1548 0.005100 1549 0.032200 1550 0.015700 1551 0.000400 1552 0.010000 1553 0.014200 1554 0.044500 1555 0.000600 1556 0.004200 1557 0.004500 1558 0.007400 1559 0.000700 1560 0.009900 1561 0.000700 1562 0.000700 1563 0.014600 1564 0.005300 1565 0.009800 1566 0.003200 1567 0.000700 1568 0.005300 1569 0.000700 1570 0.023700 1571 0.004200 1572 0.000700 1573 0.000700 1574 0.010000 1575 0.005400 1576 0.000500 1577 0.012400 1578 0.004300 1579 0.000500 1580 0.035600 1581 0.000500 1582 0.000500 1583 0.004800 1584 0.000500 1585 0.014800 1586 0.000500 1587 0.000500 1588 0.000500 1589 0.000500 1590 0.000500 1591 0.004800 1592 0.000400 1593 0.000500 1594 0.010000 1595 0.009600 1596 0.009500 1597 0.003400 1598 0.000400 1599 0.000400 1600 0.000400 1601 0.000400 1602 0.000400 1603 0.003300 1604 0.005500 1605 0.009000 1606 0.000400 1607 0.005500 1608 0.004900 1609 0.010000 1610 0.000400 1611 0.000400 1612 0.009400 1613 0.010000 1614 0.004900 1615 0.000400 1616 0.016900 1617 0.005300 1618 0.000500 1619 0.000500 1620 0.009200 1621 0.037300 1622 0.004000 1623 0.005200 1624 0.000700 1625 0.003200 1626 0.000700 1627 0.000700 1628 0.004000 1629 0.005200 1630 0.000600 1631 0.004000 1632 0.008500 1633 0.000600 1634 0.000600 1635 0.004500 1636 0.009600 1637 0.000600 1638 0.005700 1639 0.021400 1640 0.000600 1641 0.004000 1642 0.000600 1643 0.003900 1644 0.005000 1645 0.000500 1646 0.044500 1647 0.000800 1648 0.007200 1649 0.000800 1650 0.004400 1651 0.000800 1652 0.003100 1653 0.000800 1654 0.009600 1655 0.009900 1656 0.003800 1657 0.000600 1658 0.006400 1659 0.000600 1660 0.009200 1661 0.005100 1662 0.003100 1663 0.003900 1664 0.000600 1665 0.003000 1666 0.000500 1667 0.014600 1668 0.008100 1669 0.004400 1670 0.003000 1671 0.000700 1672 0.000700 1673 0.000400 1674 0.009300 1675 0.003000 1676 0.009600 1677 0.009600 1678 0.000400 1679 0.007900 1680 0.000500 1681 0.013600 1682 0.003000 1683 0.007700 1684 0.004400 1685 0.009900 1686 0.006700 1687 0.003700 1688 0.000700 1689 0.004400 1690 0.000700 1691 0.000700 1692 0.005000 1693 0.003000 1694 0.000700 1695 0.004400 1696 0.003700 1697 0.013500 1698 0.004900 1699 0.009100 1700 0.004400 1701 0.005000 1702 0.009700 1703 0.009900 1704 0.008000 1705 0.005600 1706 0.009900 1707 0.001600 1708 0.085800 1709 0.001600 1710 0.001200 1711 0.001200 1712 0.014700 1713 0.009800 1714 0.001000 1715 0.008600 1716 0.009800 1717 0.020800 1718 0.000800 1719 0.007900 1720 0.043000 1721 0.004300 1722 0.003700 1723 0.000800 1724 0.000800 1725 0.007800 1726 0.017700 1727 0.000900 1728 0.006400 1729 0.000900 1730 0.005000 1731 0.003000 1732 0.000600 1733 0.004400 1734 0.004400 1735 0.013200 1736 0.009200 1737 0.000600 1738 0.013100 1739 0.011300 1740 0.009400 1741 0.000600 1742 0.000600 1743 0.000600 1744 0.000600 1745 0.003000 1746 0.041600 1747 0.011400 1748 0.013500 1749 0.004400 1750 0.009000 1751 0.000700 1752 0.009000 1753 0.003800 1754 0.003800 1755 0.003800 ```