+
+| Model | Avg | STEM | Social Science | Humanities | Others |
+| -------- | ----- | ----- | -------------- | ---------- | ------ |
+| ChatGPT | 54.4 | 52.9 | 61.8 | 50.9 | 53.6 |
+| OpenChat | 47.29 | 45.22 | 52.49 | 48.52 | 45.08 |
+
+
+
Massive Multitask Language Understanding in Chinese (CMMLU, 5-shot)
+
+
+| Models | STEM | Humanities | SocialSciences | Other | ChinaSpecific | Avg |
+| -------- | ----- | ---------- | -------------- | ----- | ------------- | ----- |
+| ChatGPT | 47.81 | 55.68 | 56.5 | 62.66 | 50.69 | 55.51 |
+| OpenChat | 38.7 | 45.99 | 48.32 | 50.23 | 43.27 | 45.85 |
+
+
+
Limitations
+
+
+**Foundation Model Limitations**
+Despite its advanced capabilities, OpenChat is still bound by the limitations inherent in its foundation models. These limitations may impact the model's performance in areas such as:
+
+- Complex reasoning
+- Mathematical and arithmetic tasks
+- Programming and coding challenges
+
+**Hallucination of Non-existent Information**
+OpenChat may sometimes generate information that does not exist or is not accurate, also known as "hallucination". Users should be aware of this possibility and verify any critical information obtained from the model.
+
+**Safety**
+OpenChat may sometimes generate harmful, hate speech, biased responses, or answer unsafe questions. It's crucial to apply additional AI safety measures in use cases that require safe and moderated responses.
+
+
+
License
+
+
+Our OpenChat 3.5 code and models are distributed under the Apache License 2.0.
+
+
+
Dataset Details
+
+
+OpenChat 3.5 was trained with C-RLFT on a collection of publicly available high-quality instruction data, with a custom processing pipeline. We detail some notable subsets included here:
+
+- [OpenChat ShareGPT](https://huggingface.co/datasets/openchat/openchat_sharegpt4_dataset)
+- [Open-Orca with FLAN answers](https://huggingface.co/datasets/imone/OpenOrca_FLAN)
+- [Feedback-Collection](https://huggingface.co/datasets/kaist-ai/Feedback-Collection)
+- Capybara [1](https://huggingface.co/datasets/LDJnr/Pure-Dove) [2](https://huggingface.co/datasets/LDJnr/Verified-Camel) [3](https://huggingface.co/datasets/LDJnr/LessWrong-Amplify-Instruct)
+- [GOAT](https://huggingface.co/datasets/tiedong/goat)
+- [Glaive](https://huggingface.co/datasets/glaiveai/glaive-code-assistant)
+- [MetaMathQA](https://huggingface.co/datasets/meta-math/MetaMathQA)
+- [MathInstruct](https://huggingface.co/datasets/TIGER-Lab/MathInstruct)
+- [OpenAssistant](https://huggingface.co/datasets/OpenAssistant/oasst_top1_2023-08-25)
+
+
+
Citation
+
+
+```
+@article{wang2023openchat,
+ title={OpenChat: Advancing Open-source Language Models with Mixed-Quality Data},
+ author={Wang, Guan and Cheng, Sijie and Zhan, Xianyuan and Li, Xiangang and Song, Sen and Liu, Yang},
+ journal={arXiv preprint arXiv:2309.11235},
+ year={2023}
+}
+```
+
+
+
Acknowledgments
+
+
+We extend our heartfelt gratitude to AutoMeta and caesus from Alignment Lab AI, LDJ and Teknium from Nous Research, alpin and TearGosling from Pygmalion AI for their substantial contributions to data collection and model training.
+
+Special thanks go to Changling Liu from GPT Desk Pte. Ltd., Qiying Yu at Tsinghua University, Baochang Ma, and Hao Wan from 01.AI company for their generous provision of resources. We are also deeply grateful to Jianxiong Li and Peng Li at Tsinghua University for their insightful discussions.
+
+Furthermore, we appreciate the developers behind the following projects for their significant contributions to our research: [Mistral](https://mistral.ai/), [Chain-of-Thought Hub](https://github.com/FranxYao/chain-of-thought-hub), [Llama 2](https://ai.meta.com/llama/), [Self-Instruct](https://arxiv.org/abs/2212.10560), [FastChat (Vicuna)](https://github.com/lm-sys/FastChat), [Alpaca](https://github.com/tatsu-lab/stanford_alpaca.git), and [StarCoder](https://github.com/bigcode-project/starcoder). Their work has been instrumental in driving our research forward.
\ No newline at end of file
diff --git a/gitignore b/gitignore
new file mode 100644
index 0000000000000000000000000000000000000000..a35f18942d50b992f61ead8342140ff414d5c9dc
--- /dev/null
+++ b/gitignore
@@ -0,0 +1 @@
+mod_cache_before_build.pkl
\ No newline at end of file
diff --git a/mod_cache_before_build.pkl b/mod_cache_before_build.pkl
new file mode 100644
index 0000000000000000000000000000000000000000..d2e35cdd1866e16630b71e573d031d45826de8b6
--- /dev/null
+++ b/mod_cache_before_build.pkl
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6599ae6afe4b9efae456b69477f70c705509a73bb335d36fdd588e7229aa28f
+size 19969634
diff --git a/openchat-3.5-1210-q4f32_1-webgpu.wasm b/openchat-3.5-1210-q4f32_1-webgpu.wasm
new file mode 100755
index 0000000000000000000000000000000000000000..9c1902bb3e34bcb599a7bb294f2428270c0778e0
--- /dev/null
+++ b/openchat-3.5-1210-q4f32_1-webgpu.wasm
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ded14028f12c53bad643587e8d00df8e0cc7036cfda836fb2c2484a70ee28a0e
+size 2439077
diff --git a/params/added_tokens.json b/params/added_tokens.json
new file mode 100644
index 0000000000000000000000000000000000000000..12a98694bf3dbf213d189451d772b42275487ac7
--- /dev/null
+++ b/params/added_tokens.json
@@ -0,0 +1,4 @@
+{
+ "<|end_of_turn|>": 32000,
+ "<|pad_0|>": 32001
+}
diff --git a/params/mlc-chat-config.json b/params/mlc-chat-config.json
new file mode 100644
index 0000000000000000000000000000000000000000..3fec9d4b242a41c92c8621eacdc8de558675a370
--- /dev/null
+++ b/params/mlc-chat-config.json
@@ -0,0 +1,20 @@
+{
+ "model_lib": "openchat-3.5-1210-q4f32_1",
+ "local_id": "openchat-3.5-1210-q4f32_1",
+ "conv_template": "mistral_default",
+ "temperature": 0.7,
+ "repetition_penalty": 1.0,
+ "top_p": 0.95,
+ "mean_gen_len": 128,
+ "max_gen_len": 512,
+ "max_window_size": 2048,
+ "num_shards": 1,
+ "shift_fill_factor": 0.3,
+ "tokenizer_files": [
+ "added_tokens.json",
+ "tokenizer.model"
+ ],
+ "model_category": "mistral",
+ "model_name": "openchat-3.5-1210",
+ "vocab_size": 32002
+}
\ No newline at end of file
diff --git a/params/ndarray-cache.json b/params/ndarray-cache.json
new file mode 100644
index 0000000000000000000000000000000000000000..8b0317f159933ca7453c448ec79c82426f69ac24
--- /dev/null
+++ b/params/ndarray-cache.json
@@ -0,0 +1,4456 @@
+{
+ "metadata": {
+ "ParamSize": 327
+ },
+ "records": [
+ {
+ "dataPath": "params_shard_0.bin",
+ "format": "raw-shard",
+ "nbytes": 65540096,
+ "records": [
+ {
+ "name": "param_0",
+ "shape": [
+ 32002,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 65540096,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_1.bin",
+ "format": "raw-shard",
+ "nbytes": 32113664,
+ "records": [
+ {
+ "name": "param_1",
+ "shape": [
+ 32002,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 16385024,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_2",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 16385024
+ },
+ {
+ "name": "param_3",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 28967936
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_2.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_6",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_3.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_8",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_4.bin",
+ "format": "raw-shard",
+ "nbytes": 32538624,
+ "records": [
+ {
+ "name": "param_4",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_5",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 8388608
+ },
+ {
+ "name": "param_7",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 10485760
+ },
+ {
+ "name": "param_9",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 25165824
+ },
+ {
+ "name": "param_10",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 32505856
+ },
+ {
+ "name": "param_11",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 32522240
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_5.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_16",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_6.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_12",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_13",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_14",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_15",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_7.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_18",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_8.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_17",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_19",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_20",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_21",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_9.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_26",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_10.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_22",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_23",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_24",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_25",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_11.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_28",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_12.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_27",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_29",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_30",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_31",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_13.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_36",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_14.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_32",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_33",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_34",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_35",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_15.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_38",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_16.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_37",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_39",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_40",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_41",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_17.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_46",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_18.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_42",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_43",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_44",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_45",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_19.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_48",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_20.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_47",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_49",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_50",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_51",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_21.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_56",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_22.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_52",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_53",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_54",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_55",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_23.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_58",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_24.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_57",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_59",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_60",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_61",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_25.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_66",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_26.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_62",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_63",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_64",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_65",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_27.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_68",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_28.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_67",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_69",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_70",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_71",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_29.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_76",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_30.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_72",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_73",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_74",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_75",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_31.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_78",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_32.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_77",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_79",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_80",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_81",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_33.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_86",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_34.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_82",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_83",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_84",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_85",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_35.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_88",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_36.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_87",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_89",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_90",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_91",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_37.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_96",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_38.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_92",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_93",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_94",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_95",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_39.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_98",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_40.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_97",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_99",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_100",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_101",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_41.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_106",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_42.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_102",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_103",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_104",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_105",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_43.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_108",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_44.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_107",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_109",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_110",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_111",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_45.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_116",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_46.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_112",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_113",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_114",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_115",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_47.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_118",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_48.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_117",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_119",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_120",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_121",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_49.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_126",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_50.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_122",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_123",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_124",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_125",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_51.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_128",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_52.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_127",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_129",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_130",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_131",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_53.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_136",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_54.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_132",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_133",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_134",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_135",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_55.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_138",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_56.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_137",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_139",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_140",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_141",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_57.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_146",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_58.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_142",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_143",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_144",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_145",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_59.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_148",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_60.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_147",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_149",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_150",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_151",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_61.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_156",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_62.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_152",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_153",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_154",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_155",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_63.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_158",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_64.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_157",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_159",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_160",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_161",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_65.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_166",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_66.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_162",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_163",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_164",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_165",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_67.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_168",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_68.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_167",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_169",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_170",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_171",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_69.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_176",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_70.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_172",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_173",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_174",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_175",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_71.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_178",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_72.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_177",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_179",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_180",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_181",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_73.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_186",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_74.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_182",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_183",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_184",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_185",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_75.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_188",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_76.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_187",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_189",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_190",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_191",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_77.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_196",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_78.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_192",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_193",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_194",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_195",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_79.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_198",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_80.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_197",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_199",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_200",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_201",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_81.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_206",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_82.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_202",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_203",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_204",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_205",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_83.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_208",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_84.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_207",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_209",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_210",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_211",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_85.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_216",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_86.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_212",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_213",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_214",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_215",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_87.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_218",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_88.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_217",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_219",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_220",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_221",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_89.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_226",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_90.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_222",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_223",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_224",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_225",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_91.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_228",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_92.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_227",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_229",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_230",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_231",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_93.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_236",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_94.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_232",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_233",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_234",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_235",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_95.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_238",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_96.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_237",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_239",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_240",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_241",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_97.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_246",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_98.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_242",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_243",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_244",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_245",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_99.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_248",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_100.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_247",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_249",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_250",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_251",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_101.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_256",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_102.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_252",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_253",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_254",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_255",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_103.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_258",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_104.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_257",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_259",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_260",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_261",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_105.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_266",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_106.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_262",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_263",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_264",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_265",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_107.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_268",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_108.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_267",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_269",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_270",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_271",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_109.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_276",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_110.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_272",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_273",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_274",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_275",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_111.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_278",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_112.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_277",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_279",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_280",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_281",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_113.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_286",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_114.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_282",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_283",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_284",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_285",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_115.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_288",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_116.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_287",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_289",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_290",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_291",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_117.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_296",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_118.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_292",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_293",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_294",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_295",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_119.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_298",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_120.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_297",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_299",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_300",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_301",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_121.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_306",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_122.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_302",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_303",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_304",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_305",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_123.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_308",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_124.bin",
+ "format": "raw-shard",
+ "nbytes": 22052864,
+ "records": [
+ {
+ "name": "param_307",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_309",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_310",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_311",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_125.bin",
+ "format": "raw-shard",
+ "nbytes": 58720256,
+ "records": [
+ {
+ "name": "param_316",
+ "shape": [
+ 28672,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 58720256,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_126.bin",
+ "format": "raw-shard",
+ "nbytes": 26214400,
+ "records": [
+ {
+ "name": "param_312",
+ "shape": [
+ 6144,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 12582912,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_313",
+ "shape": [
+ 6144,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 3145728,
+ "byteOffset": 12582912
+ },
+ {
+ "name": "param_314",
+ "shape": [
+ 4096,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 8388608,
+ "byteOffset": 15728640
+ },
+ {
+ "name": "param_315",
+ "shape": [
+ 4096,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 2097152,
+ "byteOffset": 24117248
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_127.bin",
+ "format": "raw-shard",
+ "nbytes": 29360128,
+ "records": [
+ {
+ "name": "param_318",
+ "shape": [
+ 4096,
+ 1792
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 29360128,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_128.bin",
+ "format": "raw-shard",
+ "nbytes": 65540096,
+ "records": [
+ {
+ "name": "param_323",
+ "shape": [
+ 32002,
+ 512
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 65540096,
+ "byteOffset": 0
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_129.bin",
+ "format": "raw-shard",
+ "nbytes": 22069248,
+ "records": [
+ {
+ "name": "param_317",
+ "shape": [
+ 28672,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 14680064,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_319",
+ "shape": [
+ 4096,
+ 448
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 7340032,
+ "byteOffset": 14680064
+ },
+ {
+ "name": "param_320",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22020096
+ },
+ {
+ "name": "param_321",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22036480
+ },
+ {
+ "name": "param_322",
+ "shape": [
+ 4096
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 16384,
+ "byteOffset": 22052864
+ }
+ ]
+ },
+ {
+ "dataPath": "params_shard_130.bin",
+ "format": "raw-shard",
+ "nbytes": 18482176,
+ "records": [
+ {
+ "name": "param_324",
+ "shape": [
+ 32002,
+ 128
+ ],
+ "dtype": "uint32",
+ "format": "raw",
+ "nbytes": 16385024,
+ "byteOffset": 0
+ },
+ {
+ "name": "param_325",
+ "shape": [
+ 2048,
+ 128
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 1048576,
+ "byteOffset": 16385024
+ },
+ {
+ "name": "param_326",
+ "shape": [
+ 2048,
+ 128
+ ],
+ "dtype": "float32",
+ "format": "raw",
+ "nbytes": 1048576,
+ "byteOffset": 17433600
+ }
+ ]
+ }
+ ]
+}
\ No newline at end of file
diff --git a/params/params_shard_0.bin b/params/params_shard_0.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ac9176b8b1928d2ccdb20e379739b8a3b7423caf
--- /dev/null
+++ b/params/params_shard_0.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d6e03178128e306f1dcd70baa4d6160654feb0945db506d671e16ac3d45adedd
+size 65540096
diff --git a/params/params_shard_1.bin b/params/params_shard_1.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2595316b6758e1f807c9bc8d288859c3e0e6754f
--- /dev/null
+++ b/params/params_shard_1.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0c8fe9172b38c5e922ed0d964cb044c87f9ebaf5499986c1b6e62aa3a03a2c4
+size 32113664
diff --git a/params/params_shard_10.bin b/params/params_shard_10.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9e32a61e05867326e56806ef408ffc6809b227e1
--- /dev/null
+++ b/params/params_shard_10.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f984c82864d0ff1d01817b31729e9943b5562eedacc210311cb8fba088220738
+size 26214400
diff --git a/params/params_shard_100.bin b/params/params_shard_100.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c11ae9620b8fe6c92b823c71672d1f136ed21828
--- /dev/null
+++ b/params/params_shard_100.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c168f39111474862dd3361831f7ef9a897d5279c021392900095371c80eed327
+size 22052864
diff --git a/params/params_shard_101.bin b/params/params_shard_101.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b76b6cb8ceb26d2c0b12e4774844cbf7046d5cf6
--- /dev/null
+++ b/params/params_shard_101.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0865254527df13ece4cac08009503dec5936d9cc0e3ac259ac92429f2544e004
+size 58720256
diff --git a/params/params_shard_102.bin b/params/params_shard_102.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d419123ab4045bbd4d5bc588914dbda52973dff4
--- /dev/null
+++ b/params/params_shard_102.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e0b5c95e9a2c8474b50fa24c5c3320071c8da4b20adf2388cc3006572095db8
+size 26214400
diff --git a/params/params_shard_103.bin b/params/params_shard_103.bin
new file mode 100644
index 0000000000000000000000000000000000000000..39d654f43c73fafd0edada78ca40a9b0d7a9ef97
--- /dev/null
+++ b/params/params_shard_103.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb3c1319203da5341728ac405d366cc3746f9231028a0c5a6985ce94e4dd53b4
+size 29360128
diff --git a/params/params_shard_104.bin b/params/params_shard_104.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c16a8cfa27953b3f9cd355ef9a98ce634d004954
--- /dev/null
+++ b/params/params_shard_104.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11e71c0e9331394e081f2f34e1af8e30b34fa7244caab498424db5b5139cd637
+size 22052864
diff --git a/params/params_shard_105.bin b/params/params_shard_105.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3faf3a56c4ceed6bb47545b45906005b53d162b5
--- /dev/null
+++ b/params/params_shard_105.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e13bf449e87e55058c089f1e907d3b482c881b923b6bc315772698ddd9ead150
+size 58720256
diff --git a/params/params_shard_106.bin b/params/params_shard_106.bin
new file mode 100644
index 0000000000000000000000000000000000000000..017071a7eae773ece94998724aa88fc87a2c1a90
--- /dev/null
+++ b/params/params_shard_106.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:100ccab386e32b93debecadf909a6a73718d43c0c101f991b1880074e86f824f
+size 26214400
diff --git a/params/params_shard_107.bin b/params/params_shard_107.bin
new file mode 100644
index 0000000000000000000000000000000000000000..fe415648dcbfe96fe1c612d7b1f53a37dcb3e41f
--- /dev/null
+++ b/params/params_shard_107.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:989edc693887f81c69f0cca60d34dfb7abbaae75a1a0fe9e9a94e4256cef2d0e
+size 29360128
diff --git a/params/params_shard_108.bin b/params/params_shard_108.bin
new file mode 100644
index 0000000000000000000000000000000000000000..42ba1c7352e634fc1d88ace4cb2a7d4deeb377f3
--- /dev/null
+++ b/params/params_shard_108.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:028bfc281de3ee5b9a6cc039d191e648a435b36e64d2280f674ad5e7d4d24938
+size 22052864
diff --git a/params/params_shard_109.bin b/params/params_shard_109.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3f95e0486c81d69afd274f9e1e4f9202b5dab631
--- /dev/null
+++ b/params/params_shard_109.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:298795c48a7a74d37d81288894c8be29fe35b842c95fd89ffc96451236bcb43b
+size 58720256
diff --git a/params/params_shard_11.bin b/params/params_shard_11.bin
new file mode 100644
index 0000000000000000000000000000000000000000..957f02351e486ccf70aebcbac1e86a8a454d54ed
--- /dev/null
+++ b/params/params_shard_11.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a1f6a30b44fa286a9395b5c4006d45de15383e28cf05f648820e466dfed7286
+size 29360128
diff --git a/params/params_shard_110.bin b/params/params_shard_110.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3cf4adc3314773ca684265ef2b9949bec2e2e854
--- /dev/null
+++ b/params/params_shard_110.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b9546594ad2b745556c140c3db23e027bed4616c0677b9403818b6cd11738a3
+size 26214400
diff --git a/params/params_shard_111.bin b/params/params_shard_111.bin
new file mode 100644
index 0000000000000000000000000000000000000000..1ccad0864b87e9c6495242b1a8f07070bff4912e
--- /dev/null
+++ b/params/params_shard_111.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a171b0f2fcd534ca503f1ec83d52ee3f672cafc7ee9dbe1f98edb479ed5fcc5
+size 29360128
diff --git a/params/params_shard_112.bin b/params/params_shard_112.bin
new file mode 100644
index 0000000000000000000000000000000000000000..42d7642d90ca5e1c7da3715f2de2ec4a951dd87d
--- /dev/null
+++ b/params/params_shard_112.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2569733f97e5ad96479421990a74fedaecb5cdf1890362720b9cad7da9d50c64
+size 22052864
diff --git a/params/params_shard_113.bin b/params/params_shard_113.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a71cdd275475ca3159689c15c8cbc190911422bc
--- /dev/null
+++ b/params/params_shard_113.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1a13f6328a7eb7e34df854d313bdd6ea8dff2a7a6711c0729150e9d5ec92adee
+size 58720256
diff --git a/params/params_shard_114.bin b/params/params_shard_114.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f780b93b164110ce3298ad300482d39d839dcdd3
--- /dev/null
+++ b/params/params_shard_114.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:571ebd03dfb1d87a0b786f580fb034a8a45c1c0ba31eb94c3d49d9de3815eec7
+size 26214400
diff --git a/params/params_shard_115.bin b/params/params_shard_115.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2fb643addb33ebcc09d804b204b46f523b794b5b
--- /dev/null
+++ b/params/params_shard_115.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:985672ed8a566008d07ff115abb9daa47eb70900ce2d379fab78e28f0e1d3338
+size 29360128
diff --git a/params/params_shard_116.bin b/params/params_shard_116.bin
new file mode 100644
index 0000000000000000000000000000000000000000..09de88c907acd4ad4b6e6bef947662597eedd6b0
--- /dev/null
+++ b/params/params_shard_116.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16fc6301661cfa0caa4e480943b61864de2f9e57aa5390a1ce8cffb938287805
+size 22052864
diff --git a/params/params_shard_117.bin b/params/params_shard_117.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9a4640bfc7229f4868fc6966013e7b67b50c6718
--- /dev/null
+++ b/params/params_shard_117.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4158851e485c43e003b36cee6bfd208a181bf236c7f9d923a8a39feff97c84cf
+size 58720256
diff --git a/params/params_shard_118.bin b/params/params_shard_118.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e9a489efb53040892e092c3bca7bb1678d7a1642
--- /dev/null
+++ b/params/params_shard_118.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1e85ff968ce6ba30cc0117622f0b46db2406cb8f67c6d5a8fd2ab61d3e7902b
+size 26214400
diff --git a/params/params_shard_119.bin b/params/params_shard_119.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ba5ec4eb281ae169a84886b749da5fa5a55d71e5
--- /dev/null
+++ b/params/params_shard_119.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:879b2627ed836f26c859547b30cbda0ac57ddce5adf19a497c660da5d4fdf86b
+size 29360128
diff --git a/params/params_shard_12.bin b/params/params_shard_12.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a699e824d1cfd64f4da2c5971c78ae2cec4b60bc
--- /dev/null
+++ b/params/params_shard_12.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da4fbe469ca06808871a27a2e234f7d1afc33eb74953a1d9ecf7bae79caa8551
+size 22052864
diff --git a/params/params_shard_120.bin b/params/params_shard_120.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e582d23b8d9d9e7710b652eda84d580515f0910a
--- /dev/null
+++ b/params/params_shard_120.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17eacab788a405dde86b7502429f9435f587516fc99802b082ec88e1368ed0a2
+size 22052864
diff --git a/params/params_shard_121.bin b/params/params_shard_121.bin
new file mode 100644
index 0000000000000000000000000000000000000000..03fc5b60bb2ff47b7153fd03f7b1f19bd12dc2ed
--- /dev/null
+++ b/params/params_shard_121.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:08c471f831354d538d08d14ff354a84f75116c1fcf7573bb825aa0bfe557b12e
+size 58720256
diff --git a/params/params_shard_122.bin b/params/params_shard_122.bin
new file mode 100644
index 0000000000000000000000000000000000000000..0ba40624bc2651107537d4ceb3259863d7596869
--- /dev/null
+++ b/params/params_shard_122.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:243161f36d5bb2c0072b5d40e167860df51ba9c02b82990904467b3c52fdc957
+size 26214400
diff --git a/params/params_shard_123.bin b/params/params_shard_123.bin
new file mode 100644
index 0000000000000000000000000000000000000000..4660b75f893d92549c28f90940b54f72640d28a8
--- /dev/null
+++ b/params/params_shard_123.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:66c81ac935520f09e5f9eccbc5ffee788dda7a2592aad0b9c72bc84577524bbb
+size 29360128
diff --git a/params/params_shard_124.bin b/params/params_shard_124.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d12e2a07418b1f4c79f4898950106c0573f7e0bd
--- /dev/null
+++ b/params/params_shard_124.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dddb400289562e429638c5a059df75d1f4f97f63071271b8c2a8d9bc86b35428
+size 22052864
diff --git a/params/params_shard_125.bin b/params/params_shard_125.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6cec79371440e13c4eb13cbd9cdc958fcd39b7bf
--- /dev/null
+++ b/params/params_shard_125.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:09134b0d34894b959a44580751d50ec6b16f6695e21eb4a31ba9b05139d210ad
+size 58720256
diff --git a/params/params_shard_126.bin b/params/params_shard_126.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3d4927308f66ad3b6d5741cdb1795c9b4c139082
--- /dev/null
+++ b/params/params_shard_126.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a83cfbf6acfafce71d4107ad826920d4386d1766fc86d08bb745aa9265e904d
+size 26214400
diff --git a/params/params_shard_127.bin b/params/params_shard_127.bin
new file mode 100644
index 0000000000000000000000000000000000000000..be833ab31101ce8a27688087bb17080bf97011df
--- /dev/null
+++ b/params/params_shard_127.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ad01318e5cbdb8c9341de98b97934be67a9fbe582931b27a728faf682454931
+size 29360128
diff --git a/params/params_shard_128.bin b/params/params_shard_128.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3474cf4fe656f0410231f4672e691c94371c6084
--- /dev/null
+++ b/params/params_shard_128.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:66d923805fcdd198b612b7be92c2ad36b50214d4bf5627bd7429e30d926e7418
+size 65540096
diff --git a/params/params_shard_129.bin b/params/params_shard_129.bin
new file mode 100644
index 0000000000000000000000000000000000000000..8cecac50baf3ea964b2f740618a0b97f63027668
--- /dev/null
+++ b/params/params_shard_129.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36d53e739bf1aa39b2bf0cfd5c6fbee5000ac3098aa59019adc6bffde331005f
+size 22069248
diff --git a/params/params_shard_13.bin b/params/params_shard_13.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9bd2857bf43f33c5fa3dbe0f2bfd055f7dd9ef34
--- /dev/null
+++ b/params/params_shard_13.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85ad750f61d9a40d89a5cd9aae88ae2190eb4964cd4dd27d0d3773e1fc35d4cf
+size 58720256
diff --git a/params/params_shard_130.bin b/params/params_shard_130.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b3c323c361306851659c56963ab1cb292157a61f
--- /dev/null
+++ b/params/params_shard_130.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:975794a189e5fe2b7c8069930ebb11ab411c372c9a9de628fb65542045572ff4
+size 18482176
diff --git a/params/params_shard_14.bin b/params/params_shard_14.bin
new file mode 100644
index 0000000000000000000000000000000000000000..49327c8ea36214b6ccd5732a55a341498990ffff
--- /dev/null
+++ b/params/params_shard_14.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0042f9a8537e23561ff279ab21ffad67854ad716d8b9ccf15c13a1193e56f6a0
+size 26214400
diff --git a/params/params_shard_15.bin b/params/params_shard_15.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d6f220db65881255e7f471fa9cc54186546c5e9e
--- /dev/null
+++ b/params/params_shard_15.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:818aa2049568e8dca0735e1b6f6dc8a5bca0cd91049a290bcfcc35f15f1a4402
+size 29360128
diff --git a/params/params_shard_16.bin b/params/params_shard_16.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a9e406aed1465c7bd057332c0a253b1f1118c61b
--- /dev/null
+++ b/params/params_shard_16.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2f29a3f47458e1d22f0955a9d4e6eaeebb79e296fa8e86167b77d80b797a1672
+size 22052864
diff --git a/params/params_shard_17.bin b/params/params_shard_17.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ba0b048740ac983c572b77e5e6bd02439f8ade83
--- /dev/null
+++ b/params/params_shard_17.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:29019f2a79a2e5a1ffe9774bab9a7522ff1d16c65a1138633fcd52f46a1b379c
+size 58720256
diff --git a/params/params_shard_18.bin b/params/params_shard_18.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3899b85f580b55d866307ac790647d4c619500ef
--- /dev/null
+++ b/params/params_shard_18.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f0ef49df39da709d6e05a99e89f677841b11a55147c48ae0aa3b71bf1e71d1e
+size 26214400
diff --git a/params/params_shard_19.bin b/params/params_shard_19.bin
new file mode 100644
index 0000000000000000000000000000000000000000..45b0b6ad9f0e820d648941d9369b497d7cddf92b
--- /dev/null
+++ b/params/params_shard_19.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a556edc0a201cf1cd961cbcdbc2195fa77e749d04d0d40151ec9bc03341401c4
+size 29360128
diff --git a/params/params_shard_2.bin b/params/params_shard_2.bin
new file mode 100644
index 0000000000000000000000000000000000000000..27f1b1dc9480c8c222af59d6e3e2fe40d2f26e0c
--- /dev/null
+++ b/params/params_shard_2.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e33cdf738243ff6126e5db26e2dfd6a38d9cfc840ad8b7792762a323c7a24d1
+size 58720256
diff --git a/params/params_shard_20.bin b/params/params_shard_20.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a985e70f345006e66b6ef1feed10456ddfc627ba
--- /dev/null
+++ b/params/params_shard_20.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b63e0abd324e0a76282205af0b4cd0b993cac0f3898e1f39db6bef39920a093a
+size 22052864
diff --git a/params/params_shard_21.bin b/params/params_shard_21.bin
new file mode 100644
index 0000000000000000000000000000000000000000..42442f7d03386bbee0acbec756c919a4f74ed4c1
--- /dev/null
+++ b/params/params_shard_21.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b0f6ff95390a235166107f0fb090a6a88ffa252d8a27739f743fee06607cf79
+size 58720256
diff --git a/params/params_shard_22.bin b/params/params_shard_22.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9cda863be72a6215a47f214b952d1a459a80cedc
--- /dev/null
+++ b/params/params_shard_22.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d66f102b7eaf3a5a85f740228f3b5b724b819862cba312b0428867b9bc92f492
+size 26214400
diff --git a/params/params_shard_23.bin b/params/params_shard_23.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c9dc9a7e97e4d2e3954575ba8ae382b26088b955
--- /dev/null
+++ b/params/params_shard_23.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:51d9e3aca67bd025bc46d96ab731f9429549b75700803522976fad20d30880ae
+size 29360128
diff --git a/params/params_shard_24.bin b/params/params_shard_24.bin
new file mode 100644
index 0000000000000000000000000000000000000000..33c51fc53a03396746948e236dfbf233aa62f214
--- /dev/null
+++ b/params/params_shard_24.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ce9ebb0c77933ae2523ee364f68999875a64d3188e577abec00238ea740d7b6
+size 22052864
diff --git a/params/params_shard_25.bin b/params/params_shard_25.bin
new file mode 100644
index 0000000000000000000000000000000000000000..79958c79c3dc767af533dcd52591b278787060c3
--- /dev/null
+++ b/params/params_shard_25.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:625a14435fda86239c1d00e316798be0e8905c8deb17d444bb7e982a5a1be9b5
+size 58720256
diff --git a/params/params_shard_26.bin b/params/params_shard_26.bin
new file mode 100644
index 0000000000000000000000000000000000000000..42bc467d42fddb67595fb609d9593be34b0c687d
--- /dev/null
+++ b/params/params_shard_26.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0765e557847265850dbd83304832879efbc456bcca379fbed4e2bc1f75fa4636
+size 26214400
diff --git a/params/params_shard_27.bin b/params/params_shard_27.bin
new file mode 100644
index 0000000000000000000000000000000000000000..46b1a566be032f32bb26a376adf2b1a18b955c6a
--- /dev/null
+++ b/params/params_shard_27.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aa73b50276f30994e9485bb2274fc8f93f2a0a4c2ce2dbbf215242487230b6ea
+size 29360128
diff --git a/params/params_shard_28.bin b/params/params_shard_28.bin
new file mode 100644
index 0000000000000000000000000000000000000000..45a433528c476d0e3b16199504d9d2e1547504e8
--- /dev/null
+++ b/params/params_shard_28.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3dc388e2e39a11ba491ae71d4f5d5d37a904991ff8b61c92e5e9c87662efcfb0
+size 22052864
diff --git a/params/params_shard_29.bin b/params/params_shard_29.bin
new file mode 100644
index 0000000000000000000000000000000000000000..880d42232b24e929c9fc4f1dcae2c5d91d95bc3e
--- /dev/null
+++ b/params/params_shard_29.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c61f5dc18696d34077bad00857de9a81aa008ea1462018a9357a900f9020ee4
+size 58720256
diff --git a/params/params_shard_3.bin b/params/params_shard_3.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b1da86a5dfebcb1ed381653758c8619837a90c7b
--- /dev/null
+++ b/params/params_shard_3.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c69f7d651b45cb8760e34a892b81636a51c0508dc0efb6f466bd8129d47e51b
+size 29360128
diff --git a/params/params_shard_30.bin b/params/params_shard_30.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9bfcbe5fa4e3adba9a6a1113ebd3c218586fab33
--- /dev/null
+++ b/params/params_shard_30.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:252cb106e6cf4d6d5e2141a4ee79d420f1b2b1bc98d37a5ca142b268208fb0a7
+size 26214400
diff --git a/params/params_shard_31.bin b/params/params_shard_31.bin
new file mode 100644
index 0000000000000000000000000000000000000000..88f86b0b34de0e63c631cede8f8304d1447fc156
--- /dev/null
+++ b/params/params_shard_31.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b4fdced575bd1a184ac91cdafc89cf6d45a2013005364a859fa2a9758fae0ae
+size 29360128
diff --git a/params/params_shard_32.bin b/params/params_shard_32.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c944e0f03b6bb62aa11c3df8602b63f614d25b93
--- /dev/null
+++ b/params/params_shard_32.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:400dfe4b1c9649cbfc88ff1256b7771fb4bb0a80e6590d3f08d6c54f4bb2e5e8
+size 22052864
diff --git a/params/params_shard_33.bin b/params/params_shard_33.bin
new file mode 100644
index 0000000000000000000000000000000000000000..38fdf848ca6537ff94905cba2da7a91703d9b393
--- /dev/null
+++ b/params/params_shard_33.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77dcaff118debbee164cae02f503e9e079b7214fd5d669a7552a3e69e28d450e
+size 58720256
diff --git a/params/params_shard_34.bin b/params/params_shard_34.bin
new file mode 100644
index 0000000000000000000000000000000000000000..88353c3d4b7854d08d2e6e95b1f1360d2d18680f
--- /dev/null
+++ b/params/params_shard_34.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8bf383c999e9493d65aa0c421ed3bbc3f316345d470ddb61638636a596ecafb0
+size 26214400
diff --git a/params/params_shard_35.bin b/params/params_shard_35.bin
new file mode 100644
index 0000000000000000000000000000000000000000..837e3fd7d1e3d9cf4cf330f94c93ea93a8982763
--- /dev/null
+++ b/params/params_shard_35.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4275f3dcc8b49098aba69be84dd81941071c0ced7c2710d46e187cbbcd931132
+size 29360128
diff --git a/params/params_shard_36.bin b/params/params_shard_36.bin
new file mode 100644
index 0000000000000000000000000000000000000000..0145e7aae8ac2a657f934d9c33af754fad7afff0
--- /dev/null
+++ b/params/params_shard_36.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a5fb990ae093dc39c89d31f31b91ad428adedcdb2d1acabaa80a2b258b99605b
+size 22052864
diff --git a/params/params_shard_37.bin b/params/params_shard_37.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d9ade86a75e3f1c1d8f59764688ed7cd9bc248ff
--- /dev/null
+++ b/params/params_shard_37.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e39315615bb7c47da4f06ec34dcea0c625d9f35ef8449f68a38edd63aa93937
+size 58720256
diff --git a/params/params_shard_38.bin b/params/params_shard_38.bin
new file mode 100644
index 0000000000000000000000000000000000000000..54dc3f22211111124851152be2995c7e38f135a2
--- /dev/null
+++ b/params/params_shard_38.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ac0c2b56cef1f085b2e6ccf33f5d0194b7bb5fdd50f4a464500a4d8139dd4e7c
+size 26214400
diff --git a/params/params_shard_39.bin b/params/params_shard_39.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5b3da358a689d834b372aa203f7dd1939e6db534
--- /dev/null
+++ b/params/params_shard_39.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb4612b7b6bdd837dd6301c6cf93200a3dec3d3fc814fa08eecb9fd1a468f891
+size 29360128
diff --git a/params/params_shard_4.bin b/params/params_shard_4.bin
new file mode 100644
index 0000000000000000000000000000000000000000..8bd47607e87475e2ada02a98e85a525a0e8030b0
--- /dev/null
+++ b/params/params_shard_4.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc6279496e7e4b17e6f6314ccd4af7e859776b50a7366c44cb6ddb4dca000231
+size 32538624
diff --git a/params/params_shard_40.bin b/params/params_shard_40.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2a9bae9ecb5e1cd1ef65a2d6d809650761e960c7
--- /dev/null
+++ b/params/params_shard_40.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:51d3be37515563f2cb88c3b20fc8ba160e902d5db73129efb8b729be4f536136
+size 22052864
diff --git a/params/params_shard_41.bin b/params/params_shard_41.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2d55ae4deebf2509a8fae4c2f1e432a36b3a569b
--- /dev/null
+++ b/params/params_shard_41.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc629af66b75a2c3f00c8e2bf42b2a5bcf0421154d948f6288acceb455f7f2e7
+size 58720256
diff --git a/params/params_shard_42.bin b/params/params_shard_42.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f39d951cd8803550a951a109fa913a5ae1f6d19b
--- /dev/null
+++ b/params/params_shard_42.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:135b9e2afc975303dd0a748f8f1f0b1a8c7c85e2f7743ebb57f0dec3ecea13b4
+size 26214400
diff --git a/params/params_shard_43.bin b/params/params_shard_43.bin
new file mode 100644
index 0000000000000000000000000000000000000000..33d646f40a936db352320e1fad1712ec8a9792e7
--- /dev/null
+++ b/params/params_shard_43.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10bfc872a82a24e3d3c2ba646f743bfd44cfec57062ac588572379caac0f4339
+size 29360128
diff --git a/params/params_shard_44.bin b/params/params_shard_44.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7442203ffa6f5fc9ec7617b557d78bd0cb23182a
--- /dev/null
+++ b/params/params_shard_44.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7871590e3dd4d8dab788cd2dd4076f3b9861500d5240429a364faddb55dced2d
+size 22052864
diff --git a/params/params_shard_45.bin b/params/params_shard_45.bin
new file mode 100644
index 0000000000000000000000000000000000000000..182242f851d7a8e394e842dfc80843cf5c707305
--- /dev/null
+++ b/params/params_shard_45.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7a3faa2a8091da7f7da2fab6c45405c121d7695b254ec5057f2d252e5799249
+size 58720256
diff --git a/params/params_shard_46.bin b/params/params_shard_46.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d3fde48ffe3fe8c1161203b1659c56a8c96fff06
--- /dev/null
+++ b/params/params_shard_46.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b9f0965cb36ad138014356c87df03a0b2da1656ed1d956601a72fe57ee96950
+size 26214400
diff --git a/params/params_shard_47.bin b/params/params_shard_47.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f20c2be4664d7ff2ac1d4c8c342e5e183135ded8
--- /dev/null
+++ b/params/params_shard_47.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0d9787a92474c03bed69ef663a7b56c2ce4d739aa0d88a672b958a3accad1e10
+size 29360128
diff --git a/params/params_shard_48.bin b/params/params_shard_48.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a4ed36bf797fb2c0f1e5daa9a7964509d6d6a210
--- /dev/null
+++ b/params/params_shard_48.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7017fbb5d0a43712fe461a175da8ac72baf1d0856cea63b1fde60962458b5645
+size 22052864
diff --git a/params/params_shard_49.bin b/params/params_shard_49.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2a5448ffcec415aba40af7fd77529dfe72a5f4f7
--- /dev/null
+++ b/params/params_shard_49.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eae0fd8dc9760ad074ab7da3c652fdd16e58ce72796f6273c96ffb0fce85ed23
+size 58720256
diff --git a/params/params_shard_5.bin b/params/params_shard_5.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a2898a759c135d3b6938b936455db25d8a8ed1e8
--- /dev/null
+++ b/params/params_shard_5.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d06e3c4de6cc99fb39a07b126eb1749e562f387409d18d72dadb7e8e4ce9c4c9
+size 58720256
diff --git a/params/params_shard_50.bin b/params/params_shard_50.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f08d9bde4afe3e90f32dd53ff1a756fb379db04c
--- /dev/null
+++ b/params/params_shard_50.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7937a5b134bd871065999f13d80f78df9199fd8e25b6d92d5313e3e4462ee05f
+size 26214400
diff --git a/params/params_shard_51.bin b/params/params_shard_51.bin
new file mode 100644
index 0000000000000000000000000000000000000000..7fe394e8caae8be9527a49fcc76819bcb30df7e5
--- /dev/null
+++ b/params/params_shard_51.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1bb70d24e73ab8f4643b8196a186707d0c39789fa8d07514730aac01d71d3c1
+size 29360128
diff --git a/params/params_shard_52.bin b/params/params_shard_52.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6d14f289ce13230fa92009950c8382592f7fb103
--- /dev/null
+++ b/params/params_shard_52.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c407ece2023ec246b16cee0afe29dbad228421b8d0bee02d19e8368fcfb5a478
+size 22052864
diff --git a/params/params_shard_53.bin b/params/params_shard_53.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2a63fe771ab162364a33839d4f50bdee55244c7b
--- /dev/null
+++ b/params/params_shard_53.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7401a1ee221f850695d4ac3f1c7929bf7e6582dcda5872c2bc4f229f8c48f3ff
+size 58720256
diff --git a/params/params_shard_54.bin b/params/params_shard_54.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e48b578c2636a23b232e9b2a4ff8e0f38be8151f
--- /dev/null
+++ b/params/params_shard_54.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a61f3d9d52315db6e49ba9277bec3ab789add9dad4ad16f28dca6fed514ba16a
+size 26214400
diff --git a/params/params_shard_55.bin b/params/params_shard_55.bin
new file mode 100644
index 0000000000000000000000000000000000000000..567614b25dc1adbbe822bcb32cf4e7d57c1de27e
--- /dev/null
+++ b/params/params_shard_55.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:faa0a4945fc7f6cc26bbd0da0e9540959cad8bc321e8013b5c6d62ae729b8914
+size 29360128
diff --git a/params/params_shard_56.bin b/params/params_shard_56.bin
new file mode 100644
index 0000000000000000000000000000000000000000..77268098cbb5e7ab021a91510f4ace4b174d5a7a
--- /dev/null
+++ b/params/params_shard_56.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b0d09e8a055a43fbbb97b339436f87456ef4ecd7f70329e731383696f0623d4
+size 22052864
diff --git a/params/params_shard_57.bin b/params/params_shard_57.bin
new file mode 100644
index 0000000000000000000000000000000000000000..ce2757a645053ded767512b5b1fc0336fed2e9c1
--- /dev/null
+++ b/params/params_shard_57.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d31f55707bef2479f3bccc980a29c8d9b0c5a8c711e8114f36ac7218dba6a3f3
+size 58720256
diff --git a/params/params_shard_58.bin b/params/params_shard_58.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e4289528b0173ccc3652df31c4f43b07c9779170
--- /dev/null
+++ b/params/params_shard_58.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:619ed352f230a7e0982107f0fb8e35078089491407893db042567b7d17ed149d
+size 26214400
diff --git a/params/params_shard_59.bin b/params/params_shard_59.bin
new file mode 100644
index 0000000000000000000000000000000000000000..6cf436b470d044c8b7ca2185b583f8c9c850559d
--- /dev/null
+++ b/params/params_shard_59.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79c36817d29ad5fa2c11a99d3a55456ae0a339e0f5637fedbb84eee3b8800d94
+size 29360128
diff --git a/params/params_shard_6.bin b/params/params_shard_6.bin
new file mode 100644
index 0000000000000000000000000000000000000000..0fbcca9dde6166b33323c286ba2a9bd9d5e21f40
--- /dev/null
+++ b/params/params_shard_6.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75c9c7c76df93d0186ffa0fffb326a655ee4a51a334356e8a4d8d0a248158afe
+size 26214400
diff --git a/params/params_shard_60.bin b/params/params_shard_60.bin
new file mode 100644
index 0000000000000000000000000000000000000000..476bfbb79033671a766872e8a46274bc87f5a9d7
--- /dev/null
+++ b/params/params_shard_60.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9d20b987fb6192c3408f44f0725cada7f6a474a783b3eca9ecc5c4c1dcc61c6
+size 22052864
diff --git a/params/params_shard_61.bin b/params/params_shard_61.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c38aa518adc007514a68a022f2e00aab6305353b
--- /dev/null
+++ b/params/params_shard_61.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9a803ebe3159c980e7c5691814f57c123ab051f3316028dc7a692d7c3888c55
+size 58720256
diff --git a/params/params_shard_62.bin b/params/params_shard_62.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f40b26b7f2cae95e6d28c47016a047b5725666d5
--- /dev/null
+++ b/params/params_shard_62.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea24b55b899d8680add331e1a1b2af52095c48d710282a7a38622ca2095e7c7f
+size 26214400
diff --git a/params/params_shard_63.bin b/params/params_shard_63.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a8bd85bb48d151106c9e18906da45490c1b6b09e
--- /dev/null
+++ b/params/params_shard_63.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9489d1666bd5095c25c959bde9a4dfd58ba1bb6f045908022a28815c1726b5e
+size 29360128
diff --git a/params/params_shard_64.bin b/params/params_shard_64.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d142e245ee3bc1f0bb2b8d3fc4acab4947047dd7
--- /dev/null
+++ b/params/params_shard_64.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9323fd33a4e443beb3f210231cbb4bafc504ac5496ed50386519ce1e8aa4a436
+size 22052864
diff --git a/params/params_shard_65.bin b/params/params_shard_65.bin
new file mode 100644
index 0000000000000000000000000000000000000000..aa9fc760c4cf0f45e89fc7b238c1db61de7ca647
--- /dev/null
+++ b/params/params_shard_65.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7225deffd95aa02d33b11441d2ba580b5abef03b1341de733914679fdd05073
+size 58720256
diff --git a/params/params_shard_66.bin b/params/params_shard_66.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2ff497639777e7bd415311f1ca8a771e57ecadca
--- /dev/null
+++ b/params/params_shard_66.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:781c83477a31cbd860eca301033cae7e8ccf8da950e62418e06722e99ca52446
+size 26214400
diff --git a/params/params_shard_67.bin b/params/params_shard_67.bin
new file mode 100644
index 0000000000000000000000000000000000000000..324dedef7a63bc7d5c5fc19cf96c586e4c531815
--- /dev/null
+++ b/params/params_shard_67.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cb69d0ecac9e360df1d777a44507b1e74d2649bc7a66ed3f425b175cf188937
+size 29360128
diff --git a/params/params_shard_68.bin b/params/params_shard_68.bin
new file mode 100644
index 0000000000000000000000000000000000000000..f5cbfa036294c944ced7f848b51d51dce4ee6d41
--- /dev/null
+++ b/params/params_shard_68.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9f2c3d0063f565041a0622937dbce6198c3042e5cbd031d8b739d07c99e0bf0d
+size 22052864
diff --git a/params/params_shard_69.bin b/params/params_shard_69.bin
new file mode 100644
index 0000000000000000000000000000000000000000..22579a91ff06f4e6d2e0abc373e1dec7d79f9e4c
--- /dev/null
+++ b/params/params_shard_69.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f801e0b46e4cc314cf157c9eeebc5745651b84025eb037e24ec57f5cc8d7d263
+size 58720256
diff --git a/params/params_shard_7.bin b/params/params_shard_7.bin
new file mode 100644
index 0000000000000000000000000000000000000000..bdd46dca1a082a30afb89f1107d71faa20f541dc
--- /dev/null
+++ b/params/params_shard_7.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2ecd4ac6177b47cd3578a9673c1e2b38237b5f8e36593eaa184aa2b947692c4
+size 29360128
diff --git a/params/params_shard_70.bin b/params/params_shard_70.bin
new file mode 100644
index 0000000000000000000000000000000000000000..dc0cfee2b4cf03e4e704dcdb82325a3dac2048f7
--- /dev/null
+++ b/params/params_shard_70.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16d3aa4544f795b48113f5f287c7ee96f1d5ef889db85a6da3e8a0c4ef634c9c
+size 26214400
diff --git a/params/params_shard_71.bin b/params/params_shard_71.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c04b6e86b00f89fee5a39754bdd88dc86f8f9d9c
--- /dev/null
+++ b/params/params_shard_71.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ee90c7b9f70512ae54a6bf6cb2a95b5b840148946e4612688d5973207e66e15
+size 29360128
diff --git a/params/params_shard_72.bin b/params/params_shard_72.bin
new file mode 100644
index 0000000000000000000000000000000000000000..8cfb0391c24605d146daeebf962fa1444dd78cb2
--- /dev/null
+++ b/params/params_shard_72.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3206978c0bd074069f88e61de15100276f0999e9bda4e72417a413c52002425c
+size 22052864
diff --git a/params/params_shard_73.bin b/params/params_shard_73.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e67aa6b3213d3161497bc32d6cd38a458bca3d63
--- /dev/null
+++ b/params/params_shard_73.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ca4badedededf944d7257cc0ce2a64027e357aed51d5d74afe71ef0f5ba2104
+size 58720256
diff --git a/params/params_shard_74.bin b/params/params_shard_74.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d437080f58df5f4f5f720dcab4213ac6917be67b
--- /dev/null
+++ b/params/params_shard_74.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7c783de3269093be4490002081bc64fc41ad8f221a77a4b71337d1c4af63528
+size 26214400
diff --git a/params/params_shard_75.bin b/params/params_shard_75.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3cf3c3444125dd75dca47159e1f59fc658dbfb9d
--- /dev/null
+++ b/params/params_shard_75.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2dd4b006e8dd6b0037ba27c2f4db77866551e35092fe85b31d8002550bb15d6a
+size 29360128
diff --git a/params/params_shard_76.bin b/params/params_shard_76.bin
new file mode 100644
index 0000000000000000000000000000000000000000..15966e88b38029f58176c5226fccc472da90cf79
--- /dev/null
+++ b/params/params_shard_76.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e5122cf6eda4e9ea7fe8351cc74bd38b0ed86cf6f00e63f434ca09a1a52f9ab
+size 22052864
diff --git a/params/params_shard_77.bin b/params/params_shard_77.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3283e7f82aba8ad9c402034e276e4ed5eba5f7dc
--- /dev/null
+++ b/params/params_shard_77.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8357cf887bd428f1783f0fce5205d25871a7fcd407cadaec7f464a017ac43984
+size 58720256
diff --git a/params/params_shard_78.bin b/params/params_shard_78.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e3476c2aff721195ffcb3fab2d89b51d675191dc
--- /dev/null
+++ b/params/params_shard_78.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3d1d7af7e65f7eeb77bca5d85bbbb5540f1a8f487b91ab6a36d4156151556ff
+size 26214400
diff --git a/params/params_shard_79.bin b/params/params_shard_79.bin
new file mode 100644
index 0000000000000000000000000000000000000000..e5abff716ece2adf37cce771bab205525c350b83
--- /dev/null
+++ b/params/params_shard_79.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6f9bb45da3ae3a87beef27b1e28906f54716164c0d106cd990721f783e97808
+size 29360128
diff --git a/params/params_shard_8.bin b/params/params_shard_8.bin
new file mode 100644
index 0000000000000000000000000000000000000000..09047fbc3e41a69465ae3e228317bb1b2af092a4
--- /dev/null
+++ b/params/params_shard_8.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1df1bfddb314362ca45232834d5aae2a84c7093d3917f98438cb0133954d5a59
+size 22052864
diff --git a/params/params_shard_80.bin b/params/params_shard_80.bin
new file mode 100644
index 0000000000000000000000000000000000000000..cccc29a0073a38ae7718dc188666f06bd653af3b
--- /dev/null
+++ b/params/params_shard_80.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78f2959e5f98b7588fbf2041980f5930f7077e1d30db71f760181f9c7a0e1f6e
+size 22052864
diff --git a/params/params_shard_81.bin b/params/params_shard_81.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c6797def32775408bf3744363e80f7b368886775
--- /dev/null
+++ b/params/params_shard_81.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab820e3c8bcae4fe08b4f34f7279e6940f2f3870fc04d35725adebc244694b06
+size 58720256
diff --git a/params/params_shard_82.bin b/params/params_shard_82.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5b6b7cc9ffe34acfe1470703860e46fa8335cf24
--- /dev/null
+++ b/params/params_shard_82.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bbdb8eadd0997e68875911507ede3db89d42e645765bb47ac2e03f222a54f1e1
+size 26214400
diff --git a/params/params_shard_83.bin b/params/params_shard_83.bin
new file mode 100644
index 0000000000000000000000000000000000000000..c3cbf2223abe836c2ec7fe216455c83bec89aba0
--- /dev/null
+++ b/params/params_shard_83.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b1a019743cb254607d585eca7dc15539d8cae882ca622939639c4e5bce21823
+size 29360128
diff --git a/params/params_shard_84.bin b/params/params_shard_84.bin
new file mode 100644
index 0000000000000000000000000000000000000000..bf329aa7c148ac740c54bb2df4b77dd829b8fc0c
--- /dev/null
+++ b/params/params_shard_84.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fa8ea4efa25d1ce6c266ec633f7cace769e4e6f5880b085bae80941684ecd8e
+size 22052864
diff --git a/params/params_shard_85.bin b/params/params_shard_85.bin
new file mode 100644
index 0000000000000000000000000000000000000000..5fd6d1ed6f686ab5b7dbe7f843708753a67f45af
--- /dev/null
+++ b/params/params_shard_85.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ccc695078c0c79c8341ad724c9406e14145d574324918b66f635b6425fedebbe
+size 58720256
diff --git a/params/params_shard_86.bin b/params/params_shard_86.bin
new file mode 100644
index 0000000000000000000000000000000000000000..bd8b3193d0167a3404130650aa2bd9bec0e26643
--- /dev/null
+++ b/params/params_shard_86.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2df0705e8f5f3c12284fdb9152ebe9c0d0a1fa82713774ca2f6ea7ba63b37266
+size 26214400
diff --git a/params/params_shard_87.bin b/params/params_shard_87.bin
new file mode 100644
index 0000000000000000000000000000000000000000..08d9c52d217c100e944af027bb0f5cbe4b6dca09
--- /dev/null
+++ b/params/params_shard_87.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a602e067cb7edaadb00da298ba3f0d7ab3bbc4ff59a95586c1327bb7c78e709
+size 29360128
diff --git a/params/params_shard_88.bin b/params/params_shard_88.bin
new file mode 100644
index 0000000000000000000000000000000000000000..fc2c779efaa3074ad1a03809727fba9fd4adf275
--- /dev/null
+++ b/params/params_shard_88.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c41a6f54472cd90cb3d91d1b78c57e94bcc428e359ac2db9b5d7b6906b2dcbb
+size 22052864
diff --git a/params/params_shard_89.bin b/params/params_shard_89.bin
new file mode 100644
index 0000000000000000000000000000000000000000..801d9b5c0a411168f70733f8a5aae4711e815a1d
--- /dev/null
+++ b/params/params_shard_89.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b782be836ded0a967d089db4bbbbe4729e16ce5ada2477be8d3b382d1b9890f5
+size 58720256
diff --git a/params/params_shard_9.bin b/params/params_shard_9.bin
new file mode 100644
index 0000000000000000000000000000000000000000..a77829590f8cb4521a5d8c4533b573015f520717
--- /dev/null
+++ b/params/params_shard_9.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:519a37acf463b30193629913e058f2410636cb8d8b4ed2cd7ed0cf4fdbf61bfd
+size 58720256
diff --git a/params/params_shard_90.bin b/params/params_shard_90.bin
new file mode 100644
index 0000000000000000000000000000000000000000..04497bb2629efb54e306e3e6548fca22b1bf955e
--- /dev/null
+++ b/params/params_shard_90.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8942d4968694dfd44aae5ac15dd9534de48436b0df9ff30d428844bfdf61f62
+size 26214400
diff --git a/params/params_shard_91.bin b/params/params_shard_91.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b500081963fd720662a193136cf1011c8e2578b1
--- /dev/null
+++ b/params/params_shard_91.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4061a3bb15a5d05ba9567d588b9211bd624cbe2aff30813d5bceec8769d546bf
+size 29360128
diff --git a/params/params_shard_92.bin b/params/params_shard_92.bin
new file mode 100644
index 0000000000000000000000000000000000000000..cf40ac1ced4f08551f8ea06cf61d1bd1a1371971
--- /dev/null
+++ b/params/params_shard_92.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:624217ae8b05b4ebf6fce18d384fc37cbc28bbbe43e0d70b3de1d5b6f7a71b77
+size 22052864
diff --git a/params/params_shard_93.bin b/params/params_shard_93.bin
new file mode 100644
index 0000000000000000000000000000000000000000..b7d0da7f6277f2a087e6ec14f02e325f0c1b79d9
--- /dev/null
+++ b/params/params_shard_93.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44976874ffaa13ad2b819c95e9f2424e0efd1b7864426307bb8596ad22986b4c
+size 58720256
diff --git a/params/params_shard_94.bin b/params/params_shard_94.bin
new file mode 100644
index 0000000000000000000000000000000000000000..3d9b338b504f899b1385051023a9889f3e4d77a0
--- /dev/null
+++ b/params/params_shard_94.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc0fcea3560ed60a19b749c2ed415e2606c66f81618ab110ac49d806fbd0ee6a
+size 26214400
diff --git a/params/params_shard_95.bin b/params/params_shard_95.bin
new file mode 100644
index 0000000000000000000000000000000000000000..9dc8491ac7ec17dee8ff62bff8ee3cdfa52d9c9c
--- /dev/null
+++ b/params/params_shard_95.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ece804491e638df181398adafd99649ac073a5809df8780f10b1a99fa8eee8ed
+size 29360128
diff --git a/params/params_shard_96.bin b/params/params_shard_96.bin
new file mode 100644
index 0000000000000000000000000000000000000000..d1fcf05eea707bb659680aa42c4762f551416239
--- /dev/null
+++ b/params/params_shard_96.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c17ccbbf63181debddc92f168a3825c7faaafcf0d718e8437c1666be3c7b4296
+size 22052864
diff --git a/params/params_shard_97.bin b/params/params_shard_97.bin
new file mode 100644
index 0000000000000000000000000000000000000000..aaa5fc17ce0d385ce470935b3bad236e37b24f3d
--- /dev/null
+++ b/params/params_shard_97.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20258b334bab2e7e9434b79d98fcc27532abd70f3f17b835e67929229a9c656b
+size 58720256
diff --git a/params/params_shard_98.bin b/params/params_shard_98.bin
new file mode 100644
index 0000000000000000000000000000000000000000..2b546f70864b7088c36dc0815fd5034327d34a66
--- /dev/null
+++ b/params/params_shard_98.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b48f1d969b6b1b786f3afab473233f8363154d71ac8bf304d8ea17aacfd24370
+size 26214400
diff --git a/params/params_shard_99.bin b/params/params_shard_99.bin
new file mode 100644
index 0000000000000000000000000000000000000000..bd8d0ed489b47a5311a06f5822f2c95e8e76695c
--- /dev/null
+++ b/params/params_shard_99.bin
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ae97bab2ecde943a208e33126d7c80e147461a93125fa1a83873968df1d347f
+size 29360128
diff --git a/params/tokenizer.model b/params/tokenizer.model
new file mode 100644
index 0000000000000000000000000000000000000000..8b443ef19c2a19acc3ac64fb9c3db4a72921dff6
--- /dev/null
+++ b/params/tokenizer.model
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055
+size 493443
diff --git a/params/tokenizer_config.json b/params/tokenizer_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..a47013a1ccd3a91d988be5ef982226d129332548
--- /dev/null
+++ b/params/tokenizer_config.json
@@ -0,0 +1,62 @@
+{
+ "add_bos_token": true,
+ "add_eos_token": false,
+ "added_tokens_decoder": {
+ "0": {
+ "content": "
",
+ "lstrip": false,
+ "normalized": false,
+ "rstrip": false,
+ "single_word": false,
+ "special": true
+ },
+ "1": {
+ "content": "",
+ "lstrip": false,
+ "normalized": false,
+ "rstrip": false,
+ "single_word": false,
+ "special": true
+ },
+ "2": {
+ "content": "",
+ "lstrip": false,
+ "normalized": false,
+ "rstrip": false,
+ "single_word": false,
+ "special": true
+ },
+ "32000": {
+ "content": "<|end_of_turn|>",
+ "lstrip": false,
+ "normalized": false,
+ "rstrip": false,
+ "single_word": false,
+ "special": true
+ },
+ "32001": {
+ "content": "<|pad_0|>",
+ "lstrip": false,
+ "normalized": false,
+ "rstrip": false,
+ "single_word": false,
+ "special": true
+ }
+ },
+ "additional_special_tokens": [
+ "<|end_of_turn|>",
+ "<|pad_0|>"
+ ],
+ "bos_token": "",
+ "chat_template": "{{ bos_token }}{% for message in messages %}{{ 'GPT4 Correct ' + message['role'].title() + ': ' + message['content'] + '<|end_of_turn|>'}}{% endfor %}{% if add_generation_prompt %}{{ 'GPT4 Correct Assistant:' }}{% endif %}",
+ "clean_up_tokenization_spaces": false,
+ "eos_token": "<|end_of_turn|>",
+ "legacy": true,
+ "model_max_length": 1000000000000000019884624838656,
+ "pad_token": null,
+ "sp_model_kwargs": {},
+ "spaces_between_special_tokens": false,
+ "tokenizer_class": "LlamaTokenizer",
+ "unk_token": "",
+ "use_default_system_prompt": true
+}