Phi-3.5-mini-instruct.Q6_K.gguf - GGUF Internal File Dump
- Endian: LITTLE endian
Key Value Metadata Store
There are 44 key-value pairs in this file
| POS | TYPE | Count | Key | Value |
|---|---|---|---|---|
| 1 | UINT32 | 1 | GGUF.version | 3 |
| 2 | UINT64 | 1 | GGUF.tensor_count | 197 |
| 3 | UINT64 | 1 | GGUF.kv_count | 41 |
| 4 | STRING | 1 | general.architecture | phi3 |
| 5 | STRING | 1 | general.type | model |
| 6 | STRING | 1 | general.name | Phi 3.5 Mini Instruct |
| 7 | STRING | 1 | general.finetune | instruct |
| 8 | STRING | 1 | general.basename | Phi-3.5 |
| 9 | STRING | 1 | general.size_label | mini |
| 10 | STRING | 1 | general.license | mit |
| 11 | STRING | 1 | general.license.link | https://huggingface.co/microso...-instruct/resolve/main/LICENSE |
| 12 | [STRING] | 3 | general.tags | [ nlp, code, text-generation ] |
| 13 | [STRING] | 1 | general.languages | [ multilingual ] |
| 14 | UINT32 | 1 | phi3.context_length | 131072 |
| 15 | UINT32 | 1 | phi3.rope.scaling.original_context_length | 4096 |
| 16 | UINT32 | 1 | phi3.embedding_length | 3072 |
| 17 | UINT32 | 1 | phi3.feed_forward_length | 8192 |
| 18 | UINT32 | 1 | phi3.block_count | 32 |
| 19 | UINT32 | 1 | phi3.attention.head_count | 32 |
| 20 | UINT32 | 1 | phi3.attention.head_count_kv | 32 |
| 21 | FLOAT32 | 1 | phi3.attention.layer_norm_rms_epsilon | 1e-05 |
| 22 | UINT32 | 1 | phi3.rope.dimension_count | 96 |
| 23 | FLOAT32 | 1 | phi3.rope.freq_base | 10000.0 |
| 24 | UINT32 | 1 | general.file_type | 18 |
| 25 | UINT32 | 1 | phi3.attention.sliding_window | 262144 |
| 26 | FLOAT32 | 1 | phi3.rope.scaling.attn_factor | 1.1902381 |
| 27 | STRING | 1 | tokenizer.ggml.model | llama |
| 28 | STRING | 1 | tokenizer.ggml.pre | default |
| 29 | [STRING] | 32064 | tokenizer.ggml.tokens | [ <unk>, <s>, </s>, <0x00>, <0x01>, ... ] |
| 30 | [FLOAT32] | 32064 | tokenizer.ggml.scores | [ -1000.0, -1000.0, -1000.0, 0.0, 0.0, 0.0, 0.0, ... ] |
| 31 | [INT32] | 32064 | tokenizer.ggml.token_type | [ 3, 3, 4, 6, 6, 6, 6, ... ] |
| 32 | UINT32 | 1 | tokenizer.ggml.bos_token_id | 1 |
| 33 | UINT32 | 1 | tokenizer.ggml.eos_token_id | 32000 |
| 34 | UINT32 | 1 | tokenizer.ggml.unknown_token_id | 0 |
| 35 | UINT32 | 1 | tokenizer.ggml.padding_token_id | 32000 |
| 36 | BOOL | 1 | tokenizer.ggml.add_bos_token | False |
| 37 | BOOL | 1 | tokenizer.ggml.add_eos_token | False |
| 38 | STRING | 1 | tokenizer.chat_template | {% for message in messages %}{...e %}{{ eos_token }}{% endif %} |
| 39 | UINT32 | 1 | general.quantization_version | 2 |
| 40 | STRING | 1 | quantize.imatrix.file | /models_out/Phi-3.5-mini-instr.../Phi-3.5-mini-instruct.imatrix |
| 41 | STRING | 1 | quantize.imatrix.dataset | /training_dir/calibration_datav3.txt |
| 42 | INT32 | 1 | quantize.imatrix.entries_count | 128 |
| 43 | INT32 | 1 | quantize.imatrix.chunks_count | 151 |
| 44 | BOOL | 1 | tokenizer.ggml.add_space_prefix | False |