File size: 6,746 Bytes
d4b0de3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
# Phi-3.5-mini-instruct.Q6_K.gguf - GGUF Internal File Dump
- Endian: LITTLE endian
## Key Value Metadata Store
There are 44 key-value pairs in this file
| POS | TYPE | Count | Key | Value |
|----:|:----------|------:|:------------------------------------------|:--------------------------------------------------------------------|
| 1 | UINT32 | 1 | GGUF.version | 3 |
| 2 | UINT64 | 1 | GGUF.tensor_count | 197 |
| 3 | UINT64 | 1 | GGUF.kv_count | 41 |
| 4 | STRING | 1 | general.architecture | `phi3` |
| 5 | STRING | 1 | general.type | `model` |
| 6 | STRING | 1 | general.name | `Phi 3.5 Mini Instruct` |
| 7 | STRING | 1 | general.finetune | `instruct` |
| 8 | STRING | 1 | general.basename | `Phi-3.5` |
| 9 | STRING | 1 | general.size_label | `mini` |
| 10 | STRING | 1 | general.license | `mit` |
| 11 | STRING | 1 | general.license.link | `https://huggingface.co/microso`...`-instruct/resolve/main/LICENSE` |
| 12 | [STRING] | 3 | general.tags | [ `nlp`, `code`, `text-generation` ] |
| 13 | [STRING] | 1 | general.languages | [ `multilingual` ] |
| 14 | UINT32 | 1 | phi3.context_length | 131072 |
| 15 | UINT32 | 1 | phi3.rope.scaling.original_context_length | 4096 |
| 16 | UINT32 | 1 | phi3.embedding_length | 3072 |
| 17 | UINT32 | 1 | phi3.feed_forward_length | 8192 |
| 18 | UINT32 | 1 | phi3.block_count | 32 |
| 19 | UINT32 | 1 | phi3.attention.head_count | 32 |
| 20 | UINT32 | 1 | phi3.attention.head_count_kv | 32 |
| 21 | FLOAT32 | 1 | phi3.attention.layer_norm_rms_epsilon | 1e-05 |
| 22 | UINT32 | 1 | phi3.rope.dimension_count | 96 |
| 23 | FLOAT32 | 1 | phi3.rope.freq_base | 10000.0 |
| 24 | UINT32 | 1 | general.file_type | 18 |
| 25 | UINT32 | 1 | phi3.attention.sliding_window | 262144 |
| 26 | FLOAT32 | 1 | phi3.rope.scaling.attn_factor | 1.1902381 |
| 27 | STRING | 1 | tokenizer.ggml.model | `llama` |
| 28 | STRING | 1 | tokenizer.ggml.pre | `default` |
| 29 | [STRING] | 32064 | tokenizer.ggml.tokens | [ `<unk>`, `<s>`, `</s>`, `<0x00>`, `<0x01>`, ... ] |
| 30 | [FLOAT32] | 32064 | tokenizer.ggml.scores | [ -1000.0, -1000.0, -1000.0, 0.0, 0.0, 0.0, 0.0, ... ] |
| 31 | [INT32] | 32064 | tokenizer.ggml.token_type | [ 3, 3, 4, 6, 6, 6, 6, ... ] |
| 32 | UINT32 | 1 | tokenizer.ggml.bos_token_id | 1 |
| 33 | UINT32 | 1 | tokenizer.ggml.eos_token_id | 32000 |
| 34 | UINT32 | 1 | tokenizer.ggml.unknown_token_id | 0 |
| 35 | UINT32 | 1 | tokenizer.ggml.padding_token_id | 32000 |
| 36 | BOOL | 1 | tokenizer.ggml.add_bos_token | False |
| 37 | BOOL | 1 | tokenizer.ggml.add_eos_token | False |
| 38 | STRING | 1 | tokenizer.chat_template | `{% for message in messages %}{`...`e %}{{ eos_token }}{% endif %}` |
| 39 | UINT32 | 1 | general.quantization_version | 2 |
| 40 | STRING | 1 | quantize.imatrix.file | `/models_out/Phi-3.5-mini-instr`...`/Phi-3.5-mini-instruct.imatrix` |
| 41 | STRING | 1 | quantize.imatrix.dataset | `/training_dir/calibration_datav3.txt` |
| 42 | INT32 | 1 | quantize.imatrix.entries_count | 128 |
| 43 | INT32 | 1 | quantize.imatrix.chunks_count | 151 |
| 44 | BOOL | 1 | tokenizer.ggml.add_space_prefix | False |
|