# Phi-3.5-mini-instruct.Q6_K.gguf - GGUF Internal File Dump

- Endian: LITTLE endian

## Key Value Metadata Store

There are 44 key-value pairs in this file

| POS | TYPE      | Count | Key                                       | Value                                                               |
|----:|:----------|------:|:------------------------------------------|:--------------------------------------------------------------------|
|   1 | UINT32    |     1 | GGUF.version                              | 3                                                                   |
|   2 | UINT64    |     1 | GGUF.tensor_count                         | 197                                                                 |
|   3 | UINT64    |     1 | GGUF.kv_count                             | 41                                                                  |
|   4 | STRING    |     1 | general.architecture                      | `phi3`                                                              |
|   5 | STRING    |     1 | general.type                              | `model`                                                             |
|   6 | STRING    |     1 | general.name                              | `Phi 3.5 Mini Instruct`                                             |
|   7 | STRING    |     1 | general.finetune                          | `instruct`                                                          |
|   8 | STRING    |     1 | general.basename                          | `Phi-3.5`                                                           |
|   9 | STRING    |     1 | general.size_label                        | `mini`                                                              |
|  10 | STRING    |     1 | general.license                           | `mit`                                                               |
|  11 | STRING    |     1 | general.license.link                      | `https://huggingface.co/microso`...`-instruct/resolve/main/LICENSE` |
|  12 | [STRING]  |     3 | general.tags                              | [ `nlp`, `code`, `text-generation` ]                                |
|  13 | [STRING]  |     1 | general.languages                         | [ `multilingual` ]                                                  |
|  14 | UINT32    |     1 | phi3.context_length                       | 131072                                                              |
|  15 | UINT32    |     1 | phi3.rope.scaling.original_context_length | 4096                                                                |
|  16 | UINT32    |     1 | phi3.embedding_length                     | 3072                                                                |
|  17 | UINT32    |     1 | phi3.feed_forward_length                  | 8192                                                                |
|  18 | UINT32    |     1 | phi3.block_count                          | 32                                                                  |
|  19 | UINT32    |     1 | phi3.attention.head_count                 | 32                                                                  |
|  20 | UINT32    |     1 | phi3.attention.head_count_kv              | 32                                                                  |
|  21 | FLOAT32   |     1 | phi3.attention.layer_norm_rms_epsilon     | 1e-05                                                               |
|  22 | UINT32    |     1 | phi3.rope.dimension_count                 | 96                                                                  |
|  23 | FLOAT32   |     1 | phi3.rope.freq_base                       | 10000.0                                                             |
|  24 | UINT32    |     1 | general.file_type                         | 18                                                                  |
|  25 | UINT32    |     1 | phi3.attention.sliding_window             | 262144                                                              |
|  26 | FLOAT32   |     1 | phi3.rope.scaling.attn_factor             | 1.1902381                                                           |
|  27 | STRING    |     1 | tokenizer.ggml.model                      | `llama`                                                             |
|  28 | STRING    |     1 | tokenizer.ggml.pre                        | `default`                                                           |
|  29 | [STRING]  | 32064 | tokenizer.ggml.tokens                     | [ `<unk>`, `<s>`, `</s>`, `<0x00>`, `<0x01>`, ... ]                 |
|  30 | [FLOAT32] | 32064 | tokenizer.ggml.scores                     | [ -1000.0, -1000.0, -1000.0, 0.0, 0.0, 0.0, 0.0, ... ]              |
|  31 | [INT32]   | 32064 | tokenizer.ggml.token_type                 | [ 3, 3, 4, 6, 6, 6, 6, ... ]                                        |
|  32 | UINT32    |     1 | tokenizer.ggml.bos_token_id               | 1                                                                   |
|  33 | UINT32    |     1 | tokenizer.ggml.eos_token_id               | 32000                                                               |
|  34 | UINT32    |     1 | tokenizer.ggml.unknown_token_id           | 0                                                                   |
|  35 | UINT32    |     1 | tokenizer.ggml.padding_token_id           | 32000                                                               |
|  36 | BOOL      |     1 | tokenizer.ggml.add_bos_token              | False                                                               |
|  37 | BOOL      |     1 | tokenizer.ggml.add_eos_token              | False                                                               |
|  38 | STRING    |     1 | tokenizer.chat_template                   | `{% for message in messages %}{`...`e %}{{ eos_token }}{% endif %}` |
|  39 | UINT32    |     1 | general.quantization_version              | 2                                                                   |
|  40 | STRING    |     1 | quantize.imatrix.file                     | `/models_out/Phi-3.5-mini-instr`...`/Phi-3.5-mini-instruct.imatrix` |
|  41 | STRING    |     1 | quantize.imatrix.dataset                  | `/training_dir/calibration_datav3.txt`                              |
|  42 | INT32     |     1 | quantize.imatrix.entries_count            | 128                                                                 |
|  43 | INT32     |     1 | quantize.imatrix.chunks_count             | 151                                                                 |
|  44 | BOOL      |     1 | tokenizer.ggml.add_space_prefix           | False                                                               |