| # Codestral-22B-v0.1.Q6_K.gguf - GGUF Internal File Dump | |
| - Endian: LITTLE endian | |
| ## Key Value Metadata Store | |
| There are 28 key-value pairs in this file | |
| | POS | TYPE | Count | Key | Value | | |
| |----:|:----------|------:|:---------------------------------------|:-----------------------------------------------------| | |
| | 1 | UINT32 | 1 | GGUF.version | 3 | | |
| | 2 | UINT64 | 1 | GGUF.tensor_count | 507 | | |
| | 3 | UINT64 | 1 | GGUF.kv_count | 25 | | |
| | 4 | STRING | 1 | general.architecture | `llama` | | |
| | 5 | STRING | 1 | general.name | `Codestral-22B-v0.1-hf-FIM-fix` | | |
| | 6 | UINT32 | 1 | llama.block_count | 56 | | |
| | 7 | UINT32 | 1 | llama.context_length | 32768 | | |
| | 8 | UINT32 | 1 | llama.embedding_length | 6144 | | |
| | 9 | UINT32 | 1 | llama.feed_forward_length | 16384 | | |
| | 10 | UINT32 | 1 | llama.attention.head_count | 48 | | |
| | 11 | UINT32 | 1 | llama.attention.head_count_kv | 8 | | |
| | 12 | FLOAT32 | 1 | llama.rope.freq_base | 1000000.0 | | |
| | 13 | FLOAT32 | 1 | llama.attention.layer_norm_rms_epsilon | 1e-05 | | |
| | 14 | UINT32 | 1 | general.file_type | 18 | | |
| | 15 | UINT32 | 1 | llama.vocab_size | 32768 | | |
| | 16 | UINT32 | 1 | llama.rope.dimension_count | 128 | | |
| | 17 | BOOL | 1 | tokenizer.ggml.add_space_prefix | False | | |
| | 18 | STRING | 1 | tokenizer.ggml.model | `llama` | | |
| | 19 | STRING | 1 | tokenizer.ggml.pre | `default` | | |
| | 20 | [STRING] | 32768 | tokenizer.ggml.tokens | [ `<unk>`, `<s>`, `</s>`, `[INST]`, `[/INST]`, ... ] | | |
| | 21 | [FLOAT32] | 32768 | tokenizer.ggml.scores | [ 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, ... ] | | |
| | 22 | [INT32] | 32768 | tokenizer.ggml.token_type | [ 2, 3, 3, 3, 3, 3, 3, ... ] | | |
| | 23 | UINT32 | 1 | tokenizer.ggml.bos_token_id | 1 | | |
| | 24 | UINT32 | 1 | tokenizer.ggml.eos_token_id | 2 | | |
| | 25 | UINT32 | 1 | tokenizer.ggml.unknown_token_id | 0 | | |
| | 26 | BOOL | 1 | tokenizer.ggml.add_bos_token | True | | |
| | 27 | BOOL | 1 | tokenizer.ggml.add_eos_token | False | | |
| | 28 | UINT32 | 1 | general.quantization_version | 2 | | |