Hugging Face's logo

MaziyarPanahi
/
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
7b
lazymergekit
mistralai/Mistral-7B-Instruct-v0.2
arjunssat/rfp_instruct_model
Inference Endpoints
text-generation-inference
Model card Files Community
MaziyarPanahi commited on
Commit
a6c641e
•
1 Parent(s): 1730d7d

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q2_K.gguf +2 -2
  2. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q3_K_L.gguf +2 -2
  3. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q3_K_M.gguf +2 -2
  4. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q3_K_S.gguf +2 -2
  5. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q4_K_M.gguf +2 -2
  6. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q4_K_S.gguf +2 -2
  7. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q5_K_M.gguf +2 -2
  8. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q5_K_S.gguf +2 -2
  9. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q6_K.gguf +2 -2
  10. rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q8_0.gguf +2 -2
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7bdef40a49071fc0faf344c7978a80eb8ccb7922fa6fbdf0f701c8cdabae9092
3
- size 2720050752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4efc82493d95ac61992aee24d73af98370ddb011e9599442a55f3a0f3353cb4
3
+ size 2719242432
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03887704a755d2f7fcb91112aca12d1ad1189d090dd1bef3c14b4951ed860115
3
- size 3822833216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f084b48530759c1573d4bd1f8a321464fc1e0d587d2243c1f14d6acd52b3aa6b
3
+ size 3822024896
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c926f1c72e5abbb64504efa2ebe9fcda6f8ff65d30c7e600464a927a9d63fa43
3
- size 3519794752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48af7455cf8c7f360325cf8782459fd0019a3f889e82342071c1672428405a11
3
+ size 3518986432
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:53e95d25d7ef632c9bafe18c25212cba23f37cb743d1f750251913a4dcc799f5
3
- size 3165376064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49264fd801ff96abf958dd938bdae51ceba437027af04a604b77ce07576a693d
3
+ size 3164567744
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b026fed17a18c4ba35432a1ee02aa11e2996cde51a1a49b4f1b068b20131ff11
3
- size 4369247808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:baad8e27585449254894a58595d7b97b1d97ac8f75130f96e42ffdf2d833193c
3
+ size 4368439488
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0508f7227884720d2826ab85b93243647538c513b775d8b71c5d6e5af089bf48
3
- size 4141182528
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e7efda6aa1546864b1524037df06c022343dcc915c377e0b3a5d96203d75a9d
3
+ size 4140374208
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:710523debeeeff46baa5aa503c5f2b407e9b9beeb5763ca64114e1b860537cc7
3
- size 5132217920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efb41c271eda457a0484f1a71523ed7704f4328f3f1322114079107460379119
3
+ size 5131409600
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a96f813e5901db440b00fe0c78f17bc9ce87f90de652f8b4520d052b812c027
3
- size 4998524480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97f296db76b4164a8927936bbae8faa13cc856e7610b3af80e9de038e06681a8
3
+ size 4997716160
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:45fedea1d887e3cd8381276e13ffe58a084ece031bebf087be3871ebaa7c3b83
3
- size 5942873664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9411ba103ebb5f175a2faccc59e464a6d86dbbfa01090a092034c7bdaed0fa4f
3
+ size 5942065344
rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d6111c95a1b1f718dd57d4c6f5297648b914ae56f8cf356a11be028690cd29ab
3
- size 7696666176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7428cd2881a750f669b72524cf220eaaa6389a307a5f56188b1a6c8fe8d7414
3
+ size 7695857856