Hugging Face's logo

LiteLLMs
/
Meta-Llama-3-8B-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
GGUF
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
4971f38
•
1 Parent(s): 911d46e

Upload folder using huggingface_hub

Browse files
Files changed (15) hide show
  1. Q2_K/Q2_K-00001-of-00001.gguf +2 -2
  2. Q3_K_L/Q3_K_L-00001-of-00001.gguf +2 -2
  3. Q3_K_M/Q3_K_M-00001-of-00001.gguf +2 -2
  4. Q3_K_S/Q3_K_S-00001-of-00001.gguf +2 -2
  5. Q4_0/Q4_0-00001-of-00001.gguf +2 -2
  6. Q4_1/Q4_1-00001-of-00001.gguf +2 -2
  7. Q4_K_M/Q4_K_M-00001-of-00001.gguf +2 -2
  8. Q4_K_S/Q4_K_S-00001-of-00001.gguf +2 -2
  9. Q5_0/Q5_0-00001-of-00001.gguf +2 -2
  10. Q5_1/Q5_1-00001-of-00001.gguf +2 -2
  11. Q5_K_M/Q5_K_M-00001-of-00001.gguf +2 -2
  12. Q5_K_S/Q5_K_S-00001-of-00001.gguf +2 -2
  13. Q6_K/Q6_K-00001-of-00001.gguf +2 -2
  14. Q8_0/Q8_0-00001-of-00001.gguf +2 -2
  15. README.md +2 -4
Q2_K/Q2_K-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:27c0211c64cf7a3e0f13e949251e6b8789cc91a879743cea6a8a75a676aec8ef
3
- size 3179644192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:497350313c67a1621ccc3397e0ef733f7c63d088a066262dac3a027d6c9f3c57
3
+ size 3179130816
Q3_K_L/Q3_K_L-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e045a4b851305ff848bc0cd31e675b74000f84095bc25ff77103f9ac053358f
3
- size 4322469152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ddd9e94e96c203d98104e041b86246be3b2ba1d007819200a4ce8996eeae271
3
+ size 4321955776
Q3_K_M/Q3_K_M-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6154339d5c381f6e413381226829547c192a0ca640b9e4fe5ba14b98a669034c
3
- size 4019430688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7c95863527fce5724e65415766e895d8777357416d18278e910ad8ee7678861
3
+ size 4018917312
Q3_K_S/Q3_K_S-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c117a949ac51b40fbca0871670b7f54dc6bcb3f720134e47233ebe3ac15cf9e
3
- size 3665012000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a7a396a0a92e1067cb076bddd0818a11189476ed4334ed8daaef851349c5faa
3
+ size 3664498624
Q4_0/Q4_0-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:90e26ee0fd2ecba94639d953c18f308ce76d2eb59411c3f09193d3c53b8fe28d
3
- size 4661724448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e13dd312757c23f1b6aff39964ed8376b7aaff3648bcf9c2ed0e1c9d624d74bf
3
+ size 4661211072
Q4_1/Q4_1-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fec087ab275cfe43e4d6556b89e56a82d92399021df260fb67377b7cc6739399
3
- size 5130765600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca718cf3a0eb1211a5f7cf86952035bd3b44c552ea46ed848d4843e8bf6e30a0
3
+ size 5130252224
Q4_K_M/Q4_K_M-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9dbf8e31a2f876104ab1f7beee1bca837af0f540bd5a79d140e535652f412292
3
- size 4921247008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:506af6cbc018df20d458c9400330a43c32cb0d23b6efdcfd76c28a39d01cf8d2
3
+ size 4920733632
Q4_K_S/Q4_K_S-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fdc9dae44de152180954c9619246fa9ab69f4ed6f0a8bdb97831b3e65854f67
3
- size 4693181728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8980e73ff8ea1bbf389060ba4a138b778189521ecdbc31b66595cadc9582ef8e
3
+ size 4692668352
Q5_0/Q5_0-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ae7a80426cc52f1c5345a293740e9f80f4c6fcc83ad113a26f37b7cd5051b28
3
- size 5599806752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e44e072d88a70c15a6b435be531d38984a345fac536d7547056fcf931d1d2786
3
+ size 5599293376
Q5_1/Q5_1-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2cab8c27e17610046920247b69963c4b0aaf387d67c2fd18553de7f85de57de2
3
- size 6068847904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa0f8ae6cafeeb2131bb70b114b861e3f34d8c2ccd4f0af3a15931e2e56d89a7
3
+ size 6068334528
Q5_K_M/Q5_K_M-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:daf1341cdbf62ca2564d1dc6bccd77525a92fb8c8bbee6d06be90b5602a2a02e
3
- size 5733500192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67cdacfbef27d17886352f3238609a5440f86b93de5464d960510a46f092d366
3
+ size 5732986816
Q5_K_S/Q5_K_S-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd8b909c4ce08d03680602781a3b15c9e703fe277997adf48fccdcbda08f6fdf
3
- size 5599806752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:907df17bd1c797765dd270dcc6e7b0d664bb2efa9f5d9909d4bf5a10bfcbd7c9
3
+ size 5599293376
Q6_K/Q6_K-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:44e526a6d1a624c1abb55a5c823881181309336066da049b98a9249d76a1a7c5
3
- size 6596519200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c44ff7b2cf17a189768866b6b778f20f7b31ef0536d3df4a23e0a053c469ec79
3
+ size 6596005824
Q8_0/Q8_0-00001-of-00001.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d77ce61aebb18f075a40b7fbebf9db75163b9048f6827b8f90a58e7ec3a9607d
3
- size 8541283616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f563da457fef91e42292a8ecad1af36b95df270bae2e57e288e50c5bf8efb016
3
+ size 8540770240
README.md CHANGED
@@ -3,7 +3,7 @@
3
  ---
4
  language:
5
  - en
6
- license: other
7
  tags:
8
  - facebook
9
  - meta
@@ -12,8 +12,6 @@ tags:
12
  - llama-3
13
  - GGUF
14
  pipeline_tag: text-generation
15
- license_name: llama3
16
- license_link: LICENSE
17
  extra_gated_prompt: "### META LLAMA 3 COMMUNITY LICENSE AGREEMENT\nMeta Llama 3 Version\
18
  \ Release Date: April 18, 2024\n\"Agreement\" means the terms and conditions for\
19
  \ use, reproduction, distribution and modification of the Llama Materials set forth\
@@ -546,7 +544,7 @@ For Hugging Face support, we recommend using transformers or TGI, but a similar
546
 
547
  **Overview** Llama 3 was pretrained on over 15 trillion tokens of data from publicly available sources. The fine-tuning data includes publicly available instruction datasets, as well as over 10M human-annotated examples. Neither the pretraining nor the fine-tuning datasets include Meta user data.
548
 
549
- **Data Freshness** The pretraining data has a cutoff of March 2023 for the 7B and December 2023 for the 70B models respectively.
550
 
551
 
552
  ## Benchmarks
 
3
  ---
4
  language:
5
  - en
6
+ license: llama3
7
  tags:
8
  - facebook
9
  - meta
 
12
  - llama-3
13
  - GGUF
14
  pipeline_tag: text-generation
 
 
15
  extra_gated_prompt: "### META LLAMA 3 COMMUNITY LICENSE AGREEMENT\nMeta Llama 3 Version\
16
  \ Release Date: April 18, 2024\n\"Agreement\" means the terms and conditions for\
17
  \ use, reproduction, distribution and modification of the Llama Materials set forth\
 
544
 
545
  **Overview** Llama 3 was pretrained on over 15 trillion tokens of data from publicly available sources. The fine-tuning data includes publicly available instruction datasets, as well as over 10M human-annotated examples. Neither the pretraining nor the fine-tuning datasets include Meta user data.
546
 
547
+ **Data Freshness** The pretraining data has a cutoff of March 2023 for the 8B and December 2023 for the 70B models respectively.
548
 
549
 
550
  ## Benchmarks