Hugging Face's logo

ModelCloud
/
Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
70b
instruct
conversational
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
5
lrl-modelcloud commited on
Commit
018dd33
•
1 Parent(s): 9c6ed3a

Upload folder using huggingface_hub (#3)

Browse files

- c96fede7e9af41a6e05b8ee202722dce78243e718c3d1b690b4393882c6d85ad (374a278a9fc863566347f845bae38da95f21b879)
- fc87ee2ae958152555ab95c2ab3b486c9a16bae02a94d88e8d57b74aea3397fb (c1ed0d8116ac7c71ab4b37f618afba01477b007e)
- af7d83b6ac5a2f056a02ebeb16cf13b3b25aac0321f219ea440b47edd5dd789b (825a9b3049b0881c332d6b5b74bb0d4cb7389b20)
- 9fdaf7886ea8363c461984b3b0c81789979ea645d68bd0b2e6e17ca0f21977ee (515a64e6200831bf856a6a9aaa603bb4242a9f71)
- 8f295ca2fda5e5e97ba870aff29f94bcd685c06df423a5a8e4f15aa348b2127e (ec75d1526d69429c0f043793c6a44fd3c1080bc3)
- e2fdf3bdaff355d62567fd6ca57fd52b1de330b0c898b2d65307925fcf488899 (3385679fd486fce6a1ed1b4401a4cf07b48719e9)

Files changed (6) hide show
  1. config.json +1 -1
  2. model-00001-of-00005.safetensors +1 -1
  3. model-00002-of-00005.safetensors +1 -1
  4. model-00003-of-00005.safetensors +1 -1
  5. model-00004-of-00005.safetensors +1 -1
  6. model-00005-of-00005.safetensors +1 -1
config.json CHANGED
@@ -53,4 +53,4 @@
53
  "transformers_version": "4.44.0.dev0",
54
  "use_cache": true,
55
  "vocab_size": 128256
56
- }
 
53
  "transformers_version": "4.44.0.dev0",
54
  "use_cache": true,
55
  "vocab_size": 128256
56
+ }
model-00001-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:07ca4a8c4c8be908d5b9c05a0f4d0f64b9c66c5eb2969b4b48bdb3ccaa3944f0
3
  size 7963341608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a7d5fd94998b50215392a4ffe20faf977524cc9e38775e016961b9cf1803d6c
3
  size 7963341608
model-00002-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:859e4966fd249d0ab6302cf94011728a1bb7d9dd38a7197bdc369c6b260db83f
3
  size 7972908440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e503008164d2b9ec4078a0ed9cfe7b72091fc623d25cabfa0262f395df159b6
3
  size 7972908440
model-00003-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e46ee3feddbdc7fbc81ef444b54a0db18d56d56ad2c830bdd4c292af911eded
3
  size 7999024080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98e78c2bcb0f40c114fcaee50687160e394fefe08b3f3097184d3e789b7caa6a
3
  size 7999024080
model-00004-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee1d18c286774c698c87c515ac471bb091c63016179700ce7f9598a2a7724513
3
  size 7972908424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05f2d33634ba440c4551528bcd1bf79103295038e686f07661ba5556fe90e232
3
  size 7972908424
model-00005-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:730c1c7fea6fd160a7a65dd3968cd0cec60a7e9c9e94a93dbba245a4b02ade30
3
  size 7884778880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc8ba4dc3adf401025754a6efb7fc47afb7bc920bee3162bbc5309858cc0bb38
3
  size 7884778880