Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
hugging-quants
/
Meta-Llama-3.1-70B-Instruct-GPTQ-INT4
like
22
Follow
Hugging Quants
151
Text Generation
Transformers
Safetensors
8 languages
llama
llama-3.1
meta
autogptq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
License:
llama3.1
Model card
Files
Files and versions
Community
7
Train
Deploy
Use this model
Update the rope scaling settings for GPTQ model
#5
by
lanking
- opened
Aug 6, 2024
base:
refs/heads/main
←
from:
refs/pr/5
Discussion
Files changed
+7
-1
lanking
Aug 6, 2024
No description provided.
Update the rope scaling settings for GPTQ model
f8af7ce4
alvarobartt
changed pull request status to
merged
Aug 6, 2024
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
