Hugging Face's logo
Andrei Panferov's picture
30 2 3

Andrei Panferov

BlackSamorez
vgoklani's profile picture Marlinski's profile picture cnmoro's profile picture
·

AI & ML interests

NLP

Recent Activity

updated a collection 15 days ago
HIGGS
updated a model 27 days ago
daslab-testing/Llama-3.3-70B-Instruct-GPTQ-4bit
updated a model 28 days ago
ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit
View all activity

Organizations

IST Austria Distributed Algorithms and Systems Lab's profile picture ISTA DASLab Testing Account's profile picture

BlackSamorez's activity

New activity in ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-4bit about 1 month ago

how do you load it?

3
#1 opened about 1 month ago by
KnutJaegersberg
New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 7 months ago

Repetitive generation without additional EOS token

2
#5 opened 7 months ago by
amrothemich
New activity in ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-1x16-hf 7 months ago

Create model card
#1 opened 7 months ago by
justheuristic
New activity in Intel/low_bit_open_llm_leaderboard 8 months ago

Add support for AQLM

3
#1 opened 8 months ago by
BlackSamorez
New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 8 months ago

~8 tok/sec with ~5k context on vLLM with Flash Attention and `kv_cache_dtype="fp8"` on 3090TI 24GB VRAM

2
#2 opened 8 months ago by
ubergarm
New activity in ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16 8 months ago

Update tokenizer_config.json
#2 opened 8 months ago by
BlackSamorez
New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 8 months ago

Update tokenizer_config.json
#1 opened 8 months ago by
BlackSamorez
New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 10 months ago

ZN2at4_ops15sum_IntList_out4callERKNS_6TensorEN3c1016OptionalArrayRefIlEEbSt8optionalINS5_10ScalarTypeEERS2

9
#3 opened 10 months ago by
LaferriereJC
New activity in ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf 10 months ago

Update README.md

1
#2 opened 10 months ago by
SpiridonSunRotator

Updated model description and added evaluation metrics.

1
#1 opened 10 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf 10 months ago

Updated description and the metrics
#1 opened 10 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf 10 months ago

Update README.md
#6 opened 10 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf 10 months ago

Updated 13b model.
#1 opened 10 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf 10 months ago

Upgrade format of this model?

2
#2 opened 10 months ago by
jaemzfleming
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf 11 months ago

Update README.md
#1 opened 11 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf 11 months ago

Upload finetuned Llama-2-7b models

1
#1 opened 11 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf 11 months ago

Upload finetuned Llama-2-7b models

1
#1 opened 11 months ago by
SpiridonSunRotator
New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 11 months ago

Loading Error: BlackSamorez/Mixtral-8x7B-Instruct-v0.1-AQLM-2Bit-1x16-hf Model in Colab

5
#2 opened 11 months ago by
lxyuan
New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf 11 months ago

Endpoint encountered an error

2
#5 opened 11 months ago by
vanokio
New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 11 months ago

Update README.md
#1 opened 11 months ago by
SpiridonSunRotator