Arka Pal's picture

27 1

Arka Pal

ArkaAbacus

·

ArkaPal999

AI & ML interests

None yet

Organizations

ArkaAbacus's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

Models disappearing from eval queue?

#805 opened 7 months ago by

New activity in abacusai/Llama-3-Smaug-8B 7 months ago

Any news about the updated model with the latest recipe?

#5 opened 7 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 7 months ago

GSM8K Evaluation has a serious bug/oversight, that is negatively impacting score of all Llama 3 models. Please consider updating to the latest commit of lm-evaluation-harness which fixes it.

#770 opened 7 months ago by

New activity in abacusai/Smaug-Llama-3-70B-Instruct 8 months ago

Smaug-LLaMa-3-8B-Instruct in the works?

#3 opened 8 months ago by

Use correct license - llama3 instead of llama2

#1 opened 8 months ago by

Prompt format?

#2 opened 8 months ago by

New activity in abacusai/Llama-3-Giraffe-70B 8 months ago

base model

#2 opened 8 months ago by

prompt? llama-3?

#1 opened 8 months ago by

New activity in abacusai/Llama-3-Smaug-8B 9 months ago

What datasets were these trained on?

#2 opened 9 months ago by

New activity in meta-llama/Meta-Llama-3-70B-Instruct 9 months ago

Fix chat template to add generation prompt only if the option is selected

#6 opened 9 months ago by

Fix chat template to add generation prompt only if the option is selected.

#4 opened 9 months ago by

New activity in meta-llama/Meta-Llama-3-8B-Instruct 9 months ago

Fix chat template to add generation prompt only if the option is selected

#9 opened 9 months ago by

Fix chat template to add generation prompt only if the option is selected

#8 opened 9 months ago by

Fix chat template to add generation prompt only if the option is selected

#7 opened 9 months ago by

Fix chat template to add generation prompt only if the option is selected

#6 opened 9 months ago by

New activity in mistralai/Mixtral-8x22B-Instruct-v0.1 9 months ago

Isn't it necessary to also include tokenizer.model?

#14 opened 9 months ago by

New activity in abacusai/Smaug-72B-v0.1 9 months ago

aaa

#25 opened 10 months ago by

New activity in abacusai/Smaug-2-72B 9 months ago

What is this?

#1 opened 9 months ago by

New activity in data-is-better-together/10k_prompts_ranked 11 months ago

Dataset error on generation

#8 opened 11 months ago by

New activity in abacusai/ARC_DPO_FewShot 11 months ago

Unexpected error in the dataset!

#1 opened 11 months ago by