Hugging Face's logo
Arka Pal's picture
27 1

Arka Pal

ArkaAbacus
sreemanti-abacus's profile picture CharlieJi's profile picture Pent's profile picture
·

AI & ML interests

None yet

Organizations

Abacus.AI, Inc.'s profile picture LiveBench's profile picture

ArkaAbacus's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 24 days ago

Models disappearing from eval queue?

7
#805 opened 25 days ago by ArkaAbacus
New activity in abacusai/Llama-3-Smaug-8B 26 days ago

Any news about the updated model with the latest recipe?

2
#5 opened about 1 month ago by ManniX-ITA
New activity in open-llm-leaderboard/open_llm_leaderboard about 2 months ago

GSM8K Evaluation has a serious bug/oversight, that is negatively impacting score of all Llama 3 models. Please consider updating to the latest commit of lm-evaluation-harness which fixes it.

3
#770 opened about 2 months ago by ArkaAbacus
New activity in abacusai/Smaug-Llama-3-70B-Instruct 2 months ago

Smaug-LLaMa-3-8B-Instruct in the works?

4
#3 opened 2 months ago by Joseph717171

Use correct license - llama3 instead of llama2

1
#1 opened 2 months ago by ddh0

Prompt format?

1
#2 opened 2 months ago by ddh0
New activity in abacusai/Llama-3-Giraffe-70B 3 months ago

base model

3
#2 opened 3 months ago by ehartford

prompt? llama-3?

1
#1 opened 3 months ago by bdambrosio
New activity in abacusai/Llama-3-Smaug-8B 3 months ago

What datasets were these trained on?

5
#2 opened 3 months ago by rombodawg
New activity in meta-llama/Meta-Llama-3-70B-Instruct 3 months ago

Fix chat template to add generation prompt only if the option is selected

1
#6 opened 3 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected.
#4 opened 3 months ago by ArkaAbacus
New activity in meta-llama/Meta-Llama-3-8B-Instruct 3 months ago

Fix chat template to add generation prompt only if the option is selected

1
#9 opened 3 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected
#8 opened 3 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected
#7 opened 3 months ago by ArkaAbacus

Fix chat template to add generation prompt only if the option is selected
#6 opened 3 months ago by ArkaAbacus
New activity in mistralai/Mixtral-8x22B-Instruct-v0.1 3 months ago

Isn't it necessary to also include tokenizer.model?

2
#14 opened 3 months ago by ArkaAbacus
New activity in abacusai/Smaug-72B-v0.1 3 months ago

aaa

1
#25 opened 4 months ago by liyon
New activity in abacusai/Smaug-2-72B 4 months ago

What is this?

1
#1 opened 4 months ago by bdambrosio
New activity in DIBT/10k_prompts_ranked 5 months ago

Dataset error on generation

2
#8 opened 5 months ago by ArkaAbacus
New activity in abacusai/ARC_DPO_FewShot 5 months ago

Unexpected error in the dataset!

1
#1 opened 5 months ago by rbgo
New activity in abacusai/HellaSwag_DPO_FewShot 5 months ago

Some unexpected error in the dataset!

2
#1 opened 5 months ago by rbgo
New activity in abacusai/Smaug-72B-v0.1 5 months ago

Questions about architecture (+ LoRA)

2
#16 opened 5 months ago by alex0dd

which chat template should we use?

4
#6 opened 6 months ago by wyxwangmed

Smaug - Japanese Language Support

2
#11 opened 6 months ago by msmmpts
New activity in abacusai/Smaug-34B-v0.1 6 months ago

The model card is wrong base_model

8
#3 opened 6 months ago by fblgit

License

2
#5 opened 6 months ago by mrfakename