Hugging Face's logo
casperhansen's picture
19 4

casperhansen

casperhansen
ctranslate2-4you's profile picture gpt3eth's profile picture tauven's profile picture
·

AI & ML interests

None yet

Organizations

Qwen's profile picture

casperhansen's activity

New activity in casperhansen/mistral-nemo-instruct-2407-awq 10 days ago

Create README.md
#3 opened 25 days ago by cfahlgren1
New activity in casperhansen/deepseek-coder-v2-instruct-awq 3 months ago

Original model perplexity

1
#1 opened 3 months ago by jacobpfau
New activity in casperhansen/llama-3-8b-instruct-awq 4 months ago

update eos token
#6 opened 4 months ago by Praful932
New activity in casperhansen/llama-3-70b-instruct-awq 6 months ago

encountered error when loading model

7
#4 opened 6 months ago by zhouzr

How did you create AWQ-quantized weights?

4
#5 opened 6 months ago by nightdude

Infinity conversation, sould eos be <|eot_id|> ?

4
#1 opened 6 months ago by Komposter43

Update generation_config.json
#3 opened 6 months ago by alugowski
New activity in casperhansen/llama-3-8b-instruct-awq 6 months ago

Create quant_config.json

1
#1 opened 6 months ago by Suparious
New activity in casperhansen/llama-3-70b-instruct-awq 6 months ago

Update generation_config.json
#2 opened 6 months ago by hmellor
New activity in TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ 8 months ago

always getting 0 in output

15
#3 opened 9 months ago by xubuild

Not supporting with TGI

1
#4 opened 9 months ago by abhishek3jangid

OC is not a multiple of cta_N = 64

2
#5 opened 9 months ago by lazyDataScientist

TGI - response is an empty string

2
#6 opened 8 months ago by p-christ

RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

2
#7 opened 8 months ago by aaganaie
New activity in Deci/DeciLM-7B-instruct 10 months ago

Add model_type to config.json

1
#2 opened 10 months ago by casperhansen
New activity in TheBloke/zephyr-7B-beta-AWQ 11 months ago

Is there a way to finetune these AWQ beasts?

4
#1 opened 11 months ago by yasmolin
New activity in TheBloke/Mistral-7B-Instruct-v0.1-AWQ about 1 year ago

KeyError: 'mistral'

14
#1 opened about 1 year ago by tripathiarpan20
New activity in mistralai/Mistral-7B-v0.1 about 1 year ago

Add Apache 2.0 license
#3 opened about 1 year ago by casperhansen

Apache 2.0 License

1
#2 opened about 1 year ago by casperhansen