xldistance's picture

18 15

xldistance

xldistance

AI & ML interests

None yet

Organizations

None yet

xldistance's activity

New activity in THUDM/glm-4-9b-chat-1m about 2 months ago

Can you quantify this model in exl2?

#7 opened about 2 months ago by

New activity in saltlux/luxia-21.4b-alignment-v1.0 4 months ago

Can you provide the EXL2 quantitative model?

#1 opened 4 months ago by

New activity in zhengr/MixTAO-7Bx2-MoE-v8.1 5 months ago

Create GGUF for this please

#2 opened 5 months ago by

New activity in cloudyu/TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16 5 months ago

Can you produce a 2.4bpw exl2 quantisation of this model?

#2 opened 5 months ago by

New activity in abacusai/Smaug-34B-v0.1 6 months ago

Can you quantify the model?

#1 opened 6 months ago by

New activity in cloudyu/Truthful_DPO_TomGrc_FusionNet_34Bx2_MoE 6 months ago

Can you make a 2.4bpw exl2 quantisation for this model?

#1 opened 6 months ago by

New activity in TomGrc/FusionNet_34Bx2_MoE 6 months ago

Can you make a fusionnet 34b moe model, 24gb of video memory is too much of a strain to run a 34BX2 model

#1 opened 6 months ago by

New activity in yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B 6 months ago

GGUF Version?

#1 opened 6 months ago by

New activity in JackCloudman/MoMo-70B-lora-1.8.6-DPO-exl2-3.4bpw 6 months ago

Can you quantize this model to 2.4 bpw?

#2 opened 6 months ago by

New activity in moreh/MoMo-72B-lora-1.8.6-DPO 6 months ago

Can you do a 2.0bpw quantization model?

#4 opened 6 months ago by

maximum context length

#3 opened 6 months ago by

New activity in LoneStriker/Mixtral_34Bx2_MoE_60B-3.0bpw-h6-exl2 6 months ago

Can you make a 2.4bpw quantization?

#1 opened 7 months ago by

New activity in one-man-army/UNA-34Beagles-32K-bf16-v1 6 months ago

Can you quantify this model?

#1 opened 6 months ago by

New activity in LoneStriker/Mixtral_34Bx2_MoE_60B-2.4bpw-h6-exl2 6 months ago

2.4bpw quantitative modeling can have broken or non-responsive responses

#1 opened 6 months ago by

New activity in LoneStriker/Mixtral_34Bx2_MoE_60B-2.65bpw-h6-exl2 7 months ago

Can you make a 2.4bpw quantization?

#1 opened 7 months ago by

New activity in keyfan/Qwen-72B-Chat-2bit 7 months ago

Is there a big performance difference between 2bit quantization and 4bit quantization conversations?

#2 opened 7 months ago by

New activity in brucethemoose/CaPlatTessDolXaBoros-34B-200K-exl2-4bpw-fiction 7 months ago

The model often answers the question over and over again with no overflow of video memory

#2 opened 7 months ago by

New activity in brucethemoose/Yi-34B-200K-DARE-merge-v5 7 months ago

4090 Graphics Card 24gb Video Memory Not Enough

#2 opened 7 months ago by