01-ai
/

Yi-1.5-34B-Chat-16K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

会出量化版本吗?

#3

by william0014 - opened Jun 6

Jun 6

请问你们会出AWQ或者GPTQ-INT4版本吗?

lorinma

01-ai org Jun 12

你好，魔搭已经提供啦，可以在这里找到 https://www.modelscope.cn/models/AI-ModelScope/Yi-1.5-34B-Chat-GPTQ/summary

lorinma changed discussion status to closed Jun 12

YShow

Jun 12

16k的这里也有 https://modelscope.cn/models/tclf90/Yi-1.5-34B-Chat-16K-GPTQ-Int4/summary

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment