bconsolvo
/

neural-chat-7b-quantized

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

neural-chat-7b-quantized

1 contributor

History: 3 commits

bconsolvo's picture

Create config.json

7019fed about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

28 Bytes

initial commit about 1 year ago
config.json

1.44 kB

Create config.json about 1 year ago
neural-chat-7b-quantized.pt
Detected Pickle imports (10)
- "__torch__.intel_extension_for_pytorch.quantization._quantize_utils.___torch_mangle_4686.QuantizationDispatchModule",
- "torch.per_channel_affine",
- "torch.BFloat16Storage",
- "torch.DoubleStorage",
- "torch._utils._rebuild_qtensor",
- "torch.QInt8Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.LongStorage"
How to fix it?
6.87 GB
LFS

Upload neural-chat-7b-quantized.pt about 1 year ago