Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
EXL2 6.5BPW Quant of BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B
- Downloads last month
- 0
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.