OpenVINO/phi-2-fp16-ov
Text Generation
•
Updated
•
17
LLM
Collection of OpenVINO optimized LLMs
-
-
OpenVINO/phi-2-int8-ov
Text Generation • Updated • 120 -
OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation • Updated • 6 -
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation • Updated • 3 -
OpenVINO/codegen25-7b-multi-fp16-ov
Text Generation • Updated • 5 -
OpenVINO/codegen25-7b-multi-int8-ov
Text Generation • Updated • 197 • 1 -
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation • Updated • 45 • 2 -
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov
Text Generation • Updated • 6 -
OpenVINO/notus-7b-v1-fp16-ov
Text Generation • Updated • 1 -
OpenVINO/notus-7b-v1-int8-ov
Text Generation • Updated • 2 -
OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation • Updated • 3 -
OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation • Updated • 36 -
OpenVINO/zephyr-7b-beta-int8-ov
Text Generation • Updated • 6 -
OpenVINO/zephyr-7b-beta-int4-ov
Text Generation • Updated • 2 -
OpenVINO/dolly-v2-3b-int4-ov
Text Generation • Updated • 10 -
OpenVINO/dolly-v2-3b-int8-ov
Text Generation • Updated • 16 -
OpenVINO/dolly-v2-3b-fp16-ov
Text Generation • Updated • 6 -
OpenVINO/codegen2-3_7B_P-int4-ov
Text Generation • Updated • 4 -
OpenVINO/codegen2-3_7B_P-fp16-ov
Text Generation • Updated • 9 -
OpenVINO/zephyr-7b-beta-fp16-ov
Text Generation • Updated • 3 -
OpenVINO/codegen2-3_7B_P-int8-ov
Text Generation • Updated • 19 • 1 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov
Text Generation • Updated • 20 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation • Updated • 84 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation • Updated • 24