Update README.md
Browse files
README.md
CHANGED
@@ -15,6 +15,9 @@ pipeline_tag: text-generation
|
|
15 |
# nullt3r/Meta-Llama-3-8B-Instruct-64k-PoSE-Q8_0-GGUF
|
16 |
This model was converted to GGUF format from [`Azma-AI/Meta-Llama-3-8B-Instruct-64k-PoSE`](https://huggingface.co/Azma-AI/Meta-Llama-3-8B-Instruct-64k-PoSE) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
17 |
Refer to the [original model card](https://huggingface.co/Azma-AI/Meta-Llama-3-8B-Instruct-64k-PoSE) for more details on the model.
|
|
|
|
|
|
|
18 |
## Use with llama.cpp
|
19 |
|
20 |
Install llama.cpp through brew.
|
|
|
15 |
# nullt3r/Meta-Llama-3-8B-Instruct-64k-PoSE-Q8_0-GGUF
|
16 |
This model was converted to GGUF format from [`Azma-AI/Meta-Llama-3-8B-Instruct-64k-PoSE`](https://huggingface.co/Azma-AI/Meta-Llama-3-8B-Instruct-64k-PoSE) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
|
17 |
Refer to the [original model card](https://huggingface.co/Azma-AI/Meta-Llama-3-8B-Instruct-64k-PoSE) for more details on the model.
|
18 |
+
|
19 |
+
**The model works great with LM Studio and standard Llama 3 profile. There is known issue in ollama however, where model does not stop generation.**
|
20 |
+
|
21 |
## Use with llama.cpp
|
22 |
|
23 |
Install llama.cpp through brew.
|