--- language: - pl license: other model_type: llama-2 pipeline_tag: text-generation tags: - facebook - meta - pytorch - llama - llama-2 - voicelab --- #### Description GGML Format model files for [This project](https://huggingface.co/Voicelab/trurl-2-13b). ### inference ```python import ctransformers from ctransformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Aspik101/trurl-2-13b-GGML",model_type="llama") prompt = "Yesterday, when I was" llm(prompt_input, max_new_tokens=256, temperature=0.9, top_p= 0.7) ```