bitnet-Llama3-8B-1.58-100B-tokens-GGUF

Running

Update run.sh

13355db verified 7 days ago

No virus

93 Bytes

	#!/bin/bash
	/app/llama-server -m /data/model.gguf -c 4096 -ngl 15 --port 7860 --host 0.0.0.0