kechengcode
/

Llama3-5B-19Layers

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama3-5B-19Layers / mergekit_config.yml

kechengcode's picture

Upload folder using huggingface_hub

27e1bdf verified about 1 month ago

history blame contribute delete

No virus

229 Bytes

	dtype: float16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 16]
	model: /home/ke.cheng1/SliceGPT/models/Llama-3-8B
	- sources:
	- layer_range: [29, 32]
	model: /home/ke.cheng1/SliceGPT/models/Llama-3-8B