Na0s
/

Llama-3.1-8b-Pruned-5-Layers

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-8b-Pruned-5-Layers / mergekit_config.yml

Na0s's picture

Upload folder using huggingface_hub

1c50977 verified about 2 months ago

history blame contribute delete

No virus

202 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 22]
	model: meta-llama/Meta-Llama-3.1-8B
	- sources:
	- layer_range: [28, 32]
	model: meta-llama/Meta-Llama-3.1-8B