Hugging Face's logo

SJ-Donald
/
llama3-passthrough

Text Generation
Transformers
Safetensors
llama
Merge
mergekit
meta-llama/Meta-Llama-3-8B
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

llama3-passthrough

llama3-passthrough is a merge of the following models using mergekit:

🧩 Configuration 

  - sources:
    - model: meta-llama/Meta-Llama-3-8B
      layer_range: [0, 24]
  - sources:
    - model: meta-llama/Meta-Llama-3-8B
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16```
Downloads last month
1,984
Safetensors
Model size
11.5B params
Tensor type
BF16
·
Inference API
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.