Hugging Face's logo

eugenepentland
/
WizardLM-7B-Landmark

Text Generation
Transformers
PyTorch
llama
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

WizardLM-7B with 10k+ context using Landmark Attention.

Model generated using Landmark-Attention-QLoRA

https://github.com/eugenepentland/landmark-attention-qlora

A merge of the following models:

https://huggingface.co/TheBloke/wizardLM-7B-HF

https://huggingface.co/eugenepentland/WizardLM-7B-Landmark-Attention-QLoRA

Can be loaded in using oobooga, make sure to have the --trust-remote-code option on for it to function.

Downloads last month
11
Inference API
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.