--- library_name: peft base_model: mistralai/Mistral-7B-Instruct-v0.1 license: apache-2.0 datasets: - Anthropic/hh-rlhf language: - en --- # Low-rank decomposition of [mitultiwari/mistral-7B-instruct-dpo](https://huggingface.co/mitultiwari/mistral-7B-instruct-dpo) using [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) as base Created using [LoRD](https://github.com/thomasgauthier/LoRD)