library_name: peft
base_model: HuggingFaceH4/zephyr-7b-beta
license: mit
language:
- hi
- en
metrics:
- f1
pipeline_tag: text-classification
tags:
- Trigger
- 7B
- LoRA
- llama2
- PEFT
Model Card for Model ID
The model does Emotion Recognition in Conversation (ERC) in Hindi-English code-mixed conversations
Model Details
Model Description
The model presented here is tailored for the EDiReF shared task at SemEval 2024, specifically addressing Emotion Recognition in Conversation (ERC) in Hindi-English code-mixed conversations
The model utilizes the strengths of large language models (LLMs) pre-trained on extensive textual data, enabling it to capture complex linguistic patterns and relationships. To enhance its performance for the EFR task, the model has been finetuned using Quantized Low Rank Adaptation (QLoRA) on the dataset with strategic prompt engineering. This involves crafting input prompts that guide the model in Emotion Recognition in Conversation (ERC) in Hindi-English code-mixed conversations
In summary, this model excels in pinpointing the emotions in Hindi-English code-mixed conversations dialogues, showcasing the effectiveness of openchat, LLM capabilities, QLoRA and strategic prompt engineering.
- Developed by: Hasan et al
- Model type: LoRA Adapter for zehpyr-7b-beta (Text classification)
- Language(s) (NLP): English
- License: MIT
Model Sources
- Repository: Multi-Party-DialoZ
- Paper [Soon]: [More Information Needed]