Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook
![Hugging Face H4's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
Hugging Face H4
Enterprise
company
AI & ML interests
Aligning LLMs to be helpful, honest, harmless, and huggy (H4)
Organization Card
About org cards
Hello world!
We're the Hugging Face H4 team, focused on aligning language models to be helpful, honest, harmless, and huggy 🤗.
models
28
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-without-revision-e0c007b1-25d2-4527-b8ec-c6f54821a847
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-with-revision-5d2f53d0-61c1-4943-ba1c-68ec8507051b
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-with-revision-b961bb0f-8012-48f9-8bcc-8373d10e3868
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-without-revision-46fd598b-6792-48e0-9c14-fe86fc035183
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-with-revision-00a840ca-835f-4370-a2d7-6cb15e1fbdfa
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-without-revision-2faed7c2-f2e5-4bba-aff4-36b7c05e6f55
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-with-revision-dcaba972-9df6-4e8c-bdc1-e7866798a289
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-without-revision-aa4674a9-930a-4a05-80fe-48924b58f04a
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-with-revision-f11da3ba-76dc-420f-87f2-dd44d4f56eed
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f0c746619cb630495b814fd/j26aNEdiOgptZxJ6akGCC.png)
HuggingFaceH4/dummy-repo-without-revision-ac646197-ad0e-4858-936a-4367fa67321a
Updated
datasets
67
HuggingFaceH4/rlaif-v_formatted
Viewer
•
Updated
•
83.1k
•
486
HuggingFaceH4/no_robots
Viewer
•
Updated
•
10k
•
4.12k
•
400
HuggingFaceH4/orca_dpo_pairs
Viewer
•
Updated
•
12.9k
•
1.07k
•
20
HuggingFaceH4/llava-instruct-mix-vsft
Viewer
•
Updated
•
273k
•
1.4k
•
16
HuggingFaceH4/h4_10k_prompts_ranked_gen
Viewer
•
Updated
•
10.3k
•
38
•
3
HuggingFaceH4/h4-anthropic-hh-rlhf-helpful-base-gen
Viewer
•
Updated
•
46.2k
•
16
•
3
HuggingFaceH4/capybara
Viewer
•
Updated
•
16k
•
1.11k
•
8
HuggingFaceH4/SystemChat
Viewer
•
Updated
•
7.02k
•
1.25k
•
6
HuggingFaceH4/orca-math-word-problems-200k
Viewer
•
Updated
•
200k
•
1.17k
•
8
HuggingFaceH4/Code-Feedback
Viewer
•
Updated
•
66.4k
•
986
•
1