Argilla
Open-source platform for human feedback and RLHF data curation
Verdict
Best open-source tool for collecting human feedback. Purpose-built for RLHF/DPO workflows. Tight Hugging Face Hub integration for publishing datasets. Essential for alignment data.
Other Data & Fine-tuning
- AxolotlStable
Easy-to-use fine-tuning toolkit supporting YAML-based configuration
- DVCStable
Git-based data and model version control for ML projects
- Hugging Face HubProduction
The GitHub of AI — models, datasets, and Spaces in one platform
- Label StudioStable
Open-source data labelling for text, images, audio, and video
- LitGPTExperimental
Lightning AI toolkit for pretraining, fine-tuning, and deploying LLMs
- PEFT / LoRAProduction
Hugging Face's parameter-efficient fine-tuning library