LitGPT
Lightning AI toolkit for pretraining, fine-tuning, and deploying LLMs
Verdict
Clean, hackable LLM training code from Lightning AI. Supports 20+ model architectures. Good for researchers wanting to understand and modify training pipelines. Less abstraction than Axolotl.
Other Data & Fine-tuning
- ArgillaStable
Open-source platform for human feedback and RLHF data curation
- AxolotlStable
Easy-to-use fine-tuning toolkit supporting YAML-based configuration
- DVCStable
Git-based data and model version control for ML projects
- Hugging Face HubProduction
The GitHub of AI — models, datasets, and Spaces in one platform
- Label StudioStable
Open-source data labelling for text, images, audio, and video
- PEFT / LoRAProduction
Hugging Face's parameter-efficient fine-tuning library