StackMap
Subscribe

LlamaFactory alternatives

Curated alternatives to LlamaFactory — and why you'd switch.

trl

Hugging Face's post-training library: SFT, DPO, GRPO, KTO and reward-model trainers on top of Transformers — from a Colab LoRA run to multi-GPU deployments.

Why switchThe two dominant open fine-tuning stacks: TRL is the code-first Hugging Face library; LlamaFactory the config-driven unified trainer with a GUI and a wider model-coverage matrix.
Full comparison →
MLX-LoRA-Studio

Native Mac app for on-device LLM fine-tuning via mlx-lm-lora: pick a model, choose SFT/LoRA/DPO-family algorithms, watch loss fall live, push to Hugging Face. No cloud, no code.

Why switchBoth GUI-driven fine-tuning across many methods. LLaMA-Factory is the CUDA-world standard (100+ models, LlamaBoard, cluster-ready); MLX LoRA Studio trades that breadth for a native Mac app that trains entirely on Apple Silicon.
Full comparison →
Soup

Fine-tune and post-train LLMs from one YAML: QLoRA, DPO/ORPO/SimPO/KTO — layer streaming trains an 8B model in 3.3GB VRAM on a laptop GPU, bit-exact against a resident run.

Why switchSame job, opposite ends: LlamaFactory covers 100+ models with cluster-grade breadth; Soup bets everything on one-YAML simplicity and making 4GB laptops viable.
Full comparison →
h2o-llmstudio

H2O's no-code GUI and framework for fine-tuning LLMs — LoRA, 8-bit, DPO and experiment tracking behind a web UI, with CLI and Docker paths for the same configs.

Why switchBoth put a GUI on fine-tuning; LLM Studio optimizes for the no-code experience, LlamaFactory for maximum model/method coverage with the GUI as one of several front doors.
Full comparison →