Efficient Post-training
High-quality data, supervised fine-tuning, and preference optimization.
Making Small Models Surprisingly Capable.
OpenMiniAI explores how better data, efficient post-training, and reinforcement learning can unlock remarkable capabilities in small language models.
Small by design. Open by default.
High-quality data, supervised fine-tuning, and preference optimization.
Learning from verifiable feedback with transparent, reproducible recipes.
Tool use, multi-step interaction, and learning from environments.
Our first goal is to study how far a 0.5B language model can go with a complete, reproducible post-training pipeline, from SFT to reinforcement learning and agentic training.