DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

著者: Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Bi, Xiao, Zhang, Haowei, Mingchuan Zhang, Y. K. Li, Yingjun Wu, Daya Guo - arXiv 2024 被引用: 6,358

BioXP-0.5B is a 🤗 Medical-AI model trained using our two-stage fine-tuning approach: Supervised Fine-Tuning (SFT): The model was initially fine-tuned on labeled data(MedMCQA) to achieve strong baseline accuracy on multiple-choice medical QA tasks. Group Relative Policy Optimization (GRPO): In the second stage, GRPO was applied to further align the model with human-like reasoning patterns. This reinforcement learning technique enhances the model’s ability to generate coherent, high-quality explanations and improve answer reliability.