公众号:面壁智能(MiniCPM)📅 Jul 3AI 产品

面壁智能发布AI全自动预训练框架ForgeTrain,8小时追平Megatron-LM

面壁智能发布全球首个完全由AI编写、无人类干预的生产级大模型预训练框架ForgeTrain。该框架针对特定模型和硬件从零自动"锻造"专用训练代码。基准测试显示,ForgeTrain在8小时内追平Megatron-LM,1.5至2天内实现稳定反超,模型FLOPS利用率提升约8%~10%,且可迁移至不同模型(MiniCPM4-0.5B/8B)和硬件(H100及昇腾NPU)。其采用四阶段Harness优化流程,全程自动判定。面壁智能将其工程思想概括为Forge Engineering。

💡 Recommended AI Tools

The large video model released by Shengshu Technology and Tsinghua University supports highly consistent simulation of characters and physical laws.
The large video generation model launched by Kuaishou supports the generation of 1080p frame rate videos up to 2 minutes long.
ByteDance's AI painting and short video generation platform supports one-click text generation and shadow generation.
Tencent's official AI assistant deeply integrates WeChat public account ecology, search and file parsing capabilities.