Xiaomi has made a giant leap in the field of artificial intelligence by opening the source code of its initial specialized Xiaomi MiMo 7B model with 7 billion parameters.
It has already rocked the AI market, surpassing significantly larger competitors such as the OpenAI closed-source o1-mini model and Alibaba’s larger QwQ-Preview model with 32 billion parameters.
This model is a big victory for the newly established Xiaomi Big Model Core Team and proof of the company’s growing focus on advancing AI capabilities from hardware to innovative software development.
Table of contents
Breaking the benchmarks with innovative thinking
What is so remarkable about MiMo is its high performance on complex reasoning tests compared to its relatively small size.
Based on publicly available mathematical reasoning assessment kits (AIME 24-25) and code efficiency (LiveCodeBench v5), the MiMo 7B model outperformed competitors with significantly higher results, thanks to an innovative strategy:
- Rich Reasoning corpus: The emphasis is on extracting rich information for reasoning.
- Synthetic improvement: generation of about 200 billion tokens of expert-level data for reasoning
- Training with a gradual increase in difficulty: three separate stages of increasing the difficulty of execution.
- Advanced Training: Total training on a staggering 25 trillion tokens.
Breakthroughs after learning
The evolution of Xiaomi MiMo did not end with pre-training – the innovations of the research group, developed after training, further improved the capabilities of the model.:
- A simple approach to data resampling: applying learning stabilization methods with its control
- Seamless deployment system: An efficiency-oriented system that accelerated training by 2.29 times and its verification by 1.96 times.
Xiaomi’s Future in AI
The launch of Xiaomi MiMo marks a serious game that Xiaomi has started in the field of AI. Although the company has earned its trust through hardware innovation, this move signals a strategic shift towards cutting-edge AI research and development.
By opening the source code of the model itself, Xiaomi is also embracing the open and collaborative nature of artificial innovation, potentially accelerating innovation in the industry.
Developers and artificial intelligence enthusiasts who want to experiment with MiMo or create extensions for it can take a model from Xiaomi’s Hugging Face repository along with detailed technical documentation.