Model Comparison
Comprehensive side-by-side analysis of model capabilities and performance
Mistral Small 3 24B Instruct
Mistral AI
Mistral Small 3 24B Instruct is a language model developed by Mistral AI. It achieves strong performance with an average score of 71.7% across 8 benchmarks. It excels particularly in Arena Hard (87.6%), HumanEval (84.8%), MT-Bench (83.5%). The model shows particular specialization in code tasks with an average performance of 83.9%. The model is available through 2 API providers. It's licensed for commercial use, making it suitable for enterprise applications. Released in 2025, it represents Mistral AI's latest advancement in AI technology.
Qwen2.5 32B Instruct
Alibaba
Qwen2.5 32B Instruct is a language model developed by Alibaba. It achieves strong performance with an average score of 74.3% across 18 benchmarks. It excels particularly in GSM8k (95.9%), HumanEval (88.4%), HellaSwag (85.2%). The model shows particular specialization in math tasks with an average performance of 89.5%. It's licensed for commercial use, making it suitable for enterprise applications. Released in 2024, it represents Alibaba's latest advancement in AI technology.
Qwen2.5 32B Instruct
Alibaba
2024-09-19
Mistral Small 3 24B Instruct
Mistral AI
2025-01-30
4 months newer
Performance Metrics
Context window and performance specifications
Mistral Small 3 24B Instruct
Qwen2.5 32B Instruct
Average performance across 4 common benchmarks
Mistral Small 3 24B Instruct
Qwen2.5 32B Instruct
Performance comparison across key benchmark categories
Mistral Small 3 24B Instruct
Qwen2.5 32B Instruct
Mistral Small 3 24B Instruct
2023-10-01
Provider Availability & Performance
Available providers and their performance metrics
Mistral Small 3 24B Instruct
DeepInfra
Mistral AI
Qwen2.5 32B Instruct
Mistral Small 3 24B Instruct
Qwen2.5 32B Instruct