Ministral 8B Instruct
Zero-eval
#1MBPP pass@1
#1French MMLU
by Mistral AI
About
Ministral 8B Instruct is a language model developed by Mistral AI. It achieves strong performance with an average score of 63.3% across 11 benchmarks. It excels particularly in MT-Bench (83.0%), Winogrande (75.3%), ARC-C (71.9%). It supports a 256K token context window for handling large documents. The model is available through 1 API provider. Released in 2024, it represents Mistral AI's latest advancement in AI technology.
Pricing Range
Input (per 1M)$0.10 -$0.10
Output (per 1M)$0.10 -$0.10
Providers1
Timeline
AnnouncedOct 16, 2024
ReleasedOct 16, 2024
Specifications
License & Family
License
Mistral Research License
Benchmark Performance Overview
Performance metrics and category breakdown
Overall Performance
11 benchmarks
Average Score
63.3%
Best Score
83.0%
High Performers (80%+)
1Performance Metrics
Max Context Window
256.0KAvg Throughput
0.1 tok/sAvg Latency
0msTop Categories
roleplay
83.0%
reasoning
73.6%
general
64.7%
math
54.5%
code
51.0%
Benchmark Performance
Top benchmark scores with normalized values (0-100%)
Ranking Across Benchmarks
Position relative to other models on each benchmark
MT-Bench
Rank #8 of 11
#5Mistral Small 3 24B Instruct
83.5%
#6Qwen2 7B Instruct
84.1%
#7Mistral Large 2
86.3%
#8Ministral 8B Instruct
83.0%
#9Llama 3.1 Nemotron Nano 8B V1
81.0%
#10Pixtral-12B
76.8%
#11Llama 3.1 Nemotron 70B Instruct
9.0%
Winogrande
Rank #11 of 19
#8Mistral NeMo Instruct
76.8%
#9Gemma 2 9B
80.6%
#10Qwen2.5-Coder 32B Instruct
80.8%
#11Ministral 8B Instruct
75.3%
#12Granite 3.3 8B Base
74.4%
#13Qwen2.5-Coder 7B Instruct
72.9%
#14Gemma 3n E4B
71.7%
ARC-C
Rank #17 of 31
#14Llama 3.2 3B Instruct
78.6%
#15Llama 3.1 8B Instruct
83.4%
#16Phi 4 Mini
83.7%
#17Ministral 8B Instruct
71.9%
#18Gemma 2 27B
71.4%
#19Command R+
71.0%
#20Qwen2.5-Coder 32B Instruct
70.5%
Arena Hard
Rank #12 of 22
#9Phi 4 Reasoning
73.3%
#10Phi 4
75.4%
#11DeepSeek-V2.5
76.2%
#12Ministral 8B Instruct
70.9%
#13Jamba 1.5 Large
65.4%
#14Granite 3.3 8B Instruct
57.6%
#15Granite 3.3 8B Base
57.6%
MBPP pass@1
Rank #1 of 1
#1Ministral 8B Instruct
70.0%
All Benchmark Results for Ministral 8B Instruct
Complete list of benchmark scores with detailed information
MT-Bench MT-Bench benchmark | roleplay | text | 83.00 | 83.0% | Self-reported |
Winogrande Winogrande benchmark | reasoning | text | 0.75 | 75.3% | Self-reported |
ARC-C ARC-C benchmark | reasoning | text | 0.72 | 71.9% | Self-reported |
Arena Hard Arena Hard benchmark | general | text | 0.71 | 70.9% | Self-reported |
MBPP pass@1 MBPP pass@1 benchmark | code | text | 0.70 | 70.0% | Self-reported |
TriviaQA TriviaQA benchmark | general | text | 0.66 | 65.5% | Self-reported |
MMLU MMLU benchmark | general | text | 0.65 | 65.0% | Self-reported |
French MMLU French MMLU benchmark | general | text | 0.57 | 57.5% | Self-reported |
MATH MATH benchmark | math | text | 0.55 | 54.5% | Self-reported |
AGIEval AGIEval benchmark | code | text | 0.48 | 48.3% | Self-reported |
Showing 1 to 10 of 11 benchmarks
Resources