Model Comparison

Comprehensive side-by-side analysis of model capabilities and performance

xAI

Grok-1.5

xAI

Grok-1.5 is a language model developed by xAI. It achieves strong performance with an average score of 63.9% across 9 benchmarks. It excels particularly in GSM8k (90.0%), DocVQA (85.6%), MMLU (81.3%). Released in 2024, it represents xAI's latest advancement in AI technology.

Mistral AI

Ministral 8B Instruct

Mistral AI

Ministral 8B Instruct is a language model developed by Mistral AI. It achieves strong performance with an average score of 63.3% across 11 benchmarks. It excels particularly in MT-Bench (83.0%), Winogrande (75.3%), ARC-C (71.9%). It supports a 256K token context window for handling large documents. The model is available through 1 API provider. Released in 2024, it represents Mistral AI's latest advancement in AI technology.

xAI

Grok-1.5

xAI

2024-03-28

Mistral AI

Ministral 8B Instruct

Mistral AI

2024-10-16

6 months newer

Performance Metrics

Context window and performance specifications

xAI

Grok-1.5

Max Context:-
Mistral AI

Ministral 8B Instruct

Larger context
Max Context:256.0K
Parameters:8.0B

Average performance across 3 common benchmarks

xAI

Grok-1.5

+17.2%
Average Score:68.7%
Mistral AI

Ministral 8B Instruct

Average Score:51.4%

Performance comparison across key benchmark categories

xAI

Grok-1.5

code
+23.1%
74.1%
general
56.1%
math
+10.0%
64.5%
Mistral AI

Ministral 8B Instruct

code
51.0%
general
+8.7%
64.7%
math
54.5%
Benchmark Scores - Detailed View
Side-by-side comparison of all benchmark scores

Provider Availability & Performance

Available providers and their performance metrics

xAI

Grok-1.5

0 providers
Mistral AI

Ministral 8B Instruct

1 providers

Mistral AI

Throughput: 0.1 tok/s
Latency: 0.18ms
xAI

Grok-1.5

+17.2%
Avg Score:68.7%
Providers:0
Mistral AI

Ministral 8B Instruct

Avg Score:51.4%
Providers:1