Model Comparison

Comprehensive side-by-side analysis of model capabilities and performance

Gemma 3n E4B Instructed

Google

Gemma 3n E4B Instructed is a multimodal language model developed by Google. The model shows competitive results across 18 benchmarks. Notable strengths include HumanEval (75.0%), MGSM (67.0%), MMLU (64.9%). The model is available through 1 API provider. As a multimodal model, it can process and understand text, images, and other input formats seamlessly. Released in 2025, it represents Google's latest advancement in AI technology.

Grok-1.5

xAI

Grok-1.5 is a language model developed by xAI. It achieves strong performance with an average score of 63.9% across 9 benchmarks. It excels particularly in GSM8k (90.0%), DocVQA (85.6%), MMLU (81.3%). Released in 2024, it represents xAI's latest advancement in AI technology.

Grok-1.5

xAI

2024-03-28

Gemma 3n E4B Instructed

Google

2025-06-26

1 year newer

Performance Metrics

Context window and performance specifications

Gemma 3n E4B Instructed

Larger context

Max Context:64.0K

Parameters:8.0B

Grok-1.5

Max Context:-

Average performance across 4 common benchmarks

Gemma 3n E4B Instructed

Average Score:53.6%

Grok-1.5

+7.0%

Average Score:60.6%

Performance comparison across key benchmark categories

Gemma 3n E4B Instructed

code

38.9%

math

52.4%

general

41.6%

Grok-1.5

code

+35.2%

74.1%

math

+12.1%

64.5%

general

+14.5%

56.1%

Benchmark Scores - Detailed View

Side-by-side comparison of all benchmark scores

Knowledge Cutoff

Training data recency comparison

Gemma 3n E4B Instructed

2024-06-01

More recent knowledge cutoff means awareness of newer technologies and frameworks

Provider Availability & Performance

Available providers and their performance metrics

Gemma 3n E4B Instructed

1 providers

Together

Throughput: 42.09 tok/s

Latency: 0.43ms

Grok-1.5

0 providers

Gemma 3n E4B Instructed

Avg Score:53.6%

Providers:1

Grok-1.5

+7.0%

Avg Score:60.6%

Providers:0