Google

Gemma 3n E4B Instructed LiteRT Preview

Multimodal
Zero-eval
#1Global-MMLU
#1Codegolf v2.2
#2MMLU-ProX
+2 more

by Google

About

Gemma 3n E4B Instructed LiteRT Preview is a multimodal language model developed by Google. The model shows competitive results across 28 benchmarks. It excels particularly in BoolQ (81.6%), ARC-E (81.6%), PIQA (81.0%). As a multimodal model, it can process and understand text, images, and other input formats seamlessly. It's licensed for commercial use, making it suitable for enterprise applications. Released in 2025, it represents Google's latest advancement in AI technology.

Timeline
AnnouncedMay 20, 2025
ReleasedMay 20, 2025
Knowledge CutoffJun 1, 2024
Specifications
Capabilities
Multimodal
License & Family
License
Gemma
Benchmark Performance Overview
Performance metrics and category breakdown

Overall Performance

28 benchmarks
Average Score
50.3%
Best Score
81.6%
High Performers (80%+)
3

Top Categories

reasoning
73.4%
math
49.2%
general
48.4%
code
38.9%
Benchmark Performance
Top benchmark scores with normalized values (0-100%)
Ranking Across Benchmarks
Position relative to other models on each benchmark

BoolQ

Rank #5 of 9
#2Gemma 3n E4B
81.6%
#3Gemma 2 9B
84.2%
#4Phi-3.5-MoE-instruct
84.6%
#5Gemma 3n E4B Instructed LiteRT Preview
81.6%
#6Phi 4 Mini
81.2%
#7Phi-3.5-mini-instruct
78.0%
#8Gemma 3n E2B
76.4%

ARC-E

Rank #4 of 6
#1Gemma 3n E4B
81.6%
#2Gemma 2 9B
88.0%
#3Gemma 2 27B
88.6%
#4Gemma 3n E4B Instructed LiteRT Preview
81.6%
#5Gemma 3n E2B Instructed LiteRT (Preview)
75.8%
#6Gemma 3n E2B
75.8%

PIQA

Rank #5 of 9
#2Phi-3.5-mini-instruct
81.0%
#3Gemma 2 9B
81.7%
#4Gemma 2 27B
83.2%
#5Gemma 3n E4B Instructed LiteRT Preview
81.0%
#6Gemma 3n E4B
81.0%
#7Gemma 3n E2B Instructed LiteRT (Preview)
78.9%
#8Gemma 3n E2B
78.9%

HellaSwag

Rank #17 of 24
#14Granite 3.3 8B Base
80.1%
#15Gemma 2 9B
81.9%
#16Qwen2.5-Coder 32B Instruct
83.0%
#17Gemma 3n E4B Instructed LiteRT Preview
78.6%
#18Gemma 3n E4B
78.6%
#19Qwen2.5-Coder 7B Instruct
76.8%
#20Gemma 3n E2B Instructed LiteRT (Preview)
72.2%

HumanEval

Rank #46 of 62
#43Gemma 3n E4B Instructed
75.0%
#44Claude 3 Haiku
75.9%
#45Qwen2.5-Omni-7B
78.7%
#46Gemma 3n E4B Instructed LiteRT Preview
75.0%
#47Gemini 1.5 Flash
74.3%
#48Grok-1.5
74.1%
#49Claude 3 Sonnet
73.0%
All Benchmark Results for Gemma 3n E4B Instructed LiteRT Preview
Complete list of benchmark scores with detailed information
BoolQ
BoolQ benchmark
general
text
0.82
81.6%
Self-reported
ARC-E
ARC-E benchmark
reasoning
text
0.82
81.6%
Self-reported
PIQA
PIQA benchmark
general
text
0.81
81.0%
Self-reported
HellaSwag
HellaSwag benchmark
reasoning
text
0.79
78.6%
Self-reported
HumanEval
HumanEval benchmark
code
text
0.75
75.0%
Self-reported
Winogrande
Winogrande benchmark
reasoning
text
0.72
71.7%
Self-reported
TriviaQA
TriviaQA benchmark
general
text
0.70
70.2%
Self-reported
MMLU
MMLU benchmark
general
text
0.65
64.9%
Self-reported
Global-MMLU-Lite
Global-MMLU-Lite benchmark
general
text
0.65
64.5%
Self-reported
MBPP
MBPP benchmark
code
text
63.60
63.6%
Self-reported
Showing 1 to 10 of 28 benchmarks