Nova Pro
Multimodal
Zero-eval
#1Translation en→Set1 COMET22
#1Translation Set1→en COMET22
#1GroundUI-1K
+11 more
by Amazon
About
Nova Pro is a multimodal language model developed by Amazon. It achieves strong performance with an average score of 73.2% across 27 benchmarks. It excels particularly in ARC-C (94.8%), GSM8k (94.8%), DocVQA (93.5%). It supports a 600K token context window for handling large documents. The model is available through 1 API provider. As a multimodal model, it can process and understand text, images, and other input formats seamlessly. Released in 2024, it represents Amazon's latest advancement in AI technology.
Pricing Range
Input (per 1M)$0.80 -$0.80
Output (per 1M)$3.20 -$3.20
Providers1
Timeline
AnnouncedNov 20, 2024
ReleasedNov 20, 2024
Specifications
Capabilities
Multimodal
License & Family
License
Proprietary
Benchmark Performance Overview
Performance metrics and category breakdown
Overall Performance
27 benchmarks
Average Score
73.2%
Best Score
94.8%
High Performers (80%+)
13Performance Metrics
Max Context Window
600.0KAvg Throughput
100.0 tok/sAvg Latency
1msTop Categories
reasoning
94.8%
code
90.5%
math
85.7%
vision
79.1%
general
67.4%
Benchmark Performance
Top benchmark scores with normalized values (0-100%)
Ranking Across Benchmarks
Position relative to other models on each benchmark
ARC-C
Rank #3 of 31
#1Claude 3 Opus
96.4%
#2Llama 3.1 405B Instruct
96.9%
#3Nova Pro
94.8%
#4Llama 3.1 70B Instruct
94.8%
#5Claude 3 Sonnet
93.2%
#6Jamba 1.5 Large
93.0%
GSM8k
Rank #12 of 46
#9Claude 3 Opus
95.0%
#10DeepSeek-V2.5
95.1%
#11Qwen2.5 72B Instruct
95.8%
#12Nova Pro
94.8%
#13Qwen2.5 14B Instruct
94.8%
#14Nova Lite
94.5%
#15Gemma 3 12B
94.4%
DocVQA
Rank #10 of 26
#7Grok-2
93.6%
#8Llama 4 Scout
94.4%
#9Llama 4 Maverick
94.4%
#10Nova Pro
93.5%
#11DeepSeek VL2
93.3%
#12Pixtral Large
93.3%
#13Grok-2 mini
93.2%
IFEval
Rank #3 of 37
#1Claude 3.7 Sonnet
93.2%
#2o3-mini
93.9%
#3Nova Pro
92.1%
#4Llama 3.3 70B Instruct
92.1%
#5Gemma 3 27B
90.4%
#6Gemma 3 4B
90.2%
ChartQA
Rank #4 of 24
#1Qwen2.5 VL 72B Instruct
89.5%
#2Llama 4 Maverick
90.0%
#3Claude 3.5 Sonnet
90.8%
#4Nova Pro
89.2%
#5Llama 4 Scout
88.8%
#6Qwen2-VL-72B-Instruct
88.3%
#7Pixtral Large
88.1%
All Benchmark Results for Nova Pro
Complete list of benchmark scores with detailed information
ARC-C ARC-C benchmark | reasoning | text | 0.95 | 94.8% | Self-reported |
GSM8k GSM8k benchmark | math | text | 0.95 | 94.8% | Self-reported |
DocVQA DocVQA benchmark | vision | multimodal | 0.94 | 93.5% | Self-reported |
IFEval IFEval benchmark | code | text | 0.92 | 92.1% | Self-reported |
ChartQA ChartQA benchmark | general | multimodal | 0.89 | 89.2% | Self-reported |
Translation en→Set1 COMET22 Translation en→Set1 COMET22 benchmark | general | text | 0.89 | 89.1% | Self-reported |
HumanEval HumanEval benchmark | code | text | 0.89 | 89.0% | Self-reported |
Translation Set1→en COMET22 Translation Set1→en COMET22 benchmark | general | text | 0.89 | 89.0% | Self-reported |
BBH BBH benchmark | general | text | 0.87 | 86.9% | Self-reported |
MMLU MMLU benchmark | general | text | 0.86 | 85.9% | Self-reported |
Showing 1 to 10 of 27 benchmarks