SWE-Lancer

general

text

About

SWE-Lancer benchmark

Evaluation Stats

Total Models3

Organizations1

Verified Results0

Self-Reported3

Benchmark Details

Max Score1

Language

en

Performance Overview

Score distribution and top performers

Score Distribution

3 models

Top Score

37.3%

Average Score

29.3%

High Performers (80%+)

0

Top Organizations

#1OpenAI

3 models

29.3%

Leaderboard

Top 3 models ranked by performance

1

37.3%

Raw: 0.373

Self-reported

2

32.6%

Raw: 0.326

Self-reported

3

18.0%

Raw: 0.18

Self-reported