Products

SWE-bench

Official Leaderboards

swebench.com Software Development / Testing & Code Quality

AI Benchmark
Desktop
Mobile
Monthly visits
190.2K
Down13.6%MoMSep 2026
Public revenue
Undisclosed
No public revenue evidence yet
Entry price
Free
No monthly subscription pricing
Creators
John Yang
@jyangballin· 7,627 followersCo-created with lieret
Launched
16mo ago
2025-07-31 · Est.

Traffic

Monthly visitsData through Sep 2026 · Oct 2026 pending
Events5 changes

Marketing moves

Launches, search & content, referrals, promotions
  • Launched on Show HN (5 pts · 1 comments)Launch

    Randomly switching between LMs at every step boosts SWE-bench score — What if your agent uses a different LM at every turn? We let mini-SWE-agent randomly switch between GPT-5 and Sonnet 4 and it scored highe…

    Aug 20, 2025 · 15mo agoLaunch page

  • Launched on Show HN (2 pts)Launch

    New SWE-bench leaderboard compares LMs without fancy agent scaffolds — Hello from the SWE-bench/SWE-agent team at Princeton/Stanford. When we created the SWE-bench benchmark in 2023 from hundreds of real-life…

    Jul 31, 2025 · 16mo agoLaunch page

Third-party reviews & case dossiers

Acquisition breakdowns, engineer reviews & open-source metrics
Show HN
2025-07-31Source
Post excerpt:
Hello from the SWE-bench/SWE-agent team at Princeton/Stanford. When we created the SWE-bench benchmark in 2023 from hundreds of real-life GitHub issues/pull requests, the highest score was just a couple of percent. The tasks were so challenging for LMs, that most people didn't even want to work on them. Half a year later, SWE-agent showed that the early 2024
Show HN
2025-08-20Source
Post excerpt:
What if your agent uses a different LM at every turn? We let mini-SWE-agent randomly switch between GPT-5 and Sonnet 4 and it scored higher on SWE-bench than with either model separately. GPT-5 by itself gets 65.0%, Sonnet 4 64.8%, but randomly switching at every step gets us 67.2% This result came pretty surprising to us. There's a few more experiments in t

Open Source & Self-Hosting

GitHub · MCP / Skill
GitHub Stars
Public repo
Forks
—
License
See repository
Primary language
—

Traffic sources

Sep 2026

Traffic breakdown

Channels

  • Organic Search63%
  • Direct24%
  • Referrals8%
  • AI Assistants4%
  • Other1%

Countries

  • United States19%
  • China14%
  • Russia11%
  • Germany5%
  • India4%

Search

Domain authority —Domain registered 2023-09-09

KeywordMonthly volume
swe bench17.2K
swe-bench7,520
swe-bench verified3,830
swebench3,400
swe benchmark2,800

Traffic data: Vaneform

Pricing

Pricing page not identified yet, or no public pricing listed.

Pages & changes

Tracked since 2026-07-31

Key pages

Weekly snapshots

Changes

  1. Nov 1 · 13d ago

    Homepage headline (H1) changed to “[SWE-bench Logo] Official Leaderboards”Positioning

    [SWE-bench Logo] Leaderboards→[SWE-bench Logo] Official Leaderboards

  2. Nov 1 · 13d ago

    Adopted technology: Chart.jsFeatures

    —→Chart.js

  3. Nov 1 · 13d ago

    Adopted technology: Cloudflare Browser InsightsFeatures

    —→Cloudflare Browser Insights

  4. Nov 1 · 13d ago

    Adopted technology: HTTP/3Features

    —→HTTP/3

  5. Nov 1 · 13d ago

    Adopted technology: jsDelivrFeatures

    —→jsDelivr

Design

First-screen visual analysis & :root CSS

Enterprise Clean (Light canvas, dense density) featuring full-bleed canvas / video / 3d layout and product ui screenshot / component visuals.

First-screen preview · click to zoom

First-screen pitch & conversion flow

“Official Leaderboards”

Full-Bleed Canvas / Video / 3D hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.

Conversion path: Full-Bleed Canvas / Video / 3D + Product UI Screenshot / Component → Direct Input / Instant Try · Trust bar: User Count, Rating, or Key Metrics

Palette · click to copy

5-D design score6.7 / 10
Typography
7.0
Color & Contrast
7.0
Layout & Spacing
7.0
Craft & Polish
7.0
Distinctiveness
5.0

Structure

Fonts
Inter
Primary visual
Product UI Screenshot / Component
Social proof
User Count, Rating, or Key Metrics
Navigation
Left App Sidebar
Theme & density
Light · Dense
Corners & depth
Small Radius · Hairline borders
Preview full AI design brief (includes :root CSS variables & layout rules)Style tokens only; never copy brand names, logos, copy, or images
# Design Brief: Enterprise Clean (with Minimal Monochrome)

Trustworthy blue-anchored palette, structured grids, and prominent customer logo walls.

## Design Tokens

```css
:root {
  --background: #f4f6f8;
  --surface: #ffffff;
  --foreground: #1c1e21;
  --muted-foreground: #6b7280;
  --accent: #1d6fea;
  --radius: 4px;
  --font-heading: "Inter", ui-sans-serif, system-ui, sans-serif;
  --font-body: "Inter", ui-sans-serif, system-ui, sans-serif;
}
```

Color area ratio: Background #F4F6F8 (~42%) · Surface #FFFFFF (~36%) · Text #1C1E21 (~10%) · Muted Text #6B7280 (~7%) · Accent #1D6FEA (~5%). Background and surface dominate the canvas; reserve the accent color for primary buttons and active states.

## Layout & Conversion Structure

- Hero layout: Full-Bleed Canvas / Video / 3D
- Navigation: Left App Sidebar
- Theme & density: Light · Dense
- Border radius & elevation: Small Radius; no drop shadows—separate layers with hairline borders and whitespace
- Primary visual medium: Product UI Screenshot / Component
- Conversion CTA: Direct Input / Instant Try · Trust bar uses User Count, Rating, or Key Metrics
- Headline hook: Category Positioning Anchor
- Hero components: Metrics Strip
- Spatial layout notes: Full-Bleed Canvas / Video / 3D hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.
- Visual summary: Enterprise Clean (Light canvas, dense density) featuring full-bleed canvas / video / 3d layout and product ui screenshot / component visuals.

## Avoid

- Experimental navigation patterns
- Low-legibility decorative fonts
- Visual novelty that obscures the value proposition

Implement the UI following the design tokens and layout specifications above: use only these color variables, and reserve the accent color strictly for primary actions and active states. Adopt only this visual style—never copy any reference product’s brand name, logo, copy, or imagery.

Questions & evidence

How much website traffic does SWE-bench get?
Vaneform estimates 190.2K website visits in 2026-09. Visits can include repeat visits; this estimate measures web traffic separately from paying customers or revenue.Source
What is SWE-bench and what platforms does it support?
SWE-bench is catalogued under Testing & Code Quality: Official Leaderboards. Supported platforms: Web.

Related products in this category

Software Development / Testing & Code Quality

These products share a catalog category. Compare customer tasks, features and deployment requirements before treating them as alternatives.