Products

Webcrawler API

Uses AISkill

Turn docs and websites into clean markdown for AI agents

webcrawlerapi.com SourceData & Analytics / Web Scraping & Extraction

AI Benchmark
Desktop
Mobile
Monthly visits
7.2K
Down9.2%MoMSep 2026
Public revenue
Undisclosed
No public revenue evidence yet
Entry price
$99/mo
Higher than 87% of peersNiche median $16.335/mo
Creators
Andrew M
@andriixzvf· 519 followers
Launched
2y ago
2024-05-01 · Est.

Traffic

Monthly visitsData through Sep 2026 · Oct 2026 pending
Events5 changes · 2 marketing moves

Marketing moves

Launches, search & content, referrals, promotions
  • Launched on BetaListLaunch

    WebCrawler API – Turn docs and websites into clean markdown for AI agents — Turn docs and websites into clean markdown for AI agents

    Jul 17 · 4mo agoLaunch page

  • Launched on DevHuntLaunch

    WebCrawler API — Simplifying Web Data Extraction for AI Applications

    Jan 6 · 10mo agoLaunch page

  • Launched on BetaListLaunch

    WebCrawler API – Simplifying Web Data Extraction for AI Applications — Simplifying Web Data Extraction for AI Applications

    Apr 4, 2025 · 20mo agoLaunch page

  • Launched on Fazier (61 upvotes)Launch

    WebCrawler API — Simplifying Web Data Extraction for AI Applications

    Mar 28, 2025 · 20mo agoLaunch page

  • Launched on DevHunt (5 upvotes)Launch

    Webcrawler API — Extract content from websites with powerful API or no-code

    Sep 3, 2024 · 2y agoLaunch page

Open Source & Agent Ecosystem

GitHub · MCP / Skill
Last commit 2026-04-25
GitHub Stars
Public repo
Forks
—
License
See repository
Primary language
—

Traffic sources

Sep 2026

Traffic breakdown

Channels

  • Direct41%
  • Organic Search32%
  • Referrals10%
  • Social6%
  • Other11%

Countries

  • United States42%
  • Brazil19%
  • Spain9%
  • India9%
  • Germany8%

Search

Domain authority —Domain registered 2023-05-12

KeywordMonthly volume
webcrawlerapi180
web crawler api130
default ram python playwright120
prompt format markdown json compasion90
procut extraction crawling library80

Traffic data: Vaneform

Pricing

Pay as you go
Free
Up to 5 parallel requests
Professional
$99/mo
Up to 20 parallel requests
Business
$499/mo
Up to 50 parallel requests

Trial: None · Free tier included · 2 paid tiers ($99–$499) · Observed 2026-11-04 · Pricing page

Entry price $99/mo, Higher than 87% of peers; “Web Scraping & Extraction” median is $16.335/mo.View pricing benchmark

Pages & changes

Tracked since 2026-08-08

Key pages

Weekly snapshots

Changes

  1. Nov 1 · 13d ago

    Homepage headline (H1) changed to “Web crawling API& data extraction API”Positioning

    Webcrawling and data scraping API for RAG and LLM→Web crawling API& data extraction API

  2. Nov 1 · 13d ago

    Removed technology: Cloudflare Browser InsightsFeatures

    Cloudflare Browser Insights→—

  3. Nov 1 · 13d ago

    Adopted technology: Open GraphFeatures

    —→Open Graph

  4. Nov 1 · 13d ago

    Adopted technology: PWAFeatures

    —→PWA

  5. Nov 1 · 13d ago

    Adopted technology: TurbopackFeatures

    —→Turbopack

Design

First-screen visual analysis & :root CSS

Soft & Friendly (Light canvas, airy density) featuring centered headline + input layout and interactive hero demo / tool visuals.

First-screen preview · click to zoom

First-screen pitch & conversion flow

“Turn docs and websites into clean markdown for AI agents”

Centered Headline + Input hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.

Conversion path: Centered Headline + Input + Interactive Hero Demo / Tool → Direct Input / Instant Try · Trust bar: User Count, Rating, or Key Metrics

Palette · click to copy

5-D design score7.5 / 10
Typography
8.0
Color & Contrast
8.0
Layout & Spacing
8.0
Craft & Polish
7.0
Distinctiveness
6.0

Structure

Fonts
Inter
Primary visual
Interactive Hero Demo / Tool
Social proof
User Count, Rating, or Key Metrics
Navigation
Full-Width Top Bar
Theme & density
Light · Airy
Corners & depth
Large Radius · With shadow
Preview full AI design brief (includes :root CSS variables & layout rules)Style tokens only; never copy brand names, logos, copy, or images
# Design Brief: Soft & Friendly (with Minimal Monochrome)

Warm low-saturation pastels, generous rounded corners, and approachable illustrations.

## Design Tokens

```css
:root {
  --background: #fcfaf8;
  --surface: #ffffff;
  --foreground: #10111d;
  --muted-foreground: #818797;
  --accent: #ee772b;
  --radius: 16px;
  --font-heading: "Inter", ui-sans-serif, system-ui, sans-serif;
  --font-body: "Inter", ui-sans-serif, system-ui, sans-serif;
}
```

Color area ratio: Background #FCFAF8 (~80%) · Surface #FFFFFF (~8%) · Text #10111D (~7%) · Muted Text #818797 (~3%) · Accent #EE772B (~2%). Background and surface dominate the canvas; reserve the accent color for primary buttons and active states.

## Layout & Conversion Structure

- Hero layout: Centered Headline + Input
- Navigation: Full-Width Top Bar
- Theme & density: Light · Airy
- Border radius & elevation: Large Radius; use elevation shadows to separate layers
- Primary visual medium: Interactive Hero Demo / Tool
- Conversion CTA: Direct Input / Instant Try · Trust bar uses User Count, Rating, or Key Metrics
- Headline hook: Pain Relief & Replacement
- Hero components: Centered Prompt / Input, Metrics Strip
- Spatial layout notes: Centered Headline + Input hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.
- Visual summary: Soft & Friendly (Light canvas, airy density) featuring centered headline + input layout and interactive hero demo / tool visuals.

## Avoid

- Harsh pure-black backgrounds
- Sharp 0px corners
- Cold technical jargon in hero copy

Implement the UI following the design tokens and layout specifications above: use only these color variables, and reserve the accent color strictly for primary actions and active states. Adopt only this visual style—never copy any reference product’s brand name, logo, copy, or imagery.

Questions & evidence

How much does Webcrawler API cost?
Pay as you go: Free; Professional: $99/mo; Business: $499/mo. Observed 2026-11-04. Check the source for current billing terms, usage limits and taxes.Source
How much website traffic does Webcrawler API get?
Vaneform estimates 7.2K website visits in 2026-09. Visits can include repeat visits; this estimate measures web traffic separately from paying customers or revenue.Source
What is Webcrawler API and what platforms does it support?
Webcrawler API is catalogued under Web Scraping & Extraction: Turn docs and websites into clean markdown for AI agents. Supported platforms: API.
Is Webcrawler API open source?
Webcrawler API has a public repository (https://github.com/webCrawlerAPI/webcr) with its source repository published.Source

Related products in this category

Data & Analytics / Web Scraping & Extraction

These products share a catalog category. Compare customer tasks, features and deployment requirements before treating them as alternatives.