Turn docs and websites into clean markdown for AI agents
webcrawlerapi.com SourceData & Analytics / Web Scraping & Extraction
- Monthly visits
- 7.2K
- Down9.2%MoMSep 2026
- Public revenue
- Undisclosed
- No public revenue evidence yet
- Entry price
- $99/mo
- Higher than 87% of peersNiche median $16.335/mo
- Launched
- 2y ago
- 2024-05-01 · Est.
Traffic
Marketing moves
Launches, search & content, referrals, promotions- I expected cloud-based browsers to be faster than my self-hosted Puppeteer. But I was wrong. WebcrawlerAPI uses headful @usekernel browsers as one of its providers, and I'm very satisfied with the service. So I thought, all right, maybe
@andriixzvf · 2026-10-24 · 0 likes · 0 reposts · 100 views
- Benchmarked DeepSeek Fetch API. Read the full test results here https://webcrawlerapi.com/blog/deepseek-fetch-api-benchmark 引用帖 @deepseek_ai: 🔍 Search & Fetch APIs are now open to everyone! Powered by our in-house search engine, serving
@andriixzvf · 2026-10-18 · 8 likes · 1 reposts · 4,107 views
Launched on BetaListLaunch
WebCrawler API – Turn docs and websites into clean markdown for AI agents — Turn docs and websites into clean markdown for AI agents
Jul 17 · 4mo agoLaunch page
Launched on DevHuntLaunch
WebCrawler API — Simplifying Web Data Extraction for AI Applications
Jan 6 · 10mo agoLaunch page
Launched on BetaListLaunch
WebCrawler API – Simplifying Web Data Extraction for AI Applications — Simplifying Web Data Extraction for AI Applications
Apr 4, 2025 · 20mo agoLaunch page
Launched on Fazier (61 upvotes)Launch
WebCrawler API — Simplifying Web Data Extraction for AI Applications
Mar 28, 2025 · 20mo agoLaunch page
Launched on DevHunt (5 upvotes)Launch
Webcrawler API — Extract content from websites with powerful API or no-code
Sep 3, 2024 · 2y agoLaunch page
Open Source & Agent Ecosystem
- GitHub Stars
- Public repo
- Forks
- —
- License
- See repository
- Primary language
- —
- Ecosystem & integrations:
- Zapier
Traffic sources
Traffic breakdown
Channels
- Direct41%
- Organic Search32%
- Referrals10%
- Social6%
- Other11%
Countries
- United States42%
- Brazil19%
- Spain9%
- India9%
- Germany8%
Search
Domain authority —Domain registered 2023-05-12
| Keyword | Monthly volume |
|---|---|
| webcrawlerapi | 180 |
| web crawler api | 130 |
| default ram python playwright | 120 |
| prompt format markdown json compasion | 90 |
| procut extraction crawling library | 80 |
Traffic data: Vaneform
Pricing
Trial: None · Free tier included · 2 paid tiers ($99–$499) · Observed 2026-11-04 · Pricing page
Entry price $99/mo, Higher than 87% of peers; “Web Scraping & Extraction” median is $16.335/mo.View pricing benchmark
Pages & changes
Key pages
Weekly snapshots- Homewebcrawlerapi.com/
- Pricingwebcrawlerapi.com/pricing Snapshot 2026-11-04
Changes
Design
Soft & Friendly (Light canvas, airy density) featuring centered headline + input layout and interactive hero demo / tool visuals.
First-screen preview · click to zoom
First-screen pitch & conversion flow
“Turn docs and websites into clean markdown for AI agents”
Centered Headline + Input hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.
Conversion path: Centered Headline + Input + Interactive Hero Demo / Tool → Direct Input / Instant Try · Trust bar: User Count, Rating, or Key Metrics
- Pain Relief & Replacement
- Centered Prompt / Input
- Metrics Strip
Palette · click to copy
- Typography
- 8.0
- Color & Contrast
- 8.0
- Layout & Spacing
- 8.0
- Craft & Polish
- 7.0
- Distinctiveness
- 6.0
Structure
- Fonts
- Inter
- Hero layout
- Centered Headline + Input
- Primary visual
- Interactive Hero Demo / Tool
- Conversion CTA
- Direct Input / Instant Try
- Social proof
- User Count, Rating, or Key Metrics
- Navigation
- Full-Width Top Bar
- Theme & density
- Light · Airy
- Corners & depth
- Large Radius · With shadow
Preview full AI design brief (includes :root CSS variables & layout rules)Style tokens only; never copy brand names, logos, copy, or images
# Design Brief: Soft & Friendly (with Minimal Monochrome)
Warm low-saturation pastels, generous rounded corners, and approachable illustrations.
## Design Tokens
```css
:root {
--background: #fcfaf8;
--surface: #ffffff;
--foreground: #10111d;
--muted-foreground: #818797;
--accent: #ee772b;
--radius: 16px;
--font-heading: "Inter", ui-sans-serif, system-ui, sans-serif;
--font-body: "Inter", ui-sans-serif, system-ui, sans-serif;
}
```
Color area ratio: Background #FCFAF8 (~80%) · Surface #FFFFFF (~8%) · Text #10111D (~7%) · Muted Text #818797 (~3%) · Accent #EE772B (~2%). Background and surface dominate the canvas; reserve the accent color for primary buttons and active states.
## Layout & Conversion Structure
- Hero layout: Centered Headline + Input
- Navigation: Full-Width Top Bar
- Theme & density: Light · Airy
- Border radius & elevation: Large Radius; use elevation shadows to separate layers
- Primary visual medium: Interactive Hero Demo / Tool
- Conversion CTA: Direct Input / Instant Try · Trust bar uses User Count, Rating, or Key Metrics
- Headline hook: Pain Relief & Replacement
- Hero components: Centered Prompt / Input, Metrics Strip
- Spatial layout notes: Centered Headline + Input hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.
- Visual summary: Soft & Friendly (Light canvas, airy density) featuring centered headline + input layout and interactive hero demo / tool visuals.
## Avoid
- Harsh pure-black backgrounds
- Sharp 0px corners
- Cold technical jargon in hero copy
Implement the UI following the design tokens and layout specifications above: use only these color variables, and reserve the accent color strictly for primary actions and active states. Adopt only this visual style—never copy any reference product’s brand name, logo, copy, or imagery.
Questions & evidence
- How much does Webcrawler API cost?
- Pay as you go: Free; Professional: $99/mo; Business: $499/mo. Observed 2026-11-04. Check the source for current billing terms, usage limits and taxes.Source
- How much website traffic does Webcrawler API get?
- Vaneform estimates 7.2K website visits in 2026-09. Visits can include repeat visits; this estimate measures web traffic separately from paying customers or revenue.Source
- What is Webcrawler API and what platforms does it support?
- Webcrawler API is catalogued under Web Scraping & Extraction: Turn docs and websites into clean markdown for AI agents. Supported platforms: API.
- Is Webcrawler API open source?
- Webcrawler API has a public repository (https://github.com/webCrawlerAPI/webcr) with its source repository published.Source
Related products in this category
These products share a catalog category. Compare customer tasks, features and deployment requirements before treating them as alternatives.
| Product | Entry price | Visits | Revenue |
|---|---|---|---|
| Apify118,333 tools for your AI | $19/mo | 4.2M | Undisclosed |
| IGExportIGExport Instagram Tools & Social Insights | — | 3.9M | Undisclosed |
| ExportTokTikTok Comment Exporter | $9.99/mo | 2.8M | Undisclosed |
| RosintRosint — Search deleted Reddit posts, removed comments, and private profiles | — | 2.7M | Undisclosed |
| Omar-Thing User FinderLook up public info for any TikTok account | — | 2.6M | Undisclosed |
| FirecrawlGive your AI agents web data and beyond | $19/mo | 1.8M | Undisclosed |