Products

crawler.sh

MCP

Clean Markdown from any website. Without the cloud bill.

crawler.sh Marketing / SEO Tools

AI Benchmark
Desktop
Mobile
Monthly visits
<5K
Oct 2026
Public revenue
Undisclosed
No public revenue evidence yet
Entry price
$8.25/mo
Lower than 88% of peersNiche median $25/mo
Creators
Mehmet Kose
@mehmetkose· 776 followers
Launched
9mo ago
2026-03-02 · Est.

Traffic

Last 12 months
Monthly visitsData through Oct 2026
Events2 marketing moves

Marketing moves

Launches, search & content, referrals, promotions
  • Launched on Show HN (2 pts)Launch

    Rust Based SEO and AEO Crawler — Ultra-fast desktop & CLI app that finds your SEO & AEO issues and allows you to extract your content as Markdown

    Mar 2 · 9mo agoLaunch page

  • Launched on Product HuntLaunch

    Free Local AEO & SEO Spider and a Markdown content extractor

    Mar 2 · 9mo agoLaunch page

MCP Server & Agent Ecosystem

GitHub · MCP / Skill

Agent, MCP & Developer Integration

MCP ServerCLI / SDK
Browse all MCP Server products →

Traffic sources

Oct 2026

Traffic breakdown

Channels

  • Direct39%
  • Organic Search31%
  • Referrals10%
  • Social6%
  • Other13%

Countries

  • United States75%
  • India25%

Search

Domain authority —Domain registered 2021-04-08

KeywordMonthly volume
google search fix old favicon140
google favicon update110
favicon google refresh100
google search console update domain icons100
create mcp for searching knoeledge using rag codex70

Traffic data: Vaneform

Pricing

Free
$0
Crawl up to 10,000 pages per session
CLI Pro
$99/yr (billed annually)
Crawl up to 10,000 pages per session
Desktop Pro
Unknown

Trial: None · 1 paid tier ($99) · Observed 2026-11-04 · Source page

Entry price $8.25/mo, Lower than 88% of peers; “SEO Tools” median is $25/mo.View pricing benchmark

Pages & changes

Tracked since 2026-03-02

Key pages

Weekly snapshots

Changes

No pricing, plan, or positioning changes detected since tracking started.

Design

First-screen visual analysis & :root CSS

Minimal Monochrome (Dark canvas, airy density) featuring centered headline + cta layout and product ui screenshot / component visuals.

First-screen preview · click to zoom

First-screen pitch & conversion flow

“Clean Markdown from any website. Without the cloud bill.”

Centered Headline + CTA hero structure paired with download app / install extension CTA and stacked avatars & testimonials.

Conversion path: Centered Headline + CTA + Product UI Screenshot / Component → Download App / Install Extension · Trust bar: Stacked Avatars & Testimonials

Palette · click to copy

5-D design score7.5 / 10
Typography
8.0
Color & Contrast
8.0
Layout & Spacing
8.0
Craft & Polish
7.0
Distinctiveness
6.0

Structure

Fonts
Inter
Primary visual
Product UI Screenshot / Component
Social proof
Stacked Avatars & Testimonials
Navigation
Full-Width Top Bar
Theme & density
Dark · Airy
Corners & depth
Pill · Hairline borders
Preview full AI design brief (includes :root CSS variables & layout rules)Style tokens only; never copy brand names, logos, copy, or images
# Design Brief: Minimal Monochrome

Monochrome palette with a single accent color, hairline dividers, and generous whitespace.

## Design Tokens

```css
:root {
  --background: #001713;
  --surface: #06231e;
  --foreground: #e8f0ee;
  --muted-foreground: #819a93;
  --accent: #8bdb91;
  --radius: 9999px;
  --font-heading: "Inter", ui-sans-serif, system-ui, sans-serif;
  --font-body: "Inter", ui-sans-serif, system-ui, sans-serif;
}
```

Color area ratio: Background #001713 (~73%) · Surface #06231E (~10%) · Text #E8F0EE (~8%) · Muted Text #819A93 (~6%) · Accent #8BDB91 (~3%). Background and surface dominate the canvas; reserve the accent color for primary buttons and active states.

## Layout & Conversion Structure

- Hero layout: Centered Headline + CTA
- Navigation: Full-Width Top Bar
- Theme & density: Dark · Airy
- Border radius & elevation: Pill; no drop shadows—separate layers with hairline borders and whitespace
- Primary visual medium: Product UI Screenshot / Component
- Conversion CTA: Download App / Install Extension · Trust bar uses Stacked Avatars & Testimonials
- Headline hook: Pain Relief & Replacement
- Hero components: Large Hero Product Shot, Metrics Strip
- Spatial layout notes: Centered Headline + CTA hero structure paired with download app / install extension CTA and stacked avatars & testimonials.
- Visual summary: Minimal Monochrome (Dark canvas, airy density) featuring centered headline + cta layout and product ui screenshot / component visuals.

## Avoid

- Multi-stop neon gradients
- Heavy drop shadows
- More than one competing accent color

Implement the UI following the design tokens and layout specifications above: use only these color variables, and reserve the accent color strictly for primary actions and active states. Adopt only this visual style—never copy any reference product’s brand name, logo, copy, or imagery.

Questions & evidence

How much does crawler.sh cost?
Free: $0; CLI Pro: $99/yr (billed annually); Desktop Pro: Unknown. Observed 2026-11-04. Check the source for current billing terms, usage limits and taxes.Source
How much website traffic does crawler.sh get?
Vaneform estimates <5K website visits in 2026-10. Visits can include repeat visits; this estimate measures web traffic separately from paying customers or revenue.Source
What is crawler.sh and what platforms does it support?
crawler.sh is catalogued under SEO Tools: Clean Markdown from any website. Without the cloud bill.. Supported platforms: MCP Server, CLI / SDK.

Related products in this category

Marketing / SEO Tools

These products share a catalog category. Compare customer tasks, features and deployment requirements before treating them as alternatives.