- Monthly visits
- 11.3K
- Up4.1%MoMOct 2026
- Public revenue
- Undisclosed
- No public revenue evidence yet
- Entry price
- $15/mo
- Lower than 66% of peersNiche median $24.994999999999997/mo
- Launched
- 7y ago
- 2019-07-08 · Est.
Traffic
Marketing moves
Launches, search & content, referrals, promotionsOpen Source & Agent Ecosystem
- GitHub Stars
- Public repo
- Forks
- —
- License
- See repository
- Primary language
- —
- Ecosystem & integrations:
- Google Search ConsolePageSpeed Insights
- Exposed tool capabilities:
- SEO AuditSitemap GeneratorInternal LinkingAudit/Analyze websitesExtract dataMonitor
Traffic sources
Traffic breakdown
Channels
- Direct40%
- Organic Search32%
- Referrals10%
- Social6%
- Other11%
Countries
- United States24%
- India19%
- Brazil17%
- Germany15%
- Pakistan9%
Search
Domain authority —Domain registered 2019-07-03
| Keyword | Monthly volume |
|---|---|
| website crawler | 2,080 |
| online crawler free | 160 |
| web address scrawler | 160 |
| website crawler online free | 140 |
| website pages crawler | 130 |
Traffic data: Vaneform
Pricing
Trial: None · Free tier included · 4 paid tiers ($15–$99) · Observed 2026-11-10 · Pricing page
Entry price $15/mo, Lower than 66% of peers; “SEO Tools” median is $24.994999999999997/mo.View pricing benchmark
Pages & changes
Key pages
Weekly snapshotsChanges
Design
Minimal Monochrome (Light canvas, balanced density) featuring split copy & visual layout and product ui screenshot / component visuals.
First-screen preview · click to zoom
First-screen pitch & conversion flow
“Website Crawler”
Split Copy & Visual hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.
Conversion path: Split Copy & Visual + Product UI Screenshot / Component → Direct Input / Instant Try · Trust bar: User Count, Rating, or Key Metrics
- Category Positioning Anchor
- Large Hero Product Shot
- Centered Prompt / Input
- Metrics Strip
Palette · click to copy
- Typography
- 8.0
- Color & Contrast
- 7.0
- Layout & Spacing
- 8.0
- Craft & Polish
- 7.0
- Distinctiveness
- 6.0
Structure
- Fonts
- Space Grotesk / Inter
- Hero layout
- Split Copy & Visual
- Primary visual
- Product UI Screenshot / Component
- Conversion CTA
- Direct Input / Instant Try
- Social proof
- User Count, Rating, or Key Metrics
- Navigation
- Full-Width Top Bar
- Theme & density
- Light · Balanced
- Corners & depth
- Small Radius · Hairline borders
Preview full AI design brief (includes :root CSS variables & layout rules)Style tokens only; never copy brand names, logos, copy, or images
# Design Brief: Minimal Monochrome
Monochrome palette with a single accent color, hairline dividers, and generous whitespace.
## Design Tokens
```css
:root {
--background: #ffffff;
--surface: #f3f3f3;
--foreground: #000000;
--muted-foreground: #131313;
--accent: #f47735;
--radius: 4px;
--font-heading: "Space Grotesk", ui-sans-serif, system-ui, sans-serif;
--font-body: "Inter", ui-sans-serif, system-ui, sans-serif;
}
```
Color area ratio: Background #FFFFFF (~74%) · Surface #F3F3F3 (~15%) · Text #000000 (~6%) · Muted Text #131313 (~4%) · Accent #F47735 (~1%). Background and surface dominate the canvas; reserve the accent color for primary buttons and active states.
## Layout & Conversion Structure
- Hero layout: Split Copy & Visual
- Navigation: Full-Width Top Bar
- Theme & density: Light · Balanced
- Border radius & elevation: Small Radius; no drop shadows—separate layers with hairline borders and whitespace
- Primary visual medium: Product UI Screenshot / Component
- Conversion CTA: Direct Input / Instant Try · Trust bar uses User Count, Rating, or Key Metrics
- Headline hook: Category Positioning Anchor
- Hero components: Large Hero Product Shot, Centered Prompt / Input, Metrics Strip
- Spatial layout notes: Split Copy & Visual hero structure paired with direct input / instant try CTA and user count, rating, or key metrics.
- Visual summary: Minimal Monochrome (Light canvas, balanced density) featuring split copy & visual layout and product ui screenshot / component visuals.
## Avoid
- Multi-stop neon gradients
- Heavy drop shadows
- More than one competing accent color
Implement the UI following the design tokens and layout specifications above: use only these color variables, and reserve the accent color strictly for primary actions and active states. Adopt only this visual style—never copy any reference product’s brand name, logo, copy, or imagery.
Questions & evidence
- How much does Website Crawler cost?
- Basic: Free; Starter: $15/mo; Growth: $35/mo; Scale: $99/mo; Enterprise: $90/mo. Observed 2026-11-10. Check the source for current billing terms, usage limits and taxes.Source
- How much website traffic does Website Crawler get?
- Vaneform estimates 11.3K website visits in 2026-10. Visits can include repeat visits; this estimate measures web traffic separately from paying customers or revenue.Source
- What is Website Crawler and what platforms does it support?
- Website Crawler is catalogued under SEO Tools: On Page SEO Checker. Supported platforms: CLI / SDK, API.
Related products in this category
These products share a catalog category. Compare customer tasks, features and deployment requirements before treating them as alternatives.
| Product | Entry price | Visits | Revenue |
|---|---|---|---|
| SEMrushGiantBe found and chosen everywhere search happens | $117.33/mo | 11.4M | $443.6M/yrClaimed |
| ahrefsGiantMake your business discoverable—in search, AI, and beyond | $50/mo | 7.8M | $100M/yrClaimed |
| smallseotoolsMatureYou need effective SEO tools which are 100% free? Check out our Search Engine Optimization tools for checking backlinks | $5.99/mo | 2.8M | Undisclosed |
| SE RankingMatureSearch data you can trust. Results you can explain. | $29/mo | 1.2M | Undisclosed |
| TubePilotMature100% Free YouTube Tools | — | 862.8K | Undisclosed |
| rankmathMatureSEO for WordPress Made Easy | $5.59/mo | 710K | Undisclosed |