The SEO crawler built for the AI era
getcrawly.com SourceMarketing / SEO Tools
- Monthly visits
- 5.2K
- Oct 2026
- Public revenue
- Undisclosed
- No public revenue evidence yet
- Entry price
- Free
- No monthly subscription pricing
- Launched
- 6mo ago
- 2026-05-14 · Est.
Traffic
Marketing moves
Launches, search & content, referrals, promotionsOpen Source & Agent Ecosystem
- GitHub Stars
- Public repo
- Forks
- —
- License
- See repository
- Primary language
- —
- Ecosystem & integrations:
- Claude CodeClaude DesktopCursorCodexWindsurfClaude
- Exposed tool capabilities:
- SEO AuditMulti-threadedConfigurable depth & limitsRobots.txt supportUser agent picker
Traffic sources
Traffic breakdown
Channels
- Direct39%
- Organic Search34%
- Referrals10%
- Social6%
- Other11%
Countries
- India58%
- United Kingdom22%
- Spain11%
- United States7%
- Egypt2%
Search
Domain authority —Domain registered 2026-05-09
| Keyword | Monthly volume |
|---|---|
| spam score checker | 101K |
| librecrawl | 7,560 |
| toxic backlink checker | 760 |
| seo crawler online | 520 |
| free seo api | 240 |
Traffic data: Vaneform
Pricing
Trial: None · Observed 2026-11-01 · Pricing page
Pages & changes
Key pages
Weekly snapshotsChanges
No pricing, plan, or positioning changes detected since tracking started.
Design
Enterprise Clean (Light canvas, balanced density) featuring centered headline + cta layout and code block / terminal / cli visuals.
First-screen preview · click to zoom
First-screen pitch & conversion flow
“The SEO crawler built for the AI era”
Centered Headline + CTA hero structure paired with download app / install extension CTA and no explicit trust bar.
Conversion path: Centered Headline + CTA + Code Block / Terminal / CLI → Download App / Install Extension
- Category Positioning Anchor
- Code & Terminal
- Large Hero Product Shot
Palette · click to copy
- Typography
- 8.0
- Color & Contrast
- 8.0
- Layout & Spacing
- 8.0
- Craft & Polish
- 8.0
- Distinctiveness
- 7.0
Structure
- Fonts
- Inter / Geist Mono
- Hero layout
- Centered Headline + CTA
- Primary visual
- Code Block / Terminal / CLI
- Conversion CTA
- Download App / Install Extension
- Social proof
- No Explicit Trust Bar
- Navigation
- Full-Width Top Bar
- Theme & density
- Light · Balanced
- Corners & depth
- Large Radius · Hairline borders
Preview full AI design brief (includes :root CSS variables & layout rules)Style tokens only; never copy brand names, logos, copy, or images
# Design Brief: Enterprise Clean (with Dark Developer)
Trustworthy blue-anchored palette, structured grids, and prominent customer logo walls.
## Design Tokens
```css
:root {
--background: #ffffff;
--surface: #f5f8fb;
--foreground: #171b29;
--muted-foreground: #7b808b;
--accent: #08cdb5;
--radius: 16px;
--font-heading: "Inter", ui-sans-serif, system-ui, sans-serif;
--font-body: "Inter", ui-sans-serif, system-ui, sans-serif;
--font-mono: "Geist Mono", ui-monospace, monospace;
}
```
Color area ratio: Background #FFFFFF (~77%) · Surface #F5F8FB (~8%) · Text #171B29 (~8%) · Muted Text #7B808B (~4%) · Accent #08CDB5 (~3%). Background and surface dominate the canvas; reserve the accent color for primary buttons and active states.
## Layout & Conversion Structure
- Hero layout: Centered Headline + CTA
- Navigation: Full-Width Top Bar
- Theme & density: Light · Balanced
- Border radius & elevation: Large Radius; no drop shadows—separate layers with hairline borders and whitespace
- Primary visual medium: Code Block / Terminal / CLI
- Conversion CTA: Download App / Install Extension
- Headline hook: Category Positioning Anchor
- Hero components: Code & Terminal, Large Hero Product Shot
- Spatial layout notes: Centered Headline + CTA hero structure paired with download app / install extension CTA and no explicit trust bar.
- Visual summary: Enterprise Clean (Light canvas, balanced density) featuring centered headline + cta layout and code block / terminal / cli visuals.
## Avoid
- Experimental navigation patterns
- Low-legibility decorative fonts
- Visual novelty that obscures the value proposition
Implement the UI following the design tokens and layout specifications above: use only these color variables, and reserve the accent color strictly for primary actions and active states. Adopt only this visual style—never copy any reference product’s brand name, logo, copy, or imagery.
Questions & evidence
- How much does Crawly cost?
- Free: £0/ forever. Observed 2026-11-01. Check the source for current billing terms, usage limits and taxes.Source
- How much website traffic does Crawly get?
- Vaneform estimates 5.2K website visits in 2026-10. Visits can include repeat visits; this estimate measures web traffic separately from paying customers or revenue.Source
- What is Crawly and what platforms does it support?
- Crawly is catalogued under SEO Tools: The SEO crawler built for the AI era. Supported platforms: MCP Server, API.
- Is Crawly open source?
- Crawly has a public repository (https://github.com/Get-Crawly/Crawly-App-Releases) with its source repository published.Source
Related products in this category
These products share a catalog category. Compare customer tasks, features and deployment requirements before treating them as alternatives.
| Product | Entry price | Visits | Revenue |
|---|---|---|---|
| SEMrushGiantBe found and chosen everywhere search happens | $117.33/mo | 11.4M | $443.6M/yrClaimed |
| ahrefsGiantMake your business discoverable—in search, AI, and beyond | $50/mo | 7.8M | $100M/yrClaimed |
| smallseotoolsMatureYou need effective SEO tools which are 100% free? Check out our Search Engine Optimization tools for checking backlinks | $5.99/mo | 2.8M | Undisclosed |
| SE RankingMatureSearch data you can trust. Results you can explain. | $29/mo | 1.2M | Undisclosed |
| TubePilotMature100% Free YouTube Tools | — | 862.8K | Undisclosed |
| rankmathMatureSEO for WordPress Made Easy | $5.59/mo | 710K | Undisclosed |