Skip to content
Ask Claude about any Chrome extension, answered with Ext Watch data. See how →
Developer Tools extension

Web Crawler

Crawl websites segment by segment and extract structured JSON data

by mayank123srivastava · 1 listing

Add to RadarChrome Web Store Free plan tracks 1 extension · no card
extwatch.com/extensions/web-crawler-haennclepgpfehgefoclaofhdnnchnhe
Web Crawlermayank123srivastava · Developer ToolsLow access
Users
22
#12,518 of 31,410 in category
Rating
5.00
1 rating · median 4.63
Version
1.0.0
4.26 MiB · Manifest V3
Access
Low2/100
1 permission
From the store listing

Screenshots

1 image from the publisher

Web Crawler screenshot 1

Description

As written by the publisher on the store

Web Crawler — Extract Website Data as JSON

Crawl any website segment by segment and extract structured data in clean JSON format. Perfect for developers, SEO analysts, researchers, and data enthusiasts who need to quickly gather and analyze website content.

🔍 What It Does Web Crawler visits every page on a website, extracts key data from each segment, and delivers it all as organized JSON — stored automatically in MongoDB for easy access.

📦 Data Extracted Per Page • Page title & meta tags (description, keywords, Open Graph) • All headings (H1–H6) • Paragraph text content • Images with alt text • Internal & external links • Script and stylesheet references • HTTP status codes

⚡ Key Features • Segment-by-segment crawling with real-time progress tracking • Auto-fill current tab URL with one click • Configurable max pages limit (1–200) • Export results as downloadable JSON file • Copy JSON to clipboard instantly • Crawl history with status tracking • Beautiful dark-mode interface • Data stored in MongoDB for persistence and querying

🛠️ How It Works

Enter a URL or auto-fill from your current tab
Click "Start Crawl" and watch the progress bar

View structured JSON results with page, link, and image counts

Export or copy the data for your projects

⚙️ Requirements This extension requires a backend server (Node.js + Express) and MongoDB. Setup instructions are available on our GitHub repository.

Built with Node.js, Express.js, Cheerio, and MongoDB.

Ratings and reviews

Ratings as the store shows them
Reviews on the store
5.001 rating on the store

No written reviews held for this listing yet.

Radar

Track Web Crawler on Radar

This page shows the listing as it is today. Add it to Radar and get one email when it changes.

  • Users and rating
  • Store text and screenshots
  • Permissions it asks for
Free plan tracks 1 extension · no card
Ext Watch Radar watchlist cards showing tracked extensions with users, rating, version and latest store change
Guide

Web Crawler, in plain words

What it is, what to use instead, what it can access and how to fix it.

At a glance

Web Crawler at a glance

Web Crawler is a Developer Tools extension by mayank123srivastava with 22 users. Chrome Web Store users rate it 5.00 out of 5 from 1 rating, which is still a small sample. By users it sits in the top half of Developer Tools extensions.

By users
#12,518of 31,410 in Developer Tools
Rating
5.00category median 4.63
Access
Low2 of 100

Web Crawler alternatives

Closest by what they do · users as the store shows them
Web Crawler225.00 ★
Web Crawler Extension5745.0 ★Manycrawl - Web Scraper2994.3 ★Arctobius - Web Crawler1545.0 ★Web Crawler152no ratingLink Crawler1215.0 ★
Permissions

Is Web Crawler safe?

Web Crawler asks for 1 permission. None of them are on our list of wide-access permissions.

Permissions show what it could do, not what it does. See the full permission list.

2/ 100Low access
Web Crawler1 permission
  • storageNot on our wide-access list

Every permission Web Crawler asks for

1 permission · none sensitive · Low access overall

Browser permissions · 1

  • Save its own settingsstorage

Sensitive marks access that reaches your data or other sites. The access level is a 0 to 100 score of all of it: under 25 is Low, 60 and up is High.

Troubleshooting

Web Crawler not working?

What recent reviews say

Store reviews from the last 90 days

We have no recent public signals of problems with Web Crawler.

Common fixes

Try them in this order
  1. 1Update Chrome and the extension
  2. 2Turn it off and on in chrome://extensions
  3. 3Reload the page
  4. 4Turn other extensions off in case two clash

Still stuck? Contact the maker or try an alternative.

300K Chrome extensions in one place

Know when a listing changes

Track any extension on Radar: users, rating, permissions and store text, with one email when something moves.

No credit card neededFree planAsk Claude on Pro