Web Crawler
- 22 users
- 5.001 rating
- #12,518in Developer Tools
Crawl websites segment by segment and extract structured JSON data
by mayank123srivastava · 1 listing
- Users
- 22
- #12,518 of 31,410 in category
- Rating
- 5.00
- 1 rating · median 4.63
- Version
- 1.0.0
- 4.26 MiB · Manifest V3
- Access
- Low2/100
- 1 permission
Description
As written by the publisher on the storeWeb Crawler — Extract Website Data as JSON
Crawl any website segment by segment and extract structured data in clean JSON format. Perfect for developers, SEO analysts, researchers, and data enthusiasts who need to quickly gather and analyze website content.
🔍 What It Does Web Crawler visits every page on a website, extracts key data from each segment, and delivers it all as organized JSON — stored automatically in MongoDB for easy access.
📦 Data Extracted Per Page • Page title & meta tags (description, keywords, Open Graph) • All headings (H1–H6) • Paragraph text content • Images with alt text • Internal & external links • Script and stylesheet references • HTTP status codes
⚡ Key Features • Segment-by-segment crawling with real-time progress tracking • Auto-fill current tab URL with one click • Configurable max pages limit (1–200) • Export results as downloadable JSON file • Copy JSON to clipboard instantly • Crawl history with status tracking • Beautiful dark-mode interface • Data stored in MongoDB for persistence and querying
🛠️ How It Works
Enter a URL or auto-fill from your current tab
Click "Start Crawl" and watch the progress bar
View structured JSON results with page, link, and image counts
Export or copy the data for your projects
⚙️ Requirements This extension requires a backend server (Node.js + Express) and MongoDB. Setup instructions are available on our GitHub repository.
Built with Node.js, Express.js, Cheerio, and MongoDB.
Ratings and reviews
Ratings as the store shows themNo written reviews held for this listing yet.
Track Web Crawler on Radar
This page shows the listing as it is today. Add it to Radar and get one email when it changes.
- Users and rating
- Store text and screenshots
- Permissions it asks for

Web Crawler, in plain words
What it is, what to use instead, what it can access and how to fix it.
Web Crawler at a glance
Web Crawler is a Developer Tools extension by mayank123srivastava with 22 users. Chrome Web Store users rate it 5.00 out of 5 from 1 rating, which is still a small sample. By users it sits in the top half of Developer Tools extensions.
- By users
- #12,518of 31,410 in Developer Tools
- Rating
- 5.00category median 4.63
- Access
- Low2 of 100
Web Crawler alternatives
Closest by what they do · users as the store shows themIs Web Crawler safe?
Web Crawler asks for 1 permission. None of them are on our list of wide-access permissions.
Permissions show what it could do, not what it does. See the full permission list.
storageNot on our wide-access list
Every permission Web Crawler asks for
1 permission · none sensitive · Low access overallBrowser permissions · 1
- Save its own settings
storage
Sensitive marks access that reaches your data or other sites. The access level is a 0 to 100 score of all of it: under 25 is Low, 60 and up is High.
Web Crawler not working?
What recent reviews say
Store reviews from the last 90 daysWe have no recent public signals of problems with Web Crawler.
Common fixes
Try them in this order- 1Update Chrome and the extension
- 2Turn it off and on in chrome://extensions
- 3Reload the page
- 4Turn other extensions off in case two clash
Still stuck? Contact the maker or try an alternative.
Know when a listing changes
Track any extension on Radar: users, rating, permissions and store text, with one email when something moves.