🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Execute complex automation scripts via remote cloud sessions , featuring integrated residential proxies , automated CAPTCHA solving , and native JavaScript rendering for the toughest dynamic websites.

All-in-one web scraping API for real-time, large-scale data extraction – proxies, CAPTCHA handling, JS rendering, and parsing in a single request returning HTML or structured JSON.

Turn plain English queries into structured web data, featuring automated markdown extraction and full JavaScript rendering for dynamic websites.

Streamlit-based app for job portal scraping

ScrapingBee is a France-based web scraping API that handles headless browsers, proxy rotation, anti-bot defenses, and CAPTCHA solving so developers can extract data from any website with a single API call.

Smart prerendering for WordPress — make your content visible to search engines, social bots, and AI crawlers. Zero config. 29+ bots. ~200ms.

CDP-based web crawler for AI agents. Extracts full content from dynamic JavaScript-rendered pages that traditional scrapers miss.

Advanced Website Cloner with GUI — Clone static & SPA websites (React/Vue/Angular) with HTML, CSS, JS, images, and auto-fixed local paths. Supports recursive cloning and offline viewing.

Docs and examples for the JS Content Crawler Lite for RAG actor on Apify

Async Playwright scraper for JS-rendered pages — handles pagination, infinite scroll, and author enrichment

web scraper resilient javascript

A Python-based ethical web crawler for penetration testing with support for JS rendering, form extraction, subdomain enumeration, and structured output for security analysis.

Zenscrape is a web scraping API that returns the rendered HTML of any target URL while handling proxy rotation, headless-browser JavaScript rendering, geotargeting, and Cloudflare protection.

JustSerpAPI Crawl Webpage Rendered HTML API Python SDK examples, with related Google Search API, Google Lens API, Google Maps API, Google News API, Google Shopping API, Google Scholar API, Google Finance API, Google Trends API, Google Jobs API, Google Patents API, Google Hotels API, and Web APIs.

Hybrid web crawler that intelligently renders JavaScript-heavy pages only when needed — balances content coverage and infrastructure cost using heuristic scoring + conditional Playwright rendering.

Universal Playwright-based scraper that captures fully rendered HTML, screenshots, and iframe content — ideal for archiving or analyzing modern JavaScript-heavy websites.

Verify AI outputs in real-time to ensure code and data accuracy before execution with this Model Context Protocol server.