Scrapfly
-
Verified
- Sponsor
- 176 followers
- United States of America
- https://scrapfly.io
- company/scrapfly
One key unlocks all five.
| API | What it does | Docs |
|---|---|---|
| Web Scraping | Scrape any page, bypass anti-bot, render JS at scale | docs |
| Cloud Browser | Remote stealth browsers with full CDP for automation | docs |
| Screenshot | Full-page screenshots, auto-scroll, element capture, PDF | docs |
| Extraction | AI-powered structured data from HTML and documents | docs |
| Crawler (beta) | Crawl entire sites with a single API call | docs |
- 🔌 MCP Server — Connect Claude, Cursor, and other LLM clients to live web data. → Repo
- 🤖 AI Browser Agent (new) — Automate any site with natural language. Self-healing, structured JSON output. → Try it
- ⌨️ Scrapfly CLI — Agentic shell for scraping, extraction, screenshots, and autonomous crawls. Works in terminals and CI. → Product page · Docs · Repo
- 🛡️ Antibot Detector (beta) — Identify which antibot guards any site (Cloudflare, DataDome, Akamai, Kasada, +20 more). → Product page · Repo
| Language | Repo | Install |
|---|---|---|
| CLI | scrapfly-cli | curl -fsSL scrapfly.io/cli | sh |
| Python | python-scrapfly | pip install scrapfly-sdk |
| TypeScript / JS | typescript-scrapfly | npm i scrapfly-sdk |
| Go | go-scrapfly | go get github.com/scrapfly/go-scrapfly |
| Rust | rust-scrapfly | cargo add scrapfly-sdk |
| Scrapy | docs | pip install "scrapfly-sdk[scrapy]" |
| n8n | n8n-nodes-scrapfly | n8n community node |
LLM framework integrations: LangChain · LlamaIndex · CrewAI · Zapier · Make · n8n
Start scraping in 60 seconds — grab a free API key, no credit card required.
Pinned Loading
Repositories
- scrapfly-cli Public
Agentic CLI for the Scrapfly platform: scrape, extract, crawl, and drive a cloud browser over CDP. Built-in LLM agent with Anthropic, OpenAI, Gemini, and Ollama. JSON-first, pipe-friendly, one static binary.
- rust-scrapfly Public
Official Rust SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Async, rustls, zero unwraps.
- typescript-scrapfly Public
Official TypeScript/JavaScript SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Ships to npm, JSR, and Deno.
- python-scrapfly Public
Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.
- go-scrapfly Public
Official Go SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser.
- scrapfly-mcp Public
Official Scrapfly MCP server for Cursor, Claude Desktop, and any MCP-compatible client. Enterprise-grade web scraping, AI extraction, and anti-bot–aware data access as first-class tools.
- Antibot-Detector Public
Real-time detection of anti-bot systems, CAPTCHAs & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
- skills Public
Scrapfly agent skills for web scraping, extraction, screenshots, crawling, and browser automation
Sponsoring
Top languages
Loading…
Most used topics
Loading…