firecrawl-alternative

Star

Here are 37 public repositories matching this topic...

ScrapeGraphAI / Scrapegraph-ai

Sponsor

Star

Python scraper based on AI

Updated Jul 20, 2026
Python

oxylabs / google-ai-mode-scraper

Star

Scrape Google AI Mode responses without blocks on a large scale.

web-scraper search-api ai-search google-ai ai-training scraper-api proxy-scrape ai-mode web-scraper-api web-search-api google-ai-mode firecrawl-alternative ai-grounding tavily-alternative

Updated Jun 8, 2026
Java

oxylabs / oxylabs-ai-studio-py

Star

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.

web-scraping search-api ai-search proxy-scraper python-ai ai-training ai-tools web-scraping-python ai-crawler web-scraping-api ai-web-scraper web-search-api ai-scraping ai-scraper web-scraping-ai firecrawl-alternative ai-grounding tavily-alternative

Updated Jul 8, 2026
Python

0xMassi / webclaw

Sponsor

Star

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

Updated Jul 23, 2026
Rust

oxylabs / ai-scraper-py

Star

AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse web sources, this tool simplifies complex scraping operations into efficient, intelligent workflows.

web-scraper search-api ai-search ai-training scraper-api ai-agent ai-studio scraper-api-github open-source-ai web-search-api ai-scraping ai-scraper firecrawl-alternative ai-grounding tavily-alternative

Updated Apr 2, 2026

oxylabs / headless-browser

Star

Execute complex automation scripts via remote cloud sessions , featuring integrated residential proxies , automated CAPTCHA solving , and native JavaScript rendering for the toughest dynamic websites.

python web-scraping search-api ai-search headless-browser ai-training scraper-api oxylabs web-search-api javascript-rendering firecrawl-alternative ai-grounding tavily-alternative

Updated Jun 22, 2026

us / crw

Sponsor

Star

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

docker markdown rust crawler ai mcp html-to-markdown web-crawler web-scraper self-hosted web-scraping data-extraction ai-agents scraping-api llm web-search-api mcp-server firecrawl-alternative tavily-alternative

Updated Jul 26, 2026
Rust

oxylabs / oxylabs-ai-studio-openclaw

Star

Official Oxylabs AI-Studio Openclaw plugin

web-scraper webscraping search-api ai-search google-ai ai-training scraper-api proxy-scrape ai-studio web-scraper-api web-search-api google-ai-mode firecrawl-alternative ai-studio-scraper ai-grounding tavily-alternative

Updated Jul 13, 2026
TypeScript

ScrapingBee / ai-web-scraper

Star

Effortlessly extract data with our AI scraper API. Simplify data extraction, get clean JSON outputs and adapt to page changes. Try it free today!

json data-extraction scraping-api proxy-scraper scraping-python web-scraping-python serp-scraper web-scraping-project web-scraping-api ai-web-scraper web-scraper-api serp-scraper-api ai-scraper ai-data-extraction firecrawl-alternative ai-powered-scraper ai-data-scraping ai-web-scraper-api

Updated Mar 13, 2026

oxylabs / web-scraper-api

Star

All-in-one web scraping API for real-time, large-scale data extraction – proxies, CAPTCHA handling, JS rendering, and parsing in a single request returning HTML or structured JSON.

json proxies web-scraper web-scraping data-extraction structured-data search-api ai-search serp-api scraper-api oxylabs web-scraping-api web-search-api javascript-rendering firecrawl-alternative tavily-alternative

Updated Jun 22, 2026

BrowserCash / teracrawl

Star

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

html-to-markdown web-scraper web-scraping data-extraction browser-automation ai-agents web-search google-serp ai-search serpapi browser-agent ai-crawler antibot-bypass ai-scraping crawl4ai firecrawl-mcp firecrawl-api firecrawl-alternative

Updated Dec 3, 2025
TypeScript

oxylabs / AI-Search-py

Star

Turn plain English queries into structured web data, featuring automated markdown extraction and full JavaScript rendering for dynamic websites.

python search-engine web-scraping search-api ai-search ai-training ai-agent oxylabs web-search-api javascript-rendering firecrawl-alternative ai-grounding

Updated Apr 16, 2026

ai-naymul / BrowserPilot

Star

Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined

Updated Jul 26, 2026
TypeScript

alex-on-ai / WebReaper

Star

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

markdown parser crawler scraper parsing dotnet mcp scraping webcrawler webscraping scraping-websites scraping-api scraping-web llm ai-agents-automation claude-code firecrawl-alternative

Updated Jul 11, 2026
C#

sadiuysal / crawl4ai-mcp-server

Star

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.