APIs, MCP servers and models to crawl a site
5 tools in the catalog do this, by name.
ApifyAPICloud platform and store of ready-made scrapers and automations (Actors)
Bright DataAPIWeb data APIs with pre-built scrapers, SERP results, cloud browsers and datasets
FirecrawlAPIScrape, crawl and search the web as LLM-ready markdown or JSON
TavilyAPIWeb search, extract and crawl API built for AI agents
ZyteAPIWeb scraping API with browser rendering and automatic data extraction