web-data

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Python scraper based on AI

Foundational low latency web data collecting in Rust

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

WarcDB: Web crawl data as SQLite databases.

Python client library for Diffbot APIs

Export Safari reading list to JSON or CSV

Zero-config CLI that gives AI agents reliable access to protected web data through Zenrows — Fetch, Extract, Batch, and Browser Sessions, plus MCP setup and agent skills. No API key needed to start.

The official Node.js SDK for Spidra.

Web Data Frames

Agent skill that gives it hands in the browser. 25+ tools to navigate, extract data, execute scripts, intercept APIs — all in user's own Chrome with their login sessions. No passwords needed. 给Agent一双手，像用户一样使用浏览器，25+自动化工具，数据完全本地处理。

简书超级爬虫, 包括文章.用户信息.评论等

Amazon product data analysis with Python & Jupyter. Includes cleaning, stats, and visualizations of categories, prices, ratings, and availability.

51 Agent Skills for the Scavio web data API: one umbrella skill plus one per platform for Google, Amazon, TikTok, LinkedIn, YouTube, Instagram, Reddit and 40 more, as structured JSON

Analyze and parse HTML responses, programmatically scrape web data, and utilize Pandas DataFrames to store, transform, and merge tables.

High-performance web scraping engine that converts any web page into clean markdown --- with 3-layer fallback (Cheerio --> Playwright --> Abrasio) and AI-powered structured extraction

Official GoAnyAPI MCP server — connect AI agents to web data, Google Search, SEO, backlinks, Google Ads Transparency, traffic, domain intelligence, and more APIs.

Web Scraper - Turn public web pages into structured, source-aware records for research workflows

Coresignal MCP - fresh company, employee, and jobs records in real time

Bright Data — independent third-party profile of a public API surface, by API Evangelist. Bright Data is an Israeli web data platform and operator of the world's largest legitimate residential proxy network (400M+ IPs across 195 countries). The platform combines proxy infrastructure (residential, ISP, datacenter, mobile) with higher-level web-acces