Web

Panniantong 77k · 7 days ago

One CLI gives agents read/search access to Twitter, Reddit, YouTube, GitHub, Bilibili and XiaoHongShu with zero API fees — multi-backend routing the maintainers repair when platforms break.

alirezamika 7.9k · 1 months ago

Learn-by-example Python scraper: give it a URL and sample values you want, it infers the extraction rules and reapplies them to similar pages. Tiny, fast, zero selectors.

browser-use 482 · 2 days ago

browser-use's thinnest LLM-to-Chrome bridge: all 652 CDP methods as typed JS calls over one WebSocket — no click() helpers, no rails; the protocol is the API.

browser-use 111.8k · yesterday

The standard library for letting AI agents drive a real browser — click, type, fill forms and complete tasks from a natural-language goal. 100k+ stars, Python.

lightpanda-io 34.3k · yesterday

From-scratch headless browser in Zig for AI agents and automation — CDP-compatible (Puppeteer/Playwright connect as-is) at ~9x the speed and ~16x less memory than headless Chrome.

browseros-ai 13.4k · yesterday

Open-source agentic browsing, twice: BrowserClaw — a browser your MCP agent drives using your real logged-in sessions — and BrowserOS, a Chromium fork with a built-in AI agent.

unclecode 80.5k · yesterday

The 74k-star LLM-native crawler: turns any site into clean, RAG-ready Markdown — adaptive crawling, JS rendering, extraction strategies, Docker deploy. Python, Apache-2.0.

apify 25.6k · yesterday

Apify's web scraping and browser automation library for Node.js/TypeScript — HTTP and headless-browser crawlers with human-like anti-blocking defaults, queues, storage and proxies.

calesthio 11.6k · 3 months ago

Self-hosted OSINT terminal: 27 open feeds — satellite fires, flights, radiation, sanctions, markets, conflict data — polled in parallel onto one Jarvis-style dashboard. LLM turns it two-way.

Thysrael 9.1k · yesterday

Your own AI news radar: monitors the sources you choose and generates daily briefings in English and Chinese — self-hosted, personal, scheduled.

nexu-io 8.6k · 9 days ago

The agentic HTML editor: your local coding-agent CLI (9 auto-detected, zero API keys) writes magazine pages, decks, posters and tweet cards via 75 skills — sandboxed preview, 1-click export.

mvanhorn 60.8k · 2 days ago

The /last30days skill: researches any topic across Reddit, X, YouTube, HN, TikTok and Polymarket in parallel, scores by real engagement, and synthesizes one grounded brief. 50+ agent hosts.

ashuttl 308 · yesterday

Six dependency-free terminal apps for weather, sun, moon, tides, radar and maps, drawn from free public data with no accounts or API keys — mouse-friendly TUIs that try to match your terminal theme.

nanobrowser 13.7k · 14 days ago

Chrome extension running a Planner/Navigator multi-agent loop inside the browser you already use, with your own API keys — a free, local alternative to OpenAI Operator.

alibaba 28.9k · 8 days ago

Alibaba's in-page GUI agent: one script tag gives any webpage its own AI agent — users drive the interface in natural language. TypeScript, tiny bundle, Chrome extension available.

pinchtab 10.2k · 6 days ago

Small Go HTTP/MCP server that gives AI agents direct control over Chrome — stealth CDP injection, multi-instance orchestration and a real-time dashboard. Local-first, single binary.

ScrapeGraphAI 30.1k · 5 days ago

LLM-driven Python scraping: describe what you want and graph pipelines extract structured data from websites or local docs (HTML, XML, JSON, Markdown). 29k stars; cloud API upsell.

D4Vinci 77.5k · 7 days ago

Adaptive Python scraping framework: selectors that relearn when sites redesign, stealth fetchers that pass Cloudflare, spiders with proxy rotation and an MCP server — request to full crawl.

scrapy 64.1k · 4 days ago

The veteran Python web crawling framework: spiders, middlewares, pipelines and battle-tested scheduling — 60k+ stars and still the reference architecture for structured scraping.

vibheksoni 1.9k · 3 days ago

MCP server for undetectable browser automation: real Chrome via nodriver + CDP, Cloudflare/anti-bot bypass, AI-written network hooks — agents browse where Playwright gets blocked.

MODSetter 16k · 3 days ago

Open-source competitive-intelligence platform for agents: live Reddit/YouTube/TikTok/Maps/search connectors; scheduled agents produce briefs and alerts into a cited knowledge base. REST + MCP.

koala73 85.2k · yesterday

Real-time global situational-awareness dashboard: curated feeds AI-synthesized into briefs over a 3D globe, cross-stream correlation and a country instability index — plus MCP, REST API and CLI.