Web

Panniantong 97.6k · today

One CLI gives agents read/search access to Twitter, Reddit, YouTube, GitHub, Bilibili and XiaoHongShu with zero API fees — multi-backend routing the maintainers repair when platforms break.

alirezamika 8.1k · 2 months ago

Learn-by-example Python scraper: give it a URL and sample values you want, it infers the extraction rules and reapplies them to similar pages. Tiny, fast, zero selectors.

browser-use 491 · 1 months ago

browser-use's thinnest LLM-to-Chrome bridge: all 652 CDP methods as typed JS calls over one WebSocket — no click() helpers, no rails; the protocol is the API.

browser-use 118k · today

The standard library for letting AI agents drive a real browser — click, type, fill forms and complete tasks from a natural-language goal. 100k+ stars, Python.

lightpanda-io 36.5k · today

From-scratch headless browser in Zig for AI agents and automation — CDP-compatible (Puppeteer/Playwright connect as-is) at ~9x the speed and ~16x less memory than headless Chrome.

browseros-ai 13.9k · today

Open-source agentic browsing, twice: BrowserClaw — a browser your MCP agent drives using your real logged-in sessions — and BrowserOS, a Chromium fork with a built-in AI agent.

unclecode 85.6k · today

The 74k-star LLM-native crawler: turns any site into clean, RAG-ready Markdown — adaptive crawling, JS rendering, extraction strategies, Docker deploy. Python, Apache-2.0.

apify 26.2k · today

Apify's web scraping and browser automation library for Node.js/TypeScript — HTTP and headless-browser crawlers with human-like anti-blocking defaults, queues, storage and proxies.

calesthio 12.1k · 4 months ago

Self-hosted OSINT terminal: 27 open feeds — satellite fires, flights, radiation, sanctions, markets, conflict data — polled in parallel onto one Jarvis-style dashboard. LLM turns it two-way.

bilawalsidhu 56.7k · today

Browser 'spy-satellite' simulator on real open data: live aircraft, ships, satellites, quakes and public cams on a photorealistic 3D globe, voice-driven by a realtime AI agent.

Thysrael 9.7k · today

Your own AI news radar: monitors the sources you choose and generates daily briefings in English and Chinese — self-hosted, personal, scheduled.

nexu-io 9.1k · 2 days ago

The agentic HTML editor: your local coding-agent CLI (9 auto-detected, zero API keys) writes magazine pages, decks, posters and tweet cards via 75 skills — sandboxed preview, 1-click export.

browser-use 23k · 15 days ago

Browser Use's speed experiment: Jev picks the operation and the target element from an indexed action space in one request, and a small LLM writes text only when typing is needed.

mvanhorn 64.4k · 2 days ago

The /last30days skill: researches any topic across Reddit, X, YouTube, HN, TikTok and Polymarket in parallel, scores by real engagement, and synthesizes one grounded brief. 50+ agent hosts.

ashuttl 627 · today

Six dependency-free terminal apps for weather, sun, moon, tides, radar and maps, drawn from free public data with no accounts or API keys — mouse-friendly TUIs that try to match your terminal theme.

lexmount 18.6k · today

Rust headless browser for AI agents on Servo/Stylo components: fetch pages as Markdown or a semantic tree, automate via CDP, WebDriver or BiDi — about 13% of Chrome's memory per task.

nanobrowser 14.1k · today

Chrome extension running a Planner/Navigator multi-agent loop inside the browser you already use, with your own API keys — a free, local alternative to OpenAI Operator.

alibaba 29.4k · yesterday

Alibaba's in-page GUI agent: one script tag gives any webpage its own AI agent — users drive the interface in natural language. TypeScript, tiny bundle, Chrome extension available.

pinchtab 10.4k · 9 days ago

Small Go HTTP/MCP server that gives AI agents direct control over Chrome — stealth CDP injection, multi-instance orchestration and a real-time dashboard. Local-first, single binary.

ScrapeGraphAI 31.8k · 9 days ago

LLM-driven Python scraping: describe what you want and graph pipelines extract structured data from websites or local docs (HTML, XML, JSON, Markdown). 29k stars; cloud API upsell.

D4Vinci 87.8k · today

Adaptive Python scraping framework: selectors that relearn when sites redesign, stealth fetchers that pass Cloudflare, spiders with proxy rotation and an MCP server — request to full crawl.

scrapy 64.8k · today

The veteran Python web crawling framework: spiders, middlewares, pipelines and battle-tested scheduling — 60k+ stars and still the reference architecture for structured scraping.

vibheksoni 2.2k · 3 days ago

MCP server for undetectable browser automation: real Chrome via nodriver + CDP, Cloudflare/anti-bot bypass, AI-written network hooks — agents browse where Playwright gets blocked.

MODSetter 16.4k · today

Open-source competitive-intelligence platform for agents: live Reddit/YouTube/TikTok/Maps/search connectors; scheduled agents produce briefs and alerts into a cited knowledge base. REST + MCP.

koala73 88.5k · today

Real-time global situational-awareness dashboard: curated feeds AI-synthesized into briefs over a 3D globe, cross-stream correlation and a country instability index — plus MCP, REST API and CLI.