[{"data":1,"prerenderedAt":4},["ShallowReactive",2],{"readme:crawl4ai":3},"\u003Ch1>🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper.\u003C\u002Fh1>\n\u003Cdiv align=\"center\">\u003Cp>\u003Ca href=\"https:\u002F\u002Ftrendshift.io\u002Frepositories\u002F11716\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Ftrendshift.io\u002Fapi\u002Fbadge\u002Frepositories\u002F11716\" alt=\"unclecode%2Fcrawl4ai | Trendshift\" width=\"250\" height=\"55\" \u002F>\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fstargazers\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fstars\u002Funclecode\u002Fcrawl4ai?style=social\" alt=\"GitHub Stars\" \u002F>\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fnetwork\u002Fmembers\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fforks\u002Funclecode\u002Fcrawl4ai?style=social\" alt=\"GitHub Forks\" \u002F>\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>\u003Ca href=\"https:\u002F\u002Fbadge.fury.io\u002Fpy\u002Fcrawl4ai\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Fbadge.fury.io\u002Fpy\u002Fcrawl4ai.svg\" alt=\"PyPI version\" \u002F>\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fpypi.org\u002Fproject\u002Fcrawl4ai\u002F\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fpypi\u002Fpyversions\u002Fcrawl4ai\" alt=\"Python Version\" \u002F>\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fpepy.tech\u002Fproject\u002Fcrawl4ai\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Fstatic.pepy.tech\u002Fbadge\u002Fcrawl4ai\u002Fmonth\" alt=\"Downloads\" \u002F>\u003C\u002Fa>\n\u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fsponsors\u002Funclecode\" rel=\"nofollow ugc noopener\">\u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fgithub\u002Fsponsors\u002Funclecode?style=flat&logo=GitHub-Sponsors&label=Sponsors&color=pink\" alt=\"GitHub Sponsors\" \u002F>\u003C\u002Fa>\u003C\u002Fp>\n\u003Chr \u002F>\n\u003Ch4>🚀 Crawl4AI Cloud API — Closed Beta (Launching Soon)\u003C\u002Fh4>\n\u003Cp>Reliable, large-scale web extraction, now built to be \u003Cem>\u003Cstrong>drastically more cost-effective\u003C\u002Fstrong>\u003C\u002Fem> than any of the existing solutions.\u003C\u002Fp>\n\u003Cp>👉 \u003Cstrong>Apply \u003Ca href=\"https:\u002F\u002Fforms.gle\u002FE9MyPaNXACnAMaqG7\" rel=\"nofollow ugc noopener\">here\u003C\u002Fa> for early access\u003C\u002Fstrong>\u003Cbr \u002F>\u003Cem>We’ll be onboarding in phases and working closely with early users.\nLimited slots.\u003C\u002Fem>\u003C\u002Fp>\n\u003Chr \u002F>\n\u003Cp align=\"center\">\n    \u003Ca href=\"https:\u002F\u002Fx.com\u002Fcrawl4ai\" rel=\"nofollow ugc noopener\">\n      \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FFollow%20on%20X-000000?style=for-the-badge&logo=x&logoColor=white\" alt=\"Follow on X\" \u002F>\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fwww.linkedin.com\u002Fcompany\u002Fcrawl4ai\" rel=\"nofollow ugc noopener\">\n      \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FFollow%20on%20LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white\" alt=\"Follow on LinkedIn\" \u002F>\n    \u003C\u002Fa>\n    \u003Ca href=\"https:\u002F\u002Fdiscord.gg\u002FjP8KfhDhyN\" rel=\"nofollow ugc noopener\">\n      \u003Cimg src=\"https:\u002F\u002Fimg.shields.io\u002Fbadge\u002FJoin%20our%20Discord-5865F2?style=for-the-badge&logo=discord&logoColor=white\" alt=\"Join our Discord\" \u002F>\n    \u003C\u002Fa>\n  \u003C\u002Fp>\n\u003C\u002Fdiv>\u003Cp>Crawl4AI turns the web into clean, LLM ready Markdown for RAG, agents, and data pipelines. Fast, controllable, battle tested by a 50k+ star community.\u003C\u002Fp>\n\u003Cp>\u003Ca href=\"#-recent-updates\" rel=\"nofollow ugc noopener\">✨ Check out latest update v0.9.2\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>✨ \u003Cstrong>New in v0.9.2\u003C\u002Fstrong>: Maintenance patch release. Fixes a \u003Ccode>MemoryAdaptiveDispatcher\u003C\u002Fcode> task\u002Fpage leak when a streaming crawl is closed, Docker Playground \"Advanced Config\" and Monitor WebSocket auth, Playwright headless-shell packaging, and GPU (\u003Ccode>ENABLE_GPU=true\u003C\u002Fcode>) Docker builds. \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fblob\u002Fmain\u002Fdocs\u002Fblog\u002Frelease-v0.9.2.md\" rel=\"nofollow ugc noopener\">Release notes →\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>✨ Recent v0.9.0: Major secure-by-default release of the Docker API server. Auth is on by default, the server binds loopback unless given a token, and the request body is now an untrusted trust boundary. \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fblob\u002Fmain\u002Fdocs\u002Fblog\u002Frelease-v0.9.0.md\" rel=\"nofollow ugc noopener\">Release notes →\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>✨ Recent v0.8.7: Security-hardening release. Fixes critical Docker API vulnerabilities (RCE, SSRF, auth bypass, file write, XSS, hardcoded JWT secret), adds DomainMapper, and ships scraping, deep-crawl, and LLM fixes. \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fblob\u002Fmain\u002Fdocs\u002Fblog\u002Frelease-v0.8.7.md\" rel=\"nofollow ugc noopener\">Release notes →\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>✨ Previous v0.8.0: Crash Recovery & Prefetch Mode! Deep crawl crash recovery with \u003Ccode>resume_state\u003C\u002Fcode> and \u003Ccode>on_state_change\u003C\u002Fcode> callbacks for long-running crawls. New \u003Ccode>prefetch=True\u003C\u002Fcode> mode for 5-10x faster URL discovery. \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fblob\u002Fmain\u002Fdocs\u002Fblog\u002Frelease-v0.8.0.md\" rel=\"nofollow ugc noopener\">Release notes →\u003C\u002Fa>\u003C\u002Fp>\n\u003Cp>✨ Previous v0.7.8: Stability & Bug Fix Release! 11 bug fixes addressing Docker API issues, LLM extraction improvements, URL handling fixes, and dependency updates. \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Funclecode\u002Fcrawl4ai\u002Fblob\u002Fmain\u002Fdocs\u002Fblog\u002Frelease-v0.7.8.md\" rel=\"nofollow ugc noopener\">Release notes →\u003C\u002Fa>\u003C\u002Fp>\n\u003Cdetails>\n  \u003Csummary>🤓 \u003Cstrong>My Personal Story\u003C\u002Fstrong>\u003C\u002Fsummary>\u003Cp>I grew up on an Amstrad, thanks to my dad, and never stopped building. In grad school I specialized in NLP an\u003C\u002Fp>\n\u003C\u002Fdetails>",1784844294536]