crawl4ai-ctf
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper (CTF fork with Docker cgroup memory + BFS/Best-First max_pages fixes)
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install crawl4ai-ctf
Dependencies
- requests
- rank-bm25
- humanize
- brotli
- fake-useragent
- aiosqlite
- tf-playwright-stealth
- litellm
- python-dotenv
- patchright
- cssselect
- psutil
- pyyaml
- pydantic
- chardet
- nltk
- snowballstemmer
- beautifulsoup4
- playwright
- rich
- anyio
- click
- httpx
- pyopenssl
- shapely
- aiofiles
- pillow
- alphashape
- lxml
- lark
- numpy
- xxhash
- aiohttp
Releases
| Version | Released | Bullseye Python 3.9 |
Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|---|
| 0.7.6.post3 | 2025-11-02 | ||||
| 0.7.6.post2 | 2025-11-02 | ||||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue