Crawl4AI
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install crawl4ai
Dependencies
- aiofiles
- rich
- httpx
- playwright
- python-dotenv
- xxhash
- pillow
- beautifulsoup4
- anyio
- brotli
- cssselect
- tf-playwright-stealth
- aiosqlite
- lxml
- snowballstemmer
- fake-useragent
- pyopenssl
- requests
- numpy
- alphashape
- aiohttp
- litellm
- nltk
- psutil
- lark
- pydantic
- pyyaml
- patchright
- chardet
- humanize
- shapely
- click
- rank-bm25
Releases
| Version | Released | Bullseye Python 3.9 |
Bookworm Python 3.11 |
Trixie Python 3.13 |
Files |
|---|---|---|---|---|---|
| 0.7.6 | 2025-10-22 | ||||
|
|||||
| 0.7.5 | 2025-10-21 | ||||
|
|||||
| 0.7.4 | 2025-08-17 | ||||
|
|||||
| 0.7.3 | 2025-08-09 | ||||
|
|||||
| 0.7.2 | 2025-07-25 | ||||
|
|||||
| 0.7.1 | 2025-07-17 | ||||
|
|||||
| 0.7.0 | 2025-07-12 | ||||
|
|||||
| 0.6.3 | 2025-05-12 | ||||
|
|||||
| 0.6.2 | 2025-04-26 | ||||
|
|||||
| 0.6.1 | 2025-04-24 | ||||
|
|||||
| 0.6.0 | 2025-04-23 | ||||
|
|||||
| 0.6.0rc1 pre-release | 2025-04-22 | ||||
|
|||||
| 0.5.0.post8 | 2025-03-25 | ||||
| 0.5.0.post7 | 2025-03-25 | ||||
| 0.5.0.post6 | 2025-03-25 | ||||
| 0.5.0.post5 | 2025-03-25 | ||||
| 0.5.0.post4 | 2025-03-06 | ||||
| 0.5.0.post3 | 2025-03-06 | ||||
| 0.5.0.post2 | 2025-03-05 | ||||
| 0.5.0.post1 | 2025-03-04 | ||||
| 0.5.0 | 2025-03-04 | ||||
|
|||||
| 0.4.248 | 2025-02-01 | ||||
|
|||||
| 0.4.248b3 pre-release | 2025-01-26 | ||||
|
|||||
| 0.4.247 | 2025-01-06 | ||||
|
|||||
| 0.4.246 | 2025-01-01 | ||||
|
|||||
| 0.4.245 | 2025-01-01 | ||||
|
|||||
| 0.4.244 | 2025-01-01 | ||||
|
|||||
| 0.4.243 | 2025-01-01 | ||||
|
|||||
| 0.4.242 | 2025-01-01 | ||||
|
|||||
| 0.4.241 | 2025-01-01 | ||||
|
|||||
| 0.4.24 | 2024-12-31 | ||||
|
|||||
| 0.4.23 | 2024-12-16 | ||||
|
|||||
| 0.4.22 | 2024-12-15 | ||||
|
|||||
| 0.4.21 | 2024-12-13 | ||||
|
|||||
| 0.4.3b3 pre-release | 2025-01-25 | ||||
|
|||||
| 0.4.3b2 pre-release | 2025-01-22 | ||||
|
|||||
| 0.4.3b1 pre-release | 2025-01-21 | ||||
|
|||||
| 0.4.1 | 2024-12-09 | ||||
|
|||||
| 0.4.0 | 2024-12-04 | ||||
|
|||||
| 0.3.746 | 2024-11-29 | ||||
|
|||||
| 0.3.745 | 2024-11-28 | ||||
|
|||||
| 0.3.744 | 2024-11-28 | ||||
|
|||||
| 0.3.743 | 2024-11-28 | ||||
|
|||||
| 0.3.742 | 2024-11-24 | ||||
|
|||||
| 0.3.741 | 2024-11-23 | ||||
|
|||||
| 0.3.731 | 2024-11-11 | ||||
| 0.3.74 | 2024-11-22 | ||||
|
|||||
| 0.3.73 | 2024-11-05 | ||||
|
|||||
| 0.3.72 | 2024-10-24 | ||||
|
|||||
| 0.3.71 | 2024-10-18 | ||||
|
|||||
| 0.3.8 | 2024-10-18 | ||||
|
|||||
| 0.3.7 | 2024-10-18 | ||||
|
|||||
| 0.3.6 | 2024-10-14 | ||||
|
|||||
| 0.3.5 | 2024-10-02 | ||||
|
|||||
| 0.3.4 | 2024-09-29 | ||||
|
|||||
| 0.3.3 | 2024-09-28 | ||||
|
|||||
| 0.3.2 | 2024-09-26 | ||||
|
|||||
| 0.3.1 | 2024-09-25 | ||||
|
|||||
| 0.3.0 | 2024-09-25 | ||||
|
|||||
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue