2025-10-25T16:24:06,013 Created temporary directory: /tmp/pip-ephem-wheel-cache-oljuweoa 2025-10-25T16:24:06,015 Created temporary directory: /tmp/pip-build-tracker-yt8z35fo 2025-10-25T16:24:06,015 Initialized build tracking at /tmp/pip-build-tracker-yt8z35fo 2025-10-25T16:24:06,016 Created build tracker: /tmp/pip-build-tracker-yt8z35fo 2025-10-25T16:24:06,017 Entered build tracker: /tmp/pip-build-tracker-yt8z35fo 2025-10-25T16:24:06,018 Created temporary directory: /tmp/pip-wheel-tegccd5e 2025-10-25T16:24:06,021 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-10-25T16:24:06,023 Created temporary directory: /tmp/pip-ephem-wheel-cache-_8jgg4xz 2025-10-25T16:24:06,060 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-10-25T16:24:06,063 2 location(s) to search for versions of crawlo: 2025-10-25T16:24:06,063 * https://pypi.org/simple/crawlo/ 2025-10-25T16:24:06,063 * https://www.piwheels.org/simple/crawlo/ 2025-10-25T16:24:06,064 Fetching project page and analyzing links: https://pypi.org/simple/crawlo/ 2025-10-25T16:24:06,065 Getting page https://pypi.org/simple/crawlo/ 2025-10-25T16:24:06,066 Found index url https://pypi.org/simple 2025-10-25T16:24:06,293 Fetched page https://pypi.org/simple/crawlo/ as application/vnd.pypi.simple.v1+json 2025-10-25T16:24:06,298 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5e/f7/15da16c9e40a732d265b11ae6f392ba6e38c843eb1a3850e1202ba0e57fa/crawlo-1.3.9-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,300 Found link https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.3.9 2025-10-25T16:24:06,300 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/4a/9c/82aeeb0713f1125291ead74dff2f44b27fee8c876a5d58b5eb08bc8a3fec/crawlo-1.4.0-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,302 Found link https://files.pythonhosted.org/packages/8d/80/d3c003285cc6ae70e0b6e71800635eed0c00e9441d0ffe0b4e0f41db962d/crawlo-1.4.0.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.0 2025-10-25T16:24:06,302 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/c4/7e/00a3eecc7fbf7b34af6ae79e82666ee8d49b743ada85547ac407641333bf/crawlo-1.4.1-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,303 Found link https://files.pythonhosted.org/packages/5b/48/c8439c1cbd3b4b819afd6885f2829772542bcce98951c0acc73079aedb95/crawlo-1.4.1.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.1 2025-10-25T16:24:06,304 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/f2/31/a52238ece7a50d949f7985dc13fedfa9d34b0aa68a9834e3cb3b93438e78/crawlo-1.4.2-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,305 Found link https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.2 2025-10-25T16:24:06,306 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/bf/15/d5e3c82633a27f783fe238da06e9ccaeb64d14385bfdd4b879b1fe86af93/crawlo-1.4.3-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,307 Found link https://files.pythonhosted.org/packages/9e/f1/26060b36cf81bfa80cd01a53739484ff7cad9f88c99decb0f0fdfc7c3069/crawlo-1.4.3.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.3 2025-10-25T16:24:06,308 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5c/0c/27b5fc6e81ddc802dec3c387a1517b6c51f9fa890811f449106bbe1ee49f/crawlo-1.4.4-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,309 Found link https://files.pythonhosted.org/packages/88/c8/6e9c00bed5250995ac9058338b5725c6312be4ce0e43a6a7da7e8ec28b65/crawlo-1.4.4.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.4 2025-10-25T16:24:06,310 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/8e/5e/78d5548bdc0911afcb3e49d372b7b0efd3384d11cc8d7904a32ef0c47359/crawlo-1.4.5-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,311 Found link https://files.pythonhosted.org/packages/79/59/23c7e418b027965bb7e79de626fb51e63c6bd0974b0e04ea4bd40dec19ba/crawlo-1.4.5.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.5 2025-10-25T16:24:06,312 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/10/50/43b2b74b9eff28f4e841b7cf02fa19435b613ff04e3f4e58d8f1871ea504/crawlo-1.4.6-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,313 Found link https://files.pythonhosted.org/packages/4e/01/62b1a4c29d140a6c3adc5880a2e6beace3bc78275a06b17351be96bc6686/crawlo-1.4.6.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.6 2025-10-25T16:24:06,313 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/42/1e/172b8c0c7a8a239936201a34eb388d453dd66b720d0d84b57f9c035f0ecb/crawlo-1.4.7-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,314 Found link https://files.pythonhosted.org/packages/ab/50/ba113f63f832494b8238d8182875dfc72d45afc191f69f4fa9ca2d4b09c4/crawlo-1.4.7.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.7 2025-10-25T16:24:06,315 Fetching project page and analyzing links: https://www.piwheels.org/simple/crawlo/ 2025-10-25T16:24:06,316 Getting page https://www.piwheels.org/simple/crawlo/ 2025-10-25T16:24:06,317 Found index url https://www.piwheels.org/simple 2025-10-25T16:24:06,529 Fetched page https://www.piwheels.org/simple/crawlo/ as text/html 2025-10-25T16:24:06,533 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.6-py3-none-any.whl#sha256=f15eba91005d4f2cd583499d8c36d1881f75e9ef02d85ce00427b50818dcaea8 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,533 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.5-py3-none-any.whl#sha256=bf7577e3497593c0511dc3eb84857f8d0c751bdae053cf0dda37179224b39d4b (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,534 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.4-py3-none-any.whl#sha256=90be59ea0da9f7da93b7844325e05af5de647c9316deda8219e1940705f880ea (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,534 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.3-py3-none-any.whl#sha256=4b40e6520c22d1a464d883cd9a27d64d7fcbcf7c825bd8c84b344b04f91c9c97 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,535 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.2-py3-none-any.whl#sha256=4f2a550553e1b2bac41ddf8f2b898fe64c49f19bb810301fa99fe1d632eeb1fd (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,536 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.1-py3-none-any.whl#sha256=5f48469ed3fa98ef76f9e622b25cdb555df1a3193b563f219c7ee540ae97dca9 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,536 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.0-py3-none-any.whl#sha256=51340c538a39da052af5ab3194e0916b203090854e495eb7b78290861e427e72 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,537 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.3.9-py3-none-any.whl#sha256=4ba32e11ae2213a168d8623a104c31659733167cee87ef5a7cdbcdf05fb931c3 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-25T16:24:06,537 Skipping link: not a file: https://www.piwheels.org/simple/crawlo/ 2025-10-25T16:24:06,538 Skipping link: not a file: https://pypi.org/simple/crawlo/ 2025-10-25T16:24:06,557 Given no hashes to check 1 links for project 'crawlo': discarding no candidates 2025-10-25T16:24:06,575 Collecting crawlo==1.4.7 2025-10-25T16:24:06,577 Created temporary directory: /tmp/pip-unpack-_u77ud8j 2025-10-25T16:24:06,789 Downloading crawlo-1.4.7.tar.gz (430 kB) 2025-10-25T16:24:07,568 Added crawlo==1.4.7 from https://files.pythonhosted.org/packages/ab/50/ba113f63f832494b8238d8182875dfc72d45afc191f69f4fa9ca2d4b09c4/crawlo-1.4.7.tar.gz to build tracker '/tmp/pip-build-tracker-yt8z35fo' 2025-10-25T16:24:07,572 Created temporary directory: /tmp/pip-build-env-opt03fwa 2025-10-25T16:24:07,577 Installing build dependencies: started 2025-10-25T16:24:07,578 Running command pip subprocess to install build dependencies 2025-10-25T16:24:08,752 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-10-25T16:24:09,330 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-10-25T16:24:09,354 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-10-25T16:24:11,086 Collecting setuptools>=80.9.0 2025-10-25T16:24:11,256 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-10-25T16:24:11,523 Collecting wheel 2025-10-25T16:24:11,543 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2025-10-25T16:24:14,425 Installing collected packages: wheel, setuptools 2025-10-25T16:24:14,670 Creating /tmp/pip-build-env-opt03fwa/overlay/local/bin 2025-10-25T16:24:14,673 changing mode of /tmp/pip-build-env-opt03fwa/overlay/local/bin/wheel to 755 2025-10-25T16:24:18,438 Successfully installed setuptools-80.9.0 wheel-0.45.1 2025-10-25T16:24:18,711 Installing build dependencies: finished with status 'done' 2025-10-25T16:24:18,717 Getting requirements to build wheel: started 2025-10-25T16:24:18,719 Running command Getting requirements to build wheel 2025-10-25T16:24:19,301 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-10-25T16:24:19,301 !! 2025-10-25T16:24:19,302 ******************************************************************************** 2025-10-25T16:24:19,303 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-10-25T16:24:19,304 License :: OSI Approved :: MIT License 2025-10-25T16:24:19,306 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-10-25T16:24:19,306 ******************************************************************************** 2025-10-25T16:24:19,307 !! 2025-10-25T16:24:19,308 self._finalize_license_expression() 2025-10-25T16:24:19,368 running egg_info 2025-10-25T16:24:19,375 writing crawlo.egg-info/PKG-INFO 2025-10-25T16:24:19,386 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-10-25T16:24:19,388 writing entry points to crawlo.egg-info/entry_points.txt 2025-10-25T16:24:19,393 writing requirements to crawlo.egg-info/requires.txt 2025-10-25T16:24:19,394 writing top-level names to crawlo.egg-info/top_level.txt 2025-10-25T16:24:19,465 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:19,486 reading manifest template 'MANIFEST.in' 2025-10-25T16:24:19,487 warning: no files found matching 'VERSION' 2025-10-25T16:24:19,488 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-10-25T16:24:19,560 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-10-25T16:24:19,563 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-10-25T16:24:19,564 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-10-25T16:24:19,567 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-10-25T16:24:19,569 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-10-25T16:24:19,571 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-10-25T16:24:19,573 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-10-25T16:24:19,575 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-10-25T16:24:19,577 no previously-included directories found matching 'samples' 2025-10-25T16:24:19,578 no previously-included directories found matching 'docs' 2025-10-25T16:24:19,599 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:19,690 Getting requirements to build wheel: finished with status 'done' 2025-10-25T16:24:19,693 Created temporary directory: /tmp/pip-modern-metadata-g_5e0h5v 2025-10-25T16:24:19,695 Preparing metadata (pyproject.toml): started 2025-10-25T16:24:19,697 Running command Preparing metadata (pyproject.toml) 2025-10-25T16:24:20,260 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-10-25T16:24:20,260 !! 2025-10-25T16:24:20,261 ******************************************************************************** 2025-10-25T16:24:20,262 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-10-25T16:24:20,263 License :: OSI Approved :: MIT License 2025-10-25T16:24:20,264 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-10-25T16:24:20,265 ******************************************************************************** 2025-10-25T16:24:20,266 !! 2025-10-25T16:24:20,267 self._finalize_license_expression() 2025-10-25T16:24:20,285 running dist_info 2025-10-25T16:24:20,297 creating /tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info 2025-10-25T16:24:20,298 writing /tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/PKG-INFO 2025-10-25T16:24:20,309 writing dependency_links to /tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/dependency_links.txt 2025-10-25T16:24:20,310 writing entry points to /tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/entry_points.txt 2025-10-25T16:24:20,315 writing requirements to /tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/requires.txt 2025-10-25T16:24:20,316 writing top-level names to /tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/top_level.txt 2025-10-25T16:24:20,318 writing manifest file '/tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:20,382 reading manifest file '/tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:20,384 reading manifest template 'MANIFEST.in' 2025-10-25T16:24:20,386 warning: no files found matching 'VERSION' 2025-10-25T16:24:20,386 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-10-25T16:24:20,458 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-10-25T16:24:20,459 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-10-25T16:24:20,461 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-10-25T16:24:20,462 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-10-25T16:24:20,464 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-10-25T16:24:20,465 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-10-25T16:24:20,467 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-10-25T16:24:20,468 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-10-25T16:24:20,469 no previously-included directories found matching 'samples' 2025-10-25T16:24:20,470 no previously-included directories found matching 'docs' 2025-10-25T16:24:20,487 writing manifest file '/tmp/pip-modern-metadata-g_5e0h5v/crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:20,488 creating '/tmp/pip-modern-metadata-g_5e0h5v/crawlo-1.4.7.dist-info' 2025-10-25T16:24:20,627 Preparing metadata (pyproject.toml): finished with status 'done' 2025-10-25T16:24:20,633 Source in /tmp/pip-wheel-tegccd5e/crawlo_7ce4a8c0eeca450490c816c2ed24c2e3 has version 1.4.7, which satisfies requirement crawlo==1.4.7 from https://files.pythonhosted.org/packages/ab/50/ba113f63f832494b8238d8182875dfc72d45afc191f69f4fa9ca2d4b09c4/crawlo-1.4.7.tar.gz 2025-10-25T16:24:20,634 Removed crawlo==1.4.7 from https://files.pythonhosted.org/packages/ab/50/ba113f63f832494b8238d8182875dfc72d45afc191f69f4fa9ca2d4b09c4/crawlo-1.4.7.tar.gz from build tracker '/tmp/pip-build-tracker-yt8z35fo' 2025-10-25T16:24:20,642 Created temporary directory: /tmp/pip-unpack-ehg8z_ef 2025-10-25T16:24:20,643 Building wheels for collected packages: crawlo 2025-10-25T16:24:20,648 Created temporary directory: /tmp/pip-wheel-znb1gsxa 2025-10-25T16:24:20,648 Destination directory: /tmp/pip-wheel-znb1gsxa 2025-10-25T16:24:20,650 Building wheel for crawlo (pyproject.toml): started 2025-10-25T16:24:20,651 Running command Building wheel for crawlo (pyproject.toml) 2025-10-25T16:24:21,193 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-10-25T16:24:21,194 !! 2025-10-25T16:24:21,195 ******************************************************************************** 2025-10-25T16:24:21,195 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-10-25T16:24:21,197 License :: OSI Approved :: MIT License 2025-10-25T16:24:21,198 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-10-25T16:24:21,198 ******************************************************************************** 2025-10-25T16:24:21,200 !! 2025-10-25T16:24:21,200 self._finalize_license_expression() 2025-10-25T16:24:21,223 running bdist_wheel 2025-10-25T16:24:21,255 running build 2025-10-25T16:24:21,255 running build_py 2025-10-25T16:24:21,270 creating build/lib/tests 2025-10-25T16:24:21,272 copying tests/final_comprehensive_test.py -> build/lib/tests 2025-10-25T16:24:21,275 copying tests/test_edge_cases.py -> build/lib/tests 2025-10-25T16:24:21,278 copying tests/test_retry_middleware.py -> build/lib/tests 2025-10-25T16:24:21,281 copying tests/baidu_performance_test.py -> build/lib/tests 2025-10-25T16:24:21,283 copying tests/log_buffering_test.py -> build/lib/tests 2025-10-25T16:24:21,286 copying tests/test_integration.py -> build/lib/tests 2025-10-25T16:24:21,289 copying tests/test_proxy_middleware.py -> build/lib/tests 2025-10-25T16:24:21,291 copying tests/simple_selector_helper_test.py -> build/lib/tests 2025-10-25T16:24:21,294 copying tests/test_logging_system.py -> build/lib/tests 2025-10-25T16:24:21,297 copying tests/test_selector_helper.py -> build/lib/tests 2025-10-25T16:24:21,299 copying tests/test_fingerprint_consistency.py -> build/lib/tests 2025-10-25T16:24:21,302 copying tests/test_config_validator.py -> build/lib/tests 2025-10-25T16:24:21,305 copying tests/test_mysql_pipeline_error.py -> build/lib/tests 2025-10-25T16:24:21,307 copying tests/controlled_spider_example.py -> build/lib/tests 2025-10-25T16:24:21,310 copying tests/final_validation_test.py -> build/lib/tests 2025-10-25T16:24:21,313 copying tests/test_asyncmy_usage.py -> build/lib/tests 2025-10-25T16:24:21,315 copying tests/test_mysql_pipeline_init_log.py -> build/lib/tests 2025-10-25T16:24:21,317 copying tests/final_log_test.py -> build/lib/tests 2025-10-25T16:24:21,320 copying tests/test_response_code_middleware.py -> build/lib/tests 2025-10-25T16:24:21,323 copying tests/test_priority_behavior.py -> build/lib/tests 2025-10-25T16:24:21,325 copying tests/log_generation_timing_test.py -> build/lib/tests 2025-10-25T16:24:21,327 copying tests/test_dedup_fix.py -> build/lib/tests 2025-10-25T16:24:21,330 copying tests/queue_blocking_test.py -> build/lib/tests 2025-10-25T16:24:21,332 copying tests/comprehensive_test.py -> build/lib/tests 2025-10-25T16:24:21,333 copying tests/test_queue_empty_check.py -> build/lib/tests 2025-10-25T16:24:21,335 copying tests/test_default_header_middleware.py -> build/lib/tests 2025-10-25T16:24:21,338 copying tests/test_mysql_pipeline_integration.py -> build/lib/tests 2025-10-25T16:24:21,340 copying tests/simple_selector_test.py -> build/lib/tests 2025-10-25T16:24:21,343 copying tests/comprehensive_framework_test.py -> build/lib/tests 2025-10-25T16:24:21,346 copying tests/test_scrapy_style_encoding.py -> build/lib/tests 2025-10-25T16:24:21,348 copying tests/test_factory_compatibility.py -> build/lib/tests 2025-10-25T16:24:21,351 copying tests/test_random_user_agent.py -> build/lib/tests 2025-10-25T16:24:21,353 copying tests/test_component_factory.py -> build/lib/tests 2025-10-25T16:24:21,356 copying tests/simple_log_test2.py -> build/lib/tests 2025-10-25T16:24:21,359 copying tests/test_proxy_middleware_integration.py -> build/lib/tests 2025-10-25T16:24:21,361 copying tests/test_user_agent_randomness.py -> build/lib/tests 2025-10-25T16:24:21,363 copying tests/test_config_merge.py -> build/lib/tests 2025-10-25T16:24:21,366 copying tests/direct_selector_helper_test.py -> build/lib/tests 2025-10-25T16:24:21,369 copying tests/simple_follow_test.py -> build/lib/tests 2025-10-25T16:24:21,371 copying tests/test_queue_type.py -> build/lib/tests 2025-10-25T16:24:21,373 copying tests/test_double_crawlo_fix.py -> build/lib/tests 2025-10-25T16:24:21,375 copying tests/test_spider_loader_comprehensive.py -> build/lib/tests 2025-10-25T16:24:21,378 copying tests/test_offsite_middleware_simple.py -> build/lib/tests 2025-10-25T16:24:21,380 copying tests/test_error_handler_compatibility.py -> build/lib/tests 2025-10-25T16:24:21,384 copying tests/test_response_improvements.py -> build/lib/tests 2025-10-25T16:24:21,386 copying tests/advanced_tools_example.py -> build/lib/tests 2025-10-25T16:24:21,389 copying tests/test_scheduler_config_update.py -> build/lib/tests 2025-10-25T16:24:21,392 copying tests/debug_log_config.py -> build/lib/tests 2025-10-25T16:24:21,394 copying tests/debug_pipelines.py -> build/lib/tests 2025-10-25T16:24:21,395 copying tests/test_proxy_strategies.py -> build/lib/tests 2025-10-25T16:24:21,398 copying tests/cleaners_example.py -> build/lib/tests 2025-10-25T16:24:21,400 copying tests/bug_check_test.py -> build/lib/tests 2025-10-25T16:24:21,403 copying tests/test_mysql_pipeline_config.py -> build/lib/tests 2025-10-25T16:24:21,406 copying tests/debug_framework_logger.py -> build/lib/tests 2025-10-25T16:24:21,408 copying tests/test_response_filter_middleware.py -> build/lib/tests 2025-10-25T16:24:21,412 copying tests/detailed_log_test.py -> build/lib/tests 2025-10-25T16:24:21,414 copying tests/test_hash_performance.py -> build/lib/tests 2025-10-25T16:24:21,416 copying tests/test_factories.py -> build/lib/tests 2025-10-25T16:24:21,418 copying tests/test_redis_key_naming.py -> build/lib/tests 2025-10-25T16:24:21,420 copying tests/redis_key_validation_demo.py -> build/lib/tests 2025-10-25T16:24:21,422 copying tests/simple_command_test.py -> build/lib/tests 2025-10-25T16:24:21,424 copying tests/verify_log_fix.py -> build/lib/tests 2025-10-25T16:24:21,427 copying tests/test_pipeline_fingerprint_consistency.py -> build/lib/tests 2025-10-25T16:24:21,429 copying tests/test_cleaners.py -> build/lib/tests 2025-10-25T16:24:21,431 copying tests/test_dedup_pipeline_consistency.py -> build/lib/tests 2025-10-25T16:24:21,434 copying tests/test_all_pipeline_fingerprints.py -> build/lib/tests 2025-10-25T16:24:21,437 copying tests/test_redis_queue.py -> build/lib/tests 2025-10-25T16:24:21,440 copying tests/test_spider_modules.py -> build/lib/tests 2025-10-25T16:24:21,441 copying tests/test_encoding_detection.py -> build/lib/tests 2025-10-25T16:24:21,444 copying tests/test_double_crawlo_fix_simple.py -> build/lib/tests 2025-10-25T16:24:21,446 copying tests/test_downloader_proxy_compatibility.py -> build/lib/tests 2025-10-25T16:24:21,450 copying tests/test_cli_arguments.py -> build/lib/tests 2025-10-25T16:24:21,453 copying tests/test_offsite_middleware.py -> build/lib/tests 2025-10-25T16:24:21,455 copying tests/dynamic_loading_test.py -> build/lib/tests 2025-10-25T16:24:21,457 copying tests/test_enhanced_error_handler_comprehensive.py -> build/lib/tests 2025-10-25T16:24:21,460 copying tests/test_logging_enhancements.py -> build/lib/tests 2025-10-25T16:24:21,462 copying tests/test_spider_loader.py -> build/lib/tests 2025-10-25T16:24:21,465 copying tests/test_user_agents.py -> build/lib/tests 2025-10-25T16:24:21,467 copying tests/test_queue_type_redis_config_consistency.py -> build/lib/tests 2025-10-25T16:24:21,470 copying tests/test_advanced_tools.py -> build/lib/tests 2025-10-25T16:24:21,472 copying tests/test_performance.py -> build/lib/tests 2025-10-25T16:24:21,475 copying tests/authenticated_proxy_example.py -> build/lib/tests 2025-10-25T16:24:21,477 copying tests/test_response_url_methods.py -> build/lib/tests 2025-10-25T16:24:21,479 copying tests/spider_log_timing_test.py -> build/lib/tests 2025-10-25T16:24:21,482 copying tests/test_middleware_debug.py -> build/lib/tests 2025-10-25T16:24:21,485 copying tests/distributed_dedup_test.py -> build/lib/tests 2025-10-25T16:24:21,487 copying tests/test_logging_integration.py -> build/lib/tests 2025-10-25T16:24:21,490 copying tests/__init__.py -> build/lib/tests 2025-10-25T16:24:21,492 copying tests/simple_url_test.py -> build/lib/tests 2025-10-25T16:24:21,494 copying tests/verify_distributed.py -> build/lib/tests 2025-10-25T16:24:21,497 copying tests/simple_crawlo_test.py -> build/lib/tests 2025-10-25T16:24:21,499 copying tests/test_mysql_pipeline_robustness.py -> build/lib/tests 2025-10-25T16:24:21,501 copying tests/test_item_dedup_redis_key.py -> build/lib/tests 2025-10-25T16:24:21,504 copying tests/test_proxy_only.py -> build/lib/tests 2025-10-25T16:24:21,506 copying tests/date_tools_example.py -> build/lib/tests 2025-10-25T16:24:21,508 copying tests/test_request_serialization.py -> build/lib/tests 2025-10-25T16:24:21,510 copying tests/test_crawlo_proxy_integration.py -> build/lib/tests 2025-10-25T16:24:21,512 copying tests/test_request_ignore_middleware.py -> build/lib/tests 2025-10-25T16:24:21,515 copying tests/test_enhanced_error_handler.py -> build/lib/tests 2025-10-25T16:24:21,518 copying tests/config_validation_demo.py -> build/lib/tests 2025-10-25T16:24:21,520 copying tests/simple_spider_test.py -> build/lib/tests 2025-10-25T16:24:21,522 copying tests/test_redis_config.py -> build/lib/tests 2025-10-25T16:24:21,525 copying tests/test_proxy_providers.py -> build/lib/tests 2025-10-25T16:24:21,527 copying tests/test_redis_key_validator.py -> build/lib/tests 2025-10-25T16:24:21,529 copying tests/test_redis_queue_type_fallback.py -> build/lib/tests 2025-10-25T16:24:21,532 copying tests/test_crawler_process_spider_modules.py -> build/lib/tests 2025-10-25T16:24:21,534 copying tests/verify_mysql_warnings.py -> build/lib/tests 2025-10-25T16:24:21,536 copying tests/distributed_test.py -> build/lib/tests 2025-10-25T16:24:21,538 copying tests/fix_log_test.py -> build/lib/tests 2025-10-25T16:24:21,540 copying tests/simple_queue_type_test.py -> build/lib/tests 2025-10-25T16:24:21,543 copying tests/baidu_test.py -> build/lib/tests 2025-10-25T16:24:21,545 copying tests/distributed_test_debug.py -> build/lib/tests 2025-10-25T16:24:21,547 copying tests/optimized_performance_test.py -> build/lib/tests 2025-10-25T16:24:21,549 copying tests/test_template_content.py -> build/lib/tests 2025-10-25T16:24:21,551 copying tests/test_simple_response.py -> build/lib/tests 2025-10-25T16:24:21,554 copying tests/test_all_commands.py -> build/lib/tests 2025-10-25T16:24:21,556 copying tests/test_crawler_process_import.py -> build/lib/tests 2025-10-25T16:24:21,558 copying tests/test_multi_directory.py -> build/lib/tests 2025-10-25T16:24:21,560 copying tests/dynamic_loading_example.py -> build/lib/tests 2025-10-25T16:24:21,563 copying tests/test_proxy_middleware_enhanced.py -> build/lib/tests 2025-10-25T16:24:21,565 copying tests/test_mysql_pipeline_refactor_simple.py -> build/lib/tests 2025-10-25T16:24:21,568 copying tests/simple_response_selector_test.py -> build/lib/tests 2025-10-25T16:24:21,570 copying tests/queue_test.py -> build/lib/tests 2025-10-25T16:24:21,572 copying tests/test_telecom_spider_redis_key.py -> build/lib/tests 2025-10-25T16:24:21,574 copying tests/test_all_redis_key_configs.py -> build/lib/tests 2025-10-25T16:24:21,577 copying tests/test_final_validation.py -> build/lib/tests 2025-10-25T16:24:21,579 copying tests/simulate_mysql_update_test.py -> build/lib/tests 2025-10-25T16:24:21,582 copying tests/test_redis_connection_pool.py -> build/lib/tests 2025-10-25T16:24:21,584 copying tests/test_template_redis_key.py -> build/lib/tests 2025-10-25T16:24:21,587 copying tests/framework_performance_test.py -> build/lib/tests 2025-10-25T16:24:21,589 copying tests/debug_configure.py -> build/lib/tests 2025-10-25T16:24:21,591 copying tests/request_params_example.py -> build/lib/tests 2025-10-25T16:24:21,594 copying tests/explain_mysql_update_behavior.py -> build/lib/tests 2025-10-25T16:24:21,596 copying tests/test_request_params.py -> build/lib/tests 2025-10-25T16:24:21,599 copying tests/test_get_component_logger.py -> build/lib/tests 2025-10-25T16:24:21,601 copying tests/test_mysql_pipeline_refactor.py -> build/lib/tests 2025-10-25T16:24:21,604 copying tests/test_mode_consistency.py -> build/lib/tests 2025-10-25T16:24:21,606 copying tests/test_download_delay_middleware.py -> build/lib/tests 2025-10-25T16:24:21,609 copying tests/test_config_consistency.py -> build/lib/tests 2025-10-25T16:24:21,612 copying tests/debug_log_levels.py -> build/lib/tests 2025-10-25T16:24:21,614 copying tests/error_handling_example.py -> build/lib/tests 2025-10-25T16:24:21,617 copying tests/test_random_headers_necessity.py -> build/lib/tests 2025-10-25T16:24:21,619 copying tests/test_priority_consistency.py -> build/lib/tests 2025-10-25T16:24:21,622 copying tests/test_controlled_spider_mixin.py -> build/lib/tests 2025-10-25T16:24:21,625 copying tests/test_batch_processor.py -> build/lib/tests 2025-10-25T16:24:21,627 copying tests/test_queue_naming.py -> build/lib/tests 2025-10-25T16:24:21,630 copying tests/test_priority_consistency_fixed.py -> build/lib/tests 2025-10-25T16:24:21,633 copying tests/performance_comparison.py -> build/lib/tests 2025-10-25T16:24:21,635 copying tests/test_fingerprint_simple.py -> build/lib/tests 2025-10-25T16:24:21,637 copying tests/test_redis_queue_name_fix.py -> build/lib/tests 2025-10-25T16:24:21,641 copying tests/test_proxy_stats.py -> build/lib/tests 2025-10-25T16:24:21,643 copying tests/test_logging_final.py -> build/lib/tests 2025-10-25T16:24:21,645 copying tests/test_distributed.py -> build/lib/tests 2025-10-25T16:24:21,647 copying tests/test_retry_middleware_realistic.py -> build/lib/tests 2025-10-25T16:24:21,650 copying tests/response_improvements_example.py -> build/lib/tests 2025-10-25T16:24:21,652 copying tests/simple_optimization_test.py -> build/lib/tests 2025-10-25T16:24:21,655 copying tests/test_response_urljoin.py -> build/lib/tests 2025-10-25T16:24:21,657 copying tests/verify_debug.py -> build/lib/tests 2025-10-25T16:24:21,659 copying tests/test_parsel.py -> build/lib/tests 2025-10-25T16:24:21,661 copying tests/test_random_headers_default.py -> build/lib/tests 2025-10-25T16:24:21,664 copying tests/test_tools.py -> build/lib/tests 2025-10-25T16:24:21,667 copying tests/test_response_selector_methods.py -> build/lib/tests 2025-10-25T16:24:21,669 copying tests/test_multiple_spider_modules.py -> build/lib/tests 2025-10-25T16:24:21,671 copying tests/test_scheduler.py -> build/lib/tests 2025-10-25T16:24:21,673 copying tests/test_mysql_pipeline_types.py -> build/lib/tests 2025-10-25T16:24:21,675 copying tests/simple_cli_test.py -> build/lib/tests 2025-10-25T16:24:21,677 copying tests/test_queue_manager_redis_key.py -> build/lib/tests 2025-10-25T16:24:21,679 copying tests/test_proxy_health_check.py -> build/lib/tests 2025-10-25T16:24:21,681 copying tests/test_optimized_selector_naming.py -> build/lib/tests 2025-10-25T16:24:21,683 copying tests/test_mysql_update_columns.py -> build/lib/tests 2025-10-25T16:24:21,684 copying tests/test_proxy_with_downloader.py -> build/lib/tests 2025-10-25T16:24:21,687 copying tests/test_date_tools.py -> build/lib/tests 2025-10-25T16:24:21,688 copying tests/test_queue_manager_double_crawlo.py -> build/lib/tests 2025-10-25T16:24:21,691 copying tests/test_encoding_core.py -> build/lib/tests 2025-10-25T16:24:21,693 copying tests/test_performance_monitor.py -> build/lib/tests 2025-10-25T16:24:21,695 copying tests/test_response_follow.py -> build/lib/tests 2025-10-25T16:24:21,697 copying tests/test_large_scale_helper.py -> build/lib/tests 2025-10-25T16:24:21,700 copying tests/test_proxy_middleware_refactored.py -> build/lib/tests 2025-10-25T16:24:21,703 copying tests/test_selector_optimizations.py -> build/lib/tests 2025-10-25T16:24:21,706 creating build/lib/crawlo 2025-10-25T16:24:21,707 copying crawlo/exceptions.py -> build/lib/crawlo 2025-10-25T16:24:21,709 copying crawlo/framework.py -> build/lib/crawlo 2025-10-25T16:24:21,712 copying crawlo/task_manager.py -> build/lib/crawlo 2025-10-25T16:24:21,714 copying crawlo/event.py -> build/lib/crawlo 2025-10-25T16:24:21,716 copying crawlo/stats_collector.py -> build/lib/crawlo 2025-10-25T16:24:21,718 copying crawlo/cli.py -> build/lib/crawlo 2025-10-25T16:24:21,720 copying crawlo/crawler.py -> build/lib/crawlo 2025-10-25T16:24:21,723 copying crawlo/project.py -> build/lib/crawlo 2025-10-25T16:24:21,726 copying crawlo/__init__.py -> build/lib/crawlo 2025-10-25T16:24:21,728 copying crawlo/__version__.py -> build/lib/crawlo 2025-10-25T16:24:21,730 copying crawlo/subscriber.py -> build/lib/crawlo 2025-10-25T16:24:21,732 copying crawlo/config_validator.py -> build/lib/crawlo 2025-10-25T16:24:21,734 copying crawlo/mode_manager.py -> build/lib/crawlo 2025-10-25T16:24:21,737 copying crawlo/interfaces.py -> build/lib/crawlo 2025-10-25T16:24:21,739 copying crawlo/config.py -> build/lib/crawlo 2025-10-25T16:24:21,742 creating build/lib/examples 2025-10-25T16:24:21,744 copying examples/__init__.py -> build/lib/examples 2025-10-25T16:24:21,746 creating build/lib/tests/test_spiders 2025-10-25T16:24:21,747 copying tests/test_spiders/test_spider.py -> build/lib/tests/test_spiders 2025-10-25T16:24:21,750 copying tests/test_spiders/__init__.py -> build/lib/tests/test_spiders 2025-10-25T16:24:21,753 creating build/lib/crawlo/data 2025-10-25T16:24:21,754 copying crawlo/data/__init__.py -> build/lib/crawlo/data 2025-10-25T16:24:21,757 copying crawlo/data/user_agents.py -> build/lib/crawlo/data 2025-10-25T16:24:21,760 creating build/lib/crawlo/queue 2025-10-25T16:24:21,761 copying crawlo/queue/redis_priority_queue.py -> build/lib/crawlo/queue 2025-10-25T16:24:21,764 copying crawlo/queue/pqueue.py -> build/lib/crawlo/queue 2025-10-25T16:24:21,766 copying crawlo/queue/queue_manager.py -> build/lib/crawlo/queue 2025-10-25T16:24:21,770 copying crawlo/queue/__init__.py -> build/lib/crawlo/queue 2025-10-25T16:24:21,773 creating build/lib/crawlo/initialization 2025-10-25T16:24:21,774 copying crawlo/initialization/phases.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,777 copying crawlo/initialization/context.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,779 copying crawlo/initialization/core.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,782 copying crawlo/initialization/utils.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,784 copying crawlo/initialization/__init__.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,786 copying crawlo/initialization/built_in.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,789 copying crawlo/initialization/registry.py -> build/lib/crawlo/initialization 2025-10-25T16:24:21,792 creating build/lib/crawlo/tools 2025-10-25T16:24:21,793 copying crawlo/tools/distributed_coordinator.py -> build/lib/crawlo/tools 2025-10-25T16:24:21,796 copying crawlo/tools/__init__.py -> build/lib/crawlo/tools 2025-10-25T16:24:21,798 copying crawlo/tools/scenario_adapter.py -> build/lib/crawlo/tools 2025-10-25T16:24:21,800 copying crawlo/tools/text_cleaner.py -> build/lib/crawlo/tools 2025-10-25T16:24:21,803 copying crawlo/tools/date_tools.py -> build/lib/crawlo/tools 2025-10-25T16:24:21,806 creating build/lib/crawlo/logging 2025-10-25T16:24:21,807 copying crawlo/logging/factory.py -> build/lib/crawlo/logging 2025-10-25T16:24:21,810 copying crawlo/logging/__init__.py -> build/lib/crawlo/logging 2025-10-25T16:24:21,812 copying crawlo/logging/manager.py -> build/lib/crawlo/logging 2025-10-25T16:24:21,814 copying crawlo/logging/config.py -> build/lib/crawlo/logging 2025-10-25T16:24:21,817 creating build/lib/crawlo/pipelines 2025-10-25T16:24:21,818 copying crawlo/pipelines/mysql_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,822 copying crawlo/pipelines/redis_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,824 copying crawlo/pipelines/csv_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,826 copying crawlo/pipelines/pipeline_manager.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,828 copying crawlo/pipelines/__init__.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,830 copying crawlo/pipelines/memory_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,832 copying crawlo/pipelines/console_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,834 copying crawlo/pipelines/mongo_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,836 copying crawlo/pipelines/json_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,838 copying crawlo/pipelines/base_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,841 copying crawlo/pipelines/database_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,844 copying crawlo/pipelines/bloom_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-25T16:24:21,847 creating build/lib/crawlo/filters 2025-10-25T16:24:21,848 copying crawlo/filters/aioredis_filter.py -> build/lib/crawlo/filters 2025-10-25T16:24:21,851 copying crawlo/filters/memory_filter.py -> build/lib/crawlo/filters 2025-10-25T16:24:21,853 copying crawlo/filters/__init__.py -> build/lib/crawlo/filters 2025-10-25T16:24:21,856 creating build/lib/crawlo/downloader 2025-10-25T16:24:21,857 copying crawlo/downloader/playwright_downloader.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,860 copying crawlo/downloader/selenium_downloader.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,863 copying crawlo/downloader/cffi_downloader.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,865 copying crawlo/downloader/hybrid_downloader.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,868 copying crawlo/downloader/__init__.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,870 copying crawlo/downloader/aiohttp_downloader.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,873 copying crawlo/downloader/httpx_downloader.py -> build/lib/crawlo/downloader 2025-10-25T16:24:21,876 creating build/lib/crawlo/commands 2025-10-25T16:24:21,877 copying crawlo/commands/genspider.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,880 copying crawlo/commands/check.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,882 copying crawlo/commands/run.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,885 copying crawlo/commands/utils.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,888 copying crawlo/commands/__init__.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,891 copying crawlo/commands/list.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,893 copying crawlo/commands/stats.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,896 copying crawlo/commands/help.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,898 copying crawlo/commands/startproject.py -> build/lib/crawlo/commands 2025-10-25T16:24:21,902 creating build/lib/crawlo/utils 2025-10-25T16:24:21,903 copying crawlo/utils/controlled_spider_mixin.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,906 copying crawlo/utils/redis_connection_pool.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,908 copying crawlo/utils/func_tools.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,911 copying crawlo/utils/mysql_connection_pool.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,914 copying crawlo/utils/request.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,917 copying crawlo/utils/leak_detector.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,920 copying crawlo/utils/selector_helper.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,922 copying crawlo/utils/batch_processor.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,924 copying crawlo/utils/redis_key_validator.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,927 copying crawlo/utils/config_manager.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,930 copying crawlo/utils/db_helper.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,933 copying crawlo/utils/text_helper.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,934 copying crawlo/utils/singleton.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,937 copying crawlo/utils/__init__.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,938 copying crawlo/utils/redis_checker.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,940 copying crawlo/utils/mongo_connection_pool.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,943 copying crawlo/utils/performance_monitor.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,945 copying crawlo/utils/fingerprint.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,947 copying crawlo/utils/misc.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,949 copying crawlo/utils/request_serializer.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,951 copying crawlo/utils/spider_loader.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,954 copying crawlo/utils/large_scale_helper.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,957 copying crawlo/utils/resource_manager.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,960 copying crawlo/utils/url_utils.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,962 copying crawlo/utils/error_handler.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,964 copying crawlo/utils/log.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,966 copying crawlo/utils/queue_helper.py -> build/lib/crawlo/utils 2025-10-25T16:24:21,969 creating build/lib/crawlo/extension 2025-10-25T16:24:21,970 copying crawlo/extension/logging_extension.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,972 copying crawlo/extension/request_recorder.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,974 copying crawlo/extension/log_interval.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,976 copying crawlo/extension/log_stats.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,978 copying crawlo/extension/__init__.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,980 copying crawlo/extension/memory_monitor.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,982 copying crawlo/extension/performance_profiler.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,984 copying crawlo/extension/health_check.py -> build/lib/crawlo/extension 2025-10-25T16:24:21,987 creating build/lib/crawlo/spider 2025-10-25T16:24:21,988 copying crawlo/spider/__init__.py -> build/lib/crawlo/spider 2025-10-25T16:24:21,991 creating build/lib/crawlo/items 2025-10-25T16:24:21,992 copying crawlo/items/base.py -> build/lib/crawlo/items 2025-10-25T16:24:21,994 copying crawlo/items/__init__.py -> build/lib/crawlo/items 2025-10-25T16:24:21,996 copying crawlo/items/fields.py -> build/lib/crawlo/items 2025-10-25T16:24:21,998 copying crawlo/items/items.py -> build/lib/crawlo/items 2025-10-25T16:24:22,000 creating build/lib/crawlo/middleware 2025-10-25T16:24:22,001 copying crawlo/middleware/download_delay.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,003 copying crawlo/middleware/response_filter.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,005 copying crawlo/middleware/offsite.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,007 copying crawlo/middleware/request_ignore.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,009 copying crawlo/middleware/default_header.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,011 copying crawlo/middleware/__init__.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,013 copying crawlo/middleware/response_code.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,016 copying crawlo/middleware/middleware_manager.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,018 copying crawlo/middleware/proxy.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,021 copying crawlo/middleware/retry.py -> build/lib/crawlo/middleware 2025-10-25T16:24:22,023 creating build/lib/crawlo/factories 2025-10-25T16:24:22,024 copying crawlo/factories/utils.py -> build/lib/crawlo/factories 2025-10-25T16:24:22,026 copying crawlo/factories/base.py -> build/lib/crawlo/factories 2025-10-25T16:24:22,028 copying crawlo/factories/crawler.py -> build/lib/crawlo/factories 2025-10-25T16:24:22,030 copying crawlo/factories/__init__.py -> build/lib/crawlo/factories 2025-10-25T16:24:22,032 copying crawlo/factories/registry.py -> build/lib/crawlo/factories 2025-10-25T16:24:22,034 creating build/lib/crawlo/network 2025-10-25T16:24:22,035 copying crawlo/network/request.py -> build/lib/crawlo/network 2025-10-25T16:24:22,039 copying crawlo/network/__init__.py -> build/lib/crawlo/network 2025-10-25T16:24:22,040 copying crawlo/network/response.py -> build/lib/crawlo/network 2025-10-25T16:24:22,044 creating build/lib/crawlo/core 2025-10-25T16:24:22,045 copying crawlo/core/engine.py -> build/lib/crawlo/core 2025-10-25T16:24:22,047 copying crawlo/core/processor.py -> build/lib/crawlo/core 2025-10-25T16:24:22,049 copying crawlo/core/__init__.py -> build/lib/crawlo/core 2025-10-25T16:24:22,051 copying crawlo/core/scheduler.py -> build/lib/crawlo/core 2025-10-25T16:24:22,055 creating build/lib/crawlo/settings 2025-10-25T16:24:22,056 copying crawlo/settings/default_settings.py -> build/lib/crawlo/settings 2025-10-25T16:24:22,059 copying crawlo/settings/__init__.py -> build/lib/crawlo/settings 2025-10-25T16:24:22,061 copying crawlo/settings/setting_manager.py -> build/lib/crawlo/settings 2025-10-25T16:24:22,063 running egg_info 2025-10-25T16:24:22,077 writing crawlo.egg-info/PKG-INFO 2025-10-25T16:24:22,085 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-10-25T16:24:22,087 writing entry points to crawlo.egg-info/entry_points.txt 2025-10-25T16:24:22,091 writing requirements to crawlo.egg-info/requires.txt 2025-10-25T16:24:22,092 writing top-level names to crawlo.egg-info/top_level.txt 2025-10-25T16:24:22,139 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:22,158 reading manifest template 'MANIFEST.in' 2025-10-25T16:24:22,159 warning: no files found matching 'VERSION' 2025-10-25T16:24:22,159 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-10-25T16:24:22,256 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-10-25T16:24:22,258 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-10-25T16:24:22,260 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-10-25T16:24:22,262 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-10-25T16:24:22,264 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-10-25T16:24:22,266 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-10-25T16:24:22,268 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-10-25T16:24:22,270 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-10-25T16:24:22,272 no previously-included directories found matching 'samples' 2025-10-25T16:24:22,273 no previously-included directories found matching 'docs' 2025-10-25T16:24:22,293 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-25T16:24:22,297 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates' is absent from the `packages` configuration. 2025-10-25T16:24:22,298 !! 2025-10-25T16:24:22,299 ******************************************************************************** 2025-10-25T16:24:22,300 ############################ 2025-10-25T16:24:22,300 # Package would be ignored # 2025-10-25T16:24:22,301 ############################ 2025-10-25T16:24:22,301 Python recognizes 'crawlo.templates' as an importable package[^1], 2025-10-25T16:24:22,301 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,302 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,303 package, please make sure that 'crawlo.templates' is explicitly added 2025-10-25T16:24:22,304 to the `packages` configuration field. 2025-10-25T16:24:22,305 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,305 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,306 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,307 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,308 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,309 If you don't want 'crawlo.templates' to be distributed and are 2025-10-25T16:24:22,309 already explicitly excluding 'crawlo.templates' via 2025-10-25T16:24:22,310 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,310 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,311 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,312 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,313 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,314 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,315 even if it does not contain any `.py` files. 2025-10-25T16:24:22,316 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,316 directory, all directories are treated like packages. 2025-10-25T16:24:22,317 ******************************************************************************** 2025-10-25T16:24:22,318 !! 2025-10-25T16:24:22,318 check.warn(importable) 2025-10-25T16:24:22,319 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project' is absent from the `packages` configuration. 2025-10-25T16:24:22,319 !! 2025-10-25T16:24:22,320 ******************************************************************************** 2025-10-25T16:24:22,321 ############################ 2025-10-25T16:24:22,321 # Package would be ignored # 2025-10-25T16:24:22,322 ############################ 2025-10-25T16:24:22,322 Python recognizes 'crawlo.templates.project' as an importable package[^1], 2025-10-25T16:24:22,323 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,324 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,324 package, please make sure that 'crawlo.templates.project' is explicitly added 2025-10-25T16:24:22,325 to the `packages` configuration field. 2025-10-25T16:24:22,326 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,327 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,327 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,328 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,329 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,330 If you don't want 'crawlo.templates.project' to be distributed and are 2025-10-25T16:24:22,331 already explicitly excluding 'crawlo.templates.project' via 2025-10-25T16:24:22,331 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,332 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,332 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,333 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,334 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,336 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,336 even if it does not contain any `.py` files. 2025-10-25T16:24:22,337 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,337 directory, all directories are treated like packages. 2025-10-25T16:24:22,338 ******************************************************************************** 2025-10-25T16:24:22,339 !! 2025-10-25T16:24:22,339 check.warn(importable) 2025-10-25T16:24:22,340 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project.spiders' is absent from the `packages` configuration. 2025-10-25T16:24:22,340 !! 2025-10-25T16:24:22,341 ******************************************************************************** 2025-10-25T16:24:22,342 ############################ 2025-10-25T16:24:22,342 # Package would be ignored # 2025-10-25T16:24:22,343 ############################ 2025-10-25T16:24:22,343 Python recognizes 'crawlo.templates.project.spiders' as an importable package[^1], 2025-10-25T16:24:22,344 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,345 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,345 package, please make sure that 'crawlo.templates.project.spiders' is explicitly added 2025-10-25T16:24:22,346 to the `packages` configuration field. 2025-10-25T16:24:22,347 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,347 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,347 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,348 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,349 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,350 If you don't want 'crawlo.templates.project.spiders' to be distributed and are 2025-10-25T16:24:22,351 already explicitly excluding 'crawlo.templates.project.spiders' via 2025-10-25T16:24:22,351 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,352 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,352 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,353 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,354 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,355 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,356 even if it does not contain any `.py` files. 2025-10-25T16:24:22,356 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,357 directory, all directories are treated like packages. 2025-10-25T16:24:22,357 ******************************************************************************** 2025-10-25T16:24:22,358 !! 2025-10-25T16:24:22,359 check.warn(importable) 2025-10-25T16:24:22,359 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.spider' is absent from the `packages` configuration. 2025-10-25T16:24:22,360 !! 2025-10-25T16:24:22,361 ******************************************************************************** 2025-10-25T16:24:22,362 ############################ 2025-10-25T16:24:22,362 # Package would be ignored # 2025-10-25T16:24:22,363 ############################ 2025-10-25T16:24:22,363 Python recognizes 'crawlo.templates.spider' as an importable package[^1], 2025-10-25T16:24:22,363 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,365 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,365 package, please make sure that 'crawlo.templates.spider' is explicitly added 2025-10-25T16:24:22,366 to the `packages` configuration field. 2025-10-25T16:24:22,367 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,367 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,368 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,369 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,370 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,371 If you don't want 'crawlo.templates.spider' to be distributed and are 2025-10-25T16:24:22,372 already explicitly excluding 'crawlo.templates.spider' via 2025-10-25T16:24:22,372 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,373 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,373 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,374 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,375 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,376 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,377 even if it does not contain any `.py` files. 2025-10-25T16:24:22,377 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,377 directory, all directories are treated like packages. 2025-10-25T16:24:22,378 ******************************************************************************** 2025-10-25T16:24:22,379 !! 2025-10-25T16:24:22,379 check.warn(importable) 2025-10-25T16:24:22,380 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy' is absent from the `packages` configuration. 2025-10-25T16:24:22,380 !! 2025-10-25T16:24:22,381 ******************************************************************************** 2025-10-25T16:24:22,381 ############################ 2025-10-25T16:24:22,382 # Package would be ignored # 2025-10-25T16:24:22,383 ############################ 2025-10-25T16:24:22,383 Python recognizes 'tests.ofweek_scrapy' as an importable package[^1], 2025-10-25T16:24:22,383 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,384 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,385 package, please make sure that 'tests.ofweek_scrapy' is explicitly added 2025-10-25T16:24:22,385 to the `packages` configuration field. 2025-10-25T16:24:22,386 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,387 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,388 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,388 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,390 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,391 If you don't want 'tests.ofweek_scrapy' to be distributed and are 2025-10-25T16:24:22,391 already explicitly excluding 'tests.ofweek_scrapy' via 2025-10-25T16:24:22,392 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,392 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,393 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,394 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,395 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,396 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,397 even if it does not contain any `.py` files. 2025-10-25T16:24:22,398 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,398 directory, all directories are treated like packages. 2025-10-25T16:24:22,399 ******************************************************************************** 2025-10-25T16:24:22,400 !! 2025-10-25T16:24:22,400 check.warn(importable) 2025-10-25T16:24:22,401 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy.ofweek_scrapy' is absent from the `packages` configuration. 2025-10-25T16:24:22,401 !! 2025-10-25T16:24:22,402 ******************************************************************************** 2025-10-25T16:24:22,403 ############################ 2025-10-25T16:24:22,403 # Package would be ignored # 2025-10-25T16:24:22,403 ############################ 2025-10-25T16:24:22,404 Python recognizes 'tests.ofweek_scrapy.ofweek_scrapy' as an importable package[^1], 2025-10-25T16:24:22,404 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,405 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,406 package, please make sure that 'tests.ofweek_scrapy.ofweek_scrapy' is explicitly added 2025-10-25T16:24:22,406 to the `packages` configuration field. 2025-10-25T16:24:22,407 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,407 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,408 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,409 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,409 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,410 If you don't want 'tests.ofweek_scrapy.ofweek_scrapy' to be distributed and are 2025-10-25T16:24:22,411 already explicitly excluding 'tests.ofweek_scrapy.ofweek_scrapy' via 2025-10-25T16:24:22,411 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,412 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,412 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,413 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,414 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,415 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,416 even if it does not contain any `.py` files. 2025-10-25T16:24:22,416 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,417 directory, all directories are treated like packages. 2025-10-25T16:24:22,417 ******************************************************************************** 2025-10-25T16:24:22,418 !! 2025-10-25T16:24:22,418 check.warn(importable) 2025-10-25T16:24:22,419 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy.ofweek_scrapy.spiders' is absent from the `packages` configuration. 2025-10-25T16:24:22,419 !! 2025-10-25T16:24:22,420 ******************************************************************************** 2025-10-25T16:24:22,421 ############################ 2025-10-25T16:24:22,421 # Package would be ignored # 2025-10-25T16:24:22,422 ############################ 2025-10-25T16:24:22,423 Python recognizes 'tests.ofweek_scrapy.ofweek_scrapy.spiders' as an importable package[^1], 2025-10-25T16:24:22,423 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,424 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,424 package, please make sure that 'tests.ofweek_scrapy.ofweek_scrapy.spiders' is explicitly added 2025-10-25T16:24:22,425 to the `packages` configuration field. 2025-10-25T16:24:22,426 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,427 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,427 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,429 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,430 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,430 If you don't want 'tests.ofweek_scrapy.ofweek_scrapy.spiders' to be distributed and are 2025-10-25T16:24:22,431 already explicitly excluding 'tests.ofweek_scrapy.ofweek_scrapy.spiders' via 2025-10-25T16:24:22,431 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,432 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,432 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,433 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,434 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,436 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,436 even if it does not contain any `.py` files. 2025-10-25T16:24:22,437 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,437 directory, all directories are treated like packages. 2025-10-25T16:24:22,438 ******************************************************************************** 2025-10-25T16:24:22,439 !! 2025-10-25T16:24:22,439 check.warn(importable) 2025-10-25T16:24:22,440 /tmp/pip-build-env-opt03fwa/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.scrapy_comparison' is absent from the `packages` configuration. 2025-10-25T16:24:22,440 !! 2025-10-25T16:24:22,441 ******************************************************************************** 2025-10-25T16:24:22,442 ############################ 2025-10-25T16:24:22,442 # Package would be ignored # 2025-10-25T16:24:22,443 ############################ 2025-10-25T16:24:22,443 Python recognizes 'tests.scrapy_comparison' as an importable package[^1], 2025-10-25T16:24:22,444 but it is absent from setuptools' `packages` configuration. 2025-10-25T16:24:22,445 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-25T16:24:22,446 package, please make sure that 'tests.scrapy_comparison' is explicitly added 2025-10-25T16:24:22,446 to the `packages` configuration field. 2025-10-25T16:24:22,447 Alternatively, you can also rely on setuptools' discovery methods 2025-10-25T16:24:22,448 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-25T16:24:22,448 instead of `find_packages(...)`/`find:`). 2025-10-25T16:24:22,450 You can read more about "package discovery" on setuptools documentation page: 2025-10-25T16:24:22,450 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-25T16:24:22,451 If you don't want 'tests.scrapy_comparison' to be distributed and are 2025-10-25T16:24:22,452 already explicitly excluding 'tests.scrapy_comparison' via 2025-10-25T16:24:22,452 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-25T16:24:22,453 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-25T16:24:22,454 combination with a more fine grained `package-data` configuration. 2025-10-25T16:24:22,455 You can read more about "package data files" on setuptools documentation page: 2025-10-25T16:24:22,456 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-25T16:24:22,457 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-25T16:24:22,458 even if it does not contain any `.py` files. 2025-10-25T16:24:22,458 On the other hand, currently there is no concept of package data 2025-10-25T16:24:22,459 directory, all directories are treated like packages. 2025-10-25T16:24:22,460 ******************************************************************************** 2025-10-25T16:24:22,461 !! 2025-10-25T16:24:22,461 check.warn(importable) 2025-10-25T16:24:22,461 copying tests/comprehensive_testing_summary.md -> build/lib/tests 2025-10-25T16:24:22,462 copying tests/monitor_redis_dedup.sh -> build/lib/tests 2025-10-25T16:24:22,462 copying tests/untested_features_report.md -> build/lib/tests 2025-10-25T16:24:22,463 creating build/lib/tests/ofweek_scrapy 2025-10-25T16:24:22,463 copying tests/ofweek_scrapy/scrapy.cfg -> build/lib/tests/ofweek_scrapy 2025-10-25T16:24:22,463 creating build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,464 copying tests/ofweek_scrapy/ofweek_scrapy/__init__.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,464 copying tests/ofweek_scrapy/ofweek_scrapy/items.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,465 copying tests/ofweek_scrapy/ofweek_scrapy/middlewares.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,465 copying tests/ofweek_scrapy/ofweek_scrapy/pipelines.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,465 copying tests/ofweek_scrapy/ofweek_scrapy/settings.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,466 creating build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-25T16:24:22,466 copying tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-25T16:24:22,467 creating build/lib/tests/scrapy_comparison 2025-10-25T16:24:22,467 copying tests/scrapy_comparison/ofweek_scrapy.py -> build/lib/tests/scrapy_comparison 2025-10-25T16:24:22,468 copying tests/scrapy_comparison/scrapy_test.py -> build/lib/tests/scrapy_comparison 2025-10-25T16:24:22,468 creating build/lib/crawlo/templates 2025-10-25T16:24:22,469 copying crawlo/templates/crawlo.cfg.tmpl -> build/lib/crawlo/templates 2025-10-25T16:24:22,469 copying crawlo/templates/run.py.tmpl -> build/lib/crawlo/templates 2025-10-25T16:24:22,470 copying crawlo/templates/spiders_init.py.tmpl -> build/lib/crawlo/templates 2025-10-25T16:24:22,470 creating build/lib/crawlo/templates/project 2025-10-25T16:24:22,471 copying crawlo/templates/project/__init__.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,471 copying crawlo/templates/project/items.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,472 copying crawlo/templates/project/middlewares.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,473 copying crawlo/templates/project/pipelines.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,473 copying crawlo/templates/project/settings.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,474 copying crawlo/templates/project/settings_distributed.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,474 copying crawlo/templates/project/settings_gentle.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,475 copying crawlo/templates/project/settings_high_performance.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,475 copying crawlo/templates/project/settings_minimal.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,476 copying crawlo/templates/project/settings_simple.py.tmpl -> build/lib/crawlo/templates/project 2025-10-25T16:24:22,476 creating build/lib/crawlo/templates/project/spiders 2025-10-25T16:24:22,477 copying crawlo/templates/project/spiders/__init__.py.tmpl -> build/lib/crawlo/templates/project/spiders 2025-10-25T16:24:22,478 creating build/lib/crawlo/templates/spider 2025-10-25T16:24:22,478 copying crawlo/templates/spider/spider.py.tmpl -> build/lib/crawlo/templates/spider 2025-10-25T16:24:22,479 installing to build/bdist.linux-armv7l/wheel 2025-10-25T16:24:22,479 running install 2025-10-25T16:24:22,480 running install_lib 2025-10-25T16:24:22,487 creating build/bdist.linux-armv7l/wheel 2025-10-25T16:24:22,492 creating build/bdist.linux-armv7l/wheel/tests 2025-10-25T16:24:22,493 copying build/lib/tests/final_comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,496 copying build/lib/tests/test_edge_cases.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,498 copying build/lib/tests/test_retry_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,501 copying build/lib/tests/baidu_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,503 copying build/lib/tests/log_buffering_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,505 copying build/lib/tests/test_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,508 copying build/lib/tests/test_proxy_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,510 copying build/lib/tests/simple_selector_helper_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,512 copying build/lib/tests/test_logging_system.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,515 copying build/lib/tests/test_selector_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,517 copying build/lib/tests/test_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,520 copying build/lib/tests/test_config_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,523 copying build/lib/tests/test_mysql_pipeline_error.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,524 copying build/lib/tests/controlled_spider_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,527 copying build/lib/tests/final_validation_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,529 copying build/lib/tests/test_asyncmy_usage.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,531 copying build/lib/tests/test_mysql_pipeline_init_log.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,533 copying build/lib/tests/final_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,535 copying build/lib/tests/test_response_code_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,538 copying build/lib/tests/test_priority_behavior.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,541 copying build/lib/tests/log_generation_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,544 copying build/lib/tests/test_dedup_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,547 copying build/lib/tests/queue_blocking_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,549 copying build/lib/tests/comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,551 copying build/lib/tests/test_queue_empty_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,553 copying build/lib/tests/test_default_header_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,555 copying build/lib/tests/test_mysql_pipeline_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,557 copying build/lib/tests/simple_selector_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,560 copying build/lib/tests/comprehensive_framework_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,562 copying build/lib/tests/test_scrapy_style_encoding.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,565 copying build/lib/tests/test_factory_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,567 copying build/lib/tests/test_random_user_agent.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,569 copying build/lib/tests/test_component_factory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,571 copying build/lib/tests/simple_log_test2.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,573 copying build/lib/tests/test_proxy_middleware_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,576 copying build/lib/tests/test_user_agent_randomness.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,579 copying build/lib/tests/test_config_merge.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,581 copying build/lib/tests/direct_selector_helper_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,583 copying build/lib/tests/simple_follow_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,585 copying build/lib/tests/test_queue_type.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,587 copying build/lib/tests/test_double_crawlo_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,589 copying build/lib/tests/test_spider_loader_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,591 copying build/lib/tests/test_offsite_middleware_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,593 copying build/lib/tests/test_error_handler_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,595 copying build/lib/tests/test_response_improvements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,597 copying build/lib/tests/advanced_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,599 copying build/lib/tests/test_scheduler_config_update.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,602 copying build/lib/tests/debug_log_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,604 copying build/lib/tests/debug_pipelines.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,606 copying build/lib/tests/test_proxy_strategies.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,608 copying build/lib/tests/cleaners_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,610 copying build/lib/tests/bug_check_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,613 creating build/bdist.linux-armv7l/wheel/tests/test_spiders 2025-10-25T16:24:22,615 copying build/lib/tests/test_spiders/test_spider.py -> build/bdist.linux-armv7l/wheel/./tests/test_spiders 2025-10-25T16:24:22,617 copying build/lib/tests/test_spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/test_spiders 2025-10-25T16:24:22,619 copying build/lib/tests/test_mysql_pipeline_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,621 copying build/lib/tests/debug_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,623 copying build/lib/tests/test_response_filter_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,627 copying build/lib/tests/detailed_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,629 copying build/lib/tests/monitor_redis_dedup.sh -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,631 copying build/lib/tests/test_hash_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,633 copying build/lib/tests/test_factories.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,636 copying build/lib/tests/test_redis_key_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,639 copying build/lib/tests/redis_key_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,641 copying build/lib/tests/simple_command_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,643 copying build/lib/tests/verify_log_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,645 copying build/lib/tests/test_pipeline_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,647 copying build/lib/tests/test_cleaners.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,649 copying build/lib/tests/test_dedup_pipeline_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,651 copying build/lib/tests/test_all_pipeline_fingerprints.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,654 copying build/lib/tests/test_redis_queue.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,656 copying build/lib/tests/comprehensive_testing_summary.md -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,659 copying build/lib/tests/test_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,661 copying build/lib/tests/test_encoding_detection.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,663 copying build/lib/tests/test_double_crawlo_fix_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,666 copying build/lib/tests/test_downloader_proxy_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,668 copying build/lib/tests/test_cli_arguments.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,671 copying build/lib/tests/untested_features_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,673 copying build/lib/tests/test_offsite_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,675 copying build/lib/tests/dynamic_loading_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,677 copying build/lib/tests/test_enhanced_error_handler_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,679 copying build/lib/tests/test_logging_enhancements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,682 copying build/lib/tests/test_spider_loader.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,684 copying build/lib/tests/test_user_agents.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,686 copying build/lib/tests/test_queue_type_redis_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,688 copying build/lib/tests/test_advanced_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,691 copying build/lib/tests/test_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,693 copying build/lib/tests/authenticated_proxy_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,695 copying build/lib/tests/test_response_url_methods.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,697 copying build/lib/tests/spider_log_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,700 copying build/lib/tests/test_middleware_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,702 copying build/lib/tests/distributed_dedup_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,705 copying build/lib/tests/test_logging_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,708 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,710 copying build/lib/tests/simple_url_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,712 copying build/lib/tests/verify_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,714 copying build/lib/tests/simple_crawlo_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,717 copying build/lib/tests/test_mysql_pipeline_robustness.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,719 copying build/lib/tests/test_item_dedup_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,721 copying build/lib/tests/test_proxy_only.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,723 copying build/lib/tests/date_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,725 copying build/lib/tests/test_request_serialization.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,728 copying build/lib/tests/test_crawlo_proxy_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,730 copying build/lib/tests/test_request_ignore_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,733 copying build/lib/tests/test_enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,736 copying build/lib/tests/config_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,738 copying build/lib/tests/simple_spider_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,740 copying build/lib/tests/test_redis_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,742 copying build/lib/tests/test_proxy_providers.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,744 copying build/lib/tests/test_redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,747 copying build/lib/tests/test_redis_queue_type_fallback.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,750 copying build/lib/tests/test_crawler_process_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,752 copying build/lib/tests/verify_mysql_warnings.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,754 copying build/lib/tests/distributed_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,756 copying build/lib/tests/fix_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,759 copying build/lib/tests/simple_queue_type_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,761 copying build/lib/tests/baidu_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,763 copying build/lib/tests/distributed_test_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,765 copying build/lib/tests/optimized_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,769 copying build/lib/tests/test_template_content.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,771 copying build/lib/tests/test_simple_response.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,773 copying build/lib/tests/test_all_commands.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,775 copying build/lib/tests/test_crawler_process_import.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,778 copying build/lib/tests/test_multi_directory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,780 copying build/lib/tests/dynamic_loading_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,784 copying build/lib/tests/test_proxy_middleware_enhanced.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,787 copying build/lib/tests/test_mysql_pipeline_refactor_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,789 copying build/lib/tests/simple_response_selector_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,791 copying build/lib/tests/queue_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,793 copying build/lib/tests/test_telecom_spider_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,796 copying build/lib/tests/test_all_redis_key_configs.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,798 copying build/lib/tests/test_final_validation.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,801 copying build/lib/tests/simulate_mysql_update_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,803 copying build/lib/tests/test_redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,805 copying build/lib/tests/test_template_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,808 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy 2025-10-25T16:24:22,810 copying build/lib/tests/ofweek_scrapy/scrapy.cfg -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy 2025-10-25T16:24:22,813 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,814 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/pipelines.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,816 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/settings.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,819 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-25T16:24:22,820 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-25T16:24:22,823 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/middlewares.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,825 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,827 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/items.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-25T16:24:22,829 copying build/lib/tests/framework_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,832 copying build/lib/tests/debug_configure.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,833 copying build/lib/tests/request_params_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,836 copying build/lib/tests/explain_mysql_update_behavior.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,838 copying build/lib/tests/test_request_params.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,840 copying build/lib/tests/test_get_component_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,843 copying build/lib/tests/test_mysql_pipeline_refactor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,846 copying build/lib/tests/test_mode_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,848 copying build/lib/tests/test_download_delay_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,851 copying build/lib/tests/test_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,853 copying build/lib/tests/debug_log_levels.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,856 copying build/lib/tests/error_handling_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,858 copying build/lib/tests/test_random_headers_necessity.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,862 creating build/bdist.linux-armv7l/wheel/tests/scrapy_comparison 2025-10-25T16:24:22,863 copying build/lib/tests/scrapy_comparison/ofweek_scrapy.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-10-25T16:24:22,866 copying build/lib/tests/scrapy_comparison/scrapy_test.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-10-25T16:24:22,868 copying build/lib/tests/test_priority_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,870 copying build/lib/tests/test_controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,872 copying build/lib/tests/test_batch_processor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,874 copying build/lib/tests/test_queue_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,876 copying build/lib/tests/test_priority_consistency_fixed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,878 copying build/lib/tests/performance_comparison.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,880 copying build/lib/tests/test_fingerprint_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,883 copying build/lib/tests/test_redis_queue_name_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,885 copying build/lib/tests/test_proxy_stats.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,886 copying build/lib/tests/test_logging_final.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,888 copying build/lib/tests/test_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,890 copying build/lib/tests/test_retry_middleware_realistic.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,892 copying build/lib/tests/response_improvements_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,894 copying build/lib/tests/simple_optimization_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,896 copying build/lib/tests/test_response_urljoin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,898 copying build/lib/tests/verify_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,900 copying build/lib/tests/test_parsel.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,901 copying build/lib/tests/test_random_headers_default.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,904 copying build/lib/tests/test_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,907 copying build/lib/tests/test_response_selector_methods.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,909 copying build/lib/tests/test_multiple_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,911 copying build/lib/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,913 copying build/lib/tests/test_mysql_pipeline_types.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,916 copying build/lib/tests/simple_cli_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,918 copying build/lib/tests/test_queue_manager_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,921 copying build/lib/tests/test_proxy_health_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,923 copying build/lib/tests/test_optimized_selector_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,925 copying build/lib/tests/test_mysql_update_columns.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,928 copying build/lib/tests/test_proxy_with_downloader.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,931 copying build/lib/tests/test_date_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,933 copying build/lib/tests/test_queue_manager_double_crawlo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,936 copying build/lib/tests/test_encoding_core.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,938 copying build/lib/tests/test_performance_monitor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,940 copying build/lib/tests/test_response_follow.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,942 copying build/lib/tests/test_large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,944 copying build/lib/tests/test_proxy_middleware_refactored.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,947 copying build/lib/tests/test_selector_optimizations.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-25T16:24:22,951 creating build/bdist.linux-armv7l/wheel/crawlo 2025-10-25T16:24:22,954 creating build/bdist.linux-armv7l/wheel/crawlo/data 2025-10-25T16:24:22,955 copying build/lib/crawlo/data/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-10-25T16:24:22,958 copying build/lib/crawlo/data/user_agents.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-10-25T16:24:22,960 copying build/lib/crawlo/exceptions.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:22,964 creating build/bdist.linux-armv7l/wheel/crawlo/queue 2025-10-25T16:24:22,965 copying build/lib/crawlo/queue/redis_priority_queue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-25T16:24:22,968 copying build/lib/crawlo/queue/pqueue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-25T16:24:22,971 copying build/lib/crawlo/queue/queue_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-25T16:24:22,974 copying build/lib/crawlo/queue/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-25T16:24:22,976 copying build/lib/crawlo/framework.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:22,979 copying build/lib/crawlo/task_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:22,981 copying build/lib/crawlo/event.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:22,984 creating build/bdist.linux-armv7l/wheel/crawlo/initialization 2025-10-25T16:24:22,985 copying build/lib/crawlo/initialization/phases.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:22,989 copying build/lib/crawlo/initialization/context.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:22,992 copying build/lib/crawlo/initialization/core.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:22,994 copying build/lib/crawlo/initialization/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:22,997 copying build/lib/crawlo/initialization/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:22,999 copying build/lib/crawlo/initialization/built_in.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:23,001 copying build/lib/crawlo/initialization/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-25T16:24:23,005 creating build/bdist.linux-armv7l/wheel/crawlo/tools 2025-10-25T16:24:23,006 copying build/lib/crawlo/tools/distributed_coordinator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-25T16:24:23,009 copying build/lib/crawlo/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-25T16:24:23,011 copying build/lib/crawlo/tools/scenario_adapter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-25T16:24:23,014 copying build/lib/crawlo/tools/text_cleaner.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-25T16:24:23,016 copying build/lib/crawlo/tools/date_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-25T16:24:23,019 creating build/bdist.linux-armv7l/wheel/crawlo/templates 2025-10-25T16:24:23,021 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project 2025-10-25T16:24:23,023 copying build/lib/crawlo/templates/project/middlewares.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,026 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project/spiders 2025-10-25T16:24:23,027 copying build/lib/crawlo/templates/project/spiders/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project/spiders 2025-10-25T16:24:23,029 copying build/lib/crawlo/templates/project/settings_high_performance.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,032 copying build/lib/crawlo/templates/project/settings_gentle.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,035 copying build/lib/crawlo/templates/project/settings.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,037 copying build/lib/crawlo/templates/project/settings_minimal.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,039 copying build/lib/crawlo/templates/project/items.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,042 copying build/lib/crawlo/templates/project/pipelines.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,044 copying build/lib/crawlo/templates/project/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,046 copying build/lib/crawlo/templates/project/settings_simple.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,048 copying build/lib/crawlo/templates/project/settings_distributed.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-25T16:24:23,050 creating build/bdist.linux-armv7l/wheel/crawlo/templates/spider 2025-10-25T16:24:23,051 copying build/lib/crawlo/templates/spider/spider.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/spider 2025-10-25T16:24:23,053 copying build/lib/crawlo/templates/run.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-10-25T16:24:23,055 copying build/lib/crawlo/templates/spiders_init.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-10-25T16:24:23,056 copying build/lib/crawlo/templates/crawlo.cfg.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-10-25T16:24:23,058 copying build/lib/crawlo/stats_collector.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,060 creating build/bdist.linux-armv7l/wheel/crawlo/logging 2025-10-25T16:24:23,061 copying build/lib/crawlo/logging/factory.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-25T16:24:23,063 copying build/lib/crawlo/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-25T16:24:23,065 copying build/lib/crawlo/logging/manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-25T16:24:23,067 copying build/lib/crawlo/logging/config.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-25T16:24:23,069 copying build/lib/crawlo/cli.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,072 copying build/lib/crawlo/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,075 copying build/lib/crawlo/project.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,077 copying build/lib/crawlo/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,080 creating build/bdist.linux-armv7l/wheel/crawlo/pipelines 2025-10-25T16:24:23,081 copying build/lib/crawlo/pipelines/mysql_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,084 copying build/lib/crawlo/pipelines/redis_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,086 copying build/lib/crawlo/pipelines/csv_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,089 copying build/lib/crawlo/pipelines/pipeline_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,091 copying build/lib/crawlo/pipelines/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,092 copying build/lib/crawlo/pipelines/memory_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,094 copying build/lib/crawlo/pipelines/console_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,096 copying build/lib/crawlo/pipelines/mongo_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,098 copying build/lib/crawlo/pipelines/json_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,100 copying build/lib/crawlo/pipelines/base_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,103 copying build/lib/crawlo/pipelines/database_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,105 copying build/lib/crawlo/pipelines/bloom_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-25T16:24:23,107 creating build/bdist.linux-armv7l/wheel/crawlo/filters 2025-10-25T16:24:23,108 copying build/lib/crawlo/filters/aioredis_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-10-25T16:24:23,111 copying build/lib/crawlo/filters/memory_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-10-25T16:24:23,113 copying build/lib/crawlo/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-10-25T16:24:23,116 creating build/bdist.linux-armv7l/wheel/crawlo/downloader 2025-10-25T16:24:23,117 copying build/lib/crawlo/downloader/playwright_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,119 copying build/lib/crawlo/downloader/selenium_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,121 copying build/lib/crawlo/downloader/cffi_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,123 copying build/lib/crawlo/downloader/hybrid_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,125 copying build/lib/crawlo/downloader/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,127 copying build/lib/crawlo/downloader/aiohttp_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,129 copying build/lib/crawlo/downloader/httpx_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-25T16:24:23,132 creating build/bdist.linux-armv7l/wheel/crawlo/commands 2025-10-25T16:24:23,133 copying build/lib/crawlo/commands/genspider.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,135 copying build/lib/crawlo/commands/check.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,138 copying build/lib/crawlo/commands/run.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,140 copying build/lib/crawlo/commands/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,142 copying build/lib/crawlo/commands/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,144 copying build/lib/crawlo/commands/list.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,146 copying build/lib/crawlo/commands/stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,148 copying build/lib/crawlo/commands/help.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,151 copying build/lib/crawlo/commands/startproject.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-25T16:24:23,154 creating build/bdist.linux-armv7l/wheel/crawlo/utils 2025-10-25T16:24:23,155 copying build/lib/crawlo/utils/controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,158 copying build/lib/crawlo/utils/redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,160 copying build/lib/crawlo/utils/func_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,162 copying build/lib/crawlo/utils/mysql_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,164 copying build/lib/crawlo/utils/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,167 copying build/lib/crawlo/utils/leak_detector.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,169 copying build/lib/crawlo/utils/selector_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,171 copying build/lib/crawlo/utils/batch_processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,173 copying build/lib/crawlo/utils/redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,175 copying build/lib/crawlo/utils/config_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,178 copying build/lib/crawlo/utils/db_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,180 copying build/lib/crawlo/utils/text_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,182 copying build/lib/crawlo/utils/singleton.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,184 copying build/lib/crawlo/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,185 copying build/lib/crawlo/utils/redis_checker.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,187 copying build/lib/crawlo/utils/mongo_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,189 copying build/lib/crawlo/utils/performance_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,191 copying build/lib/crawlo/utils/fingerprint.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,193 copying build/lib/crawlo/utils/misc.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,195 copying build/lib/crawlo/utils/request_serializer.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,197 copying build/lib/crawlo/utils/spider_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,200 copying build/lib/crawlo/utils/large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,202 copying build/lib/crawlo/utils/resource_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,205 copying build/lib/crawlo/utils/url_utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,207 copying build/lib/crawlo/utils/error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,209 copying build/lib/crawlo/utils/log.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,211 copying build/lib/crawlo/utils/queue_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-25T16:24:23,214 creating build/bdist.linux-armv7l/wheel/crawlo/extension 2025-10-25T16:24:23,215 copying build/lib/crawlo/extension/logging_extension.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,217 copying build/lib/crawlo/extension/request_recorder.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,219 copying build/lib/crawlo/extension/log_interval.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,221 copying build/lib/crawlo/extension/log_stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,223 copying build/lib/crawlo/extension/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,225 copying build/lib/crawlo/extension/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,228 copying build/lib/crawlo/extension/performance_profiler.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,230 copying build/lib/crawlo/extension/health_check.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-25T16:24:23,232 copying build/lib/crawlo/__version__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,234 copying build/lib/crawlo/subscriber.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,237 creating build/bdist.linux-armv7l/wheel/crawlo/spider 2025-10-25T16:24:23,238 copying build/lib/crawlo/spider/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/spider 2025-10-25T16:24:23,240 copying build/lib/crawlo/config_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,243 creating build/bdist.linux-armv7l/wheel/crawlo/items 2025-10-25T16:24:23,244 copying build/lib/crawlo/items/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-25T16:24:23,246 copying build/lib/crawlo/items/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-25T16:24:23,248 copying build/lib/crawlo/items/fields.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-25T16:24:23,250 copying build/lib/crawlo/items/items.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-25T16:24:23,252 creating build/bdist.linux-armv7l/wheel/crawlo/middleware 2025-10-25T16:24:23,253 copying build/lib/crawlo/middleware/download_delay.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,255 copying build/lib/crawlo/middleware/response_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,257 copying build/lib/crawlo/middleware/offsite.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,259 copying build/lib/crawlo/middleware/request_ignore.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,261 copying build/lib/crawlo/middleware/default_header.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,263 copying build/lib/crawlo/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,265 copying build/lib/crawlo/middleware/response_code.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,267 copying build/lib/crawlo/middleware/middleware_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,269 copying build/lib/crawlo/middleware/proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,272 copying build/lib/crawlo/middleware/retry.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-25T16:24:23,274 creating build/bdist.linux-armv7l/wheel/crawlo/factories 2025-10-25T16:24:23,275 copying build/lib/crawlo/factories/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-25T16:24:23,277 copying build/lib/crawlo/factories/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-25T16:24:23,279 copying build/lib/crawlo/factories/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-25T16:24:23,281 copying build/lib/crawlo/factories/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-25T16:24:23,282 copying build/lib/crawlo/factories/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-25T16:24:23,285 creating build/bdist.linux-armv7l/wheel/crawlo/network 2025-10-25T16:24:23,286 copying build/lib/crawlo/network/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-10-25T16:24:23,288 copying build/lib/crawlo/network/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-10-25T16:24:23,290 copying build/lib/crawlo/network/response.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-10-25T16:24:23,293 copying build/lib/crawlo/mode_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,295 copying build/lib/crawlo/interfaces.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,297 creating build/bdist.linux-armv7l/wheel/crawlo/core 2025-10-25T16:24:23,298 copying build/lib/crawlo/core/engine.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-25T16:24:23,301 copying build/lib/crawlo/core/processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-25T16:24:23,303 copying build/lib/crawlo/core/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-25T16:24:23,305 copying build/lib/crawlo/core/scheduler.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-25T16:24:23,308 creating build/bdist.linux-armv7l/wheel/crawlo/settings 2025-10-25T16:24:23,310 copying build/lib/crawlo/settings/default_settings.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-10-25T16:24:23,312 copying build/lib/crawlo/settings/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-10-25T16:24:23,314 copying build/lib/crawlo/settings/setting_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-10-25T16:24:23,316 copying build/lib/crawlo/config.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-25T16:24:23,319 creating build/bdist.linux-armv7l/wheel/examples 2025-10-25T16:24:23,320 copying build/lib/examples/__init__.py -> build/bdist.linux-armv7l/wheel/./examples 2025-10-25T16:24:23,322 running install_egg_info 2025-10-25T16:24:23,335 Copying crawlo.egg-info to build/bdist.linux-armv7l/wheel/./crawlo-1.4.7-py3.11.egg-info 2025-10-25T16:24:23,348 running install_scripts 2025-10-25T16:24:23,356 creating build/bdist.linux-armv7l/wheel/crawlo-1.4.7.dist-info/WHEEL 2025-10-25T16:24:23,359 creating '/tmp/pip-wheel-znb1gsxa/.tmp-zjfa0mlq/crawlo-1.4.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-10-25T16:24:23,362 adding 'crawlo/__init__.py' 2025-10-25T16:24:23,363 adding 'crawlo/__version__.py' 2025-10-25T16:24:23,364 adding 'crawlo/cli.py' 2025-10-25T16:24:23,366 adding 'crawlo/config.py' 2025-10-25T16:24:23,368 adding 'crawlo/config_validator.py' 2025-10-25T16:24:23,371 adding 'crawlo/crawler.py' 2025-10-25T16:24:23,373 adding 'crawlo/event.py' 2025-10-25T16:24:23,374 adding 'crawlo/exceptions.py' 2025-10-25T16:24:23,376 adding 'crawlo/framework.py' 2025-10-25T16:24:23,377 adding 'crawlo/interfaces.py' 2025-10-25T16:24:23,379 adding 'crawlo/mode_manager.py' 2025-10-25T16:24:23,381 adding 'crawlo/project.py' 2025-10-25T16:24:23,383 adding 'crawlo/stats_collector.py' 2025-10-25T16:24:23,384 adding 'crawlo/subscriber.py' 2025-10-25T16:24:23,386 adding 'crawlo/task_manager.py' 2025-10-25T16:24:23,387 adding 'crawlo/commands/__init__.py' 2025-10-25T16:24:23,390 adding 'crawlo/commands/check.py' 2025-10-25T16:24:23,391 adding 'crawlo/commands/genspider.py' 2025-10-25T16:24:23,393 adding 'crawlo/commands/help.py' 2025-10-25T16:24:23,395 adding 'crawlo/commands/list.py' 2025-10-25T16:24:23,396 adding 'crawlo/commands/run.py' 2025-10-25T16:24:23,399 adding 'crawlo/commands/startproject.py' 2025-10-25T16:24:23,401 adding 'crawlo/commands/stats.py' 2025-10-25T16:24:23,402 adding 'crawlo/commands/utils.py' 2025-10-25T16:24:23,404 adding 'crawlo/core/__init__.py' 2025-10-25T16:24:23,406 adding 'crawlo/core/engine.py' 2025-10-25T16:24:23,408 adding 'crawlo/core/processor.py' 2025-10-25T16:24:23,410 adding 'crawlo/core/scheduler.py' 2025-10-25T16:24:23,411 adding 'crawlo/data/__init__.py' 2025-10-25T16:24:23,413 adding 'crawlo/data/user_agents.py' 2025-10-25T16:24:23,415 adding 'crawlo/downloader/__init__.py' 2025-10-25T16:24:23,417 adding 'crawlo/downloader/aiohttp_downloader.py' 2025-10-25T16:24:23,419 adding 'crawlo/downloader/cffi_downloader.py' 2025-10-25T16:24:23,421 adding 'crawlo/downloader/httpx_downloader.py' 2025-10-25T16:24:23,423 adding 'crawlo/downloader/hybrid_downloader.py' 2025-10-25T16:24:23,425 adding 'crawlo/downloader/playwright_downloader.py' 2025-10-25T16:24:23,427 adding 'crawlo/downloader/selenium_downloader.py' 2025-10-25T16:24:23,429 adding 'crawlo/extension/__init__.py' 2025-10-25T16:24:23,431 adding 'crawlo/extension/health_check.py' 2025-10-25T16:24:23,432 adding 'crawlo/extension/log_interval.py' 2025-10-25T16:24:23,434 adding 'crawlo/extension/log_stats.py' 2025-10-25T16:24:23,435 adding 'crawlo/extension/logging_extension.py' 2025-10-25T16:24:23,437 adding 'crawlo/extension/memory_monitor.py' 2025-10-25T16:24:23,438 adding 'crawlo/extension/performance_profiler.py' 2025-10-25T16:24:23,440 adding 'crawlo/extension/request_recorder.py' 2025-10-25T16:24:23,441 adding 'crawlo/factories/__init__.py' 2025-10-25T16:24:23,443 adding 'crawlo/factories/base.py' 2025-10-25T16:24:23,444 adding 'crawlo/factories/crawler.py' 2025-10-25T16:24:23,445 adding 'crawlo/factories/registry.py' 2025-10-25T16:24:23,447 adding 'crawlo/factories/utils.py' 2025-10-25T16:24:23,449 adding 'crawlo/filters/__init__.py' 2025-10-25T16:24:23,451 adding 'crawlo/filters/aioredis_filter.py' 2025-10-25T16:24:23,452 adding 'crawlo/filters/memory_filter.py' 2025-10-25T16:24:23,454 adding 'crawlo/initialization/__init__.py' 2025-10-25T16:24:23,456 adding 'crawlo/initialization/built_in.py' 2025-10-25T16:24:23,458 adding 'crawlo/initialization/context.py' 2025-10-25T16:24:23,459 adding 'crawlo/initialization/core.py' 2025-10-25T16:24:23,461 adding 'crawlo/initialization/phases.py' 2025-10-25T16:24:23,463 adding 'crawlo/initialization/registry.py' 2025-10-25T16:24:23,464 adding 'crawlo/initialization/utils.py' 2025-10-25T16:24:23,465 adding 'crawlo/items/__init__.py' 2025-10-25T16:24:23,467 adding 'crawlo/items/base.py' 2025-10-25T16:24:23,468 adding 'crawlo/items/fields.py' 2025-10-25T16:24:23,469 adding 'crawlo/items/items.py' 2025-10-25T16:24:23,471 adding 'crawlo/logging/__init__.py' 2025-10-25T16:24:23,472 adding 'crawlo/logging/config.py' 2025-10-25T16:24:23,474 adding 'crawlo/logging/factory.py' 2025-10-25T16:24:23,475 adding 'crawlo/logging/manager.py' 2025-10-25T16:24:23,477 adding 'crawlo/middleware/__init__.py' 2025-10-25T16:24:23,478 adding 'crawlo/middleware/default_header.py' 2025-10-25T16:24:23,480 adding 'crawlo/middleware/download_delay.py' 2025-10-25T16:24:23,481 adding 'crawlo/middleware/middleware_manager.py' 2025-10-25T16:24:23,483 adding 'crawlo/middleware/offsite.py' 2025-10-25T16:24:23,484 adding 'crawlo/middleware/proxy.py' 2025-10-25T16:24:23,486 adding 'crawlo/middleware/request_ignore.py' 2025-10-25T16:24:23,487 adding 'crawlo/middleware/response_code.py' 2025-10-25T16:24:23,489 adding 'crawlo/middleware/response_filter.py' 2025-10-25T16:24:23,490 adding 'crawlo/middleware/retry.py' 2025-10-25T16:24:23,492 adding 'crawlo/network/__init__.py' 2025-10-25T16:24:23,494 adding 'crawlo/network/request.py' 2025-10-25T16:24:23,496 adding 'crawlo/network/response.py' 2025-10-25T16:24:23,498 adding 'crawlo/pipelines/__init__.py' 2025-10-25T16:24:23,500 adding 'crawlo/pipelines/base_pipeline.py' 2025-10-25T16:24:23,502 adding 'crawlo/pipelines/bloom_dedup_pipeline.py' 2025-10-25T16:24:23,503 adding 'crawlo/pipelines/console_pipeline.py' 2025-10-25T16:24:23,505 adding 'crawlo/pipelines/csv_pipeline.py' 2025-10-25T16:24:23,507 adding 'crawlo/pipelines/database_dedup_pipeline.py' 2025-10-25T16:24:23,508 adding 'crawlo/pipelines/json_pipeline.py' 2025-10-25T16:24:23,510 adding 'crawlo/pipelines/memory_dedup_pipeline.py' 2025-10-25T16:24:23,511 adding 'crawlo/pipelines/mongo_pipeline.py' 2025-10-25T16:24:23,513 adding 'crawlo/pipelines/mysql_pipeline.py' 2025-10-25T16:24:23,515 adding 'crawlo/pipelines/pipeline_manager.py' 2025-10-25T16:24:23,516 adding 'crawlo/pipelines/redis_dedup_pipeline.py' 2025-10-25T16:24:23,518 adding 'crawlo/queue/__init__.py' 2025-10-25T16:24:23,519 adding 'crawlo/queue/pqueue.py' 2025-10-25T16:24:23,522 adding 'crawlo/queue/queue_manager.py' 2025-10-25T16:24:23,525 adding 'crawlo/queue/redis_priority_queue.py' 2025-10-25T16:24:23,526 adding 'crawlo/settings/__init__.py' 2025-10-25T16:24:23,528 adding 'crawlo/settings/default_settings.py' 2025-10-25T16:24:23,530 adding 'crawlo/settings/setting_manager.py' 2025-10-25T16:24:23,533 adding 'crawlo/spider/__init__.py' 2025-10-25T16:24:23,535 adding 'crawlo/templates/crawlo.cfg.tmpl' 2025-10-25T16:24:23,536 adding 'crawlo/templates/run.py.tmpl' 2025-10-25T16:24:23,537 adding 'crawlo/templates/spiders_init.py.tmpl' 2025-10-25T16:24:23,539 adding 'crawlo/templates/project/__init__.py.tmpl' 2025-10-25T16:24:23,540 adding 'crawlo/templates/project/items.py.tmpl' 2025-10-25T16:24:23,542 adding 'crawlo/templates/project/middlewares.py.tmpl' 2025-10-25T16:24:23,543 adding 'crawlo/templates/project/pipelines.py.tmpl' 2025-10-25T16:24:23,544 adding 'crawlo/templates/project/settings.py.tmpl' 2025-10-25T16:24:23,546 adding 'crawlo/templates/project/settings_distributed.py.tmpl' 2025-10-25T16:24:23,547 adding 'crawlo/templates/project/settings_gentle.py.tmpl' 2025-10-25T16:24:23,549 adding 'crawlo/templates/project/settings_high_performance.py.tmpl' 2025-10-25T16:24:23,550 adding 'crawlo/templates/project/settings_minimal.py.tmpl' 2025-10-25T16:24:23,552 adding 'crawlo/templates/project/settings_simple.py.tmpl' 2025-10-25T16:24:23,554 adding 'crawlo/templates/project/spiders/__init__.py.tmpl' 2025-10-25T16:24:23,555 adding 'crawlo/templates/spider/spider.py.tmpl' 2025-10-25T16:24:23,557 adding 'crawlo/tools/__init__.py' 2025-10-25T16:24:23,559 adding 'crawlo/tools/date_tools.py' 2025-10-25T16:24:23,561 adding 'crawlo/tools/distributed_coordinator.py' 2025-10-25T16:24:23,562 adding 'crawlo/tools/scenario_adapter.py' 2025-10-25T16:24:23,564 adding 'crawlo/tools/text_cleaner.py' 2025-10-25T16:24:23,566 adding 'crawlo/utils/__init__.py' 2025-10-25T16:24:23,568 adding 'crawlo/utils/batch_processor.py' 2025-10-25T16:24:23,570 adding 'crawlo/utils/config_manager.py' 2025-10-25T16:24:23,572 adding 'crawlo/utils/controlled_spider_mixin.py' 2025-10-25T16:24:23,573 adding 'crawlo/utils/db_helper.py' 2025-10-25T16:24:23,575 adding 'crawlo/utils/error_handler.py' 2025-10-25T16:24:23,577 adding 'crawlo/utils/fingerprint.py' 2025-10-25T16:24:23,578 adding 'crawlo/utils/func_tools.py' 2025-10-25T16:24:23,580 adding 'crawlo/utils/large_scale_helper.py' 2025-10-25T16:24:23,581 adding 'crawlo/utils/leak_detector.py' 2025-10-25T16:24:23,583 adding 'crawlo/utils/log.py' 2025-10-25T16:24:23,584 adding 'crawlo/utils/misc.py' 2025-10-25T16:24:23,585 adding 'crawlo/utils/mongo_connection_pool.py' 2025-10-25T16:24:23,587 adding 'crawlo/utils/mysql_connection_pool.py' 2025-10-25T16:24:23,589 adding 'crawlo/utils/performance_monitor.py' 2025-10-25T16:24:23,590 adding 'crawlo/utils/queue_helper.py' 2025-10-25T16:24:23,592 adding 'crawlo/utils/redis_checker.py' 2025-10-25T16:24:23,594 adding 'crawlo/utils/redis_connection_pool.py' 2025-10-25T16:24:23,596 adding 'crawlo/utils/redis_key_validator.py' 2025-10-25T16:24:23,598 adding 'crawlo/utils/request.py' 2025-10-25T16:24:23,599 adding 'crawlo/utils/request_serializer.py' 2025-10-25T16:24:23,601 adding 'crawlo/utils/resource_manager.py' 2025-10-25T16:24:23,602 adding 'crawlo/utils/selector_helper.py' 2025-10-25T16:24:23,604 adding 'crawlo/utils/singleton.py' 2025-10-25T16:24:23,605 adding 'crawlo/utils/spider_loader.py' 2025-10-25T16:24:23,607 adding 'crawlo/utils/text_helper.py' 2025-10-25T16:24:23,608 adding 'crawlo/utils/url_utils.py' 2025-10-25T16:24:23,610 adding 'examples/__init__.py' 2025-10-25T16:24:23,615 adding 'tests/__init__.py' 2025-10-25T16:24:23,617 adding 'tests/advanced_tools_example.py' 2025-10-25T16:24:23,618 adding 'tests/authenticated_proxy_example.py' 2025-10-25T16:24:23,619 adding 'tests/baidu_performance_test.py' 2025-10-25T16:24:23,621 adding 'tests/baidu_test.py' 2025-10-25T16:24:23,622 adding 'tests/bug_check_test.py' 2025-10-25T16:24:23,624 adding 'tests/cleaners_example.py' 2025-10-25T16:24:23,625 adding 'tests/comprehensive_framework_test.py' 2025-10-25T16:24:23,627 adding 'tests/comprehensive_test.py' 2025-10-25T16:24:23,628 adding 'tests/comprehensive_testing_summary.md' 2025-10-25T16:24:23,630 adding 'tests/config_validation_demo.py' 2025-10-25T16:24:23,632 adding 'tests/controlled_spider_example.py' 2025-10-25T16:24:23,633 adding 'tests/date_tools_example.py' 2025-10-25T16:24:23,634 adding 'tests/debug_configure.py' 2025-10-25T16:24:23,636 adding 'tests/debug_framework_logger.py' 2025-10-25T16:24:23,637 adding 'tests/debug_log_config.py' 2025-10-25T16:24:23,639 adding 'tests/debug_log_levels.py' 2025-10-25T16:24:23,640 adding 'tests/debug_pipelines.py' 2025-10-25T16:24:23,642 adding 'tests/detailed_log_test.py' 2025-10-25T16:24:23,643 adding 'tests/direct_selector_helper_test.py' 2025-10-25T16:24:23,645 adding 'tests/distributed_dedup_test.py' 2025-10-25T16:24:23,646 adding 'tests/distributed_test.py' 2025-10-25T16:24:23,648 adding 'tests/distributed_test_debug.py' 2025-10-25T16:24:23,650 adding 'tests/dynamic_loading_example.py' 2025-10-25T16:24:23,651 adding 'tests/dynamic_loading_test.py' 2025-10-25T16:24:23,653 adding 'tests/error_handling_example.py' 2025-10-25T16:24:23,654 adding 'tests/explain_mysql_update_behavior.py' 2025-10-25T16:24:23,656 adding 'tests/final_comprehensive_test.py' 2025-10-25T16:24:23,658 adding 'tests/final_log_test.py' 2025-10-25T16:24:23,659 adding 'tests/final_validation_test.py' 2025-10-25T16:24:23,661 adding 'tests/fix_log_test.py' 2025-10-25T16:24:23,662 adding 'tests/framework_performance_test.py' 2025-10-25T16:24:23,664 adding 'tests/log_buffering_test.py' 2025-10-25T16:24:23,665 adding 'tests/log_generation_timing_test.py' 2025-10-25T16:24:23,667 adding 'tests/monitor_redis_dedup.sh' 2025-10-25T16:24:23,668 adding 'tests/optimized_performance_test.py' 2025-10-25T16:24:23,670 adding 'tests/performance_comparison.py' 2025-10-25T16:24:23,671 adding 'tests/queue_blocking_test.py' 2025-10-25T16:24:23,672 adding 'tests/queue_test.py' 2025-10-25T16:24:23,674 adding 'tests/redis_key_validation_demo.py' 2025-10-25T16:24:23,675 adding 'tests/request_params_example.py' 2025-10-25T16:24:23,676 adding 'tests/response_improvements_example.py' 2025-10-25T16:24:23,677 adding 'tests/simple_cli_test.py' 2025-10-25T16:24:23,679 adding 'tests/simple_command_test.py' 2025-10-25T16:24:23,680 adding 'tests/simple_crawlo_test.py' 2025-10-25T16:24:23,681 adding 'tests/simple_follow_test.py' 2025-10-25T16:24:23,683 adding 'tests/simple_log_test2.py' 2025-10-25T16:24:23,684 adding 'tests/simple_optimization_test.py' 2025-10-25T16:24:23,685 adding 'tests/simple_queue_type_test.py' 2025-10-25T16:24:23,686 adding 'tests/simple_response_selector_test.py' 2025-10-25T16:24:23,688 adding 'tests/simple_selector_helper_test.py' 2025-10-25T16:24:23,689 adding 'tests/simple_selector_test.py' 2025-10-25T16:24:23,691 adding 'tests/simple_spider_test.py' 2025-10-25T16:24:23,692 adding 'tests/simple_url_test.py' 2025-10-25T16:24:23,694 adding 'tests/simulate_mysql_update_test.py' 2025-10-25T16:24:23,695 adding 'tests/spider_log_timing_test.py' 2025-10-25T16:24:23,696 adding 'tests/test_advanced_tools.py' 2025-10-25T16:24:23,698 adding 'tests/test_all_commands.py' 2025-10-25T16:24:23,699 adding 'tests/test_all_pipeline_fingerprints.py' 2025-10-25T16:24:23,701 adding 'tests/test_all_redis_key_configs.py' 2025-10-25T16:24:23,702 adding 'tests/test_asyncmy_usage.py' 2025-10-25T16:24:23,703 adding 'tests/test_batch_processor.py' 2025-10-25T16:24:23,705 adding 'tests/test_cleaners.py' 2025-10-25T16:24:23,706 adding 'tests/test_cli_arguments.py' 2025-10-25T16:24:23,708 adding 'tests/test_component_factory.py' 2025-10-25T16:24:23,709 adding 'tests/test_config_consistency.py' 2025-10-25T16:24:23,710 adding 'tests/test_config_merge.py' 2025-10-25T16:24:23,712 adding 'tests/test_config_validator.py' 2025-10-25T16:24:23,713 adding 'tests/test_controlled_spider_mixin.py' 2025-10-25T16:24:23,714 adding 'tests/test_crawler_process_import.py' 2025-10-25T16:24:23,716 adding 'tests/test_crawler_process_spider_modules.py' 2025-10-25T16:24:23,717 adding 'tests/test_crawlo_proxy_integration.py' 2025-10-25T16:24:23,719 adding 'tests/test_date_tools.py' 2025-10-25T16:24:23,720 adding 'tests/test_dedup_fix.py' 2025-10-25T16:24:23,722 adding 'tests/test_dedup_pipeline_consistency.py' 2025-10-25T16:24:23,723 adding 'tests/test_default_header_middleware.py' 2025-10-25T16:24:23,725 adding 'tests/test_distributed.py' 2025-10-25T16:24:23,726 adding 'tests/test_double_crawlo_fix.py' 2025-10-25T16:24:23,728 adding 'tests/test_double_crawlo_fix_simple.py' 2025-10-25T16:24:23,729 adding 'tests/test_download_delay_middleware.py' 2025-10-25T16:24:23,731 adding 'tests/test_downloader_proxy_compatibility.py' 2025-10-25T16:24:23,732 adding 'tests/test_edge_cases.py' 2025-10-25T16:24:23,734 adding 'tests/test_encoding_core.py' 2025-10-25T16:24:23,735 adding 'tests/test_encoding_detection.py' 2025-10-25T16:24:23,737 adding 'tests/test_enhanced_error_handler.py' 2025-10-25T16:24:23,739 adding 'tests/test_enhanced_error_handler_comprehensive.py' 2025-10-25T16:24:23,740 adding 'tests/test_error_handler_compatibility.py' 2025-10-25T16:24:23,742 adding 'tests/test_factories.py' 2025-10-25T16:24:23,743 adding 'tests/test_factory_compatibility.py' 2025-10-25T16:24:23,745 adding 'tests/test_final_validation.py' 2025-10-25T16:24:23,746 adding 'tests/test_fingerprint_consistency.py' 2025-10-25T16:24:23,747 adding 'tests/test_fingerprint_simple.py' 2025-10-25T16:24:23,749 adding 'tests/test_get_component_logger.py' 2025-10-25T16:24:23,750 adding 'tests/test_hash_performance.py' 2025-10-25T16:24:23,752 adding 'tests/test_integration.py' 2025-10-25T16:24:23,753 adding 'tests/test_item_dedup_redis_key.py' 2025-10-25T16:24:23,755 adding 'tests/test_large_scale_helper.py' 2025-10-25T16:24:23,756 adding 'tests/test_logging_enhancements.py' 2025-10-25T16:24:23,758 adding 'tests/test_logging_final.py' 2025-10-25T16:24:23,759 adding 'tests/test_logging_integration.py' 2025-10-25T16:24:23,761 adding 'tests/test_logging_system.py' 2025-10-25T16:24:23,762 adding 'tests/test_middleware_debug.py' 2025-10-25T16:24:23,764 adding 'tests/test_mode_consistency.py' 2025-10-25T16:24:23,765 adding 'tests/test_multi_directory.py' 2025-10-25T16:24:23,766 adding 'tests/test_multiple_spider_modules.py' 2025-10-25T16:24:23,768 adding 'tests/test_mysql_pipeline_config.py' 2025-10-25T16:24:23,769 adding 'tests/test_mysql_pipeline_error.py' 2025-10-25T16:24:23,770 adding 'tests/test_mysql_pipeline_init_log.py' 2025-10-25T16:24:23,771 adding 'tests/test_mysql_pipeline_integration.py' 2025-10-25T16:24:23,773 adding 'tests/test_mysql_pipeline_refactor.py' 2025-10-25T16:24:23,774 adding 'tests/test_mysql_pipeline_refactor_simple.py' 2025-10-25T16:24:23,776 adding 'tests/test_mysql_pipeline_robustness.py' 2025-10-25T16:24:23,777 adding 'tests/test_mysql_pipeline_types.py' 2025-10-25T16:24:23,778 adding 'tests/test_mysql_update_columns.py' 2025-10-25T16:24:23,780 adding 'tests/test_offsite_middleware.py' 2025-10-25T16:24:23,782 adding 'tests/test_offsite_middleware_simple.py' 2025-10-25T16:24:23,783 adding 'tests/test_optimized_selector_naming.py' 2025-10-25T16:24:23,784 adding 'tests/test_parsel.py' 2025-10-25T16:24:23,786 adding 'tests/test_performance.py' 2025-10-25T16:24:23,787 adding 'tests/test_performance_monitor.py' 2025-10-25T16:24:23,789 adding 'tests/test_pipeline_fingerprint_consistency.py' 2025-10-25T16:24:23,790 adding 'tests/test_priority_behavior.py' 2025-10-25T16:24:23,792 adding 'tests/test_priority_consistency.py' 2025-10-25T16:24:23,794 adding 'tests/test_priority_consistency_fixed.py' 2025-10-25T16:24:23,795 adding 'tests/test_proxy_health_check.py' 2025-10-25T16:24:23,796 adding 'tests/test_proxy_middleware.py' 2025-10-25T16:24:23,798 adding 'tests/test_proxy_middleware_enhanced.py' 2025-10-25T16:24:23,799 adding 'tests/test_proxy_middleware_integration.py' 2025-10-25T16:24:23,801 adding 'tests/test_proxy_middleware_refactored.py' 2025-10-25T16:24:23,802 adding 'tests/test_proxy_only.py' 2025-10-25T16:24:23,804 adding 'tests/test_proxy_providers.py' 2025-10-25T16:24:23,805 adding 'tests/test_proxy_stats.py' 2025-10-25T16:24:23,806 adding 'tests/test_proxy_strategies.py' 2025-10-25T16:24:23,808 adding 'tests/test_proxy_with_downloader.py' 2025-10-25T16:24:23,809 adding 'tests/test_queue_empty_check.py' 2025-10-25T16:24:23,810 adding 'tests/test_queue_manager_double_crawlo.py' 2025-10-25T16:24:23,812 adding 'tests/test_queue_manager_redis_key.py' 2025-10-25T16:24:23,813 adding 'tests/test_queue_naming.py' 2025-10-25T16:24:23,815 adding 'tests/test_queue_type.py' 2025-10-25T16:24:23,816 adding 'tests/test_queue_type_redis_config_consistency.py' 2025-10-25T16:24:23,818 adding 'tests/test_random_headers_default.py' 2025-10-25T16:24:23,820 adding 'tests/test_random_headers_necessity.py' 2025-10-25T16:24:23,821 adding 'tests/test_random_user_agent.py' 2025-10-25T16:24:23,823 adding 'tests/test_redis_config.py' 2025-10-25T16:24:23,824 adding 'tests/test_redis_connection_pool.py' 2025-10-25T16:24:23,826 adding 'tests/test_redis_key_naming.py' 2025-10-25T16:24:23,827 adding 'tests/test_redis_key_validator.py' 2025-10-25T16:24:23,829 adding 'tests/test_redis_queue.py' 2025-10-25T16:24:23,830 adding 'tests/test_redis_queue_name_fix.py' 2025-10-25T16:24:23,832 adding 'tests/test_redis_queue_type_fallback.py' 2025-10-25T16:24:23,833 adding 'tests/test_request_ignore_middleware.py' 2025-10-25T16:24:23,835 adding 'tests/test_request_params.py' 2025-10-25T16:24:23,836 adding 'tests/test_request_serialization.py' 2025-10-25T16:24:23,838 adding 'tests/test_response_code_middleware.py' 2025-10-25T16:24:23,840 adding 'tests/test_response_filter_middleware.py' 2025-10-25T16:24:23,841 adding 'tests/test_response_follow.py' 2025-10-25T16:24:23,843 adding 'tests/test_response_improvements.py' 2025-10-25T16:24:23,844 adding 'tests/test_response_selector_methods.py' 2025-10-25T16:24:23,845 adding 'tests/test_response_url_methods.py' 2025-10-25T16:24:23,847 adding 'tests/test_response_urljoin.py' 2025-10-25T16:24:23,848 adding 'tests/test_retry_middleware.py' 2025-10-25T16:24:23,850 adding 'tests/test_retry_middleware_realistic.py' 2025-10-25T16:24:23,851 adding 'tests/test_scheduler.py' 2025-10-25T16:24:23,853 adding 'tests/test_scheduler_config_update.py' 2025-10-25T16:24:23,854 adding 'tests/test_scrapy_style_encoding.py' 2025-10-25T16:24:23,855 adding 'tests/test_selector_helper.py' 2025-10-25T16:24:23,856 adding 'tests/test_selector_optimizations.py' 2025-10-25T16:24:23,858 adding 'tests/test_simple_response.py' 2025-10-25T16:24:23,859 adding 'tests/test_spider_loader.py' 2025-10-25T16:24:23,860 adding 'tests/test_spider_loader_comprehensive.py' 2025-10-25T16:24:23,861 adding 'tests/test_spider_modules.py' 2025-10-25T16:24:23,863 adding 'tests/test_telecom_spider_redis_key.py' 2025-10-25T16:24:23,864 adding 'tests/test_template_content.py' 2025-10-25T16:24:23,866 adding 'tests/test_template_redis_key.py' 2025-10-25T16:24:23,867 adding 'tests/test_tools.py' 2025-10-25T16:24:23,869 adding 'tests/test_user_agent_randomness.py' 2025-10-25T16:24:23,870 adding 'tests/test_user_agents.py' 2025-10-25T16:24:23,871 adding 'tests/untested_features_report.md' 2025-10-25T16:24:23,872 adding 'tests/verify_debug.py' 2025-10-25T16:24:23,874 adding 'tests/verify_distributed.py' 2025-10-25T16:24:23,875 adding 'tests/verify_log_fix.py' 2025-10-25T16:24:23,877 adding 'tests/verify_mysql_warnings.py' 2025-10-25T16:24:23,878 adding 'tests/ofweek_scrapy/scrapy.cfg' 2025-10-25T16:24:23,880 adding 'tests/ofweek_scrapy/ofweek_scrapy/__init__.py' 2025-10-25T16:24:23,881 adding 'tests/ofweek_scrapy/ofweek_scrapy/items.py' 2025-10-25T16:24:23,882 adding 'tests/ofweek_scrapy/ofweek_scrapy/middlewares.py' 2025-10-25T16:24:23,883 adding 'tests/ofweek_scrapy/ofweek_scrapy/pipelines.py' 2025-10-25T16:24:23,885 adding 'tests/ofweek_scrapy/ofweek_scrapy/settings.py' 2025-10-25T16:24:23,887 adding 'tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py' 2025-10-25T16:24:23,888 adding 'tests/scrapy_comparison/ofweek_scrapy.py' 2025-10-25T16:24:23,890 adding 'tests/scrapy_comparison/scrapy_test.py' 2025-10-25T16:24:23,892 adding 'tests/test_spiders/__init__.py' 2025-10-25T16:24:23,893 adding 'tests/test_spiders/test_spider.py' 2025-10-25T16:24:23,895 adding 'crawlo-1.4.7.dist-info/METADATA' 2025-10-25T16:24:23,897 adding 'crawlo-1.4.7.dist-info/WHEEL' 2025-10-25T16:24:23,898 adding 'crawlo-1.4.7.dist-info/entry_points.txt' 2025-10-25T16:24:23,898 adding 'crawlo-1.4.7.dist-info/top_level.txt' 2025-10-25T16:24:23,904 adding 'crawlo-1.4.7.dist-info/RECORD' 2025-10-25T16:24:23,916 removing build/bdist.linux-armv7l/wheel 2025-10-25T16:24:24,087 Building wheel for crawlo (pyproject.toml): finished with status 'done' 2025-10-25T16:24:24,104 Created wheel for crawlo: filename=crawlo-1.4.7-py3-none-any.whl size=634612 sha256=23bc0206106afe6c3abfb3b4cb9bc5752939177d6b868ad3a4aa3f0b86fd18c3 2025-10-25T16:24:24,106 Stored in directory: /tmp/pip-ephem-wheel-cache-_8jgg4xz/wheels/17/cc/46/bfb4158591b83c2cca796c32568104b7dc1565d217ecea9158 2025-10-25T16:24:24,132 Successfully built crawlo 2025-10-25T16:24:24,149 Removed build tracker: '/tmp/pip-build-tracker-yt8z35fo'