2025-09-30T08:11:36,124 Created temporary directory: /tmp/pip-ephem-wheel-cache-5v48379z 2025-09-30T08:11:36,126 Created temporary directory: /tmp/pip-build-tracker-ug8527tg 2025-09-30T08:11:36,127 Initialized build tracking at /tmp/pip-build-tracker-ug8527tg 2025-09-30T08:11:36,127 Created build tracker: /tmp/pip-build-tracker-ug8527tg 2025-09-30T08:11:36,128 Entered build tracker: /tmp/pip-build-tracker-ug8527tg 2025-09-30T08:11:36,128 Created temporary directory: /tmp/pip-wheel-sw5lb_63 2025-09-30T08:11:36,131 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-09-30T08:11:36,134 Created temporary directory: /tmp/pip-ephem-wheel-cache-gbvcbulm 2025-09-30T08:11:36,155 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-09-30T08:11:36,159 2 location(s) to search for versions of crawlo: 2025-09-30T08:11:36,159 * https://pypi.org/simple/crawlo/ 2025-09-30T08:11:36,159 * https://www.piwheels.org/simple/crawlo/ 2025-09-30T08:11:36,159 Fetching project page and analyzing links: https://pypi.org/simple/crawlo/ 2025-09-30T08:11:36,160 Getting page https://pypi.org/simple/crawlo/ 2025-09-30T08:11:36,162 Found index url https://pypi.org/simple 2025-09-30T08:11:36,373 Fetched page https://pypi.org/simple/crawlo/ as application/vnd.pypi.simple.v1+json 2025-09-30T08:11:36,377 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5e/f7/15da16c9e40a732d265b11ae6f392ba6e38c843eb1a3850e1202ba0e57fa/crawlo-1.3.9-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,378 Found link https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.3.9 2025-09-30T08:11:36,378 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/4a/9c/82aeeb0713f1125291ead74dff2f44b27fee8c876a5d58b5eb08bc8a3fec/crawlo-1.4.0-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,379 Found link https://files.pythonhosted.org/packages/8d/80/d3c003285cc6ae70e0b6e71800635eed0c00e9441d0ffe0b4e0f41db962d/crawlo-1.4.0.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.0 2025-09-30T08:11:36,380 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/c4/7e/00a3eecc7fbf7b34af6ae79e82666ee8d49b743ada85547ac407641333bf/crawlo-1.4.1-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,381 Found link https://files.pythonhosted.org/packages/5b/48/c8439c1cbd3b4b819afd6885f2829772542bcce98951c0acc73079aedb95/crawlo-1.4.1.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.1 2025-09-30T08:11:36,382 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/f2/31/a52238ece7a50d949f7985dc13fedfa9d34b0aa68a9834e3cb3b93438e78/crawlo-1.4.2-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,383 Found link https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.2 2025-09-30T08:11:36,384 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/bf/15/d5e3c82633a27f783fe238da06e9ccaeb64d14385bfdd4b879b1fe86af93/crawlo-1.4.3-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,385 Found link https://files.pythonhosted.org/packages/9e/f1/26060b36cf81bfa80cd01a53739484ff7cad9f88c99decb0f0fdfc7c3069/crawlo-1.4.3.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.3 2025-09-30T08:11:36,385 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5c/0c/27b5fc6e81ddc802dec3c387a1517b6c51f9fa890811f449106bbe1ee49f/crawlo-1.4.4-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,386 Found link https://files.pythonhosted.org/packages/88/c8/6e9c00bed5250995ac9058338b5725c6312be4ce0e43a6a7da7e8ec28b65/crawlo-1.4.4.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.4 2025-09-30T08:11:36,387 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/8e/5e/78d5548bdc0911afcb3e49d372b7b0efd3384d11cc8d7904a32ef0c47359/crawlo-1.4.5-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,388 Found link https://files.pythonhosted.org/packages/79/59/23c7e418b027965bb7e79de626fb51e63c6bd0974b0e04ea4bd40dec19ba/crawlo-1.4.5.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.5 2025-09-30T08:11:36,388 Fetching project page and analyzing links: https://www.piwheels.org/simple/crawlo/ 2025-09-30T08:11:36,389 Getting page https://www.piwheels.org/simple/crawlo/ 2025-09-30T08:11:36,390 Found index url https://www.piwheels.org/simple 2025-09-30T08:11:36,549 Fetched page https://www.piwheels.org/simple/crawlo/ as text/html 2025-09-30T08:11:36,552 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.4-py3-none-any.whl#sha256=90be59ea0da9f7da93b7844325e05af5de647c9316deda8219e1940705f880ea (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,553 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.3-py3-none-any.whl#sha256=4b40e6520c22d1a464d883cd9a27d64d7fcbcf7c825bd8c84b344b04f91c9c97 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,553 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.2-py3-none-any.whl#sha256=4f2a550553e1b2bac41ddf8f2b898fe64c49f19bb810301fa99fe1d632eeb1fd (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,554 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.1-py3-none-any.whl#sha256=5f48469ed3fa98ef76f9e622b25cdb555df1a3193b563f219c7ee540ae97dca9 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,554 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.0-py3-none-any.whl#sha256=51340c538a39da052af5ab3194e0916b203090854e495eb7b78290861e427e72 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,555 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.3.9-py3-none-any.whl#sha256=4ba32e11ae2213a168d8623a104c31659733167cee87ef5a7cdbcdf05fb931c3 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-30T08:11:36,556 Skipping link: not a file: https://www.piwheels.org/simple/crawlo/ 2025-09-30T08:11:36,556 Skipping link: not a file: https://pypi.org/simple/crawlo/ 2025-09-30T08:11:36,576 Given no hashes to check 1 links for project 'crawlo': discarding no candidates 2025-09-30T08:11:36,593 Collecting crawlo==1.4.5 2025-09-30T08:11:36,596 Created temporary directory: /tmp/pip-unpack-lfg3bvqn 2025-09-30T08:11:36,804 Downloading crawlo-1.4.5.tar.gz (419 kB) 2025-09-30T08:11:37,595 Added crawlo==1.4.5 from https://files.pythonhosted.org/packages/79/59/23c7e418b027965bb7e79de626fb51e63c6bd0974b0e04ea4bd40dec19ba/crawlo-1.4.5.tar.gz to build tracker '/tmp/pip-build-tracker-ug8527tg' 2025-09-30T08:11:37,599 Created temporary directory: /tmp/pip-build-env-6r4frn72 2025-09-30T08:11:37,604 Installing build dependencies: started 2025-09-30T08:11:37,605 Running command pip subprocess to install build dependencies 2025-09-30T08:11:38,764 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-09-30T08:11:39,365 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-09-30T08:11:39,390 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-09-30T08:11:41,109 Collecting setuptools>=80.9.0 2025-09-30T08:11:41,199 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-09-30T08:11:41,471 Collecting wheel 2025-09-30T08:11:41,488 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2025-09-30T08:11:44,514 Installing collected packages: wheel, setuptools 2025-09-30T08:11:44,756 Creating /tmp/pip-build-env-6r4frn72/overlay/local/bin 2025-09-30T08:11:44,758 changing mode of /tmp/pip-build-env-6r4frn72/overlay/local/bin/wheel to 755 2025-09-30T08:11:49,682 Successfully installed setuptools-80.9.0 wheel-0.45.1 2025-09-30T08:11:49,954 Installing build dependencies: finished with status 'done' 2025-09-30T08:11:49,960 Getting requirements to build wheel: started 2025-09-30T08:11:49,961 Running command Getting requirements to build wheel 2025-09-30T08:11:50,573 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-30T08:11:50,573 !! 2025-09-30T08:11:50,574 ******************************************************************************** 2025-09-30T08:11:50,575 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-30T08:11:50,576 License :: OSI Approved :: MIT License 2025-09-30T08:11:50,577 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-30T08:11:50,577 ******************************************************************************** 2025-09-30T08:11:50,578 !! 2025-09-30T08:11:50,579 self._finalize_license_expression() 2025-09-30T08:11:50,638 running egg_info 2025-09-30T08:11:50,646 writing crawlo.egg-info/PKG-INFO 2025-09-30T08:11:50,655 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-09-30T08:11:50,658 writing entry points to crawlo.egg-info/entry_points.txt 2025-09-30T08:11:50,663 writing requirements to crawlo.egg-info/requires.txt 2025-09-30T08:11:50,665 writing top-level names to crawlo.egg-info/top_level.txt 2025-09-30T08:11:50,736 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:50,757 reading manifest template 'MANIFEST.in' 2025-09-30T08:11:50,758 warning: no files found matching 'VERSION' 2025-09-30T08:11:50,759 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-30T08:11:50,837 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-30T08:11:50,839 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-30T08:11:50,842 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-30T08:11:50,844 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-30T08:11:50,847 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-30T08:11:50,850 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-30T08:11:50,852 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-30T08:11:50,855 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-30T08:11:50,857 no previously-included directories found matching 'samples' 2025-09-30T08:11:50,859 no previously-included directories found matching 'docs' 2025-09-30T08:11:50,880 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:50,970 Getting requirements to build wheel: finished with status 'done' 2025-09-30T08:11:50,973 Created temporary directory: /tmp/pip-modern-metadata-u1ha0hs1 2025-09-30T08:11:50,975 Preparing metadata (pyproject.toml): started 2025-09-30T08:11:50,976 Running command Preparing metadata (pyproject.toml) 2025-09-30T08:11:51,527 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-30T08:11:51,528 !! 2025-09-30T08:11:51,529 ******************************************************************************** 2025-09-30T08:11:51,529 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-30T08:11:51,530 License :: OSI Approved :: MIT License 2025-09-30T08:11:51,531 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-30T08:11:51,531 ******************************************************************************** 2025-09-30T08:11:51,532 !! 2025-09-30T08:11:51,533 self._finalize_license_expression() 2025-09-30T08:11:51,552 running dist_info 2025-09-30T08:11:51,564 creating /tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info 2025-09-30T08:11:51,565 writing /tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/PKG-INFO 2025-09-30T08:11:51,574 writing dependency_links to /tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/dependency_links.txt 2025-09-30T08:11:51,575 writing entry points to /tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/entry_points.txt 2025-09-30T08:11:51,580 writing requirements to /tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/requires.txt 2025-09-30T08:11:51,581 writing top-level names to /tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/top_level.txt 2025-09-30T08:11:51,583 writing manifest file '/tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:51,646 reading manifest file '/tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:51,648 reading manifest template 'MANIFEST.in' 2025-09-30T08:11:51,649 warning: no files found matching 'VERSION' 2025-09-30T08:11:51,650 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-30T08:11:51,722 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-30T08:11:51,723 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-30T08:11:51,724 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-30T08:11:51,726 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-30T08:11:51,728 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-30T08:11:51,729 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-30T08:11:51,730 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-30T08:11:51,732 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-30T08:11:51,733 no previously-included directories found matching 'samples' 2025-09-30T08:11:51,734 no previously-included directories found matching 'docs' 2025-09-30T08:11:51,750 writing manifest file '/tmp/pip-modern-metadata-u1ha0hs1/crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:51,752 creating '/tmp/pip-modern-metadata-u1ha0hs1/crawlo-1.4.5.dist-info' 2025-09-30T08:11:51,886 Preparing metadata (pyproject.toml): finished with status 'done' 2025-09-30T08:11:51,891 Source in /tmp/pip-wheel-sw5lb_63/crawlo_a05ce267fdda445fb64bb607264aa304 has version 1.4.5, which satisfies requirement crawlo==1.4.5 from https://files.pythonhosted.org/packages/79/59/23c7e418b027965bb7e79de626fb51e63c6bd0974b0e04ea4bd40dec19ba/crawlo-1.4.5.tar.gz 2025-09-30T08:11:51,892 Removed crawlo==1.4.5 from https://files.pythonhosted.org/packages/79/59/23c7e418b027965bb7e79de626fb51e63c6bd0974b0e04ea4bd40dec19ba/crawlo-1.4.5.tar.gz from build tracker '/tmp/pip-build-tracker-ug8527tg' 2025-09-30T08:11:51,899 Created temporary directory: /tmp/pip-unpack-omega202 2025-09-30T08:11:51,900 Building wheels for collected packages: crawlo 2025-09-30T08:11:51,905 Created temporary directory: /tmp/pip-wheel-b6dcit3q 2025-09-30T08:11:51,905 Destination directory: /tmp/pip-wheel-b6dcit3q 2025-09-30T08:11:51,907 Building wheel for crawlo (pyproject.toml): started 2025-09-30T08:11:51,909 Running command Building wheel for crawlo (pyproject.toml) 2025-09-30T08:11:52,454 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-30T08:11:52,454 !! 2025-09-30T08:11:52,455 ******************************************************************************** 2025-09-30T08:11:52,456 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-30T08:11:52,457 License :: OSI Approved :: MIT License 2025-09-30T08:11:52,458 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-30T08:11:52,459 ******************************************************************************** 2025-09-30T08:11:52,460 !! 2025-09-30T08:11:52,461 self._finalize_license_expression() 2025-09-30T08:11:52,483 running bdist_wheel 2025-09-30T08:11:52,514 running build 2025-09-30T08:11:52,515 running build_py 2025-09-30T08:11:52,529 creating build/lib/tests 2025-09-30T08:11:52,531 copying tests/test_controlled_spider_mixin.py -> build/lib/tests 2025-09-30T08:11:52,533 copying tests/test_user_agents.py -> build/lib/tests 2025-09-30T08:11:52,535 copying tests/test_all_commands.py -> build/lib/tests 2025-09-30T08:11:52,538 copying tests/test_queue_naming.py -> build/lib/tests 2025-09-30T08:11:52,540 copying tests/test_random_headers_default.py -> build/lib/tests 2025-09-30T08:11:52,543 copying tests/test_template_redis_key.py -> build/lib/tests 2025-09-30T08:11:52,546 copying tests/spider_log_timing_test.py -> build/lib/tests 2025-09-30T08:11:52,548 copying tests/cleaners_example.py -> build/lib/tests 2025-09-30T08:11:52,550 copying tests/test_spider_modules.py -> build/lib/tests 2025-09-30T08:11:52,552 copying tests/test_telecom_spider_redis_key.py -> build/lib/tests 2025-09-30T08:11:52,555 copying tests/test_config_validator.py -> build/lib/tests 2025-09-30T08:11:52,557 copying tests/test_comprehensive.py -> build/lib/tests 2025-09-30T08:11:52,560 copying tests/test_redis_connection_pool.py -> build/lib/tests 2025-09-30T08:11:52,562 copying tests/test_response_selector_methods.py -> build/lib/tests 2025-09-30T08:11:52,564 copying tests/verify_log_fix.py -> build/lib/tests 2025-09-30T08:11:52,567 copying tests/test_queue_manager_redis_key.py -> build/lib/tests 2025-09-30T08:11:52,569 copying tests/final_validation_test.py -> build/lib/tests 2025-09-30T08:11:52,572 copying tests/test_all_pipeline_fingerprints.py -> build/lib/tests 2025-09-30T08:11:52,574 copying tests/test_distributed.py -> build/lib/tests 2025-09-30T08:11:52,576 copying tests/test_final_validation.py -> build/lib/tests 2025-09-30T08:11:52,579 copying tests/test_queue_manager_double_crawlo.py -> build/lib/tests 2025-09-30T08:11:52,582 copying tests/simple_selector_test.py -> build/lib/tests 2025-09-30T08:11:52,584 copying tests/simple_optimization_test.py -> build/lib/tests 2025-09-30T08:11:52,586 copying tests/config_validation_demo.py -> build/lib/tests 2025-09-30T08:11:52,588 copying tests/final_comprehensive_test.py -> build/lib/tests 2025-09-30T08:11:52,591 copying tests/test_encoding_core.py -> build/lib/tests 2025-09-30T08:11:52,593 copying tests/error_handling_example.py -> build/lib/tests 2025-09-30T08:11:52,595 copying tests/debug_framework_logger.py -> build/lib/tests 2025-09-30T08:11:52,597 copying tests/test_dedup_pipeline_consistency.py -> build/lib/tests 2025-09-30T08:11:52,599 copying tests/test_config_merge.py -> build/lib/tests 2025-09-30T08:11:52,602 copying tests/test_request_params.py -> build/lib/tests 2025-09-30T08:11:52,604 copying tests/test_queue_empty_check.py -> build/lib/tests 2025-09-30T08:11:52,606 copying tests/test_queue_type.py -> build/lib/tests 2025-09-30T08:11:52,608 copying tests/test_redis_queue.py -> build/lib/tests 2025-09-30T08:11:52,611 copying tests/test_crawler_process_import.py -> build/lib/tests 2025-09-30T08:11:52,612 copying tests/performance_comparison.py -> build/lib/tests 2025-09-30T08:11:52,615 copying tests/test_encoding_detection.py -> build/lib/tests 2025-09-30T08:11:52,617 copying tests/test_double_crawlo_fix.py -> build/lib/tests 2025-09-30T08:11:52,620 copying tests/test_multi_directory.py -> build/lib/tests 2025-09-30T08:11:52,622 copying tests/test_proxy_api.py -> build/lib/tests 2025-09-30T08:11:52,624 copying tests/test_date_tools.py -> build/lib/tests 2025-09-30T08:11:52,626 copying tests/redis_key_validation_demo.py -> build/lib/tests 2025-09-30T08:11:52,629 copying tests/simple_queue_type_test.py -> build/lib/tests 2025-09-30T08:11:52,631 copying tests/queue_blocking_test.py -> build/lib/tests 2025-09-30T08:11:52,633 copying tests/response_improvements_example.py -> build/lib/tests 2025-09-30T08:11:52,635 copying tests/simple_log_test2.py -> build/lib/tests 2025-09-30T08:11:52,637 copying tests/test_real_scenario_proxy.py -> build/lib/tests 2025-09-30T08:11:52,640 copying tests/test_priority_behavior.py -> build/lib/tests 2025-09-30T08:11:52,642 copying tests/test_logging_system.py -> build/lib/tests 2025-09-30T08:11:52,645 copying tests/debug_log_levels.py -> build/lib/tests 2025-09-30T08:11:52,647 copying tests/__init__.py -> build/lib/tests 2025-09-30T08:11:52,649 copying tests/distributed_test.py -> build/lib/tests 2025-09-30T08:11:52,651 copying tests/simple_command_test.py -> build/lib/tests 2025-09-30T08:11:52,653 copying tests/test_priority_consistency_fixed.py -> build/lib/tests 2025-09-30T08:11:52,656 copying tests/test_all_redis_key_configs.py -> build/lib/tests 2025-09-30T08:11:52,658 copying tests/test_selector_helper.py -> build/lib/tests 2025-09-30T08:11:52,660 copying tests/test_queue_type_redis_config_consistency.py -> build/lib/tests 2025-09-30T08:11:52,663 copying tests/test_advanced_tools.py -> build/lib/tests 2025-09-30T08:11:52,665 copying tests/test_config_consistency.py -> build/lib/tests 2025-09-30T08:11:52,667 copying tests/test_scheduler_config_update.py -> build/lib/tests 2025-09-30T08:11:52,669 copying tests/test_redis_config.py -> build/lib/tests 2025-09-30T08:11:52,672 copying tests/date_tools_example.py -> build/lib/tests 2025-09-30T08:11:52,674 copying tests/test_integration.py -> build/lib/tests 2025-09-30T08:11:52,676 copying tests/test_proxy_middleware.py -> build/lib/tests 2025-09-30T08:11:52,678 copying tests/test_downloader_proxy_compatibility.py -> build/lib/tests 2025-09-30T08:11:52,681 copying tests/distributed_test_debug.py -> build/lib/tests 2025-09-30T08:11:52,683 copying tests/test_offsite_middleware.py -> build/lib/tests 2025-09-30T08:11:52,686 copying tests/log_buffering_test.py -> build/lib/tests 2025-09-30T08:11:52,688 copying tests/test_tools.py -> build/lib/tests 2025-09-30T08:11:52,691 copying tests/bug_check_test.py -> build/lib/tests 2025-09-30T08:11:52,694 copying tests/test_factory_compatibility.py -> build/lib/tests 2025-09-30T08:11:52,696 copying tests/simple_spider_test.py -> build/lib/tests 2025-09-30T08:11:52,698 copying tests/test_proxy_strategies.py -> build/lib/tests 2025-09-30T08:11:52,701 copying tests/test_response_url_methods.py -> build/lib/tests 2025-09-30T08:11:52,703 copying tests/test_proxy_providers.py -> build/lib/tests 2025-09-30T08:11:52,705 copying tests/test_proxy_stats.py -> build/lib/tests 2025-09-30T08:11:52,707 copying tests/simple_selector_helper_test.py -> build/lib/tests 2025-09-30T08:11:52,709 copying tests/test_download_delay_middleware.py -> build/lib/tests 2025-09-30T08:11:52,712 copying tests/log_generation_timing_test.py -> build/lib/tests 2025-09-30T08:11:52,714 copying tests/test_factories.py -> build/lib/tests 2025-09-30T08:11:52,717 copying tests/test_response_filter_middleware.py -> build/lib/tests 2025-09-30T08:11:52,719 copying tests/simple_follow_test.py -> build/lib/tests 2025-09-30T08:11:52,721 copying tests/test_fingerprint_consistency.py -> build/lib/tests 2025-09-30T08:11:52,724 copying tests/test_simple_response.py -> build/lib/tests 2025-09-30T08:11:52,725 copying tests/debug_pipelines.py -> build/lib/tests 2025-09-30T08:11:52,727 copying tests/test_edge_cases.py -> build/lib/tests 2025-09-30T08:11:52,730 copying tests/dynamic_loading_example.py -> build/lib/tests 2025-09-30T08:11:52,733 copying tests/test_proxy_health_check.py -> build/lib/tests 2025-09-30T08:11:52,734 copying tests/detailed_log_test.py -> build/lib/tests 2025-09-30T08:11:52,737 copying tests/optimized_performance_test.py -> build/lib/tests 2025-09-30T08:11:52,739 copying tests/test_get_component_logger.py -> build/lib/tests 2025-09-30T08:11:52,741 copying tests/test_redis_queue_name_fix.py -> build/lib/tests 2025-09-30T08:11:52,744 copying tests/comprehensive_test.py -> build/lib/tests 2025-09-30T08:11:52,746 copying tests/test_batch_processor.py -> build/lib/tests 2025-09-30T08:11:52,748 copying tests/test_spider_loader.py -> build/lib/tests 2025-09-30T08:11:52,751 copying tests/test_double_crawlo_fix_simple.py -> build/lib/tests 2025-09-30T08:11:52,753 copying tests/debug_configure.py -> build/lib/tests 2025-09-30T08:11:52,755 copying tests/test_mode_consistency.py -> build/lib/tests 2025-09-30T08:11:52,757 copying tests/test_retry_middleware.py -> build/lib/tests 2025-09-30T08:11:52,760 copying tests/env_config_example.py -> build/lib/tests 2025-09-30T08:11:52,762 copying tests/test_optimized_selector_naming.py -> build/lib/tests 2025-09-30T08:11:52,764 copying tests/verify_distributed.py -> build/lib/tests 2025-09-30T08:11:52,766 copying tests/test_dynamic_proxy.py -> build/lib/tests 2025-09-30T08:11:52,768 copying tests/test_logging_enhancements.py -> build/lib/tests 2025-09-30T08:11:52,771 copying tests/test_redis_key_naming.py -> build/lib/tests 2025-09-30T08:11:52,773 copying tests/test_offsite_middleware_simple.py -> build/lib/tests 2025-09-30T08:11:52,776 copying tests/test_dynamic_proxy_config.py -> build/lib/tests 2025-09-30T08:11:52,778 copying tests/request_params_example.py -> build/lib/tests 2025-09-30T08:11:52,780 copying tests/test_response_urljoin.py -> build/lib/tests 2025-09-30T08:11:52,782 copying tests/debug_log_config.py -> build/lib/tests 2025-09-30T08:11:52,784 copying tests/test_request_ignore_middleware.py -> build/lib/tests 2025-09-30T08:11:52,786 copying tests/comprehensive_framework_test.py -> build/lib/tests 2025-09-30T08:11:52,788 copying tests/test_pipeline_fingerprint_consistency.py -> build/lib/tests 2025-09-30T08:11:52,790 copying tests/test_random_user_agent.py -> build/lib/tests 2025-09-30T08:11:52,792 copying tests/test_request_serialization.py -> build/lib/tests 2025-09-30T08:11:52,794 copying tests/test_logging_integration.py -> build/lib/tests 2025-09-30T08:11:52,797 copying tests/test_selector_optimizations.py -> build/lib/tests 2025-09-30T08:11:52,799 copying tests/test_hash_performance.py -> build/lib/tests 2025-09-30T08:11:52,801 copying tests/test_response_improvements.py -> build/lib/tests 2025-09-30T08:11:52,803 copying tests/test_performance.py -> build/lib/tests 2025-09-30T08:11:52,805 copying tests/test_parsel.py -> build/lib/tests 2025-09-30T08:11:52,807 copying tests/baidu_performance_test.py -> build/lib/tests 2025-09-30T08:11:52,809 copying tests/test_item_dedup_redis_key.py -> build/lib/tests 2025-09-30T08:11:52,811 copying tests/test_spider_loader_comprehensive.py -> build/lib/tests 2025-09-30T08:11:52,813 copying tests/simple_response_selector_test.py -> build/lib/tests 2025-09-30T08:11:52,815 copying tests/test_enhanced_error_handler_comprehensive.py -> build/lib/tests 2025-09-30T08:11:52,817 copying tests/test_authenticated_proxy.py -> build/lib/tests 2025-09-30T08:11:52,819 copying tests/test_redis_key_validator.py -> build/lib/tests 2025-09-30T08:11:52,821 copying tests/test_scrapy_style_encoding.py -> build/lib/tests 2025-09-30T08:11:52,823 copying tests/test_env_config.py -> build/lib/tests 2025-09-30T08:11:52,825 copying tests/direct_selector_helper_test.py -> build/lib/tests 2025-09-30T08:11:52,827 copying tests/test_large_scale_config.py -> build/lib/tests 2025-09-30T08:11:52,831 copying tests/test_component_factory.py -> build/lib/tests 2025-09-30T08:11:52,833 copying tests/baidu_test.py -> build/lib/tests 2025-09-30T08:11:52,835 copying tests/test_dynamic_proxy_real.py -> build/lib/tests 2025-09-30T08:11:52,837 copying tests/test_enhanced_error_handler.py -> build/lib/tests 2025-09-30T08:11:52,839 copying tests/dynamic_loading_test.py -> build/lib/tests 2025-09-30T08:11:52,841 copying tests/test_middleware_debug.py -> build/lib/tests 2025-09-30T08:11:52,844 copying tests/test_proxy_middleware_enhanced.py -> build/lib/tests 2025-09-30T08:11:52,846 copying tests/test_fingerprint_simple.py -> build/lib/tests 2025-09-30T08:11:52,848 copying tests/authenticated_proxy_example.py -> build/lib/tests 2025-09-30T08:11:52,849 copying tests/test_random_headers_necessity.py -> build/lib/tests 2025-09-30T08:11:52,852 copying tests/test_large_scale_helper.py -> build/lib/tests 2025-09-30T08:11:52,854 copying tests/test_crawler_process_spider_modules.py -> build/lib/tests 2025-09-30T08:11:52,856 copying tests/test_priority_consistency.py -> build/lib/tests 2025-09-30T08:11:52,858 copying tests/test_template_content.py -> build/lib/tests 2025-09-30T08:11:52,860 copying tests/test_proxy_middleware_integration.py -> build/lib/tests 2025-09-30T08:11:52,862 copying tests/simple_url_test.py -> build/lib/tests 2025-09-30T08:11:52,864 copying tests/test_response_follow.py -> build/lib/tests 2025-09-30T08:11:52,866 copying tests/test_performance_monitor.py -> build/lib/tests 2025-09-30T08:11:52,868 copying tests/test_crawlo_proxy_integration.py -> build/lib/tests 2025-09-30T08:11:52,870 copying tests/test_cleaners.py -> build/lib/tests 2025-09-30T08:11:52,872 copying tests/test_response_code_middleware.py -> build/lib/tests 2025-09-30T08:11:52,874 copying tests/final_log_test.py -> build/lib/tests 2025-09-30T08:11:52,877 copying tests/test_dynamic_downloaders_proxy.py -> build/lib/tests 2025-09-30T08:11:52,879 copying tests/test_user_agent_randomness.py -> build/lib/tests 2025-09-30T08:11:52,881 copying tests/test_multiple_spider_modules.py -> build/lib/tests 2025-09-30T08:11:52,883 copying tests/fix_log_test.py -> build/lib/tests 2025-09-30T08:11:52,885 copying tests/simple_crawlo_test.py -> build/lib/tests 2025-09-30T08:11:52,888 copying tests/tools_example.py -> build/lib/tests 2025-09-30T08:11:52,890 copying tests/controlled_spider_example.py -> build/lib/tests 2025-09-30T08:11:52,892 copying tests/test_retry_middleware_realistic.py -> build/lib/tests 2025-09-30T08:11:52,894 copying tests/test_proxy_middleware_refactored.py -> build/lib/tests 2025-09-30T08:11:52,897 copying tests/advanced_tools_example.py -> build/lib/tests 2025-09-30T08:11:52,899 copying tests/test_redis_queue_type_fallback.py -> build/lib/tests 2025-09-30T08:11:52,902 copying tests/test_default_header_middleware.py -> build/lib/tests 2025-09-30T08:11:52,904 copying tests/test_error_handler_compatibility.py -> build/lib/tests 2025-09-30T08:11:52,906 copying tests/test_logging_final.py -> build/lib/tests 2025-09-30T08:11:52,909 copying tests/framework_performance_test.py -> build/lib/tests 2025-09-30T08:11:52,911 copying tests/queue_test.py -> build/lib/tests 2025-09-30T08:11:52,913 copying tests/test_dedup_fix.py -> build/lib/tests 2025-09-30T08:11:52,915 copying tests/verify_debug.py -> build/lib/tests 2025-09-30T08:11:52,917 copying tests/test_framework_env_usage.py -> build/lib/tests 2025-09-30T08:11:52,919 copying tests/test_scheduler.py -> build/lib/tests 2025-09-30T08:11:52,922 creating build/lib/examples 2025-09-30T08:11:52,923 copying examples/__init__.py -> build/lib/examples 2025-09-30T08:11:52,925 creating build/lib/crawlo 2025-09-30T08:11:52,926 copying crawlo/subscriber.py -> build/lib/crawlo 2025-09-30T08:11:52,928 copying crawlo/task_manager.py -> build/lib/crawlo 2025-09-30T08:11:52,931 copying crawlo/exceptions.py -> build/lib/crawlo 2025-09-30T08:11:52,932 copying crawlo/crawler.py -> build/lib/crawlo 2025-09-30T08:11:52,935 copying crawlo/__init__.py -> build/lib/crawlo 2025-09-30T08:11:52,937 copying crawlo/project.py -> build/lib/crawlo 2025-09-30T08:11:52,939 copying crawlo/framework.py -> build/lib/crawlo 2025-09-30T08:11:52,942 copying crawlo/config_validator.py -> build/lib/crawlo 2025-09-30T08:11:52,944 copying crawlo/cli.py -> build/lib/crawlo 2025-09-30T08:11:52,946 copying crawlo/__version__.py -> build/lib/crawlo 2025-09-30T08:11:52,948 copying crawlo/stats_collector.py -> build/lib/crawlo 2025-09-30T08:11:52,949 copying crawlo/event.py -> build/lib/crawlo 2025-09-30T08:11:52,951 copying crawlo/interfaces.py -> build/lib/crawlo 2025-09-30T08:11:52,953 copying crawlo/config.py -> build/lib/crawlo 2025-09-30T08:11:52,955 copying crawlo/mode_manager.py -> build/lib/crawlo 2025-09-30T08:11:52,958 creating build/lib/tests/test_spiders 2025-09-30T08:11:52,959 copying tests/test_spiders/__init__.py -> build/lib/tests/test_spiders 2025-09-30T08:11:52,961 copying tests/test_spiders/test_spider.py -> build/lib/tests/test_spiders 2025-09-30T08:11:52,964 creating build/lib/crawlo/utils 2025-09-30T08:11:52,965 copying crawlo/utils/large_scale_config.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,968 copying crawlo/utils/system.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,969 copying crawlo/utils/text_helper.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,971 copying crawlo/utils/redis_connection_pool.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,974 copying crawlo/utils/redis_key_validator.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,976 copying crawlo/utils/spider_loader.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,978 copying crawlo/utils/fingerprint.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,980 copying crawlo/utils/error_handler.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,983 copying crawlo/utils/large_scale_helper.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,985 copying crawlo/utils/selector_helper.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,987 copying crawlo/utils/__init__.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,989 copying crawlo/utils/log.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,991 copying crawlo/utils/url.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,993 copying crawlo/utils/performance_monitor.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,995 copying crawlo/utils/func_tools.py -> build/lib/crawlo/utils 2025-09-30T08:11:52,997 copying crawlo/utils/batch_processor.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,000 copying crawlo/utils/db_helper.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,002 copying crawlo/utils/misc.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,004 copying crawlo/utils/controlled_spider_mixin.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,006 copying crawlo/utils/tools.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,008 copying crawlo/utils/request.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,011 copying crawlo/utils/request_serializer.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,013 copying crawlo/utils/queue_helper.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,015 copying crawlo/utils/env_config.py -> build/lib/crawlo/utils 2025-09-30T08:11:53,018 creating build/lib/crawlo/downloader 2025-09-30T08:11:53,019 copying crawlo/downloader/aiohttp_downloader.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,021 copying crawlo/downloader/__init__.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,023 copying crawlo/downloader/hybrid_downloader.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,025 copying crawlo/downloader/httpx_downloader.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,028 copying crawlo/downloader/cffi_downloader.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,030 copying crawlo/downloader/playwright_downloader.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,032 copying crawlo/downloader/selenium_downloader.py -> build/lib/crawlo/downloader 2025-09-30T08:11:53,036 creating build/lib/crawlo/extension 2025-09-30T08:11:53,036 copying crawlo/extension/memory_monitor.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,039 copying crawlo/extension/__init__.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,041 copying crawlo/extension/log_interval.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,043 copying crawlo/extension/request_recorder.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,045 copying crawlo/extension/logging_extension.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,047 copying crawlo/extension/health_check.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,049 copying crawlo/extension/performance_profiler.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,052 copying crawlo/extension/log_stats.py -> build/lib/crawlo/extension 2025-09-30T08:11:53,054 creating build/lib/crawlo/logging 2025-09-30T08:11:53,055 copying crawlo/logging/manager.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,057 copying crawlo/logging/async_handler.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,059 copying crawlo/logging/sampler.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,062 copying crawlo/logging/__init__.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,064 copying crawlo/logging/factory.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,066 copying crawlo/logging/monitor.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,068 copying crawlo/logging/config.py -> build/lib/crawlo/logging 2025-09-30T08:11:53,071 creating build/lib/crawlo/data 2025-09-30T08:11:53,072 copying crawlo/data/__init__.py -> build/lib/crawlo/data 2025-09-30T08:11:53,074 copying crawlo/data/user_agents.py -> build/lib/crawlo/data 2025-09-30T08:11:53,077 creating build/lib/crawlo/queue 2025-09-30T08:11:53,078 copying crawlo/queue/pqueue.py -> build/lib/crawlo/queue 2025-09-30T08:11:53,080 copying crawlo/queue/__init__.py -> build/lib/crawlo/queue 2025-09-30T08:11:53,081 copying crawlo/queue/queue_manager.py -> build/lib/crawlo/queue 2025-09-30T08:11:53,084 copying crawlo/queue/redis_priority_queue.py -> build/lib/crawlo/queue 2025-09-30T08:11:53,087 creating build/lib/crawlo/middleware 2025-09-30T08:11:53,088 copying crawlo/middleware/__init__.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,090 copying crawlo/middleware/request_ignore.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,092 copying crawlo/middleware/download_delay.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,094 copying crawlo/middleware/proxy.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,097 copying crawlo/middleware/response_filter.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,099 copying crawlo/middleware/offsite.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,101 copying crawlo/middleware/retry.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,104 copying crawlo/middleware/default_header.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,106 copying crawlo/middleware/middleware_manager.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,109 copying crawlo/middleware/simple_proxy.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,111 copying crawlo/middleware/response_code.py -> build/lib/crawlo/middleware 2025-09-30T08:11:53,113 creating build/lib/crawlo/items 2025-09-30T08:11:53,114 copying crawlo/items/base.py -> build/lib/crawlo/items 2025-09-30T08:11:53,116 copying crawlo/items/__init__.py -> build/lib/crawlo/items 2025-09-30T08:11:53,118 copying crawlo/items/fields.py -> build/lib/crawlo/items 2025-09-30T08:11:53,120 copying crawlo/items/items.py -> build/lib/crawlo/items 2025-09-30T08:11:53,122 creating build/lib/crawlo/network 2025-09-30T08:11:53,123 copying crawlo/network/__init__.py -> build/lib/crawlo/network 2025-09-30T08:11:53,125 copying crawlo/network/request.py -> build/lib/crawlo/network 2025-09-30T08:11:53,127 copying crawlo/network/response.py -> build/lib/crawlo/network 2025-09-30T08:11:53,130 creating build/lib/crawlo/initialization 2025-09-30T08:11:53,131 copying crawlo/initialization/__init__.py -> build/lib/crawlo/initialization 2025-09-30T08:11:53,133 copying crawlo/initialization/context.py -> build/lib/crawlo/initialization 2025-09-30T08:11:53,135 copying crawlo/initialization/built_in.py -> build/lib/crawlo/initialization 2025-09-30T08:11:53,138 copying crawlo/initialization/phases.py -> build/lib/crawlo/initialization 2025-09-30T08:11:53,140 copying crawlo/initialization/registry.py -> build/lib/crawlo/initialization 2025-09-30T08:11:53,142 copying crawlo/initialization/core.py -> build/lib/crawlo/initialization 2025-09-30T08:11:53,145 creating build/lib/crawlo/settings 2025-09-30T08:11:53,146 copying crawlo/settings/setting_manager.py -> build/lib/crawlo/settings 2025-09-30T08:11:53,149 copying crawlo/settings/__init__.py -> build/lib/crawlo/settings 2025-09-30T08:11:53,151 copying crawlo/settings/default_settings.py -> build/lib/crawlo/settings 2025-09-30T08:11:53,155 creating build/lib/crawlo/tools 2025-09-30T08:11:53,156 copying crawlo/tools/request_tools.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,158 copying crawlo/tools/data_validator.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,160 copying crawlo/tools/__init__.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,162 copying crawlo/tools/scenario_adapter.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,164 copying crawlo/tools/encoding_converter.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,166 copying crawlo/tools/network_diagnostic.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,169 copying crawlo/tools/data_formatter.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,171 copying crawlo/tools/retry_mechanism.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,174 copying crawlo/tools/text_cleaner.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,176 copying crawlo/tools/authenticated_proxy.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,178 copying crawlo/tools/date_tools.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,181 copying crawlo/tools/distributed_coordinator.py -> build/lib/crawlo/tools 2025-09-30T08:11:53,184 creating build/lib/crawlo/pipelines 2025-09-30T08:11:53,185 copying crawlo/pipelines/database_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,187 copying crawlo/pipelines/mongo_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,190 copying crawlo/pipelines/json_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,192 copying crawlo/pipelines/csv_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,194 copying crawlo/pipelines/__init__.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,196 copying crawlo/pipelines/pipeline_manager.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,198 copying crawlo/pipelines/bloom_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,201 copying crawlo/pipelines/console_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,202 copying crawlo/pipelines/memory_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,204 copying crawlo/pipelines/redis_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,207 copying crawlo/pipelines/mysql_pipeline.py -> build/lib/crawlo/pipelines 2025-09-30T08:11:53,210 creating build/lib/crawlo/commands 2025-09-30T08:11:53,211 copying crawlo/commands/help.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,213 copying crawlo/commands/__init__.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,215 copying crawlo/commands/utils.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,217 copying crawlo/commands/startproject.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,220 copying crawlo/commands/genspider.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,222 copying crawlo/commands/stats.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,224 copying crawlo/commands/run.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,227 copying crawlo/commands/list.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,229 copying crawlo/commands/check.py -> build/lib/crawlo/commands 2025-09-30T08:11:53,232 creating build/lib/crawlo/core 2025-09-30T08:11:53,233 copying crawlo/core/processor.py -> build/lib/crawlo/core 2025-09-30T08:11:53,235 copying crawlo/core/__init__.py -> build/lib/crawlo/core 2025-09-30T08:11:53,237 copying crawlo/core/engine.py -> build/lib/crawlo/core 2025-09-30T08:11:53,239 copying crawlo/core/scheduler.py -> build/lib/crawlo/core 2025-09-30T08:11:53,242 creating build/lib/crawlo/factories 2025-09-30T08:11:53,243 copying crawlo/factories/base.py -> build/lib/crawlo/factories 2025-09-30T08:11:53,245 copying crawlo/factories/crawler.py -> build/lib/crawlo/factories 2025-09-30T08:11:53,247 copying crawlo/factories/__init__.py -> build/lib/crawlo/factories 2025-09-30T08:11:53,249 copying crawlo/factories/registry.py -> build/lib/crawlo/factories 2025-09-30T08:11:53,251 creating build/lib/crawlo/spider 2025-09-30T08:11:53,252 copying crawlo/spider/__init__.py -> build/lib/crawlo/spider 2025-09-30T08:11:53,256 creating build/lib/crawlo/filters 2025-09-30T08:11:53,257 copying crawlo/filters/memory_filter.py -> build/lib/crawlo/filters 2025-09-30T08:11:53,259 copying crawlo/filters/__init__.py -> build/lib/crawlo/filters 2025-09-30T08:11:53,262 copying crawlo/filters/aioredis_filter.py -> build/lib/crawlo/filters 2025-09-30T08:11:53,264 running egg_info 2025-09-30T08:11:53,278 writing crawlo.egg-info/PKG-INFO 2025-09-30T08:11:53,286 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-09-30T08:11:53,288 writing entry points to crawlo.egg-info/entry_points.txt 2025-09-30T08:11:53,293 writing requirements to crawlo.egg-info/requires.txt 2025-09-30T08:11:53,294 writing top-level names to crawlo.egg-info/top_level.txt 2025-09-30T08:11:53,339 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:53,357 reading manifest template 'MANIFEST.in' 2025-09-30T08:11:53,359 warning: no files found matching 'VERSION' 2025-09-30T08:11:53,359 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-30T08:11:53,433 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-30T08:11:53,435 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-30T08:11:53,437 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-30T08:11:53,439 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-30T08:11:53,442 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-30T08:11:53,444 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-30T08:11:53,447 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-30T08:11:53,449 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-30T08:11:53,450 no previously-included directories found matching 'samples' 2025-09-30T08:11:53,452 no previously-included directories found matching 'docs' 2025-09-30T08:11:53,472 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-30T08:11:53,476 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates' is absent from the `packages` configuration. 2025-09-30T08:11:53,477 !! 2025-09-30T08:11:53,477 ******************************************************************************** 2025-09-30T08:11:53,478 ############################ 2025-09-30T08:11:53,479 # Package would be ignored # 2025-09-30T08:11:53,479 ############################ 2025-09-30T08:11:53,479 Python recognizes 'crawlo.templates' as an importable package[^1], 2025-09-30T08:11:53,480 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,480 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,481 package, please make sure that 'crawlo.templates' is explicitly added 2025-09-30T08:11:53,481 to the `packages` configuration field. 2025-09-30T08:11:53,482 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,482 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,483 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,484 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,485 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,486 If you don't want 'crawlo.templates' to be distributed and are 2025-09-30T08:11:53,487 already explicitly excluding 'crawlo.templates' via 2025-09-30T08:11:53,487 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,487 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,488 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,489 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,490 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,491 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,492 even if it does not contain any `.py` files. 2025-09-30T08:11:53,493 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,493 directory, all directories are treated like packages. 2025-09-30T08:11:53,494 ******************************************************************************** 2025-09-30T08:11:53,495 !! 2025-09-30T08:11:53,495 check.warn(importable) 2025-09-30T08:11:53,496 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project' is absent from the `packages` configuration. 2025-09-30T08:11:53,496 !! 2025-09-30T08:11:53,497 ******************************************************************************** 2025-09-30T08:11:53,498 ############################ 2025-09-30T08:11:53,499 # Package would be ignored # 2025-09-30T08:11:53,499 ############################ 2025-09-30T08:11:53,500 Python recognizes 'crawlo.templates.project' as an importable package[^1], 2025-09-30T08:11:53,500 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,502 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,502 package, please make sure that 'crawlo.templates.project' is explicitly added 2025-09-30T08:11:53,503 to the `packages` configuration field. 2025-09-30T08:11:53,504 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,504 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,505 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,506 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,507 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,508 If you don't want 'crawlo.templates.project' to be distributed and are 2025-09-30T08:11:53,508 already explicitly excluding 'crawlo.templates.project' via 2025-09-30T08:11:53,508 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,509 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,509 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,510 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,511 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,512 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,513 even if it does not contain any `.py` files. 2025-09-30T08:11:53,513 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,514 directory, all directories are treated like packages. 2025-09-30T08:11:53,514 ******************************************************************************** 2025-09-30T08:11:53,515 !! 2025-09-30T08:11:53,515 check.warn(importable) 2025-09-30T08:11:53,516 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project.spiders' is absent from the `packages` configuration. 2025-09-30T08:11:53,516 !! 2025-09-30T08:11:53,517 ******************************************************************************** 2025-09-30T08:11:53,518 ############################ 2025-09-30T08:11:53,518 # Package would be ignored # 2025-09-30T08:11:53,519 ############################ 2025-09-30T08:11:53,519 Python recognizes 'crawlo.templates.project.spiders' as an importable package[^1], 2025-09-30T08:11:53,520 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,521 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,521 package, please make sure that 'crawlo.templates.project.spiders' is explicitly added 2025-09-30T08:11:53,522 to the `packages` configuration field. 2025-09-30T08:11:53,523 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,523 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,524 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,525 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,526 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,527 If you don't want 'crawlo.templates.project.spiders' to be distributed and are 2025-09-30T08:11:53,528 already explicitly excluding 'crawlo.templates.project.spiders' via 2025-09-30T08:11:53,528 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,529 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,529 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,530 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,531 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,533 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,534 even if it does not contain any `.py` files. 2025-09-30T08:11:53,534 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,535 directory, all directories are treated like packages. 2025-09-30T08:11:53,535 ******************************************************************************** 2025-09-30T08:11:53,536 !! 2025-09-30T08:11:53,536 check.warn(importable) 2025-09-30T08:11:53,537 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.spider' is absent from the `packages` configuration. 2025-09-30T08:11:53,537 !! 2025-09-30T08:11:53,538 ******************************************************************************** 2025-09-30T08:11:53,539 ############################ 2025-09-30T08:11:53,539 # Package would be ignored # 2025-09-30T08:11:53,540 ############################ 2025-09-30T08:11:53,540 Python recognizes 'crawlo.templates.spider' as an importable package[^1], 2025-09-30T08:11:53,541 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,542 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,542 package, please make sure that 'crawlo.templates.spider' is explicitly added 2025-09-30T08:11:53,542 to the `packages` configuration field. 2025-09-30T08:11:53,543 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,544 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,544 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,545 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,546 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,547 If you don't want 'crawlo.templates.spider' to be distributed and are 2025-09-30T08:11:53,548 already explicitly excluding 'crawlo.templates.spider' via 2025-09-30T08:11:53,548 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,549 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,549 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,550 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,551 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,553 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,553 even if it does not contain any `.py` files. 2025-09-30T08:11:53,554 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,554 directory, all directories are treated like packages. 2025-09-30T08:11:53,555 ******************************************************************************** 2025-09-30T08:11:53,556 !! 2025-09-30T08:11:53,556 check.warn(importable) 2025-09-30T08:11:53,557 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy' is absent from the `packages` configuration. 2025-09-30T08:11:53,557 !! 2025-09-30T08:11:53,558 ******************************************************************************** 2025-09-30T08:11:53,559 ############################ 2025-09-30T08:11:53,559 # Package would be ignored # 2025-09-30T08:11:53,560 ############################ 2025-09-30T08:11:53,560 Python recognizes 'tests.ofweek_scrapy' as an importable package[^1], 2025-09-30T08:11:53,561 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,562 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,563 package, please make sure that 'tests.ofweek_scrapy' is explicitly added 2025-09-30T08:11:53,563 to the `packages` configuration field. 2025-09-30T08:11:53,564 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,564 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,565 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,566 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,567 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,568 If you don't want 'tests.ofweek_scrapy' to be distributed and are 2025-09-30T08:11:53,568 already explicitly excluding 'tests.ofweek_scrapy' via 2025-09-30T08:11:53,568 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,569 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,569 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,571 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,572 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,574 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,574 even if it does not contain any `.py` files. 2025-09-30T08:11:53,575 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,575 directory, all directories are treated like packages. 2025-09-30T08:11:53,576 ******************************************************************************** 2025-09-30T08:11:53,577 !! 2025-09-30T08:11:53,578 check.warn(importable) 2025-09-30T08:11:53,578 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy.ofweek_scrapy' is absent from the `packages` configuration. 2025-09-30T08:11:53,579 !! 2025-09-30T08:11:53,580 ******************************************************************************** 2025-09-30T08:11:53,581 ############################ 2025-09-30T08:11:53,581 # Package would be ignored # 2025-09-30T08:11:53,582 ############################ 2025-09-30T08:11:53,582 Python recognizes 'tests.ofweek_scrapy.ofweek_scrapy' as an importable package[^1], 2025-09-30T08:11:53,583 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,584 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,584 package, please make sure that 'tests.ofweek_scrapy.ofweek_scrapy' is explicitly added 2025-09-30T08:11:53,585 to the `packages` configuration field. 2025-09-30T08:11:53,586 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,586 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,587 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,588 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,589 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,590 If you don't want 'tests.ofweek_scrapy.ofweek_scrapy' to be distributed and are 2025-09-30T08:11:53,590 already explicitly excluding 'tests.ofweek_scrapy.ofweek_scrapy' via 2025-09-30T08:11:53,591 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,592 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,593 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,593 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,594 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,595 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,596 even if it does not contain any `.py` files. 2025-09-30T08:11:53,596 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,596 directory, all directories are treated like packages. 2025-09-30T08:11:53,597 ******************************************************************************** 2025-09-30T08:11:53,598 !! 2025-09-30T08:11:53,598 check.warn(importable) 2025-09-30T08:11:53,598 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy.ofweek_scrapy.spiders' is absent from the `packages` configuration. 2025-09-30T08:11:53,599 !! 2025-09-30T08:11:53,600 ******************************************************************************** 2025-09-30T08:11:53,600 ############################ 2025-09-30T08:11:53,601 # Package would be ignored # 2025-09-30T08:11:53,601 ############################ 2025-09-30T08:11:53,602 Python recognizes 'tests.ofweek_scrapy.ofweek_scrapy.spiders' as an importable package[^1], 2025-09-30T08:11:53,602 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,603 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,604 package, please make sure that 'tests.ofweek_scrapy.ofweek_scrapy.spiders' is explicitly added 2025-09-30T08:11:53,604 to the `packages` configuration field. 2025-09-30T08:11:53,605 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,606 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,606 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,607 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,609 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,610 If you don't want 'tests.ofweek_scrapy.ofweek_scrapy.spiders' to be distributed and are 2025-09-30T08:11:53,611 already explicitly excluding 'tests.ofweek_scrapy.ofweek_scrapy.spiders' via 2025-09-30T08:11:53,611 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,612 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,612 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,613 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,615 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,616 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,617 even if it does not contain any `.py` files. 2025-09-30T08:11:53,618 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,618 directory, all directories are treated like packages. 2025-09-30T08:11:53,619 ******************************************************************************** 2025-09-30T08:11:53,621 !! 2025-09-30T08:11:53,621 check.warn(importable) 2025-09-30T08:11:53,622 /tmp/pip-build-env-6r4frn72/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.scrapy_comparison' is absent from the `packages` configuration. 2025-09-30T08:11:53,623 !! 2025-09-30T08:11:53,624 ******************************************************************************** 2025-09-30T08:11:53,625 ############################ 2025-09-30T08:11:53,625 # Package would be ignored # 2025-09-30T08:11:53,626 ############################ 2025-09-30T08:11:53,626 Python recognizes 'tests.scrapy_comparison' as an importable package[^1], 2025-09-30T08:11:53,626 but it is absent from setuptools' `packages` configuration. 2025-09-30T08:11:53,627 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-30T08:11:53,628 package, please make sure that 'tests.scrapy_comparison' is explicitly added 2025-09-30T08:11:53,628 to the `packages` configuration field. 2025-09-30T08:11:53,629 Alternatively, you can also rely on setuptools' discovery methods 2025-09-30T08:11:53,630 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-30T08:11:53,630 instead of `find_packages(...)`/`find:`). 2025-09-30T08:11:53,631 You can read more about "package discovery" on setuptools documentation page: 2025-09-30T08:11:53,632 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-30T08:11:53,633 If you don't want 'tests.scrapy_comparison' to be distributed and are 2025-09-30T08:11:53,633 already explicitly excluding 'tests.scrapy_comparison' via 2025-09-30T08:11:53,634 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-30T08:11:53,635 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-30T08:11:53,635 combination with a more fine grained `package-data` configuration. 2025-09-30T08:11:53,636 You can read more about "package data files" on setuptools documentation page: 2025-09-30T08:11:53,638 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-30T08:11:53,639 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-30T08:11:53,640 even if it does not contain any `.py` files. 2025-09-30T08:11:53,641 On the other hand, currently there is no concept of package data 2025-09-30T08:11:53,641 directory, all directories are treated like packages. 2025-09-30T08:11:53,642 ******************************************************************************** 2025-09-30T08:11:53,643 !! 2025-09-30T08:11:53,643 check.warn(importable) 2025-09-30T08:11:53,644 copying tests/comprehensive_testing_summary.md -> build/lib/tests 2025-09-30T08:11:53,644 copying tests/untested_features_report.md -> build/lib/tests 2025-09-30T08:11:53,645 creating build/lib/tests/ofweek_scrapy 2025-09-30T08:11:53,645 copying tests/ofweek_scrapy/scrapy.cfg -> build/lib/tests/ofweek_scrapy 2025-09-30T08:11:53,646 creating build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,646 copying tests/ofweek_scrapy/ofweek_scrapy/__init__.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,647 copying tests/ofweek_scrapy/ofweek_scrapy/items.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,647 copying tests/ofweek_scrapy/ofweek_scrapy/middlewares.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,648 copying tests/ofweek_scrapy/ofweek_scrapy/pipelines.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,648 copying tests/ofweek_scrapy/ofweek_scrapy/settings.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,649 creating build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-09-30T08:11:53,650 copying tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-09-30T08:11:53,650 copying tests/ofweek_scrapy/ofweek_scrapy/spiders/ofweek_spider.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-09-30T08:11:53,651 creating build/lib/tests/scrapy_comparison 2025-09-30T08:11:53,651 copying tests/scrapy_comparison/ofweek_scrapy.py -> build/lib/tests/scrapy_comparison 2025-09-30T08:11:53,652 copying tests/scrapy_comparison/scrapy_test.py -> build/lib/tests/scrapy_comparison 2025-09-30T08:11:53,652 creating build/lib/crawlo/templates 2025-09-30T08:11:53,652 copying crawlo/templates/crawlo.cfg.tmpl -> build/lib/crawlo/templates 2025-09-30T08:11:53,653 copying crawlo/templates/run.py.tmpl -> build/lib/crawlo/templates 2025-09-30T08:11:53,653 copying crawlo/templates/spiders_init.py.tmpl -> build/lib/crawlo/templates 2025-09-30T08:11:53,654 creating build/lib/crawlo/templates/project 2025-09-30T08:11:53,654 copying crawlo/templates/project/__init__.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,655 copying crawlo/templates/project/items.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,655 copying crawlo/templates/project/middlewares.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,656 copying crawlo/templates/project/pipelines.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,656 copying crawlo/templates/project/settings.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,657 copying crawlo/templates/project/settings_distributed.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,657 copying crawlo/templates/project/settings_gentle.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,658 copying crawlo/templates/project/settings_high_performance.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,659 copying crawlo/templates/project/settings_minimal.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,659 copying crawlo/templates/project/settings_simple.py.tmpl -> build/lib/crawlo/templates/project 2025-09-30T08:11:53,660 creating build/lib/crawlo/templates/project/spiders 2025-09-30T08:11:53,660 copying crawlo/templates/project/spiders/__init__.py.tmpl -> build/lib/crawlo/templates/project/spiders 2025-09-30T08:11:53,661 creating build/lib/crawlo/templates/spider 2025-09-30T08:11:53,662 copying crawlo/templates/spider/spider.py.tmpl -> build/lib/crawlo/templates/spider 2025-09-30T08:11:53,662 installing to build/bdist.linux-armv7l/wheel 2025-09-30T08:11:53,663 running install 2025-09-30T08:11:53,663 running install_lib 2025-09-30T08:11:53,670 creating build/bdist.linux-armv7l/wheel 2025-09-30T08:11:53,676 creating build/bdist.linux-armv7l/wheel/tests 2025-09-30T08:11:53,677 copying build/lib/tests/test_controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,679 copying build/lib/tests/test_user_agents.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,681 copying build/lib/tests/test_all_commands.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,683 copying build/lib/tests/test_queue_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,685 copying build/lib/tests/test_random_headers_default.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,688 copying build/lib/tests/test_template_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,690 copying build/lib/tests/spider_log_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,692 copying build/lib/tests/comprehensive_testing_summary.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,694 copying build/lib/tests/cleaners_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,697 copying build/lib/tests/test_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,699 copying build/lib/tests/test_telecom_spider_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,701 copying build/lib/tests/test_config_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,703 copying build/lib/tests/test_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,706 copying build/lib/tests/test_redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,708 copying build/lib/tests/test_response_selector_methods.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,710 copying build/lib/tests/verify_log_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,712 copying build/lib/tests/test_queue_manager_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,714 copying build/lib/tests/final_validation_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,716 copying build/lib/tests/test_all_pipeline_fingerprints.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,719 copying build/lib/tests/test_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,720 copying build/lib/tests/test_final_validation.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,723 copying build/lib/tests/test_queue_manager_double_crawlo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,725 copying build/lib/tests/simple_selector_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,727 copying build/lib/tests/simple_optimization_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,729 copying build/lib/tests/config_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,731 copying build/lib/tests/final_comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,733 copying build/lib/tests/test_encoding_core.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,735 copying build/lib/tests/error_handling_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,737 copying build/lib/tests/debug_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,739 copying build/lib/tests/test_dedup_pipeline_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,742 copying build/lib/tests/test_config_merge.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,744 copying build/lib/tests/test_request_params.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,746 copying build/lib/tests/test_queue_empty_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,748 copying build/lib/tests/test_queue_type.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,750 copying build/lib/tests/test_redis_queue.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,752 copying build/lib/tests/test_crawler_process_import.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,754 copying build/lib/tests/performance_comparison.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,756 copying build/lib/tests/test_encoding_detection.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,758 copying build/lib/tests/untested_features_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,761 copying build/lib/tests/test_double_crawlo_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,763 copying build/lib/tests/test_multi_directory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,765 copying build/lib/tests/test_proxy_api.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,767 copying build/lib/tests/test_date_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,769 copying build/lib/tests/redis_key_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,771 copying build/lib/tests/simple_queue_type_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,773 copying build/lib/tests/queue_blocking_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,775 copying build/lib/tests/response_improvements_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,777 copying build/lib/tests/simple_log_test2.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,779 copying build/lib/tests/test_real_scenario_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,782 copying build/lib/tests/test_priority_behavior.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,784 copying build/lib/tests/test_logging_system.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,786 copying build/lib/tests/debug_log_levels.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,788 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,790 copying build/lib/tests/distributed_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,792 copying build/lib/tests/simple_command_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,794 copying build/lib/tests/test_priority_consistency_fixed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,796 copying build/lib/tests/test_all_redis_key_configs.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,799 copying build/lib/tests/test_selector_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,801 copying build/lib/tests/test_queue_type_redis_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,803 copying build/lib/tests/test_advanced_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,805 copying build/lib/tests/test_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,807 copying build/lib/tests/test_scheduler_config_update.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,809 copying build/lib/tests/test_redis_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,811 copying build/lib/tests/date_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,813 copying build/lib/tests/test_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,816 copying build/lib/tests/test_proxy_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,818 copying build/lib/tests/test_downloader_proxy_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,820 copying build/lib/tests/distributed_test_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,822 copying build/lib/tests/test_offsite_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,824 copying build/lib/tests/log_buffering_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,827 creating build/bdist.linux-armv7l/wheel/tests/scrapy_comparison 2025-09-30T08:11:53,828 copying build/lib/tests/scrapy_comparison/scrapy_test.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-09-30T08:11:53,830 copying build/lib/tests/scrapy_comparison/ofweek_scrapy.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-09-30T08:11:53,832 copying build/lib/tests/test_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,835 copying build/lib/tests/bug_check_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,837 copying build/lib/tests/test_factory_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,839 copying build/lib/tests/simple_spider_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,841 copying build/lib/tests/test_proxy_strategies.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,843 copying build/lib/tests/test_response_url_methods.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,845 copying build/lib/tests/test_proxy_providers.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,847 copying build/lib/tests/test_proxy_stats.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,849 creating build/bdist.linux-armv7l/wheel/tests/test_spiders 2025-09-30T08:11:53,850 copying build/lib/tests/test_spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/test_spiders 2025-09-30T08:11:53,852 copying build/lib/tests/test_spiders/test_spider.py -> build/bdist.linux-armv7l/wheel/./tests/test_spiders 2025-09-30T08:11:53,854 copying build/lib/tests/simple_selector_helper_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,856 copying build/lib/tests/test_download_delay_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,859 copying build/lib/tests/log_generation_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,861 copying build/lib/tests/test_factories.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,863 copying build/lib/tests/test_response_filter_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,866 copying build/lib/tests/simple_follow_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,868 copying build/lib/tests/test_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,870 copying build/lib/tests/test_simple_response.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,872 copying build/lib/tests/debug_pipelines.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,874 copying build/lib/tests/test_edge_cases.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,876 copying build/lib/tests/dynamic_loading_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,878 copying build/lib/tests/test_proxy_health_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,880 copying build/lib/tests/detailed_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,882 copying build/lib/tests/optimized_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,884 copying build/lib/tests/test_get_component_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,886 copying build/lib/tests/test_redis_queue_name_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,888 copying build/lib/tests/comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,890 copying build/lib/tests/test_batch_processor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,892 copying build/lib/tests/test_spider_loader.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,894 copying build/lib/tests/test_double_crawlo_fix_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,896 copying build/lib/tests/debug_configure.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,898 copying build/lib/tests/test_mode_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,900 copying build/lib/tests/test_retry_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,903 copying build/lib/tests/env_config_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,905 copying build/lib/tests/test_optimized_selector_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,907 copying build/lib/tests/verify_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,909 copying build/lib/tests/test_dynamic_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,911 copying build/lib/tests/test_logging_enhancements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,914 copying build/lib/tests/test_redis_key_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,916 copying build/lib/tests/test_offsite_middleware_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,919 copying build/lib/tests/test_dynamic_proxy_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,921 copying build/lib/tests/request_params_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,923 copying build/lib/tests/test_response_urljoin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,925 copying build/lib/tests/debug_log_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,927 copying build/lib/tests/test_request_ignore_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,929 copying build/lib/tests/comprehensive_framework_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,931 copying build/lib/tests/test_pipeline_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,932 copying build/lib/tests/test_random_user_agent.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,934 copying build/lib/tests/test_request_serialization.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,936 copying build/lib/tests/test_logging_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,939 copying build/lib/tests/test_selector_optimizations.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,941 copying build/lib/tests/test_hash_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,943 copying build/lib/tests/test_response_improvements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,945 copying build/lib/tests/test_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,947 copying build/lib/tests/test_parsel.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,949 copying build/lib/tests/baidu_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,951 copying build/lib/tests/test_item_dedup_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,953 copying build/lib/tests/test_spider_loader_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,955 copying build/lib/tests/simple_response_selector_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,957 copying build/lib/tests/test_enhanced_error_handler_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,960 copying build/lib/tests/test_authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,962 copying build/lib/tests/test_redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,965 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy 2025-09-30T08:11:53,966 copying build/lib/tests/ofweek_scrapy/scrapy.cfg -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy 2025-09-30T08:11:53,969 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,970 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-09-30T08:11:53,971 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-09-30T08:11:53,974 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders/ofweek_spider.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-09-30T08:11:53,976 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,977 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/middlewares.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,979 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/items.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,981 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/settings.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,983 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/pipelines.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-09-30T08:11:53,985 copying build/lib/tests/test_scrapy_style_encoding.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,987 copying build/lib/tests/test_env_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,989 copying build/lib/tests/direct_selector_helper_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,991 copying build/lib/tests/test_large_scale_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,993 copying build/lib/tests/test_component_factory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,995 copying build/lib/tests/baidu_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,997 copying build/lib/tests/test_dynamic_proxy_real.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:53,998 copying build/lib/tests/test_enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,001 copying build/lib/tests/dynamic_loading_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,002 copying build/lib/tests/test_middleware_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,004 copying build/lib/tests/test_proxy_middleware_enhanced.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,006 copying build/lib/tests/test_fingerprint_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,008 copying build/lib/tests/authenticated_proxy_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,010 copying build/lib/tests/test_random_headers_necessity.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,012 copying build/lib/tests/test_large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,014 copying build/lib/tests/test_crawler_process_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,016 copying build/lib/tests/test_priority_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,018 copying build/lib/tests/test_template_content.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,020 copying build/lib/tests/test_proxy_middleware_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,022 copying build/lib/tests/simple_url_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,024 copying build/lib/tests/test_response_follow.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,026 copying build/lib/tests/test_performance_monitor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,028 copying build/lib/tests/test_crawlo_proxy_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,030 copying build/lib/tests/test_cleaners.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,032 copying build/lib/tests/test_response_code_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,035 copying build/lib/tests/final_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,037 copying build/lib/tests/test_dynamic_downloaders_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,039 copying build/lib/tests/test_user_agent_randomness.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,041 copying build/lib/tests/test_multiple_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,043 copying build/lib/tests/fix_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,045 copying build/lib/tests/simple_crawlo_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,048 copying build/lib/tests/tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,050 copying build/lib/tests/controlled_spider_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,052 copying build/lib/tests/test_retry_middleware_realistic.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,055 copying build/lib/tests/test_proxy_middleware_refactored.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,057 copying build/lib/tests/advanced_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,059 copying build/lib/tests/test_redis_queue_type_fallback.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,062 copying build/lib/tests/test_default_header_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,064 copying build/lib/tests/test_error_handler_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,066 copying build/lib/tests/test_logging_final.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,068 copying build/lib/tests/framework_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,070 copying build/lib/tests/queue_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,072 copying build/lib/tests/test_dedup_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,075 copying build/lib/tests/verify_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,076 copying build/lib/tests/test_framework_env_usage.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,078 copying build/lib/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-30T08:11:54,082 creating build/bdist.linux-armv7l/wheel/examples 2025-09-30T08:11:54,083 copying build/lib/examples/__init__.py -> build/bdist.linux-armv7l/wheel/./examples 2025-09-30T08:11:54,085 creating build/bdist.linux-armv7l/wheel/crawlo 2025-09-30T08:11:54,087 creating build/bdist.linux-armv7l/wheel/crawlo/utils 2025-09-30T08:11:54,088 copying build/lib/crawlo/utils/large_scale_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,091 copying build/lib/crawlo/utils/system.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,092 copying build/lib/crawlo/utils/text_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,094 copying build/lib/crawlo/utils/redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,097 copying build/lib/crawlo/utils/redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,099 copying build/lib/crawlo/utils/spider_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,101 copying build/lib/crawlo/utils/fingerprint.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,103 copying build/lib/crawlo/utils/error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,106 copying build/lib/crawlo/utils/large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,110 copying build/lib/crawlo/utils/selector_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,112 copying build/lib/crawlo/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,114 copying build/lib/crawlo/utils/log.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,115 copying build/lib/crawlo/utils/url.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,117 copying build/lib/crawlo/utils/performance_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,120 copying build/lib/crawlo/utils/func_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,122 copying build/lib/crawlo/utils/batch_processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,124 copying build/lib/crawlo/utils/db_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,127 copying build/lib/crawlo/utils/misc.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,129 copying build/lib/crawlo/utils/controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,131 copying build/lib/crawlo/utils/tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,133 copying build/lib/crawlo/utils/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,136 copying build/lib/crawlo/utils/request_serializer.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,138 copying build/lib/crawlo/utils/queue_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,140 copying build/lib/crawlo/utils/env_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-30T08:11:54,143 creating build/bdist.linux-armv7l/wheel/crawlo/downloader 2025-09-30T08:11:54,144 copying build/lib/crawlo/downloader/aiohttp_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,146 copying build/lib/crawlo/downloader/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,149 copying build/lib/crawlo/downloader/hybrid_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,151 copying build/lib/crawlo/downloader/httpx_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,153 copying build/lib/crawlo/downloader/cffi_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,156 copying build/lib/crawlo/downloader/playwright_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,158 copying build/lib/crawlo/downloader/selenium_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-30T08:11:54,161 copying build/lib/crawlo/subscriber.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,163 copying build/lib/crawlo/task_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,166 copying build/lib/crawlo/exceptions.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,168 creating build/bdist.linux-armv7l/wheel/crawlo/templates 2025-09-30T08:11:54,169 copying build/lib/crawlo/templates/spiders_init.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-30T08:11:54,171 copying build/lib/crawlo/templates/run.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-30T08:11:54,173 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project 2025-09-30T08:11:54,175 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project/spiders 2025-09-30T08:11:54,176 copying build/lib/crawlo/templates/project/spiders/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project/spiders 2025-09-30T08:11:54,178 copying build/lib/crawlo/templates/project/settings_minimal.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,180 copying build/lib/crawlo/templates/project/settings.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,182 copying build/lib/crawlo/templates/project/middlewares.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,184 copying build/lib/crawlo/templates/project/settings_high_performance.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,186 copying build/lib/crawlo/templates/project/settings_gentle.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,188 copying build/lib/crawlo/templates/project/settings_distributed.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,191 copying build/lib/crawlo/templates/project/settings_simple.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,193 copying build/lib/crawlo/templates/project/pipelines.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,195 copying build/lib/crawlo/templates/project/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,196 copying build/lib/crawlo/templates/project/items.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-30T08:11:54,198 copying build/lib/crawlo/templates/crawlo.cfg.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-30T08:11:54,201 creating build/bdist.linux-armv7l/wheel/crawlo/templates/spider 2025-09-30T08:11:54,202 copying build/lib/crawlo/templates/spider/spider.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/spider 2025-09-30T08:11:54,205 creating build/bdist.linux-armv7l/wheel/crawlo/extension 2025-09-30T08:11:54,206 copying build/lib/crawlo/extension/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,208 copying build/lib/crawlo/extension/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,210 copying build/lib/crawlo/extension/log_interval.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,213 copying build/lib/crawlo/extension/request_recorder.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,215 copying build/lib/crawlo/extension/logging_extension.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,217 copying build/lib/crawlo/extension/health_check.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,219 copying build/lib/crawlo/extension/performance_profiler.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,221 copying build/lib/crawlo/extension/log_stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-30T08:11:54,224 creating build/bdist.linux-armv7l/wheel/crawlo/logging 2025-09-30T08:11:54,225 copying build/lib/crawlo/logging/manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,226 copying build/lib/crawlo/logging/async_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,229 copying build/lib/crawlo/logging/sampler.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,231 copying build/lib/crawlo/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,233 copying build/lib/crawlo/logging/factory.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,235 copying build/lib/crawlo/logging/monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,237 copying build/lib/crawlo/logging/config.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-30T08:11:54,240 creating build/bdist.linux-armv7l/wheel/crawlo/data 2025-09-30T08:11:54,241 copying build/lib/crawlo/data/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-09-30T08:11:54,243 copying build/lib/crawlo/data/user_agents.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-09-30T08:11:54,245 copying build/lib/crawlo/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,248 copying build/lib/crawlo/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,250 copying build/lib/crawlo/project.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,253 copying build/lib/crawlo/framework.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,256 creating build/bdist.linux-armv7l/wheel/crawlo/queue 2025-09-30T08:11:54,257 copying build/lib/crawlo/queue/pqueue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-30T08:11:54,259 copying build/lib/crawlo/queue/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-30T08:11:54,260 copying build/lib/crawlo/queue/queue_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-30T08:11:54,263 copying build/lib/crawlo/queue/redis_priority_queue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-30T08:11:54,265 copying build/lib/crawlo/config_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,268 creating build/bdist.linux-armv7l/wheel/crawlo/middleware 2025-09-30T08:11:54,269 copying build/lib/crawlo/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,271 copying build/lib/crawlo/middleware/request_ignore.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,273 copying build/lib/crawlo/middleware/download_delay.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,275 copying build/lib/crawlo/middleware/proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,278 copying build/lib/crawlo/middleware/response_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,280 copying build/lib/crawlo/middleware/offsite.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,282 copying build/lib/crawlo/middleware/retry.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,284 copying build/lib/crawlo/middleware/default_header.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,286 copying build/lib/crawlo/middleware/middleware_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,289 copying build/lib/crawlo/middleware/simple_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,290 copying build/lib/crawlo/middleware/response_code.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-30T08:11:54,293 creating build/bdist.linux-armv7l/wheel/crawlo/items 2025-09-30T08:11:54,294 copying build/lib/crawlo/items/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-30T08:11:54,296 copying build/lib/crawlo/items/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-30T08:11:54,298 copying build/lib/crawlo/items/fields.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-30T08:11:54,300 copying build/lib/crawlo/items/items.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-30T08:11:54,302 creating build/bdist.linux-armv7l/wheel/crawlo/network 2025-09-30T08:11:54,303 copying build/lib/crawlo/network/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-30T08:11:54,305 copying build/lib/crawlo/network/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-30T08:11:54,308 copying build/lib/crawlo/network/response.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-30T08:11:54,311 creating build/bdist.linux-armv7l/wheel/crawlo/initialization 2025-09-30T08:11:54,312 copying build/lib/crawlo/initialization/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-30T08:11:54,314 copying build/lib/crawlo/initialization/context.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-30T08:11:54,316 copying build/lib/crawlo/initialization/built_in.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-30T08:11:54,318 copying build/lib/crawlo/initialization/phases.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-30T08:11:54,321 copying build/lib/crawlo/initialization/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-30T08:11:54,323 copying build/lib/crawlo/initialization/core.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-30T08:11:54,326 creating build/bdist.linux-armv7l/wheel/crawlo/settings 2025-09-30T08:11:54,327 copying build/lib/crawlo/settings/setting_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-30T08:11:54,329 copying build/lib/crawlo/settings/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-30T08:11:54,331 copying build/lib/crawlo/settings/default_settings.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-30T08:11:54,333 copying build/lib/crawlo/cli.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,336 creating build/bdist.linux-armv7l/wheel/crawlo/tools 2025-09-30T08:11:54,337 copying build/lib/crawlo/tools/request_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,339 copying build/lib/crawlo/tools/data_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,341 copying build/lib/crawlo/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,344 copying build/lib/crawlo/tools/scenario_adapter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,346 copying build/lib/crawlo/tools/encoding_converter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,348 copying build/lib/crawlo/tools/network_diagnostic.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,350 copying build/lib/crawlo/tools/data_formatter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,353 copying build/lib/crawlo/tools/retry_mechanism.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,355 copying build/lib/crawlo/tools/text_cleaner.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,357 copying build/lib/crawlo/tools/authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,359 copying build/lib/crawlo/tools/date_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,362 copying build/lib/crawlo/tools/distributed_coordinator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-30T08:11:54,365 creating build/bdist.linux-armv7l/wheel/crawlo/pipelines 2025-09-30T08:11:54,366 copying build/lib/crawlo/pipelines/database_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,368 copying build/lib/crawlo/pipelines/mongo_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,373 copying build/lib/crawlo/pipelines/json_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,378 copying build/lib/crawlo/pipelines/csv_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,383 copying build/lib/crawlo/pipelines/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,385 copying build/lib/crawlo/pipelines/pipeline_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,389 copying build/lib/crawlo/pipelines/bloom_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,395 copying build/lib/crawlo/pipelines/console_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,398 copying build/lib/crawlo/pipelines/memory_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,400 copying build/lib/crawlo/pipelines/redis_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,403 copying build/lib/crawlo/pipelines/mysql_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-30T08:11:54,408 copying build/lib/crawlo/__version__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,410 copying build/lib/crawlo/stats_collector.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,413 creating build/bdist.linux-armv7l/wheel/crawlo/commands 2025-09-30T08:11:54,414 copying build/lib/crawlo/commands/help.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,418 copying build/lib/crawlo/commands/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,421 copying build/lib/crawlo/commands/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,426 copying build/lib/crawlo/commands/startproject.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,430 copying build/lib/crawlo/commands/genspider.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,651 copying build/lib/crawlo/commands/stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,653 copying build/lib/crawlo/commands/run.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,655 copying build/lib/crawlo/commands/list.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,658 copying build/lib/crawlo/commands/check.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-30T08:11:54,661 copying build/lib/crawlo/event.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,663 creating build/bdist.linux-armv7l/wheel/crawlo/core 2025-09-30T08:11:54,664 copying build/lib/crawlo/core/processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-30T08:11:54,666 copying build/lib/crawlo/core/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-30T08:11:54,668 copying build/lib/crawlo/core/engine.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-30T08:11:54,670 copying build/lib/crawlo/core/scheduler.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-30T08:11:54,673 copying build/lib/crawlo/interfaces.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,675 creating build/bdist.linux-armv7l/wheel/crawlo/factories 2025-09-30T08:11:54,676 copying build/lib/crawlo/factories/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-30T08:11:54,677 copying build/lib/crawlo/factories/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-30T08:11:54,679 copying build/lib/crawlo/factories/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-30T08:11:54,681 copying build/lib/crawlo/factories/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-30T08:11:54,683 copying build/lib/crawlo/config.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,686 creating build/bdist.linux-armv7l/wheel/crawlo/spider 2025-09-30T08:11:54,687 copying build/lib/crawlo/spider/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/spider 2025-09-30T08:11:54,689 copying build/lib/crawlo/mode_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-30T08:11:54,692 creating build/bdist.linux-armv7l/wheel/crawlo/filters 2025-09-30T08:11:54,693 copying build/lib/crawlo/filters/memory_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-30T08:11:54,696 copying build/lib/crawlo/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-30T08:11:54,698 copying build/lib/crawlo/filters/aioredis_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-30T08:11:54,700 running install_egg_info 2025-09-30T08:11:54,713 Copying crawlo.egg-info to build/bdist.linux-armv7l/wheel/./crawlo-1.4.5-py3.11.egg-info 2025-09-30T08:11:54,726 running install_scripts 2025-09-30T08:11:54,735 creating build/bdist.linux-armv7l/wheel/crawlo-1.4.5.dist-info/WHEEL 2025-09-30T08:11:54,738 creating '/tmp/pip-wheel-b6dcit3q/.tmp-m98s_e27/crawlo-1.4.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-09-30T08:11:54,741 adding 'crawlo/__init__.py' 2025-09-30T08:11:54,743 adding 'crawlo/__version__.py' 2025-09-30T08:11:54,744 adding 'crawlo/cli.py' 2025-09-30T08:11:54,746 adding 'crawlo/config.py' 2025-09-30T08:11:54,748 adding 'crawlo/config_validator.py' 2025-09-30T08:11:54,751 adding 'crawlo/crawler.py' 2025-09-30T08:11:54,753 adding 'crawlo/event.py' 2025-09-30T08:11:54,754 adding 'crawlo/exceptions.py' 2025-09-30T08:11:54,756 adding 'crawlo/framework.py' 2025-09-30T08:11:54,757 adding 'crawlo/interfaces.py' 2025-09-30T08:11:54,758 adding 'crawlo/mode_manager.py' 2025-09-30T08:11:54,761 adding 'crawlo/project.py' 2025-09-30T08:11:54,762 adding 'crawlo/stats_collector.py' 2025-09-30T08:11:54,764 adding 'crawlo/subscriber.py' 2025-09-30T08:11:54,767 adding 'crawlo/task_manager.py' 2025-09-30T08:11:54,769 adding 'crawlo/commands/__init__.py' 2025-09-30T08:11:54,773 adding 'crawlo/commands/check.py' 2025-09-30T08:11:54,775 adding 'crawlo/commands/genspider.py' 2025-09-30T08:11:54,777 adding 'crawlo/commands/help.py' 2025-09-30T08:11:54,780 adding 'crawlo/commands/list.py' 2025-09-30T08:11:54,783 adding 'crawlo/commands/run.py' 2025-09-30T08:11:54,787 adding 'crawlo/commands/startproject.py' 2025-09-30T08:11:54,789 adding 'crawlo/commands/stats.py' 2025-09-30T08:11:54,792 adding 'crawlo/commands/utils.py' 2025-09-30T08:11:54,794 adding 'crawlo/core/__init__.py' 2025-09-30T08:11:54,798 adding 'crawlo/core/engine.py' 2025-09-30T08:11:54,800 adding 'crawlo/core/processor.py' 2025-09-30T08:11:54,802 adding 'crawlo/core/scheduler.py' 2025-09-30T08:11:54,805 adding 'crawlo/data/__init__.py' 2025-09-30T08:11:54,807 adding 'crawlo/data/user_agents.py' 2025-09-30T08:11:54,810 adding 'crawlo/downloader/__init__.py' 2025-09-30T08:11:54,813 adding 'crawlo/downloader/aiohttp_downloader.py' 2025-09-30T08:11:54,815 adding 'crawlo/downloader/cffi_downloader.py' 2025-09-30T08:11:54,818 adding 'crawlo/downloader/httpx_downloader.py' 2025-09-30T08:11:54,821 adding 'crawlo/downloader/hybrid_downloader.py' 2025-09-30T08:11:54,824 adding 'crawlo/downloader/playwright_downloader.py' 2025-09-30T08:11:54,828 adding 'crawlo/downloader/selenium_downloader.py' 2025-09-30T08:11:54,830 adding 'crawlo/extension/__init__.py' 2025-09-30T08:11:54,833 adding 'crawlo/extension/health_check.py' 2025-09-30T08:11:54,835 adding 'crawlo/extension/log_interval.py' 2025-09-30T08:11:54,836 adding 'crawlo/extension/log_stats.py' 2025-09-30T08:11:54,838 adding 'crawlo/extension/logging_extension.py' 2025-09-30T08:11:54,840 adding 'crawlo/extension/memory_monitor.py' 2025-09-30T08:11:54,842 adding 'crawlo/extension/performance_profiler.py' 2025-09-30T08:11:54,844 adding 'crawlo/extension/request_recorder.py' 2025-09-30T08:11:54,847 adding 'crawlo/factories/__init__.py' 2025-09-30T08:11:54,848 adding 'crawlo/factories/base.py' 2025-09-30T08:11:54,850 adding 'crawlo/factories/crawler.py' 2025-09-30T08:11:54,852 adding 'crawlo/factories/registry.py' 2025-09-30T08:11:54,855 adding 'crawlo/filters/__init__.py' 2025-09-30T08:11:54,857 adding 'crawlo/filters/aioredis_filter.py' 2025-09-30T08:11:54,860 adding 'crawlo/filters/memory_filter.py' 2025-09-30T08:11:54,862 adding 'crawlo/initialization/__init__.py' 2025-09-30T08:11:54,864 adding 'crawlo/initialization/built_in.py' 2025-09-30T08:11:54,866 adding 'crawlo/initialization/context.py' 2025-09-30T08:11:54,868 adding 'crawlo/initialization/core.py' 2025-09-30T08:11:54,869 adding 'crawlo/initialization/phases.py' 2025-09-30T08:11:54,870 adding 'crawlo/initialization/registry.py' 2025-09-30T08:11:54,872 adding 'crawlo/items/__init__.py' 2025-09-30T08:11:54,874 adding 'crawlo/items/base.py' 2025-09-30T08:11:54,875 adding 'crawlo/items/fields.py' 2025-09-30T08:11:54,876 adding 'crawlo/items/items.py' 2025-09-30T08:11:54,878 adding 'crawlo/logging/__init__.py' 2025-09-30T08:11:54,880 adding 'crawlo/logging/async_handler.py' 2025-09-30T08:11:54,881 adding 'crawlo/logging/config.py' 2025-09-30T08:11:54,883 adding 'crawlo/logging/factory.py' 2025-09-30T08:11:54,884 adding 'crawlo/logging/manager.py' 2025-09-30T08:11:54,886 adding 'crawlo/logging/monitor.py' 2025-09-30T08:11:54,887 adding 'crawlo/logging/sampler.py' 2025-09-30T08:11:54,889 adding 'crawlo/middleware/__init__.py' 2025-09-30T08:11:54,891 adding 'crawlo/middleware/default_header.py' 2025-09-30T08:11:54,892 adding 'crawlo/middleware/download_delay.py' 2025-09-30T08:11:54,894 adding 'crawlo/middleware/middleware_manager.py' 2025-09-30T08:11:54,895 adding 'crawlo/middleware/offsite.py' 2025-09-30T08:11:54,898 adding 'crawlo/middleware/proxy.py' 2025-09-30T08:11:54,899 adding 'crawlo/middleware/request_ignore.py' 2025-09-30T08:11:54,901 adding 'crawlo/middleware/response_code.py' 2025-09-30T08:11:54,902 adding 'crawlo/middleware/response_filter.py' 2025-09-30T08:11:54,904 adding 'crawlo/middleware/retry.py' 2025-09-30T08:11:54,905 adding 'crawlo/middleware/simple_proxy.py' 2025-09-30T08:11:54,907 adding 'crawlo/network/__init__.py' 2025-09-30T08:11:54,909 adding 'crawlo/network/request.py' 2025-09-30T08:11:54,912 adding 'crawlo/network/response.py' 2025-09-30T08:11:54,914 adding 'crawlo/pipelines/__init__.py' 2025-09-30T08:11:54,915 adding 'crawlo/pipelines/bloom_dedup_pipeline.py' 2025-09-30T08:11:54,916 adding 'crawlo/pipelines/console_pipeline.py' 2025-09-30T08:11:54,918 adding 'crawlo/pipelines/csv_pipeline.py' 2025-09-30T08:11:54,920 adding 'crawlo/pipelines/database_dedup_pipeline.py' 2025-09-30T08:11:54,921 adding 'crawlo/pipelines/json_pipeline.py' 2025-09-30T08:11:54,923 adding 'crawlo/pipelines/memory_dedup_pipeline.py' 2025-09-30T08:11:54,924 adding 'crawlo/pipelines/mongo_pipeline.py' 2025-09-30T08:11:54,926 adding 'crawlo/pipelines/mysql_pipeline.py' 2025-09-30T08:11:54,927 adding 'crawlo/pipelines/pipeline_manager.py' 2025-09-30T08:11:54,929 adding 'crawlo/pipelines/redis_dedup_pipeline.py' 2025-09-30T08:11:54,931 adding 'crawlo/queue/__init__.py' 2025-09-30T08:11:54,932 adding 'crawlo/queue/pqueue.py' 2025-09-30T08:11:54,934 adding 'crawlo/queue/queue_manager.py' 2025-09-30T08:11:54,937 adding 'crawlo/queue/redis_priority_queue.py' 2025-09-30T08:11:54,938 adding 'crawlo/settings/__init__.py' 2025-09-30T08:11:54,940 adding 'crawlo/settings/default_settings.py' 2025-09-30T08:11:54,942 adding 'crawlo/settings/setting_manager.py' 2025-09-30T08:11:54,945 adding 'crawlo/spider/__init__.py' 2025-09-30T08:11:54,947 adding 'crawlo/templates/crawlo.cfg.tmpl' 2025-09-30T08:11:54,949 adding 'crawlo/templates/run.py.tmpl' 2025-09-30T08:11:54,950 adding 'crawlo/templates/spiders_init.py.tmpl' 2025-09-30T08:11:54,951 adding 'crawlo/templates/project/__init__.py.tmpl' 2025-09-30T08:11:54,953 adding 'crawlo/templates/project/items.py.tmpl' 2025-09-30T08:11:54,954 adding 'crawlo/templates/project/middlewares.py.tmpl' 2025-09-30T08:11:54,955 adding 'crawlo/templates/project/pipelines.py.tmpl' 2025-09-30T08:11:54,956 adding 'crawlo/templates/project/settings.py.tmpl' 2025-09-30T08:11:54,958 adding 'crawlo/templates/project/settings_distributed.py.tmpl' 2025-09-30T08:11:54,959 adding 'crawlo/templates/project/settings_gentle.py.tmpl' 2025-09-30T08:11:54,961 adding 'crawlo/templates/project/settings_high_performance.py.tmpl' 2025-09-30T08:11:54,962 adding 'crawlo/templates/project/settings_minimal.py.tmpl' 2025-09-30T08:11:54,964 adding 'crawlo/templates/project/settings_simple.py.tmpl' 2025-09-30T08:11:54,966 adding 'crawlo/templates/project/spiders/__init__.py.tmpl' 2025-09-30T08:11:54,968 adding 'crawlo/templates/spider/spider.py.tmpl' 2025-09-30T08:11:54,970 adding 'crawlo/tools/__init__.py' 2025-09-30T08:11:54,971 adding 'crawlo/tools/authenticated_proxy.py' 2025-09-30T08:11:54,973 adding 'crawlo/tools/data_formatter.py' 2025-09-30T08:11:54,975 adding 'crawlo/tools/data_validator.py' 2025-09-30T08:11:54,976 adding 'crawlo/tools/date_tools.py' 2025-09-30T08:11:54,978 adding 'crawlo/tools/distributed_coordinator.py' 2025-09-30T08:11:54,980 adding 'crawlo/tools/encoding_converter.py' 2025-09-30T08:11:54,982 adding 'crawlo/tools/network_diagnostic.py' 2025-09-30T08:11:54,983 adding 'crawlo/tools/request_tools.py' 2025-09-30T08:11:54,984 adding 'crawlo/tools/retry_mechanism.py' 2025-09-30T08:11:54,986 adding 'crawlo/tools/scenario_adapter.py' 2025-09-30T08:11:54,988 adding 'crawlo/tools/text_cleaner.py' 2025-09-30T08:11:54,990 adding 'crawlo/utils/__init__.py' 2025-09-30T08:11:54,992 adding 'crawlo/utils/batch_processor.py' 2025-09-30T08:11:54,994 adding 'crawlo/utils/controlled_spider_mixin.py' 2025-09-30T08:11:54,996 adding 'crawlo/utils/db_helper.py' 2025-09-30T08:11:54,998 adding 'crawlo/utils/env_config.py' 2025-09-30T08:11:55,000 adding 'crawlo/utils/error_handler.py' 2025-09-30T08:11:55,001 adding 'crawlo/utils/fingerprint.py' 2025-09-30T08:11:55,003 adding 'crawlo/utils/func_tools.py' 2025-09-30T08:11:55,004 adding 'crawlo/utils/large_scale_config.py' 2025-09-30T08:11:55,006 adding 'crawlo/utils/large_scale_helper.py' 2025-09-30T08:11:55,008 adding 'crawlo/utils/log.py' 2025-09-30T08:11:55,009 adding 'crawlo/utils/misc.py' 2025-09-30T08:11:55,011 adding 'crawlo/utils/performance_monitor.py' 2025-09-30T08:11:55,012 adding 'crawlo/utils/queue_helper.py' 2025-09-30T08:11:55,014 adding 'crawlo/utils/redis_connection_pool.py' 2025-09-30T08:11:55,016 adding 'crawlo/utils/redis_key_validator.py' 2025-09-30T08:11:55,018 adding 'crawlo/utils/request.py' 2025-09-30T08:11:55,019 adding 'crawlo/utils/request_serializer.py' 2025-09-30T08:11:55,021 adding 'crawlo/utils/selector_helper.py' 2025-09-30T08:11:55,022 adding 'crawlo/utils/spider_loader.py' 2025-09-30T08:11:55,023 adding 'crawlo/utils/system.py' 2025-09-30T08:11:55,025 adding 'crawlo/utils/text_helper.py' 2025-09-30T08:11:55,026 adding 'crawlo/utils/tools.py' 2025-09-30T08:11:55,027 adding 'crawlo/utils/url.py' 2025-09-30T08:11:55,029 adding 'examples/__init__.py' 2025-09-30T08:11:55,034 adding 'tests/__init__.py' 2025-09-30T08:11:55,036 adding 'tests/advanced_tools_example.py' 2025-09-30T08:11:55,037 adding 'tests/authenticated_proxy_example.py' 2025-09-30T08:11:55,038 adding 'tests/baidu_performance_test.py' 2025-09-30T08:11:55,040 adding 'tests/baidu_test.py' 2025-09-30T08:11:55,041 adding 'tests/bug_check_test.py' 2025-09-30T08:11:55,043 adding 'tests/cleaners_example.py' 2025-09-30T08:11:55,044 adding 'tests/comprehensive_framework_test.py' 2025-09-30T08:11:55,046 adding 'tests/comprehensive_test.py' 2025-09-30T08:11:55,047 adding 'tests/comprehensive_testing_summary.md' 2025-09-30T08:11:55,049 adding 'tests/config_validation_demo.py' 2025-09-30T08:11:55,050 adding 'tests/controlled_spider_example.py' 2025-09-30T08:11:55,052 adding 'tests/date_tools_example.py' 2025-09-30T08:11:55,053 adding 'tests/debug_configure.py' 2025-09-30T08:11:55,055 adding 'tests/debug_framework_logger.py' 2025-09-30T08:11:55,056 adding 'tests/debug_log_config.py' 2025-09-30T08:11:55,057 adding 'tests/debug_log_levels.py' 2025-09-30T08:11:55,058 adding 'tests/debug_pipelines.py' 2025-09-30T08:11:55,060 adding 'tests/detailed_log_test.py' 2025-09-30T08:11:55,061 adding 'tests/direct_selector_helper_test.py' 2025-09-30T08:11:55,063 adding 'tests/distributed_test.py' 2025-09-30T08:11:55,064 adding 'tests/distributed_test_debug.py' 2025-09-30T08:11:55,066 adding 'tests/dynamic_loading_example.py' 2025-09-30T08:11:55,067 adding 'tests/dynamic_loading_test.py' 2025-09-30T08:11:55,069 adding 'tests/env_config_example.py' 2025-09-30T08:11:55,070 adding 'tests/error_handling_example.py' 2025-09-30T08:11:55,072 adding 'tests/final_comprehensive_test.py' 2025-09-30T08:11:55,074 adding 'tests/final_log_test.py' 2025-09-30T08:11:55,075 adding 'tests/final_validation_test.py' 2025-09-30T08:11:55,077 adding 'tests/fix_log_test.py' 2025-09-30T08:11:55,079 adding 'tests/framework_performance_test.py' 2025-09-30T08:11:55,080 adding 'tests/log_buffering_test.py' 2025-09-30T08:11:55,081 adding 'tests/log_generation_timing_test.py' 2025-09-30T08:11:55,083 adding 'tests/optimized_performance_test.py' 2025-09-30T08:11:55,085 adding 'tests/performance_comparison.py' 2025-09-30T08:11:55,086 adding 'tests/queue_blocking_test.py' 2025-09-30T08:11:55,088 adding 'tests/queue_test.py' 2025-09-30T08:11:55,089 adding 'tests/redis_key_validation_demo.py' 2025-09-30T08:11:55,091 adding 'tests/request_params_example.py' 2025-09-30T08:11:55,092 adding 'tests/response_improvements_example.py' 2025-09-30T08:11:55,094 adding 'tests/simple_command_test.py' 2025-09-30T08:11:55,095 adding 'tests/simple_crawlo_test.py' 2025-09-30T08:11:55,097 adding 'tests/simple_follow_test.py' 2025-09-30T08:11:55,099 adding 'tests/simple_log_test2.py' 2025-09-30T08:11:55,100 adding 'tests/simple_optimization_test.py' 2025-09-30T08:11:55,101 adding 'tests/simple_queue_type_test.py' 2025-09-30T08:11:55,103 adding 'tests/simple_response_selector_test.py' 2025-09-30T08:11:55,104 adding 'tests/simple_selector_helper_test.py' 2025-09-30T08:11:55,106 adding 'tests/simple_selector_test.py' 2025-09-30T08:11:55,107 adding 'tests/simple_spider_test.py' 2025-09-30T08:11:55,108 adding 'tests/simple_url_test.py' 2025-09-30T08:11:55,110 adding 'tests/spider_log_timing_test.py' 2025-09-30T08:11:55,111 adding 'tests/test_advanced_tools.py' 2025-09-30T08:11:55,113 adding 'tests/test_all_commands.py' 2025-09-30T08:11:55,115 adding 'tests/test_all_pipeline_fingerprints.py' 2025-09-30T08:11:55,116 adding 'tests/test_all_redis_key_configs.py' 2025-09-30T08:11:55,117 adding 'tests/test_authenticated_proxy.py' 2025-09-30T08:11:55,119 adding 'tests/test_batch_processor.py' 2025-09-30T08:11:55,120 adding 'tests/test_cleaners.py' 2025-09-30T08:11:55,121 adding 'tests/test_component_factory.py' 2025-09-30T08:11:55,123 adding 'tests/test_comprehensive.py' 2025-09-30T08:11:55,124 adding 'tests/test_config_consistency.py' 2025-09-30T08:11:55,125 adding 'tests/test_config_merge.py' 2025-09-30T08:11:55,126 adding 'tests/test_config_validator.py' 2025-09-30T08:11:55,128 adding 'tests/test_controlled_spider_mixin.py' 2025-09-30T08:11:55,129 adding 'tests/test_crawler_process_import.py' 2025-09-30T08:11:55,130 adding 'tests/test_crawler_process_spider_modules.py' 2025-09-30T08:11:55,131 adding 'tests/test_crawlo_proxy_integration.py' 2025-09-30T08:11:55,133 adding 'tests/test_date_tools.py' 2025-09-30T08:11:55,134 adding 'tests/test_dedup_fix.py' 2025-09-30T08:11:55,136 adding 'tests/test_dedup_pipeline_consistency.py' 2025-09-30T08:11:55,137 adding 'tests/test_default_header_middleware.py' 2025-09-30T08:11:55,139 adding 'tests/test_distributed.py' 2025-09-30T08:11:55,140 adding 'tests/test_double_crawlo_fix.py' 2025-09-30T08:11:55,142 adding 'tests/test_double_crawlo_fix_simple.py' 2025-09-30T08:11:55,143 adding 'tests/test_download_delay_middleware.py' 2025-09-30T08:11:55,145 adding 'tests/test_downloader_proxy_compatibility.py' 2025-09-30T08:11:55,146 adding 'tests/test_dynamic_downloaders_proxy.py' 2025-09-30T08:11:55,148 adding 'tests/test_dynamic_proxy.py' 2025-09-30T08:11:55,149 adding 'tests/test_dynamic_proxy_config.py' 2025-09-30T08:11:55,150 adding 'tests/test_dynamic_proxy_real.py' 2025-09-30T08:11:55,152 adding 'tests/test_edge_cases.py' 2025-09-30T08:11:55,154 adding 'tests/test_encoding_core.py' 2025-09-30T08:11:55,155 adding 'tests/test_encoding_detection.py' 2025-09-30T08:11:55,156 adding 'tests/test_enhanced_error_handler.py' 2025-09-30T08:11:55,158 adding 'tests/test_enhanced_error_handler_comprehensive.py' 2025-09-30T08:11:55,160 adding 'tests/test_env_config.py' 2025-09-30T08:11:55,161 adding 'tests/test_error_handler_compatibility.py' 2025-09-30T08:11:55,163 adding 'tests/test_factories.py' 2025-09-30T08:11:55,164 adding 'tests/test_factory_compatibility.py' 2025-09-30T08:11:55,166 adding 'tests/test_final_validation.py' 2025-09-30T08:11:55,167 adding 'tests/test_fingerprint_consistency.py' 2025-09-30T08:11:55,169 adding 'tests/test_fingerprint_simple.py' 2025-09-30T08:11:55,170 adding 'tests/test_framework_env_usage.py' 2025-09-30T08:11:55,171 adding 'tests/test_get_component_logger.py' 2025-09-30T08:11:55,173 adding 'tests/test_hash_performance.py' 2025-09-30T08:11:55,174 adding 'tests/test_integration.py' 2025-09-30T08:11:55,176 adding 'tests/test_item_dedup_redis_key.py' 2025-09-30T08:11:55,177 adding 'tests/test_large_scale_config.py' 2025-09-30T08:11:55,179 adding 'tests/test_large_scale_helper.py' 2025-09-30T08:11:55,181 adding 'tests/test_logging_enhancements.py' 2025-09-30T08:11:55,182 adding 'tests/test_logging_final.py' 2025-09-30T08:11:55,184 adding 'tests/test_logging_integration.py' 2025-09-30T08:11:55,186 adding 'tests/test_logging_system.py' 2025-09-30T08:11:55,187 adding 'tests/test_middleware_debug.py' 2025-09-30T08:11:55,189 adding 'tests/test_mode_consistency.py' 2025-09-30T08:11:55,190 adding 'tests/test_multi_directory.py' 2025-09-30T08:11:55,191 adding 'tests/test_multiple_spider_modules.py' 2025-09-30T08:11:55,193 adding 'tests/test_offsite_middleware.py' 2025-09-30T08:11:55,195 adding 'tests/test_offsite_middleware_simple.py' 2025-09-30T08:11:55,197 adding 'tests/test_optimized_selector_naming.py' 2025-09-30T08:11:55,198 adding 'tests/test_parsel.py' 2025-09-30T08:11:55,200 adding 'tests/test_performance.py' 2025-09-30T08:11:55,201 adding 'tests/test_performance_monitor.py' 2025-09-30T08:11:55,203 adding 'tests/test_pipeline_fingerprint_consistency.py' 2025-09-30T08:11:55,205 adding 'tests/test_priority_behavior.py' 2025-09-30T08:11:55,206 adding 'tests/test_priority_consistency.py' 2025-09-30T08:11:55,208 adding 'tests/test_priority_consistency_fixed.py' 2025-09-30T08:11:55,209 adding 'tests/test_proxy_api.py' 2025-09-30T08:11:55,210 adding 'tests/test_proxy_health_check.py' 2025-09-30T08:11:55,212 adding 'tests/test_proxy_middleware.py' 2025-09-30T08:11:55,213 adding 'tests/test_proxy_middleware_enhanced.py' 2025-09-30T08:11:55,215 adding 'tests/test_proxy_middleware_integration.py' 2025-09-30T08:11:55,216 adding 'tests/test_proxy_middleware_refactored.py' 2025-09-30T08:11:55,217 adding 'tests/test_proxy_providers.py' 2025-09-30T08:11:55,218 adding 'tests/test_proxy_stats.py' 2025-09-30T08:11:55,220 adding 'tests/test_proxy_strategies.py' 2025-09-30T08:11:55,221 adding 'tests/test_queue_empty_check.py' 2025-09-30T08:11:55,222 adding 'tests/test_queue_manager_double_crawlo.py' 2025-09-30T08:11:55,224 adding 'tests/test_queue_manager_redis_key.py' 2025-09-30T08:11:55,225 adding 'tests/test_queue_naming.py' 2025-09-30T08:11:55,227 adding 'tests/test_queue_type.py' 2025-09-30T08:11:55,228 adding 'tests/test_queue_type_redis_config_consistency.py' 2025-09-30T08:11:55,230 adding 'tests/test_random_headers_default.py' 2025-09-30T08:11:55,232 adding 'tests/test_random_headers_necessity.py' 2025-09-30T08:11:55,233 adding 'tests/test_random_user_agent.py' 2025-09-30T08:11:55,235 adding 'tests/test_real_scenario_proxy.py' 2025-09-30T08:11:55,236 adding 'tests/test_redis_config.py' 2025-09-30T08:11:55,238 adding 'tests/test_redis_connection_pool.py' 2025-09-30T08:11:55,239 adding 'tests/test_redis_key_naming.py' 2025-09-30T08:11:55,241 adding 'tests/test_redis_key_validator.py' 2025-09-30T08:11:55,242 adding 'tests/test_redis_queue.py' 2025-09-30T08:11:55,244 adding 'tests/test_redis_queue_name_fix.py' 2025-09-30T08:11:55,245 adding 'tests/test_redis_queue_type_fallback.py' 2025-09-30T08:11:55,246 adding 'tests/test_request_ignore_middleware.py' 2025-09-30T08:11:55,248 adding 'tests/test_request_params.py' 2025-09-30T08:11:55,249 adding 'tests/test_request_serialization.py' 2025-09-30T08:11:55,251 adding 'tests/test_response_code_middleware.py' 2025-09-30T08:11:55,253 adding 'tests/test_response_filter_middleware.py' 2025-09-30T08:11:55,254 adding 'tests/test_response_follow.py' 2025-09-30T08:11:55,256 adding 'tests/test_response_improvements.py' 2025-09-30T08:11:55,257 adding 'tests/test_response_selector_methods.py' 2025-09-30T08:11:55,259 adding 'tests/test_response_url_methods.py' 2025-09-30T08:11:55,260 adding 'tests/test_response_urljoin.py' 2025-09-30T08:11:55,262 adding 'tests/test_retry_middleware.py' 2025-09-30T08:11:55,263 adding 'tests/test_retry_middleware_realistic.py' 2025-09-30T08:11:55,265 adding 'tests/test_scheduler.py' 2025-09-30T08:11:55,266 adding 'tests/test_scheduler_config_update.py' 2025-09-30T08:11:55,268 adding 'tests/test_scrapy_style_encoding.py' 2025-09-30T08:11:55,269 adding 'tests/test_selector_helper.py' 2025-09-30T08:11:55,271 adding 'tests/test_selector_optimizations.py' 2025-09-30T08:11:55,272 adding 'tests/test_simple_response.py' 2025-09-30T08:11:55,273 adding 'tests/test_spider_loader.py' 2025-09-30T08:11:55,275 adding 'tests/test_spider_loader_comprehensive.py' 2025-09-30T08:11:55,276 adding 'tests/test_spider_modules.py' 2025-09-30T08:11:55,277 adding 'tests/test_telecom_spider_redis_key.py' 2025-09-30T08:11:55,279 adding 'tests/test_template_content.py' 2025-09-30T08:11:55,280 adding 'tests/test_template_redis_key.py' 2025-09-30T08:11:55,282 adding 'tests/test_tools.py' 2025-09-30T08:11:55,283 adding 'tests/test_user_agent_randomness.py' 2025-09-30T08:11:55,285 adding 'tests/test_user_agents.py' 2025-09-30T08:11:55,287 adding 'tests/tools_example.py' 2025-09-30T08:11:55,288 adding 'tests/untested_features_report.md' 2025-09-30T08:11:55,289 adding 'tests/verify_debug.py' 2025-09-30T08:11:55,291 adding 'tests/verify_distributed.py' 2025-09-30T08:11:55,292 adding 'tests/verify_log_fix.py' 2025-09-30T08:11:55,294 adding 'tests/ofweek_scrapy/scrapy.cfg' 2025-09-30T08:11:55,295 adding 'tests/ofweek_scrapy/ofweek_scrapy/__init__.py' 2025-09-30T08:11:55,296 adding 'tests/ofweek_scrapy/ofweek_scrapy/items.py' 2025-09-30T08:11:55,298 adding 'tests/ofweek_scrapy/ofweek_scrapy/middlewares.py' 2025-09-30T08:11:55,299 adding 'tests/ofweek_scrapy/ofweek_scrapy/pipelines.py' 2025-09-30T08:11:55,300 adding 'tests/ofweek_scrapy/ofweek_scrapy/settings.py' 2025-09-30T08:11:55,302 adding 'tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py' 2025-09-30T08:11:55,303 adding 'tests/ofweek_scrapy/ofweek_scrapy/spiders/ofweek_spider.py' 2025-09-30T08:11:55,305 adding 'tests/scrapy_comparison/ofweek_scrapy.py' 2025-09-30T08:11:55,307 adding 'tests/scrapy_comparison/scrapy_test.py' 2025-09-30T08:11:55,308 adding 'tests/test_spiders/__init__.py' 2025-09-30T08:11:55,309 adding 'tests/test_spiders/test_spider.py' 2025-09-30T08:11:55,311 adding 'crawlo-1.4.5.dist-info/METADATA' 2025-09-30T08:11:55,312 adding 'crawlo-1.4.5.dist-info/WHEEL' 2025-09-30T08:11:55,313 adding 'crawlo-1.4.5.dist-info/entry_points.txt' 2025-09-30T08:11:55,314 adding 'crawlo-1.4.5.dist-info/top_level.txt' 2025-09-30T08:11:55,320 adding 'crawlo-1.4.5.dist-info/RECORD' 2025-09-30T08:11:55,336 removing build/bdist.linux-armv7l/wheel 2025-09-30T08:11:55,506 Building wheel for crawlo (pyproject.toml): finished with status 'done' 2025-09-30T08:11:55,524 Created wheel for crawlo: filename=crawlo-1.4.5-py3-none-any.whl size=627524 sha256=bf7577e3497593c0511dc3eb84857f8d0c751bdae053cf0dda37179224b39d4b 2025-09-30T08:11:55,525 Stored in directory: /tmp/pip-ephem-wheel-cache-gbvcbulm/wheels/43/53/b3/f6d988de0e0f2f9b7032487f2a2925c80bea93afe382e208db 2025-09-30T08:11:55,547 Successfully built crawlo 2025-09-30T08:11:55,565 Removed build tracker: '/tmp/pip-build-tracker-ug8527tg'