2025-09-26T20:29:28,783 Created temporary directory: /tmp/pip-ephem-wheel-cache-fyzeiip0 2025-09-26T20:29:28,785 Created temporary directory: /tmp/pip-build-tracker-t7cc3q4_ 2025-09-26T20:29:28,786 Initialized build tracking at /tmp/pip-build-tracker-t7cc3q4_ 2025-09-26T20:29:28,786 Created build tracker: /tmp/pip-build-tracker-t7cc3q4_ 2025-09-26T20:29:28,787 Entered build tracker: /tmp/pip-build-tracker-t7cc3q4_ 2025-09-26T20:29:28,787 Created temporary directory: /tmp/pip-wheel-jeduxfoe 2025-09-26T20:29:28,791 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-09-26T20:29:28,793 Created temporary directory: /tmp/pip-ephem-wheel-cache-1ha24kz6 2025-09-26T20:29:28,815 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-09-26T20:29:28,818 2 location(s) to search for versions of crawlo: 2025-09-26T20:29:28,818 * https://pypi.org/simple/crawlo/ 2025-09-26T20:29:28,818 * https://www.piwheels.org/simple/crawlo/ 2025-09-26T20:29:28,819 Fetching project page and analyzing links: https://pypi.org/simple/crawlo/ 2025-09-26T20:29:28,820 Getting page https://pypi.org/simple/crawlo/ 2025-09-26T20:29:28,821 Found index url https://pypi.org/simple 2025-09-26T20:29:29,096 Fetched page https://pypi.org/simple/crawlo/ as application/vnd.pypi.simple.v1+json 2025-09-26T20:29:29,098 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5e/f7/15da16c9e40a732d265b11ae6f392ba6e38c843eb1a3850e1202ba0e57fa/crawlo-1.3.9-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-26T20:29:29,099 Found link https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.3.9 2025-09-26T20:29:29,100 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/4a/9c/82aeeb0713f1125291ead74dff2f44b27fee8c876a5d58b5eb08bc8a3fec/crawlo-1.4.0-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-26T20:29:29,102 Found link https://files.pythonhosted.org/packages/8d/80/d3c003285cc6ae70e0b6e71800635eed0c00e9441d0ffe0b4e0f41db962d/crawlo-1.4.0.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.0 2025-09-26T20:29:29,103 Fetching project page and analyzing links: https://www.piwheels.org/simple/crawlo/ 2025-09-26T20:29:29,104 Getting page https://www.piwheels.org/simple/crawlo/ 2025-09-26T20:29:29,106 Found index url https://www.piwheels.org/simple 2025-09-26T20:29:29,279 Fetched page https://www.piwheels.org/simple/crawlo/ as text/html 2025-09-26T20:29:29,280 Skipping link: not a file: https://www.piwheels.org/simple/crawlo/ 2025-09-26T20:29:29,281 Skipping link: not a file: https://pypi.org/simple/crawlo/ 2025-09-26T20:29:29,300 Given no hashes to check 1 links for project 'crawlo': discarding no candidates 2025-09-26T20:29:29,318 Collecting crawlo==1.3.9 2025-09-26T20:29:29,321 Created temporary directory: /tmp/pip-unpack-kzbhwuq9 2025-09-26T20:29:29,535 Downloading crawlo-1.3.9.tar.gz (385 kB) 2025-09-26T20:29:30,229 Added crawlo==1.3.9 from https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz to build tracker '/tmp/pip-build-tracker-t7cc3q4_' 2025-09-26T20:29:30,233 Created temporary directory: /tmp/pip-build-env-jl9a3h34 2025-09-26T20:29:30,239 Installing build dependencies: started 2025-09-26T20:29:30,240 Running command pip subprocess to install build dependencies 2025-09-26T20:29:31,416 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-09-26T20:29:32,249 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-09-26T20:29:32,273 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-09-26T20:29:33,992 Collecting setuptools>=80.9.0 2025-09-26T20:29:34,083 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-09-26T20:29:34,630 Collecting wheel 2025-09-26T20:29:34,708 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2025-09-26T20:29:37,949 Installing collected packages: wheel, setuptools 2025-09-26T20:29:38,412 Creating /tmp/pip-build-env-jl9a3h34/overlay/local/bin 2025-09-26T20:29:38,414 changing mode of /tmp/pip-build-env-jl9a3h34/overlay/local/bin/wheel to 755 2025-09-26T20:29:42,820 Successfully installed setuptools-80.9.0 wheel-0.45.1 2025-09-26T20:29:43,103 Installing build dependencies: finished with status 'done' 2025-09-26T20:29:43,110 Getting requirements to build wheel: started 2025-09-26T20:29:43,111 Running command Getting requirements to build wheel 2025-09-26T20:29:43,690 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-26T20:29:43,690 !! 2025-09-26T20:29:43,691 ******************************************************************************** 2025-09-26T20:29:43,692 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-26T20:29:43,693 License :: OSI Approved :: MIT License 2025-09-26T20:29:43,694 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-26T20:29:43,695 ******************************************************************************** 2025-09-26T20:29:43,696 !! 2025-09-26T20:29:43,696 self._finalize_license_expression() 2025-09-26T20:29:43,757 running egg_info 2025-09-26T20:29:43,764 writing crawlo.egg-info/PKG-INFO 2025-09-26T20:29:43,774 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-09-26T20:29:43,776 writing entry points to crawlo.egg-info/entry_points.txt 2025-09-26T20:29:43,781 writing requirements to crawlo.egg-info/requires.txt 2025-09-26T20:29:43,782 writing top-level names to crawlo.egg-info/top_level.txt 2025-09-26T20:29:43,849 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:43,866 reading manifest template 'MANIFEST.in' 2025-09-26T20:29:43,867 warning: no files found matching 'VERSION' 2025-09-26T20:29:43,868 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-26T20:29:43,925 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-26T20:29:43,927 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-26T20:29:43,929 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-26T20:29:43,931 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-26T20:29:43,933 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-26T20:29:43,935 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-26T20:29:43,937 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-26T20:29:43,939 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-26T20:29:43,940 no previously-included directories found matching 'samples' 2025-09-26T20:29:43,941 no previously-included directories found matching 'docs' 2025-09-26T20:29:43,959 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:44,053 Getting requirements to build wheel: finished with status 'done' 2025-09-26T20:29:44,056 Created temporary directory: /tmp/pip-modern-metadata-x7lx1ptl 2025-09-26T20:29:44,059 Preparing metadata (pyproject.toml): started 2025-09-26T20:29:44,060 Running command Preparing metadata (pyproject.toml) 2025-09-26T20:29:44,866 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-26T20:29:44,866 !! 2025-09-26T20:29:44,867 ******************************************************************************** 2025-09-26T20:29:44,868 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-26T20:29:44,870 License :: OSI Approved :: MIT License 2025-09-26T20:29:44,871 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-26T20:29:44,871 ******************************************************************************** 2025-09-26T20:29:44,872 !! 2025-09-26T20:29:44,873 self._finalize_license_expression() 2025-09-26T20:29:44,893 running dist_info 2025-09-26T20:29:44,905 creating /tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info 2025-09-26T20:29:44,906 writing /tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/PKG-INFO 2025-09-26T20:29:44,916 writing dependency_links to /tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/dependency_links.txt 2025-09-26T20:29:44,918 writing entry points to /tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/entry_points.txt 2025-09-26T20:29:44,922 writing requirements to /tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/requires.txt 2025-09-26T20:29:44,924 writing top-level names to /tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/top_level.txt 2025-09-26T20:29:44,925 writing manifest file '/tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:44,985 reading manifest file '/tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:44,988 reading manifest template 'MANIFEST.in' 2025-09-26T20:29:44,989 warning: no files found matching 'VERSION' 2025-09-26T20:29:44,989 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-26T20:29:45,047 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-26T20:29:45,048 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-26T20:29:45,049 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-26T20:29:45,050 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-26T20:29:45,052 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-26T20:29:45,053 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-26T20:29:45,054 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-26T20:29:45,056 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-26T20:29:45,057 no previously-included directories found matching 'samples' 2025-09-26T20:29:45,057 no previously-included directories found matching 'docs' 2025-09-26T20:29:45,071 writing manifest file '/tmp/pip-modern-metadata-x7lx1ptl/crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:45,073 creating '/tmp/pip-modern-metadata-x7lx1ptl/crawlo-1.3.9.dist-info' 2025-09-26T20:29:45,214 Preparing metadata (pyproject.toml): finished with status 'done' 2025-09-26T20:29:45,222 Source in /tmp/pip-wheel-jeduxfoe/crawlo_de6cf403c6e64a39a3ea579d690fc8bd has version 1.3.9, which satisfies requirement crawlo==1.3.9 from https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz 2025-09-26T20:29:45,223 Removed crawlo==1.3.9 from https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz from build tracker '/tmp/pip-build-tracker-t7cc3q4_' 2025-09-26T20:29:45,234 Created temporary directory: /tmp/pip-unpack-tueexd_5 2025-09-26T20:29:45,235 Building wheels for collected packages: crawlo 2025-09-26T20:29:45,239 Created temporary directory: /tmp/pip-wheel-ekba1i2e 2025-09-26T20:29:45,239 Destination directory: /tmp/pip-wheel-ekba1i2e 2025-09-26T20:29:45,241 Building wheel for crawlo (pyproject.toml): started 2025-09-26T20:29:45,243 Running command Building wheel for crawlo (pyproject.toml) 2025-09-26T20:29:45,794 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-26T20:29:45,794 !! 2025-09-26T20:29:45,795 ******************************************************************************** 2025-09-26T20:29:45,796 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-26T20:29:45,797 License :: OSI Approved :: MIT License 2025-09-26T20:29:45,798 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-26T20:29:45,799 ******************************************************************************** 2025-09-26T20:29:45,800 !! 2025-09-26T20:29:45,800 self._finalize_license_expression() 2025-09-26T20:29:45,824 running bdist_wheel 2025-09-26T20:29:45,854 running build 2025-09-26T20:29:45,855 running build_py 2025-09-26T20:29:45,865 creating build/lib/crawlo 2025-09-26T20:29:45,867 copying crawlo/stats_collector.py -> build/lib/crawlo 2025-09-26T20:29:45,869 copying crawlo/framework.py -> build/lib/crawlo 2025-09-26T20:29:45,872 copying crawlo/task_manager.py -> build/lib/crawlo 2025-09-26T20:29:45,874 copying crawlo/event.py -> build/lib/crawlo 2025-09-26T20:29:45,876 copying crawlo/config.py -> build/lib/crawlo 2025-09-26T20:29:45,879 copying crawlo/config_validator.py -> build/lib/crawlo 2025-09-26T20:29:45,881 copying crawlo/subscriber.py -> build/lib/crawlo 2025-09-26T20:29:45,883 copying crawlo/__init__.py -> build/lib/crawlo 2025-09-26T20:29:45,885 copying crawlo/crawler.py -> build/lib/crawlo 2025-09-26T20:29:45,888 copying crawlo/mode_manager.py -> build/lib/crawlo 2025-09-26T20:29:45,890 copying crawlo/__version__.py -> build/lib/crawlo 2025-09-26T20:29:45,892 copying crawlo/exceptions.py -> build/lib/crawlo 2025-09-26T20:29:45,894 copying crawlo/cli.py -> build/lib/crawlo 2025-09-26T20:29:45,896 copying crawlo/project.py -> build/lib/crawlo 2025-09-26T20:29:45,899 creating build/lib/examples 2025-09-26T20:29:45,900 copying examples/__init__.py -> build/lib/examples 2025-09-26T20:29:45,905 creating build/lib/tests 2025-09-26T20:29:45,906 copying tests/test_response_code_middleware.py -> build/lib/tests 2025-09-26T20:29:45,909 copying tests/test_distributed.py -> build/lib/tests 2025-09-26T20:29:45,911 copying tests/test_redis_key_naming.py -> build/lib/tests 2025-09-26T20:29:45,913 copying tests/test_framework_startup.py -> build/lib/tests 2025-09-26T20:29:45,915 copying tests/date_tools_example.py -> build/lib/tests 2025-09-26T20:29:45,917 copying tests/test_controlled_spider_mixin.py -> build/lib/tests 2025-09-26T20:29:45,919 copying tests/redis_key_validation_demo.py -> build/lib/tests 2025-09-26T20:29:45,921 copying tests/test_env_config.py -> build/lib/tests 2025-09-26T20:29:45,924 copying tests/test_request_ignore_middleware.py -> build/lib/tests 2025-09-26T20:29:45,926 copying tests/tools_example.py -> build/lib/tests 2025-09-26T20:29:45,929 copying tests/response_improvements_example.py -> build/lib/tests 2025-09-26T20:29:45,931 copying tests/test_config_consistency.py -> build/lib/tests 2025-09-26T20:29:45,933 copying tests/test_simple_response.py -> build/lib/tests 2025-09-26T20:29:45,935 copying tests/verify_log_fix.py -> build/lib/tests 2025-09-26T20:29:45,937 copying tests/test_user_agents.py -> build/lib/tests 2025-09-26T20:29:45,939 copying tests/test_tools.py -> build/lib/tests 2025-09-26T20:29:45,941 copying tests/simple_spider_test.py -> build/lib/tests 2025-09-26T20:29:45,943 copying tests/test_enhanced_error_handler_comprehensive.py -> build/lib/tests 2025-09-26T20:29:45,946 copying tests/test_proxy_middleware_enhanced.py -> build/lib/tests 2025-09-26T20:29:45,948 copying tests/log_generation_timing_test.py -> build/lib/tests 2025-09-26T20:29:45,950 copying tests/spider_log_timing_test.py -> build/lib/tests 2025-09-26T20:29:45,952 copying tests/test_performance_monitor.py -> build/lib/tests 2025-09-26T20:29:45,954 copying tests/test_all_redis_key_configs.py -> build/lib/tests 2025-09-26T20:29:45,956 copying tests/test_proxy_middleware.py -> build/lib/tests 2025-09-26T20:29:45,958 copying tests/test_performance.py -> build/lib/tests 2025-09-26T20:29:45,961 copying tests/test_authenticated_proxy.py -> build/lib/tests 2025-09-26T20:29:45,963 copying tests/test_error_handler_compatibility.py -> build/lib/tests 2025-09-26T20:29:45,965 copying tests/test_integration.py -> build/lib/tests 2025-09-26T20:29:45,967 copying tests/test_retry_middleware.py -> build/lib/tests 2025-09-26T20:29:45,970 copying tests/test_queue_empty_check.py -> build/lib/tests 2025-09-26T20:29:45,971 copying tests/test_mode_change.py -> build/lib/tests 2025-09-26T20:29:45,973 copying tests/simple_crawlo_test.py -> build/lib/tests 2025-09-26T20:29:45,976 copying tests/simple_test.py -> build/lib/tests 2025-09-26T20:29:45,978 copying tests/comprehensive_test.py -> build/lib/tests 2025-09-26T20:29:45,979 copying tests/optimized_performance_test.py -> build/lib/tests 2025-09-26T20:29:45,982 copying tests/test_config_validator.py -> build/lib/tests 2025-09-26T20:29:45,984 copying tests/test_all_commands.py -> build/lib/tests 2025-09-26T20:29:45,987 copying tests/test_proxy_strategies.py -> build/lib/tests 2025-09-26T20:29:45,989 copying tests/test_redis_config.py -> build/lib/tests 2025-09-26T20:29:45,991 copying tests/dynamic_loading_test.py -> build/lib/tests 2025-09-26T20:29:45,993 copying tests/test_redis_queue_name_fix.py -> build/lib/tests 2025-09-26T20:29:45,995 copying tests/test_framework_logger.py -> build/lib/tests 2025-09-26T20:29:45,997 copying tests/test_dynamic_proxy_real.py -> build/lib/tests 2025-09-26T20:29:45,999 copying tests/test_telecom_spider_redis_key.py -> build/lib/tests 2025-09-26T20:29:46,002 copying tests/distributed_test_debug.py -> build/lib/tests 2025-09-26T20:29:46,004 copying tests/simple_optimization_test.py -> build/lib/tests 2025-09-26T20:29:46,006 copying tests/test_proxy_middleware_integration.py -> build/lib/tests 2025-09-26T20:29:46,008 copying tests/test_dedup_fix.py -> build/lib/tests 2025-09-26T20:29:46,011 copying tests/final_validation_test.py -> build/lib/tests 2025-09-26T20:29:46,013 copying tests/debug_log_config.py -> build/lib/tests 2025-09-26T20:29:46,015 copying tests/test_random_user_agent.py -> build/lib/tests 2025-09-26T20:29:46,017 copying tests/verify_distributed.py -> build/lib/tests 2025-09-26T20:29:46,019 copying tests/test_scheduler.py -> build/lib/tests 2025-09-26T20:29:46,022 copying tests/test_downloader_proxy_compatibility.py -> build/lib/tests 2025-09-26T20:29:46,025 copying tests/dynamic_loading_example.py -> build/lib/tests 2025-09-26T20:29:46,029 copying tests/test_date_tools.py -> build/lib/tests 2025-09-26T20:29:46,031 copying tests/test_dynamic_downloaders_proxy.py -> build/lib/tests 2025-09-26T20:29:46,033 copying tests/test_framework_env_usage.py -> build/lib/tests 2025-09-26T20:29:46,035 copying tests/final_comprehensive_test.py -> build/lib/tests 2025-09-26T20:29:46,037 copying tests/test_redis_queue.py -> build/lib/tests 2025-09-26T20:29:46,040 copying tests/request_params_example.py -> build/lib/tests 2025-09-26T20:29:46,042 copying tests/debug_framework_logger.py -> build/lib/tests 2025-09-26T20:29:46,044 copying tests/test_request_params.py -> build/lib/tests 2025-09-26T20:29:46,046 copying tests/test_final_validation.py -> build/lib/tests 2025-09-26T20:29:46,048 copying tests/test_dynamic_proxy_config.py -> build/lib/tests 2025-09-26T20:29:46,051 copying tests/test_proxy_api.py -> build/lib/tests 2025-09-26T20:29:46,053 copying tests/env_config_example.py -> build/lib/tests 2025-09-26T20:29:46,055 copying tests/error_handling_example.py -> build/lib/tests 2025-09-26T20:29:46,057 copying tests/final_log_test.py -> build/lib/tests 2025-09-26T20:29:46,060 copying tests/__init__.py -> build/lib/tests 2025-09-26T20:29:46,062 copying tests/test_request_serialization.py -> build/lib/tests 2025-09-26T20:29:46,064 copying tests/framework_performance_test.py -> build/lib/tests 2025-09-26T20:29:46,066 copying tests/test_queue_manager_double_crawlo.py -> build/lib/tests 2025-09-26T20:29:46,068 copying tests/test_proxy_middleware_refactored.py -> build/lib/tests 2025-09-26T20:29:46,071 copying tests/verify_debug.py -> build/lib/tests 2025-09-26T20:29:46,073 copying tests/test_advanced_tools.py -> build/lib/tests 2025-09-26T20:29:46,075 copying tests/test_queue_type.py -> build/lib/tests 2025-09-26T20:29:46,077 copying tests/config_validation_demo.py -> build/lib/tests 2025-09-26T20:29:46,079 copying tests/test_cleaners.py -> build/lib/tests 2025-09-26T20:29:46,081 copying tests/test_mode_consistency.py -> build/lib/tests 2025-09-26T20:29:46,083 copying tests/simple_log_test2.py -> build/lib/tests 2025-09-26T20:29:46,085 copying tests/test_edge_cases.py -> build/lib/tests 2025-09-26T20:29:46,087 copying tests/test_proxy_stats.py -> build/lib/tests 2025-09-26T20:29:46,089 copying tests/test_large_scale_config.py -> build/lib/tests 2025-09-26T20:29:46,091 copying tests/test_component_factory.py -> build/lib/tests 2025-09-26T20:29:46,094 copying tests/cleaners_example.py -> build/lib/tests 2025-09-26T20:29:46,096 copying tests/debug_log_levels.py -> build/lib/tests 2025-09-26T20:29:46,098 copying tests/test_template_content.py -> build/lib/tests 2025-09-26T20:29:46,100 copying tests/comprehensive_framework_test.py -> build/lib/tests 2025-09-26T20:29:46,103 copying tests/queue_blocking_test.py -> build/lib/tests 2025-09-26T20:29:46,105 copying tests/test_queue_naming.py -> build/lib/tests 2025-09-26T20:29:46,107 copying tests/test_double_crawlo_fix.py -> build/lib/tests 2025-09-26T20:29:46,109 copying tests/queue_test.py -> build/lib/tests 2025-09-26T20:29:46,111 copying tests/test_crawlo_proxy_integration.py -> build/lib/tests 2025-09-26T20:29:46,113 copying tests/test_double_crawlo_fix_simple.py -> build/lib/tests 2025-09-26T20:29:46,115 copying tests/performance_comparison.py -> build/lib/tests 2025-09-26T20:29:46,118 copying tests/test_queue_manager_redis_key.py -> build/lib/tests 2025-09-26T20:29:46,120 copying tests/detailed_log_test.py -> build/lib/tests 2025-09-26T20:29:46,122 copying tests/baidu_test.py -> build/lib/tests 2025-09-26T20:29:46,124 copying tests/test_proxy_health_check.py -> build/lib/tests 2025-09-26T20:29:46,126 copying tests/test_logging_system.py -> build/lib/tests 2025-09-26T20:29:46,129 copying tests/test_response_improvements.py -> build/lib/tests 2025-09-26T20:29:46,131 copying tests/test_batch_processor.py -> build/lib/tests 2025-09-26T20:29:46,134 copying tests/test_redis_key_validator.py -> build/lib/tests 2025-09-26T20:29:46,136 copying tests/debug_configure.py -> build/lib/tests 2025-09-26T20:29:46,138 copying tests/test_offsite_middleware.py -> build/lib/tests 2025-09-26T20:29:46,140 copying tests/test_enhanced_error_handler.py -> build/lib/tests 2025-09-26T20:29:46,143 copying tests/advanced_tools_example.py -> build/lib/tests 2025-09-26T20:29:46,146 copying tests/test_scheduler_config_update.py -> build/lib/tests 2025-09-26T20:29:46,148 copying tests/test_parsel.py -> build/lib/tests 2025-09-26T20:29:46,150 copying tests/debug_pipelines.py -> build/lib/tests 2025-09-26T20:29:46,152 copying tests/test_template_redis_key.py -> build/lib/tests 2025-09-26T20:29:46,154 copying tests/test_config_merge.py -> build/lib/tests 2025-09-26T20:29:46,157 copying tests/test_default_header_middleware.py -> build/lib/tests 2025-09-26T20:29:46,159 copying tests/test_large_scale_helper.py -> build/lib/tests 2025-09-26T20:29:46,161 copying tests/controlled_spider_example.py -> build/lib/tests 2025-09-26T20:29:46,164 copying tests/simple_queue_type_test.py -> build/lib/tests 2025-09-26T20:29:46,165 copying tests/test_factories.py -> build/lib/tests 2025-09-26T20:29:46,168 copying tests/test_proxy_providers.py -> build/lib/tests 2025-09-26T20:29:46,170 copying tests/authenticated_proxy_example.py -> build/lib/tests 2025-09-26T20:29:46,172 copying tests/test_get_component_logger.py -> build/lib/tests 2025-09-26T20:29:46,174 copying tests/test_download_delay_middleware.py -> build/lib/tests 2025-09-26T20:29:46,176 copying tests/simple_log_test.py -> build/lib/tests 2025-09-26T20:29:46,178 copying tests/test_real_scenario_proxy.py -> build/lib/tests 2025-09-26T20:29:46,180 copying tests/test_comprehensive.py -> build/lib/tests 2025-09-26T20:29:46,183 copying tests/test_item_dedup_redis_key.py -> build/lib/tests 2025-09-26T20:29:46,185 copying tests/simple_command_test.py -> build/lib/tests 2025-09-26T20:29:46,186 copying tests/log_buffering_test.py -> build/lib/tests 2025-09-26T20:29:46,188 copying tests/distributed_test.py -> build/lib/tests 2025-09-26T20:29:46,190 copying tests/baidu_performance_test.py -> build/lib/tests 2025-09-26T20:29:46,192 copying tests/test_redis_connection_pool.py -> build/lib/tests 2025-09-26T20:29:46,194 copying tests/test_dynamic_proxy.py -> build/lib/tests 2025-09-26T20:29:46,196 copying tests/test_response_filter_middleware.py -> build/lib/tests 2025-09-26T20:29:46,199 copying tests/fix_log_test.py -> build/lib/tests 2025-09-26T20:29:46,201 creating build/lib/crawlo/data 2025-09-26T20:29:46,202 copying crawlo/data/__init__.py -> build/lib/crawlo/data 2025-09-26T20:29:46,204 copying crawlo/data/user_agents.py -> build/lib/crawlo/data 2025-09-26T20:29:46,207 creating build/lib/crawlo/settings 2025-09-26T20:29:46,208 copying crawlo/settings/default_settings.py -> build/lib/crawlo/settings 2025-09-26T20:29:46,211 copying crawlo/settings/__init__.py -> build/lib/crawlo/settings 2025-09-26T20:29:46,213 copying crawlo/settings/setting_manager.py -> build/lib/crawlo/settings 2025-09-26T20:29:46,216 creating build/lib/crawlo/pipelines 2025-09-26T20:29:46,217 copying crawlo/pipelines/bloom_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,219 copying crawlo/pipelines/pipeline_manager.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,221 copying crawlo/pipelines/redis_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,224 copying crawlo/pipelines/json_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,226 copying crawlo/pipelines/mysql_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,228 copying crawlo/pipelines/memory_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,230 copying crawlo/pipelines/__init__.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,232 copying crawlo/pipelines/console_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,234 copying crawlo/pipelines/database_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,237 copying crawlo/pipelines/mongo_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,239 copying crawlo/pipelines/csv_pipeline.py -> build/lib/crawlo/pipelines 2025-09-26T20:29:46,242 creating build/lib/crawlo/commands 2025-09-26T20:29:46,244 copying crawlo/commands/list.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,247 copying crawlo/commands/help.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,249 copying crawlo/commands/check.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,252 copying crawlo/commands/__init__.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,254 copying crawlo/commands/stats.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,257 copying crawlo/commands/utils.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,259 copying crawlo/commands/genspider.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,262 copying crawlo/commands/run.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,264 copying crawlo/commands/startproject.py -> build/lib/crawlo/commands 2025-09-26T20:29:46,267 creating build/lib/crawlo/network 2025-09-26T20:29:46,268 copying crawlo/network/response.py -> build/lib/crawlo/network 2025-09-26T20:29:46,271 copying crawlo/network/__init__.py -> build/lib/crawlo/network 2025-09-26T20:29:46,273 copying crawlo/network/request.py -> build/lib/crawlo/network 2025-09-26T20:29:46,277 creating build/lib/crawlo/utils 2025-09-26T20:29:46,278 copying crawlo/utils/error_handler.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,280 copying crawlo/utils/class_loader.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,282 copying crawlo/utils/performance_monitor.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,285 copying crawlo/utils/redis_connection_pool.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,287 copying crawlo/utils/batch_processor.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,290 copying crawlo/utils/env_config.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,292 copying crawlo/utils/db_helper.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,295 copying crawlo/utils/spider_loader.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,297 copying crawlo/utils/redis_key_validator.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,299 copying crawlo/utils/controlled_spider_mixin.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,302 copying crawlo/utils/request_serializer.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,305 copying crawlo/utils/__init__.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,307 copying crawlo/utils/request.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,310 copying crawlo/utils/large_scale_config.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,312 copying crawlo/utils/log.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,314 copying crawlo/utils/tools.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,316 copying crawlo/utils/enhanced_error_handler.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,319 copying crawlo/utils/url.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,321 copying crawlo/utils/func_tools.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,323 copying crawlo/utils/queue_helper.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,325 copying crawlo/utils/system.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,327 copying crawlo/utils/large_scale_helper.py -> build/lib/crawlo/utils 2025-09-26T20:29:46,330 creating build/lib/crawlo/core 2025-09-26T20:29:46,331 copying crawlo/core/scheduler.py -> build/lib/crawlo/core 2025-09-26T20:29:46,334 copying crawlo/core/__init__.py -> build/lib/crawlo/core 2025-09-26T20:29:46,336 copying crawlo/core/engine.py -> build/lib/crawlo/core 2025-09-26T20:29:46,339 copying crawlo/core/processor.py -> build/lib/crawlo/core 2025-09-26T20:29:46,342 creating build/lib/crawlo/logging 2025-09-26T20:29:46,343 copying crawlo/logging/config.py -> build/lib/crawlo/logging 2025-09-26T20:29:46,345 copying crawlo/logging/factory.py -> build/lib/crawlo/logging 2025-09-26T20:29:46,347 copying crawlo/logging/__init__.py -> build/lib/crawlo/logging 2025-09-26T20:29:46,349 copying crawlo/logging/manager.py -> build/lib/crawlo/logging 2025-09-26T20:29:46,352 creating build/lib/crawlo/items 2025-09-26T20:29:46,353 copying crawlo/items/base.py -> build/lib/crawlo/items 2025-09-26T20:29:46,355 copying crawlo/items/__init__.py -> build/lib/crawlo/items 2025-09-26T20:29:46,357 copying crawlo/items/fields.py -> build/lib/crawlo/items 2025-09-26T20:29:46,359 copying crawlo/items/items.py -> build/lib/crawlo/items 2025-09-26T20:29:46,362 creating build/lib/crawlo/initialization 2025-09-26T20:29:46,363 copying crawlo/initialization/__init__.py -> build/lib/crawlo/initialization 2025-09-26T20:29:46,365 copying crawlo/initialization/registry.py -> build/lib/crawlo/initialization 2025-09-26T20:29:46,368 copying crawlo/initialization/context.py -> build/lib/crawlo/initialization 2025-09-26T20:29:46,370 copying crawlo/initialization/core.py -> build/lib/crawlo/initialization 2025-09-26T20:29:46,372 copying crawlo/initialization/phases.py -> build/lib/crawlo/initialization 2025-09-26T20:29:46,375 copying crawlo/initialization/built_in.py -> build/lib/crawlo/initialization 2025-09-26T20:29:46,378 creating build/lib/crawlo/factories 2025-09-26T20:29:46,379 copying crawlo/factories/base.py -> build/lib/crawlo/factories 2025-09-26T20:29:46,381 copying crawlo/factories/__init__.py -> build/lib/crawlo/factories 2025-09-26T20:29:46,383 copying crawlo/factories/crawler.py -> build/lib/crawlo/factories 2025-09-26T20:29:46,385 copying crawlo/factories/registry.py -> build/lib/crawlo/factories 2025-09-26T20:29:46,388 creating build/lib/crawlo/middleware 2025-09-26T20:29:46,389 copying crawlo/middleware/offsite.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,391 copying crawlo/middleware/response_code.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,394 copying crawlo/middleware/retry.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,396 copying crawlo/middleware/middleware_manager.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,398 copying crawlo/middleware/default_header.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,401 copying crawlo/middleware/download_delay.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,403 copying crawlo/middleware/proxy.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,406 copying crawlo/middleware/__init__.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,408 copying crawlo/middleware/simple_proxy.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,410 copying crawlo/middleware/request_ignore.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,413 copying crawlo/middleware/response_filter.py -> build/lib/crawlo/middleware 2025-09-26T20:29:46,416 creating build/lib/crawlo/downloader 2025-09-26T20:29:46,417 copying crawlo/downloader/aiohttp_downloader.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,420 copying crawlo/downloader/playwright_downloader.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,423 copying crawlo/downloader/httpx_downloader.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,425 copying crawlo/downloader/__init__.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,427 copying crawlo/downloader/cffi_downloader.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,430 copying crawlo/downloader/hybrid_downloader.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,433 copying crawlo/downloader/selenium_downloader.py -> build/lib/crawlo/downloader 2025-09-26T20:29:46,436 creating build/lib/crawlo/queue 2025-09-26T20:29:46,437 copying crawlo/queue/queue_manager.py -> build/lib/crawlo/queue 2025-09-26T20:29:46,440 copying crawlo/queue/redis_priority_queue.py -> build/lib/crawlo/queue 2025-09-26T20:29:46,443 copying crawlo/queue/__init__.py -> build/lib/crawlo/queue 2025-09-26T20:29:46,445 copying crawlo/queue/pqueue.py -> build/lib/crawlo/queue 2025-09-26T20:29:46,447 creating build/lib/crawlo/extension 2025-09-26T20:29:46,448 copying crawlo/extension/log_stats.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,450 copying crawlo/extension/performance_profiler.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,453 copying crawlo/extension/health_check.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,455 copying crawlo/extension/memory_monitor.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,457 copying crawlo/extension/__init__.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,459 copying crawlo/extension/request_recorder.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,461 copying crawlo/extension/logging_extension.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,464 copying crawlo/extension/log_interval.py -> build/lib/crawlo/extension 2025-09-26T20:29:46,466 creating build/lib/crawlo/filters 2025-09-26T20:29:46,467 copying crawlo/filters/__init__.py -> build/lib/crawlo/filters 2025-09-26T20:29:46,469 copying crawlo/filters/memory_filter.py -> build/lib/crawlo/filters 2025-09-26T20:29:46,472 copying crawlo/filters/aioredis_filter.py -> build/lib/crawlo/filters 2025-09-26T20:29:46,475 creating build/lib/crawlo/tools 2025-09-26T20:29:46,476 copying crawlo/tools/anti_crawler.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,479 copying crawlo/tools/network_diagnostic.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,481 copying crawlo/tools/text_cleaner.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,484 copying crawlo/tools/authenticated_proxy.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,486 copying crawlo/tools/encoding_converter.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,489 copying crawlo/tools/__init__.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,491 copying crawlo/tools/request_tools.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,494 copying crawlo/tools/distributed_coordinator.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,497 copying crawlo/tools/retry_mechanism.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,499 copying crawlo/tools/date_tools.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,501 copying crawlo/tools/scenario_adapter.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,504 copying crawlo/tools/data_formatter.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,506 copying crawlo/tools/data_validator.py -> build/lib/crawlo/tools 2025-09-26T20:29:46,509 creating build/lib/crawlo/spider 2025-09-26T20:29:46,510 copying crawlo/spider/__init__.py -> build/lib/crawlo/spider 2025-09-26T20:29:46,513 running egg_info 2025-09-26T20:29:46,527 writing crawlo.egg-info/PKG-INFO 2025-09-26T20:29:46,537 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-09-26T20:29:46,538 writing entry points to crawlo.egg-info/entry_points.txt 2025-09-26T20:29:46,543 writing requirements to crawlo.egg-info/requires.txt 2025-09-26T20:29:46,544 writing top-level names to crawlo.egg-info/top_level.txt 2025-09-26T20:29:46,588 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:46,604 reading manifest template 'MANIFEST.in' 2025-09-26T20:29:46,605 warning: no files found matching 'VERSION' 2025-09-26T20:29:46,606 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-26T20:29:46,667 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-26T20:29:46,668 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-26T20:29:46,670 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-26T20:29:46,672 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-26T20:29:46,674 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-26T20:29:46,676 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-26T20:29:46,678 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-26T20:29:46,679 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-26T20:29:46,681 no previously-included directories found matching 'samples' 2025-09-26T20:29:46,682 no previously-included directories found matching 'docs' 2025-09-26T20:29:46,700 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-26T20:29:46,704 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates' is absent from the `packages` configuration. 2025-09-26T20:29:46,705 !! 2025-09-26T20:29:46,706 ******************************************************************************** 2025-09-26T20:29:46,707 ############################ 2025-09-26T20:29:46,708 # Package would be ignored # 2025-09-26T20:29:46,708 ############################ 2025-09-26T20:29:46,708 Python recognizes 'crawlo.templates' as an importable package[^1], 2025-09-26T20:29:46,709 but it is absent from setuptools' `packages` configuration. 2025-09-26T20:29:46,710 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-26T20:29:46,710 package, please make sure that 'crawlo.templates' is explicitly added 2025-09-26T20:29:46,711 to the `packages` configuration field. 2025-09-26T20:29:46,711 Alternatively, you can also rely on setuptools' discovery methods 2025-09-26T20:29:46,712 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-26T20:29:46,712 instead of `find_packages(...)`/`find:`). 2025-09-26T20:29:46,713 You can read more about "package discovery" on setuptools documentation page: 2025-09-26T20:29:46,714 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-26T20:29:46,715 If you don't want 'crawlo.templates' to be distributed and are 2025-09-26T20:29:46,715 already explicitly excluding 'crawlo.templates' via 2025-09-26T20:29:46,716 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-26T20:29:46,716 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-26T20:29:46,717 combination with a more fine grained `package-data` configuration. 2025-09-26T20:29:46,718 You can read more about "package data files" on setuptools documentation page: 2025-09-26T20:29:46,719 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-26T20:29:46,720 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-26T20:29:46,721 even if it does not contain any `.py` files. 2025-09-26T20:29:46,722 On the other hand, currently there is no concept of package data 2025-09-26T20:29:46,722 directory, all directories are treated like packages. 2025-09-26T20:29:46,723 ******************************************************************************** 2025-09-26T20:29:46,724 !! 2025-09-26T20:29:46,725 check.warn(importable) 2025-09-26T20:29:46,725 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project' is absent from the `packages` configuration. 2025-09-26T20:29:46,726 !! 2025-09-26T20:29:46,727 ******************************************************************************** 2025-09-26T20:29:46,728 ############################ 2025-09-26T20:29:46,728 # Package would be ignored # 2025-09-26T20:29:46,729 ############################ 2025-09-26T20:29:46,729 Python recognizes 'crawlo.templates.project' as an importable package[^1], 2025-09-26T20:29:46,730 but it is absent from setuptools' `packages` configuration. 2025-09-26T20:29:46,731 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-26T20:29:46,732 package, please make sure that 'crawlo.templates.project' is explicitly added 2025-09-26T20:29:46,733 to the `packages` configuration field. 2025-09-26T20:29:46,734 Alternatively, you can also rely on setuptools' discovery methods 2025-09-26T20:29:46,735 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-26T20:29:46,736 instead of `find_packages(...)`/`find:`). 2025-09-26T20:29:46,737 You can read more about "package discovery" on setuptools documentation page: 2025-09-26T20:29:46,738 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-26T20:29:46,740 If you don't want 'crawlo.templates.project' to be distributed and are 2025-09-26T20:29:46,740 already explicitly excluding 'crawlo.templates.project' via 2025-09-26T20:29:46,741 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-26T20:29:46,741 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-26T20:29:46,742 combination with a more fine grained `package-data` configuration. 2025-09-26T20:29:46,743 You can read more about "package data files" on setuptools documentation page: 2025-09-26T20:29:46,744 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-26T20:29:46,746 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-26T20:29:46,746 even if it does not contain any `.py` files. 2025-09-26T20:29:46,747 On the other hand, currently there is no concept of package data 2025-09-26T20:29:46,747 directory, all directories are treated like packages. 2025-09-26T20:29:46,748 ******************************************************************************** 2025-09-26T20:29:46,748 !! 2025-09-26T20:29:46,749 check.warn(importable) 2025-09-26T20:29:46,749 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project.spiders' is absent from the `packages` configuration. 2025-09-26T20:29:46,750 !! 2025-09-26T20:29:46,751 ******************************************************************************** 2025-09-26T20:29:46,751 ############################ 2025-09-26T20:29:46,752 # Package would be ignored # 2025-09-26T20:29:46,752 ############################ 2025-09-26T20:29:46,753 Python recognizes 'crawlo.templates.project.spiders' as an importable package[^1], 2025-09-26T20:29:46,754 but it is absent from setuptools' `packages` configuration. 2025-09-26T20:29:46,755 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-26T20:29:46,755 package, please make sure that 'crawlo.templates.project.spiders' is explicitly added 2025-09-26T20:29:46,756 to the `packages` configuration field. 2025-09-26T20:29:46,757 Alternatively, you can also rely on setuptools' discovery methods 2025-09-26T20:29:46,758 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-26T20:29:46,758 instead of `find_packages(...)`/`find:`). 2025-09-26T20:29:46,759 You can read more about "package discovery" on setuptools documentation page: 2025-09-26T20:29:46,760 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-26T20:29:46,761 If you don't want 'crawlo.templates.project.spiders' to be distributed and are 2025-09-26T20:29:46,762 already explicitly excluding 'crawlo.templates.project.spiders' via 2025-09-26T20:29:46,763 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-26T20:29:46,763 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-26T20:29:46,764 combination with a more fine grained `package-data` configuration. 2025-09-26T20:29:46,765 You can read more about "package data files" on setuptools documentation page: 2025-09-26T20:29:46,766 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-26T20:29:46,768 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-26T20:29:46,768 even if it does not contain any `.py` files. 2025-09-26T20:29:46,769 On the other hand, currently there is no concept of package data 2025-09-26T20:29:46,769 directory, all directories are treated like packages. 2025-09-26T20:29:46,770 ******************************************************************************** 2025-09-26T20:29:46,771 !! 2025-09-26T20:29:46,772 check.warn(importable) 2025-09-26T20:29:46,772 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.spider' is absent from the `packages` configuration. 2025-09-26T20:29:46,773 !! 2025-09-26T20:29:46,774 ******************************************************************************** 2025-09-26T20:29:46,774 ############################ 2025-09-26T20:29:46,775 # Package would be ignored # 2025-09-26T20:29:46,775 ############################ 2025-09-26T20:29:46,776 Python recognizes 'crawlo.templates.spider' as an importable package[^1], 2025-09-26T20:29:46,776 but it is absent from setuptools' `packages` configuration. 2025-09-26T20:29:46,777 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-26T20:29:46,778 package, please make sure that 'crawlo.templates.spider' is explicitly added 2025-09-26T20:29:46,778 to the `packages` configuration field. 2025-09-26T20:29:46,779 Alternatively, you can also rely on setuptools' discovery methods 2025-09-26T20:29:46,780 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-26T20:29:46,781 instead of `find_packages(...)`/`find:`). 2025-09-26T20:29:46,781 You can read more about "package discovery" on setuptools documentation page: 2025-09-26T20:29:46,782 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-26T20:29:46,783 If you don't want 'crawlo.templates.spider' to be distributed and are 2025-09-26T20:29:46,784 already explicitly excluding 'crawlo.templates.spider' via 2025-09-26T20:29:46,784 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-26T20:29:46,785 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-26T20:29:46,786 combination with a more fine grained `package-data` configuration. 2025-09-26T20:29:46,787 You can read more about "package data files" on setuptools documentation page: 2025-09-26T20:29:46,788 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-26T20:29:46,789 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-26T20:29:46,790 even if it does not contain any `.py` files. 2025-09-26T20:29:46,791 On the other hand, currently there is no concept of package data 2025-09-26T20:29:46,791 directory, all directories are treated like packages. 2025-09-26T20:29:46,792 ******************************************************************************** 2025-09-26T20:29:46,793 !! 2025-09-26T20:29:46,794 check.warn(importable) 2025-09-26T20:29:46,794 /tmp/pip-build-env-jl9a3h34/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.scrapy_comparison' is absent from the `packages` configuration. 2025-09-26T20:29:46,795 !! 2025-09-26T20:29:46,796 ******************************************************************************** 2025-09-26T20:29:46,797 ############################ 2025-09-26T20:29:46,797 # Package would be ignored # 2025-09-26T20:29:46,798 ############################ 2025-09-26T20:29:46,798 Python recognizes 'tests.scrapy_comparison' as an importable package[^1], 2025-09-26T20:29:46,799 but it is absent from setuptools' `packages` configuration. 2025-09-26T20:29:46,800 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-26T20:29:46,801 package, please make sure that 'tests.scrapy_comparison' is explicitly added 2025-09-26T20:29:46,801 to the `packages` configuration field. 2025-09-26T20:29:46,803 Alternatively, you can also rely on setuptools' discovery methods 2025-09-26T20:29:46,803 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-26T20:29:46,804 instead of `find_packages(...)`/`find:`). 2025-09-26T20:29:46,805 You can read more about "package discovery" on setuptools documentation page: 2025-09-26T20:29:46,806 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-26T20:29:46,806 If you don't want 'tests.scrapy_comparison' to be distributed and are 2025-09-26T20:29:46,807 already explicitly excluding 'tests.scrapy_comparison' via 2025-09-26T20:29:46,807 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-26T20:29:46,808 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-26T20:29:46,808 combination with a more fine grained `package-data` configuration. 2025-09-26T20:29:46,809 You can read more about "package data files" on setuptools documentation page: 2025-09-26T20:29:46,810 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-26T20:29:46,812 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-26T20:29:46,812 even if it does not contain any `.py` files. 2025-09-26T20:29:46,813 On the other hand, currently there is no concept of package data 2025-09-26T20:29:46,813 directory, all directories are treated like packages. 2025-09-26T20:29:46,814 ******************************************************************************** 2025-09-26T20:29:46,816 !! 2025-09-26T20:29:46,817 check.warn(importable) 2025-09-26T20:29:46,818 creating build/lib/crawlo/templates 2025-09-26T20:29:46,819 copying crawlo/templates/crawlo.cfg.tmpl -> build/lib/crawlo/templates 2025-09-26T20:29:46,819 copying crawlo/templates/run.py.tmpl -> build/lib/crawlo/templates 2025-09-26T20:29:46,820 copying crawlo/templates/spiders_init.py.tmpl -> build/lib/crawlo/templates 2025-09-26T20:29:46,821 creating build/lib/crawlo/templates/project 2025-09-26T20:29:46,822 copying crawlo/templates/project/__init__.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,822 copying crawlo/templates/project/items.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,823 copying crawlo/templates/project/middlewares.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,823 copying crawlo/templates/project/pipelines.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,824 copying crawlo/templates/project/settings.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,824 copying crawlo/templates/project/settings_distributed.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,825 copying crawlo/templates/project/settings_gentle.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,826 copying crawlo/templates/project/settings_high_performance.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,826 copying crawlo/templates/project/settings_minimal.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,827 copying crawlo/templates/project/settings_simple.py.tmpl -> build/lib/crawlo/templates/project 2025-09-26T20:29:46,828 creating build/lib/crawlo/templates/project/spiders 2025-09-26T20:29:46,828 copying crawlo/templates/project/spiders/__init__.py.tmpl -> build/lib/crawlo/templates/project/spiders 2025-09-26T20:29:46,829 creating build/lib/crawlo/templates/spider 2025-09-26T20:29:46,830 copying crawlo/templates/spider/spider.py.tmpl -> build/lib/crawlo/templates/spider 2025-09-26T20:29:46,830 copying tests/comprehensive_testing_summary.md -> build/lib/tests 2025-09-26T20:29:46,831 copying tests/final_command_test_report.md -> build/lib/tests 2025-09-26T20:29:46,832 copying tests/untested_features_report.md -> build/lib/tests 2025-09-26T20:29:46,832 creating build/lib/tests/scrapy_comparison 2025-09-26T20:29:46,833 copying tests/scrapy_comparison/ofweek_scrapy.py -> build/lib/tests/scrapy_comparison 2025-09-26T20:29:46,834 copying tests/scrapy_comparison/scrapy_test.py -> build/lib/tests/scrapy_comparison 2025-09-26T20:29:46,842 installing to build/bdist.linux-armv7l/wheel 2025-09-26T20:29:46,842 running install 2025-09-26T20:29:46,866 running install_lib 2025-09-26T20:29:46,874 creating build/bdist.linux-armv7l/wheel 2025-09-26T20:29:46,877 creating build/bdist.linux-armv7l/wheel/crawlo 2025-09-26T20:29:46,878 creating build/bdist.linux-armv7l/wheel/crawlo/data 2025-09-26T20:29:46,879 copying build/lib/crawlo/data/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-09-26T20:29:46,881 copying build/lib/crawlo/data/user_agents.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-09-26T20:29:46,884 copying build/lib/crawlo/stats_collector.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:46,886 copying build/lib/crawlo/framework.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:46,888 creating build/bdist.linux-armv7l/wheel/crawlo/settings 2025-09-26T20:29:46,889 copying build/lib/crawlo/settings/default_settings.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-26T20:29:46,892 copying build/lib/crawlo/settings/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-26T20:29:46,893 copying build/lib/crawlo/settings/setting_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-26T20:29:46,896 copying build/lib/crawlo/task_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:46,899 copying build/lib/crawlo/event.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:46,901 copying build/lib/crawlo/config.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:46,905 creating build/bdist.linux-armv7l/wheel/crawlo/pipelines 2025-09-26T20:29:46,907 copying build/lib/crawlo/pipelines/bloom_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,914 copying build/lib/crawlo/pipelines/pipeline_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,916 copying build/lib/crawlo/pipelines/redis_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,919 copying build/lib/crawlo/pipelines/json_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,921 copying build/lib/crawlo/pipelines/mysql_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,924 copying build/lib/crawlo/pipelines/memory_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,926 copying build/lib/crawlo/pipelines/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,927 copying build/lib/crawlo/pipelines/console_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,929 copying build/lib/crawlo/pipelines/database_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,931 copying build/lib/crawlo/pipelines/mongo_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,934 copying build/lib/crawlo/pipelines/csv_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-26T20:29:46,937 creating build/bdist.linux-armv7l/wheel/crawlo/commands 2025-09-26T20:29:46,938 copying build/lib/crawlo/commands/list.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,940 copying build/lib/crawlo/commands/help.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,943 copying build/lib/crawlo/commands/check.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,946 copying build/lib/crawlo/commands/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,948 copying build/lib/crawlo/commands/stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,950 copying build/lib/crawlo/commands/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,952 copying build/lib/crawlo/commands/genspider.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,955 copying build/lib/crawlo/commands/run.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,957 copying build/lib/crawlo/commands/startproject.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-26T20:29:46,961 creating build/bdist.linux-armv7l/wheel/crawlo/network 2025-09-26T20:29:46,962 copying build/lib/crawlo/network/response.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-26T20:29:46,965 copying build/lib/crawlo/network/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-26T20:29:46,967 copying build/lib/crawlo/network/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-26T20:29:46,970 creating build/bdist.linux-armv7l/wheel/crawlo/utils 2025-09-26T20:29:46,971 copying build/lib/crawlo/utils/error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,973 copying build/lib/crawlo/utils/class_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,975 copying build/lib/crawlo/utils/performance_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,977 copying build/lib/crawlo/utils/redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,979 copying build/lib/crawlo/utils/batch_processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,982 copying build/lib/crawlo/utils/env_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,985 copying build/lib/crawlo/utils/db_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,988 copying build/lib/crawlo/utils/spider_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,991 copying build/lib/crawlo/utils/redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:46,995 copying build/lib/crawlo/utils/controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,000 copying build/lib/crawlo/utils/request_serializer.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,004 copying build/lib/crawlo/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,007 copying build/lib/crawlo/utils/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,010 copying build/lib/crawlo/utils/large_scale_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,012 copying build/lib/crawlo/utils/log.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,014 copying build/lib/crawlo/utils/tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,016 copying build/lib/crawlo/utils/enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,018 copying build/lib/crawlo/utils/url.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,020 copying build/lib/crawlo/utils/func_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,022 copying build/lib/crawlo/utils/queue_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,025 copying build/lib/crawlo/utils/system.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,026 copying build/lib/crawlo/utils/large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-26T20:29:47,029 copying build/lib/crawlo/config_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,033 creating build/bdist.linux-armv7l/wheel/crawlo/core 2025-09-26T20:29:47,034 copying build/lib/crawlo/core/scheduler.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-26T20:29:47,037 copying build/lib/crawlo/core/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-26T20:29:47,039 copying build/lib/crawlo/core/engine.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-26T20:29:47,042 copying build/lib/crawlo/core/processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-26T20:29:47,044 creating build/bdist.linux-armv7l/wheel/crawlo/logging 2025-09-26T20:29:47,045 copying build/lib/crawlo/logging/config.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-26T20:29:47,048 copying build/lib/crawlo/logging/factory.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-26T20:29:47,050 copying build/lib/crawlo/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-26T20:29:47,052 copying build/lib/crawlo/logging/manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-26T20:29:47,054 copying build/lib/crawlo/subscriber.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,057 creating build/bdist.linux-armv7l/wheel/crawlo/items 2025-09-26T20:29:47,058 copying build/lib/crawlo/items/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-26T20:29:47,060 copying build/lib/crawlo/items/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-26T20:29:47,062 copying build/lib/crawlo/items/fields.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-26T20:29:47,064 copying build/lib/crawlo/items/items.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-26T20:29:47,067 creating build/bdist.linux-armv7l/wheel/crawlo/templates 2025-09-26T20:29:47,069 copying build/lib/crawlo/templates/crawlo.cfg.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-26T20:29:47,071 copying build/lib/crawlo/templates/run.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-26T20:29:47,293 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project 2025-09-26T20:29:47,294 copying build/lib/crawlo/templates/project/items.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,297 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project/spiders 2025-09-26T20:29:47,298 copying build/lib/crawlo/templates/project/spiders/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project/spiders 2025-09-26T20:29:47,300 copying build/lib/crawlo/templates/project/settings_distributed.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,302 copying build/lib/crawlo/templates/project/pipelines.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,304 copying build/lib/crawlo/templates/project/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,306 copying build/lib/crawlo/templates/project/settings_minimal.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,308 copying build/lib/crawlo/templates/project/settings_gentle.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,310 copying build/lib/crawlo/templates/project/settings_simple.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,313 copying build/lib/crawlo/templates/project/middlewares.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,315 copying build/lib/crawlo/templates/project/settings.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,317 copying build/lib/crawlo/templates/project/settings_high_performance.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-26T20:29:47,320 copying build/lib/crawlo/templates/spiders_init.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-26T20:29:47,322 creating build/bdist.linux-armv7l/wheel/crawlo/templates/spider 2025-09-26T20:29:47,323 copying build/lib/crawlo/templates/spider/spider.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/spider 2025-09-26T20:29:47,326 creating build/bdist.linux-armv7l/wheel/crawlo/initialization 2025-09-26T20:29:47,327 copying build/lib/crawlo/initialization/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-26T20:29:47,329 copying build/lib/crawlo/initialization/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-26T20:29:47,332 copying build/lib/crawlo/initialization/context.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-26T20:29:47,334 copying build/lib/crawlo/initialization/core.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-26T20:29:47,337 copying build/lib/crawlo/initialization/phases.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-26T20:29:47,339 copying build/lib/crawlo/initialization/built_in.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-26T20:29:47,342 creating build/bdist.linux-armv7l/wheel/crawlo/factories 2025-09-26T20:29:47,343 copying build/lib/crawlo/factories/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-26T20:29:47,345 copying build/lib/crawlo/factories/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-26T20:29:47,347 copying build/lib/crawlo/factories/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-26T20:29:47,349 copying build/lib/crawlo/factories/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-26T20:29:47,351 copying build/lib/crawlo/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,353 copying build/lib/crawlo/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,355 copying build/lib/crawlo/mode_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,358 creating build/bdist.linux-armv7l/wheel/crawlo/middleware 2025-09-26T20:29:47,359 copying build/lib/crawlo/middleware/offsite.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,362 copying build/lib/crawlo/middleware/response_code.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,364 copying build/lib/crawlo/middleware/retry.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,367 copying build/lib/crawlo/middleware/middleware_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,369 copying build/lib/crawlo/middleware/default_header.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,372 copying build/lib/crawlo/middleware/download_delay.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,374 copying build/lib/crawlo/middleware/proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,377 copying build/lib/crawlo/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,379 copying build/lib/crawlo/middleware/simple_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,382 copying build/lib/crawlo/middleware/request_ignore.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,384 copying build/lib/crawlo/middleware/response_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-26T20:29:47,387 copying build/lib/crawlo/__version__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,391 creating build/bdist.linux-armv7l/wheel/crawlo/downloader 2025-09-26T20:29:47,393 copying build/lib/crawlo/downloader/aiohttp_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,397 copying build/lib/crawlo/downloader/playwright_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,400 copying build/lib/crawlo/downloader/httpx_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,403 copying build/lib/crawlo/downloader/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,407 copying build/lib/crawlo/downloader/cffi_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,410 copying build/lib/crawlo/downloader/hybrid_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,413 copying build/lib/crawlo/downloader/selenium_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-26T20:29:47,417 creating build/bdist.linux-armv7l/wheel/crawlo/queue 2025-09-26T20:29:47,418 copying build/lib/crawlo/queue/queue_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-26T20:29:47,422 copying build/lib/crawlo/queue/redis_priority_queue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-26T20:29:47,426 copying build/lib/crawlo/queue/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-26T20:29:47,429 copying build/lib/crawlo/queue/pqueue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-26T20:29:47,431 copying build/lib/crawlo/exceptions.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,435 creating build/bdist.linux-armv7l/wheel/crawlo/extension 2025-09-26T20:29:47,436 copying build/lib/crawlo/extension/log_stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,439 copying build/lib/crawlo/extension/performance_profiler.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,442 copying build/lib/crawlo/extension/health_check.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,445 copying build/lib/crawlo/extension/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,448 copying build/lib/crawlo/extension/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,451 copying build/lib/crawlo/extension/request_recorder.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,454 copying build/lib/crawlo/extension/logging_extension.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,456 copying build/lib/crawlo/extension/log_interval.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-26T20:29:47,459 copying build/lib/crawlo/cli.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,463 creating build/bdist.linux-armv7l/wheel/crawlo/filters 2025-09-26T20:29:47,465 copying build/lib/crawlo/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-26T20:29:47,468 copying build/lib/crawlo/filters/memory_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-26T20:29:47,471 copying build/lib/crawlo/filters/aioredis_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-26T20:29:47,475 creating build/bdist.linux-armv7l/wheel/crawlo/tools 2025-09-26T20:29:47,477 copying build/lib/crawlo/tools/anti_crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,480 copying build/lib/crawlo/tools/network_diagnostic.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,483 copying build/lib/crawlo/tools/text_cleaner.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,486 copying build/lib/crawlo/tools/authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,488 copying build/lib/crawlo/tools/encoding_converter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,491 copying build/lib/crawlo/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,493 copying build/lib/crawlo/tools/request_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,495 copying build/lib/crawlo/tools/distributed_coordinator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,498 copying build/lib/crawlo/tools/retry_mechanism.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,501 copying build/lib/crawlo/tools/date_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,503 copying build/lib/crawlo/tools/scenario_adapter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,506 copying build/lib/crawlo/tools/data_formatter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,509 copying build/lib/crawlo/tools/data_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-26T20:29:47,512 copying build/lib/crawlo/project.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-26T20:29:47,515 creating build/bdist.linux-armv7l/wheel/crawlo/spider 2025-09-26T20:29:47,516 copying build/lib/crawlo/spider/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/spider 2025-09-26T20:29:47,520 creating build/bdist.linux-armv7l/wheel/examples 2025-09-26T20:29:47,522 copying build/lib/examples/__init__.py -> build/bdist.linux-armv7l/wheel/./examples 2025-09-26T20:29:47,527 creating build/bdist.linux-armv7l/wheel/tests 2025-09-26T20:29:47,529 copying build/lib/tests/test_response_code_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,532 copying build/lib/tests/test_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,534 copying build/lib/tests/test_redis_key_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,536 copying build/lib/tests/test_framework_startup.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,539 copying build/lib/tests/date_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,541 copying build/lib/tests/test_controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,543 copying build/lib/tests/redis_key_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,546 copying build/lib/tests/test_env_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,548 copying build/lib/tests/test_request_ignore_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,551 copying build/lib/tests/tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,553 copying build/lib/tests/response_improvements_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,556 copying build/lib/tests/test_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,558 copying build/lib/tests/test_simple_response.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,560 copying build/lib/tests/verify_log_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,562 copying build/lib/tests/test_user_agents.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,564 copying build/lib/tests/test_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,567 copying build/lib/tests/simple_spider_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,569 copying build/lib/tests/test_enhanced_error_handler_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,572 copying build/lib/tests/test_proxy_middleware_enhanced.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,574 copying build/lib/tests/log_generation_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,577 copying build/lib/tests/spider_log_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,580 copying build/lib/tests/test_performance_monitor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,582 copying build/lib/tests/test_all_redis_key_configs.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,584 copying build/lib/tests/test_proxy_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,587 copying build/lib/tests/test_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,589 copying build/lib/tests/test_authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,592 copying build/lib/tests/test_error_handler_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,594 copying build/lib/tests/test_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,596 copying build/lib/tests/test_retry_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,598 copying build/lib/tests/test_queue_empty_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,600 copying build/lib/tests/test_mode_change.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,602 copying build/lib/tests/simple_crawlo_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,604 copying build/lib/tests/simple_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,606 copying build/lib/tests/comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,608 copying build/lib/tests/optimized_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,610 copying build/lib/tests/test_config_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,612 copying build/lib/tests/test_all_commands.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,615 copying build/lib/tests/test_proxy_strategies.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,617 copying build/lib/tests/test_redis_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,618 copying build/lib/tests/untested_features_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,620 copying build/lib/tests/dynamic_loading_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,622 copying build/lib/tests/test_redis_queue_name_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,625 copying build/lib/tests/test_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,627 copying build/lib/tests/test_dynamic_proxy_real.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,629 copying build/lib/tests/test_telecom_spider_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,631 copying build/lib/tests/distributed_test_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,633 copying build/lib/tests/simple_optimization_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,635 copying build/lib/tests/test_proxy_middleware_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,637 copying build/lib/tests/test_dedup_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,639 copying build/lib/tests/final_validation_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,641 copying build/lib/tests/debug_log_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,643 copying build/lib/tests/test_random_user_agent.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,645 copying build/lib/tests/verify_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,647 copying build/lib/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,650 copying build/lib/tests/test_downloader_proxy_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,652 copying build/lib/tests/dynamic_loading_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,655 copying build/lib/tests/test_date_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,657 copying build/lib/tests/test_dynamic_downloaders_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,659 copying build/lib/tests/test_framework_env_usage.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,661 copying build/lib/tests/final_comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,663 copying build/lib/tests/test_redis_queue.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,666 copying build/lib/tests/request_params_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,668 copying build/lib/tests/debug_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,670 copying build/lib/tests/test_request_params.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,672 copying build/lib/tests/test_final_validation.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,674 copying build/lib/tests/test_dynamic_proxy_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,677 copying build/lib/tests/test_proxy_api.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,679 copying build/lib/tests/env_config_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,681 copying build/lib/tests/error_handling_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,683 copying build/lib/tests/final_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,686 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,688 copying build/lib/tests/test_request_serialization.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,690 copying build/lib/tests/framework_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,692 copying build/lib/tests/test_queue_manager_double_crawlo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,694 copying build/lib/tests/test_proxy_middleware_refactored.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,697 copying build/lib/tests/verify_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,698 copying build/lib/tests/test_advanced_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,701 copying build/lib/tests/test_queue_type.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,703 copying build/lib/tests/config_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,705 copying build/lib/tests/test_cleaners.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,707 copying build/lib/tests/test_mode_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,708 copying build/lib/tests/simple_log_test2.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,710 copying build/lib/tests/test_edge_cases.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,713 copying build/lib/tests/test_proxy_stats.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,715 copying build/lib/tests/test_large_scale_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,717 copying build/lib/tests/test_component_factory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,719 copying build/lib/tests/cleaners_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,722 copying build/lib/tests/debug_log_levels.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,724 copying build/lib/tests/test_template_content.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,726 copying build/lib/tests/comprehensive_framework_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,728 copying build/lib/tests/queue_blocking_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,730 copying build/lib/tests/test_queue_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,732 copying build/lib/tests/test_double_crawlo_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,734 copying build/lib/tests/queue_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,736 copying build/lib/tests/test_crawlo_proxy_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,738 copying build/lib/tests/test_double_crawlo_fix_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,741 copying build/lib/tests/performance_comparison.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,743 copying build/lib/tests/test_queue_manager_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,746 copying build/lib/tests/detailed_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,748 copying build/lib/tests/baidu_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,750 copying build/lib/tests/test_proxy_health_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,752 copying build/lib/tests/comprehensive_testing_summary.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,754 copying build/lib/tests/test_logging_system.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,757 copying build/lib/tests/test_response_improvements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,759 copying build/lib/tests/test_batch_processor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,761 copying build/lib/tests/test_redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,763 copying build/lib/tests/debug_configure.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,765 copying build/lib/tests/test_offsite_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,768 copying build/lib/tests/test_enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,770 copying build/lib/tests/advanced_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,773 copying build/lib/tests/test_scheduler_config_update.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,776 copying build/lib/tests/test_parsel.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,778 copying build/lib/tests/debug_pipelines.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,780 copying build/lib/tests/test_template_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,782 copying build/lib/tests/test_config_merge.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,785 copying build/lib/tests/test_default_header_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,787 copying build/lib/tests/test_large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,790 copying build/lib/tests/controlled_spider_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,792 copying build/lib/tests/simple_queue_type_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,794 copying build/lib/tests/test_factories.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,797 copying build/lib/tests/test_proxy_providers.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,799 copying build/lib/tests/final_command_test_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,800 copying build/lib/tests/authenticated_proxy_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,803 copying build/lib/tests/test_get_component_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,805 copying build/lib/tests/test_download_delay_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,807 copying build/lib/tests/simple_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,809 copying build/lib/tests/test_real_scenario_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,811 copying build/lib/tests/test_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,814 creating build/bdist.linux-armv7l/wheel/tests/scrapy_comparison 2025-09-26T20:29:47,815 copying build/lib/tests/scrapy_comparison/ofweek_scrapy.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-09-26T20:29:47,818 copying build/lib/tests/scrapy_comparison/scrapy_test.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-09-26T20:29:47,820 copying build/lib/tests/test_item_dedup_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,822 copying build/lib/tests/simple_command_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,824 copying build/lib/tests/log_buffering_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,826 copying build/lib/tests/distributed_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,827 copying build/lib/tests/baidu_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,829 copying build/lib/tests/test_redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,832 copying build/lib/tests/test_dynamic_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,835 copying build/lib/tests/test_response_filter_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,837 copying build/lib/tests/fix_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-26T20:29:47,839 running install_egg_info 2025-09-26T20:29:47,854 Copying crawlo.egg-info to build/bdist.linux-armv7l/wheel/./crawlo-1.3.9-py3.11.egg-info 2025-09-26T20:29:47,867 running install_scripts 2025-09-26T20:29:47,876 creating build/bdist.linux-armv7l/wheel/crawlo-1.3.9.dist-info/WHEEL 2025-09-26T20:29:47,879 creating '/tmp/pip-wheel-ekba1i2e/.tmp-t6oilquy/crawlo-1.3.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-09-26T20:29:47,882 adding 'crawlo/__init__.py' 2025-09-26T20:29:47,884 adding 'crawlo/__version__.py' 2025-09-26T20:29:47,885 adding 'crawlo/cli.py' 2025-09-26T20:29:47,887 adding 'crawlo/config.py' 2025-09-26T20:29:47,889 adding 'crawlo/config_validator.py' 2025-09-26T20:29:47,893 adding 'crawlo/crawler.py' 2025-09-26T20:29:47,894 adding 'crawlo/event.py' 2025-09-26T20:29:47,895 adding 'crawlo/exceptions.py' 2025-09-26T20:29:47,897 adding 'crawlo/framework.py' 2025-09-26T20:29:47,899 adding 'crawlo/mode_manager.py' 2025-09-26T20:29:47,901 adding 'crawlo/project.py' 2025-09-26T20:29:47,902 adding 'crawlo/stats_collector.py' 2025-09-26T20:29:47,904 adding 'crawlo/subscriber.py' 2025-09-26T20:29:47,905 adding 'crawlo/task_manager.py' 2025-09-26T20:29:47,907 adding 'crawlo/commands/__init__.py' 2025-09-26T20:29:47,910 adding 'crawlo/commands/check.py' 2025-09-26T20:29:47,911 adding 'crawlo/commands/genspider.py' 2025-09-26T20:29:47,913 adding 'crawlo/commands/help.py' 2025-09-26T20:29:47,915 adding 'crawlo/commands/list.py' 2025-09-26T20:29:47,916 adding 'crawlo/commands/run.py' 2025-09-26T20:29:47,919 adding 'crawlo/commands/startproject.py' 2025-09-26T20:29:47,921 adding 'crawlo/commands/stats.py' 2025-09-26T20:29:47,922 adding 'crawlo/commands/utils.py' 2025-09-26T20:29:47,924 adding 'crawlo/core/__init__.py' 2025-09-26T20:29:47,927 adding 'crawlo/core/engine.py' 2025-09-26T20:29:47,928 adding 'crawlo/core/processor.py' 2025-09-26T20:29:47,930 adding 'crawlo/core/scheduler.py' 2025-09-26T20:29:47,932 adding 'crawlo/data/__init__.py' 2025-09-26T20:29:47,934 adding 'crawlo/data/user_agents.py' 2025-09-26T20:29:47,937 adding 'crawlo/downloader/__init__.py' 2025-09-26T20:29:47,939 adding 'crawlo/downloader/aiohttp_downloader.py' 2025-09-26T20:29:47,941 adding 'crawlo/downloader/cffi_downloader.py' 2025-09-26T20:29:47,943 adding 'crawlo/downloader/httpx_downloader.py' 2025-09-26T20:29:47,945 adding 'crawlo/downloader/hybrid_downloader.py' 2025-09-26T20:29:47,947 adding 'crawlo/downloader/playwright_downloader.py' 2025-09-26T20:29:47,950 adding 'crawlo/downloader/selenium_downloader.py' 2025-09-26T20:29:47,952 adding 'crawlo/extension/__init__.py' 2025-09-26T20:29:47,954 adding 'crawlo/extension/health_check.py' 2025-09-26T20:29:47,955 adding 'crawlo/extension/log_interval.py' 2025-09-26T20:29:47,957 adding 'crawlo/extension/log_stats.py' 2025-09-26T20:29:47,958 adding 'crawlo/extension/logging_extension.py' 2025-09-26T20:29:47,959 adding 'crawlo/extension/memory_monitor.py' 2025-09-26T20:29:47,961 adding 'crawlo/extension/performance_profiler.py' 2025-09-26T20:29:47,963 adding 'crawlo/extension/request_recorder.py' 2025-09-26T20:29:47,964 adding 'crawlo/factories/__init__.py' 2025-09-26T20:29:47,966 adding 'crawlo/factories/base.py' 2025-09-26T20:29:47,967 adding 'crawlo/factories/crawler.py' 2025-09-26T20:29:47,968 adding 'crawlo/factories/registry.py' 2025-09-26T20:29:47,970 adding 'crawlo/filters/__init__.py' 2025-09-26T20:29:47,972 adding 'crawlo/filters/aioredis_filter.py' 2025-09-26T20:29:47,974 adding 'crawlo/filters/memory_filter.py' 2025-09-26T20:29:47,976 adding 'crawlo/initialization/__init__.py' 2025-09-26T20:29:47,978 adding 'crawlo/initialization/built_in.py' 2025-09-26T20:29:47,979 adding 'crawlo/initialization/context.py' 2025-09-26T20:29:47,981 adding 'crawlo/initialization/core.py' 2025-09-26T20:29:47,983 adding 'crawlo/initialization/phases.py' 2025-09-26T20:29:47,984 adding 'crawlo/initialization/registry.py' 2025-09-26T20:29:47,986 adding 'crawlo/items/__init__.py' 2025-09-26T20:29:47,987 adding 'crawlo/items/base.py' 2025-09-26T20:29:47,989 adding 'crawlo/items/fields.py' 2025-09-26T20:29:47,990 adding 'crawlo/items/items.py' 2025-09-26T20:29:47,992 adding 'crawlo/logging/__init__.py' 2025-09-26T20:29:47,993 adding 'crawlo/logging/config.py' 2025-09-26T20:29:47,995 adding 'crawlo/logging/factory.py' 2025-09-26T20:29:47,996 adding 'crawlo/logging/manager.py' 2025-09-26T20:29:47,998 adding 'crawlo/middleware/__init__.py' 2025-09-26T20:29:48,000 adding 'crawlo/middleware/default_header.py' 2025-09-26T20:29:48,001 adding 'crawlo/middleware/download_delay.py' 2025-09-26T20:29:48,003 adding 'crawlo/middleware/middleware_manager.py' 2025-09-26T20:29:48,004 adding 'crawlo/middleware/offsite.py' 2025-09-26T20:29:48,006 adding 'crawlo/middleware/proxy.py' 2025-09-26T20:29:48,008 adding 'crawlo/middleware/request_ignore.py' 2025-09-26T20:29:48,009 adding 'crawlo/middleware/response_code.py' 2025-09-26T20:29:48,010 adding 'crawlo/middleware/response_filter.py' 2025-09-26T20:29:48,012 adding 'crawlo/middleware/retry.py' 2025-09-26T20:29:48,013 adding 'crawlo/middleware/simple_proxy.py' 2025-09-26T20:29:48,015 adding 'crawlo/network/__init__.py' 2025-09-26T20:29:48,017 adding 'crawlo/network/request.py' 2025-09-26T20:29:48,019 adding 'crawlo/network/response.py' 2025-09-26T20:29:48,021 adding 'crawlo/pipelines/__init__.py' 2025-09-26T20:29:48,023 adding 'crawlo/pipelines/bloom_dedup_pipeline.py' 2025-09-26T20:29:48,024 adding 'crawlo/pipelines/console_pipeline.py' 2025-09-26T20:29:48,026 adding 'crawlo/pipelines/csv_pipeline.py' 2025-09-26T20:29:48,028 adding 'crawlo/pipelines/database_dedup_pipeline.py' 2025-09-26T20:29:48,029 adding 'crawlo/pipelines/json_pipeline.py' 2025-09-26T20:29:48,031 adding 'crawlo/pipelines/memory_dedup_pipeline.py' 2025-09-26T20:29:48,032 adding 'crawlo/pipelines/mongo_pipeline.py' 2025-09-26T20:29:48,034 adding 'crawlo/pipelines/mysql_pipeline.py' 2025-09-26T20:29:48,036 adding 'crawlo/pipelines/pipeline_manager.py' 2025-09-26T20:29:48,037 adding 'crawlo/pipelines/redis_dedup_pipeline.py' 2025-09-26T20:29:48,039 adding 'crawlo/queue/__init__.py' 2025-09-26T20:29:48,040 adding 'crawlo/queue/pqueue.py' 2025-09-26T20:29:48,043 adding 'crawlo/queue/queue_manager.py' 2025-09-26T20:29:48,045 adding 'crawlo/queue/redis_priority_queue.py' 2025-09-26T20:29:48,047 adding 'crawlo/settings/__init__.py' 2025-09-26T20:29:48,049 adding 'crawlo/settings/default_settings.py' 2025-09-26T20:29:48,051 adding 'crawlo/settings/setting_manager.py' 2025-09-26T20:29:48,054 adding 'crawlo/spider/__init__.py' 2025-09-26T20:29:48,056 adding 'crawlo/templates/crawlo.cfg.tmpl' 2025-09-26T20:29:48,057 adding 'crawlo/templates/run.py.tmpl' 2025-09-26T20:29:48,059 adding 'crawlo/templates/spiders_init.py.tmpl' 2025-09-26T20:29:48,060 adding 'crawlo/templates/project/__init__.py.tmpl' 2025-09-26T20:29:48,062 adding 'crawlo/templates/project/items.py.tmpl' 2025-09-26T20:29:48,063 adding 'crawlo/templates/project/middlewares.py.tmpl' 2025-09-26T20:29:48,064 adding 'crawlo/templates/project/pipelines.py.tmpl' 2025-09-26T20:29:48,066 adding 'crawlo/templates/project/settings.py.tmpl' 2025-09-26T20:29:48,067 adding 'crawlo/templates/project/settings_distributed.py.tmpl' 2025-09-26T20:29:48,069 adding 'crawlo/templates/project/settings_gentle.py.tmpl' 2025-09-26T20:29:48,071 adding 'crawlo/templates/project/settings_high_performance.py.tmpl' 2025-09-26T20:29:48,072 adding 'crawlo/templates/project/settings_minimal.py.tmpl' 2025-09-26T20:29:48,073 adding 'crawlo/templates/project/settings_simple.py.tmpl' 2025-09-26T20:29:48,075 adding 'crawlo/templates/project/spiders/__init__.py.tmpl' 2025-09-26T20:29:48,077 adding 'crawlo/templates/spider/spider.py.tmpl' 2025-09-26T20:29:48,079 adding 'crawlo/tools/__init__.py' 2025-09-26T20:29:48,081 adding 'crawlo/tools/anti_crawler.py' 2025-09-26T20:29:48,082 adding 'crawlo/tools/authenticated_proxy.py' 2025-09-26T20:29:48,084 adding 'crawlo/tools/data_formatter.py' 2025-09-26T20:29:48,085 adding 'crawlo/tools/data_validator.py' 2025-09-26T20:29:48,087 adding 'crawlo/tools/date_tools.py' 2025-09-26T20:29:48,089 adding 'crawlo/tools/distributed_coordinator.py' 2025-09-26T20:29:48,091 adding 'crawlo/tools/encoding_converter.py' 2025-09-26T20:29:48,093 adding 'crawlo/tools/network_diagnostic.py' 2025-09-26T20:29:48,094 adding 'crawlo/tools/request_tools.py' 2025-09-26T20:29:48,095 adding 'crawlo/tools/retry_mechanism.py' 2025-09-26T20:29:48,097 adding 'crawlo/tools/scenario_adapter.py' 2025-09-26T20:29:48,099 adding 'crawlo/tools/text_cleaner.py' 2025-09-26T20:29:48,101 adding 'crawlo/utils/__init__.py' 2025-09-26T20:29:48,102 adding 'crawlo/utils/batch_processor.py' 2025-09-26T20:29:48,104 adding 'crawlo/utils/class_loader.py' 2025-09-26T20:29:48,106 adding 'crawlo/utils/controlled_spider_mixin.py' 2025-09-26T20:29:48,108 adding 'crawlo/utils/db_helper.py' 2025-09-26T20:29:48,110 adding 'crawlo/utils/enhanced_error_handler.py' 2025-09-26T20:29:48,111 adding 'crawlo/utils/env_config.py' 2025-09-26T20:29:48,113 adding 'crawlo/utils/error_handler.py' 2025-09-26T20:29:48,114 adding 'crawlo/utils/func_tools.py' 2025-09-26T20:29:48,116 adding 'crawlo/utils/large_scale_config.py' 2025-09-26T20:29:48,118 adding 'crawlo/utils/large_scale_helper.py' 2025-09-26T20:29:48,119 adding 'crawlo/utils/log.py' 2025-09-26T20:29:48,121 adding 'crawlo/utils/performance_monitor.py' 2025-09-26T20:29:48,123 adding 'crawlo/utils/queue_helper.py' 2025-09-26T20:29:48,125 adding 'crawlo/utils/redis_connection_pool.py' 2025-09-26T20:29:48,126 adding 'crawlo/utils/redis_key_validator.py' 2025-09-26T20:29:48,128 adding 'crawlo/utils/request.py' 2025-09-26T20:29:48,130 adding 'crawlo/utils/request_serializer.py' 2025-09-26T20:29:48,131 adding 'crawlo/utils/spider_loader.py' 2025-09-26T20:29:48,132 adding 'crawlo/utils/system.py' 2025-09-26T20:29:48,133 adding 'crawlo/utils/tools.py' 2025-09-26T20:29:48,135 adding 'crawlo/utils/url.py' 2025-09-26T20:29:48,137 adding 'examples/__init__.py' 2025-09-26T20:29:48,142 adding 'tests/__init__.py' 2025-09-26T20:29:48,144 adding 'tests/advanced_tools_example.py' 2025-09-26T20:29:48,145 adding 'tests/authenticated_proxy_example.py' 2025-09-26T20:29:48,147 adding 'tests/baidu_performance_test.py' 2025-09-26T20:29:48,148 adding 'tests/baidu_test.py' 2025-09-26T20:29:48,149 adding 'tests/cleaners_example.py' 2025-09-26T20:29:48,151 adding 'tests/comprehensive_framework_test.py' 2025-09-26T20:29:48,152 adding 'tests/comprehensive_test.py' 2025-09-26T20:29:48,154 adding 'tests/comprehensive_testing_summary.md' 2025-09-26T20:29:48,156 adding 'tests/config_validation_demo.py' 2025-09-26T20:29:48,157 adding 'tests/controlled_spider_example.py' 2025-09-26T20:29:48,159 adding 'tests/date_tools_example.py' 2025-09-26T20:29:48,160 adding 'tests/debug_configure.py' 2025-09-26T20:29:48,162 adding 'tests/debug_framework_logger.py' 2025-09-26T20:29:48,163 adding 'tests/debug_log_config.py' 2025-09-26T20:29:48,165 adding 'tests/debug_log_levels.py' 2025-09-26T20:29:48,166 adding 'tests/debug_pipelines.py' 2025-09-26T20:29:48,167 adding 'tests/detailed_log_test.py' 2025-09-26T20:29:48,169 adding 'tests/distributed_test.py' 2025-09-26T20:29:48,170 adding 'tests/distributed_test_debug.py' 2025-09-26T20:29:48,172 adding 'tests/dynamic_loading_example.py' 2025-09-26T20:29:48,174 adding 'tests/dynamic_loading_test.py' 2025-09-26T20:29:48,175 adding 'tests/env_config_example.py' 2025-09-26T20:29:48,177 adding 'tests/error_handling_example.py' 2025-09-26T20:29:48,178 adding 'tests/final_command_test_report.md' 2025-09-26T20:29:48,179 adding 'tests/final_comprehensive_test.py' 2025-09-26T20:29:48,181 adding 'tests/final_log_test.py' 2025-09-26T20:29:48,182 adding 'tests/final_validation_test.py' 2025-09-26T20:29:48,184 adding 'tests/fix_log_test.py' 2025-09-26T20:29:48,185 adding 'tests/framework_performance_test.py' 2025-09-26T20:29:48,186 adding 'tests/log_buffering_test.py' 2025-09-26T20:29:48,188 adding 'tests/log_generation_timing_test.py' 2025-09-26T20:29:48,190 adding 'tests/optimized_performance_test.py' 2025-09-26T20:29:48,191 adding 'tests/performance_comparison.py' 2025-09-26T20:29:48,193 adding 'tests/queue_blocking_test.py' 2025-09-26T20:29:48,194 adding 'tests/queue_test.py' 2025-09-26T20:29:48,195 adding 'tests/redis_key_validation_demo.py' 2025-09-26T20:29:48,197 adding 'tests/request_params_example.py' 2025-09-26T20:29:48,198 adding 'tests/response_improvements_example.py' 2025-09-26T20:29:48,200 adding 'tests/simple_command_test.py' 2025-09-26T20:29:48,201 adding 'tests/simple_crawlo_test.py' 2025-09-26T20:29:48,202 adding 'tests/simple_log_test.py' 2025-09-26T20:29:48,204 adding 'tests/simple_log_test2.py' 2025-09-26T20:29:48,206 adding 'tests/simple_optimization_test.py' 2025-09-26T20:29:48,207 adding 'tests/simple_queue_type_test.py' 2025-09-26T20:29:48,208 adding 'tests/simple_spider_test.py' 2025-09-26T20:29:48,209 adding 'tests/simple_test.py' 2025-09-26T20:29:48,211 adding 'tests/spider_log_timing_test.py' 2025-09-26T20:29:48,212 adding 'tests/test_advanced_tools.py' 2025-09-26T20:29:48,214 adding 'tests/test_all_commands.py' 2025-09-26T20:29:48,215 adding 'tests/test_all_redis_key_configs.py' 2025-09-26T20:29:48,217 adding 'tests/test_authenticated_proxy.py' 2025-09-26T20:29:48,218 adding 'tests/test_batch_processor.py' 2025-09-26T20:29:48,219 adding 'tests/test_cleaners.py' 2025-09-26T20:29:48,221 adding 'tests/test_component_factory.py' 2025-09-26T20:29:48,223 adding 'tests/test_comprehensive.py' 2025-09-26T20:29:48,224 adding 'tests/test_config_consistency.py' 2025-09-26T20:29:48,225 adding 'tests/test_config_merge.py' 2025-09-26T20:29:48,227 adding 'tests/test_config_validator.py' 2025-09-26T20:29:48,228 adding 'tests/test_controlled_spider_mixin.py' 2025-09-26T20:29:48,230 adding 'tests/test_crawlo_proxy_integration.py' 2025-09-26T20:29:48,231 adding 'tests/test_date_tools.py' 2025-09-26T20:29:48,233 adding 'tests/test_dedup_fix.py' 2025-09-26T20:29:48,234 adding 'tests/test_default_header_middleware.py' 2025-09-26T20:29:48,235 adding 'tests/test_distributed.py' 2025-09-26T20:29:48,237 adding 'tests/test_double_crawlo_fix.py' 2025-09-26T20:29:48,239 adding 'tests/test_double_crawlo_fix_simple.py' 2025-09-26T20:29:48,240 adding 'tests/test_download_delay_middleware.py' 2025-09-26T20:29:48,242 adding 'tests/test_downloader_proxy_compatibility.py' 2025-09-26T20:29:48,244 adding 'tests/test_dynamic_downloaders_proxy.py' 2025-09-26T20:29:48,245 adding 'tests/test_dynamic_proxy.py' 2025-09-26T20:29:48,247 adding 'tests/test_dynamic_proxy_config.py' 2025-09-26T20:29:48,248 adding 'tests/test_dynamic_proxy_real.py' 2025-09-26T20:29:48,250 adding 'tests/test_edge_cases.py' 2025-09-26T20:29:48,252 adding 'tests/test_enhanced_error_handler.py' 2025-09-26T20:29:48,253 adding 'tests/test_enhanced_error_handler_comprehensive.py' 2025-09-26T20:29:48,255 adding 'tests/test_env_config.py' 2025-09-26T20:29:48,256 adding 'tests/test_error_handler_compatibility.py' 2025-09-26T20:29:48,258 adding 'tests/test_factories.py' 2025-09-26T20:29:48,259 adding 'tests/test_final_validation.py' 2025-09-26T20:29:48,261 adding 'tests/test_framework_env_usage.py' 2025-09-26T20:29:48,262 adding 'tests/test_framework_logger.py' 2025-09-26T20:29:48,264 adding 'tests/test_framework_startup.py' 2025-09-26T20:29:48,265 adding 'tests/test_get_component_logger.py' 2025-09-26T20:29:48,266 adding 'tests/test_integration.py' 2025-09-26T20:29:48,267 adding 'tests/test_item_dedup_redis_key.py' 2025-09-26T20:29:48,269 adding 'tests/test_large_scale_config.py' 2025-09-26T20:29:48,270 adding 'tests/test_large_scale_helper.py' 2025-09-26T20:29:48,272 adding 'tests/test_logging_system.py' 2025-09-26T20:29:48,274 adding 'tests/test_mode_change.py' 2025-09-26T20:29:48,275 adding 'tests/test_mode_consistency.py' 2025-09-26T20:29:48,276 adding 'tests/test_offsite_middleware.py' 2025-09-26T20:29:48,278 adding 'tests/test_parsel.py' 2025-09-26T20:29:48,280 adding 'tests/test_performance.py' 2025-09-26T20:29:48,281 adding 'tests/test_performance_monitor.py' 2025-09-26T20:29:48,283 adding 'tests/test_proxy_api.py' 2025-09-26T20:29:48,284 adding 'tests/test_proxy_health_check.py' 2025-09-26T20:29:48,285 adding 'tests/test_proxy_middleware.py' 2025-09-26T20:29:48,287 adding 'tests/test_proxy_middleware_enhanced.py' 2025-09-26T20:29:48,288 adding 'tests/test_proxy_middleware_integration.py' 2025-09-26T20:29:48,290 adding 'tests/test_proxy_middleware_refactored.py' 2025-09-26T20:29:48,291 adding 'tests/test_proxy_providers.py' 2025-09-26T20:29:48,292 adding 'tests/test_proxy_stats.py' 2025-09-26T20:29:48,294 adding 'tests/test_proxy_strategies.py' 2025-09-26T20:29:48,295 adding 'tests/test_queue_empty_check.py' 2025-09-26T20:29:48,296 adding 'tests/test_queue_manager_double_crawlo.py' 2025-09-26T20:29:48,298 adding 'tests/test_queue_manager_redis_key.py' 2025-09-26T20:29:48,299 adding 'tests/test_queue_naming.py' 2025-09-26T20:29:48,301 adding 'tests/test_queue_type.py' 2025-09-26T20:29:48,302 adding 'tests/test_random_user_agent.py' 2025-09-26T20:29:48,304 adding 'tests/test_real_scenario_proxy.py' 2025-09-26T20:29:48,305 adding 'tests/test_redis_config.py' 2025-09-26T20:29:48,307 adding 'tests/test_redis_connection_pool.py' 2025-09-26T20:29:48,308 adding 'tests/test_redis_key_naming.py' 2025-09-26T20:29:48,309 adding 'tests/test_redis_key_validator.py' 2025-09-26T20:29:48,311 adding 'tests/test_redis_queue.py' 2025-09-26T20:29:48,313 adding 'tests/test_redis_queue_name_fix.py' 2025-09-26T20:29:48,314 adding 'tests/test_request_ignore_middleware.py' 2025-09-26T20:29:48,315 adding 'tests/test_request_params.py' 2025-09-26T20:29:48,317 adding 'tests/test_request_serialization.py' 2025-09-26T20:29:48,319 adding 'tests/test_response_code_middleware.py' 2025-09-26T20:29:48,321 adding 'tests/test_response_filter_middleware.py' 2025-09-26T20:29:48,322 adding 'tests/test_response_improvements.py' 2025-09-26T20:29:48,324 adding 'tests/test_retry_middleware.py' 2025-09-26T20:29:48,326 adding 'tests/test_scheduler.py' 2025-09-26T20:29:48,327 adding 'tests/test_scheduler_config_update.py' 2025-09-26T20:29:48,328 adding 'tests/test_simple_response.py' 2025-09-26T20:29:48,330 adding 'tests/test_telecom_spider_redis_key.py' 2025-09-26T20:29:48,331 adding 'tests/test_template_content.py' 2025-09-26T20:29:48,333 adding 'tests/test_template_redis_key.py' 2025-09-26T20:29:48,334 adding 'tests/test_tools.py' 2025-09-26T20:29:48,336 adding 'tests/test_user_agents.py' 2025-09-26T20:29:48,337 adding 'tests/tools_example.py' 2025-09-26T20:29:48,339 adding 'tests/untested_features_report.md' 2025-09-26T20:29:48,340 adding 'tests/verify_debug.py' 2025-09-26T20:29:48,341 adding 'tests/verify_distributed.py' 2025-09-26T20:29:48,343 adding 'tests/verify_log_fix.py' 2025-09-26T20:29:48,345 adding 'tests/scrapy_comparison/ofweek_scrapy.py' 2025-09-26T20:29:48,347 adding 'tests/scrapy_comparison/scrapy_test.py' 2025-09-26T20:29:48,351 adding 'crawlo-1.3.9.dist-info/METADATA' 2025-09-26T20:29:48,352 adding 'crawlo-1.3.9.dist-info/WHEEL' 2025-09-26T20:29:48,353 adding 'crawlo-1.3.9.dist-info/entry_points.txt' 2025-09-26T20:29:48,354 adding 'crawlo-1.3.9.dist-info/top_level.txt' 2025-09-26T20:29:48,358 adding 'crawlo-1.3.9.dist-info/RECORD' 2025-09-26T20:29:48,369 removing build/bdist.linux-armv7l/wheel 2025-09-26T20:29:48,533 Building wheel for crawlo (pyproject.toml): finished with status 'done' 2025-09-26T20:29:48,548 Created wheel for crawlo: filename=crawlo-1.3.9-py3-none-any.whl size=544547 sha256=4ba32e11ae2213a168d8623a104c31659733167cee87ef5a7cdbcdf05fb931c3 2025-09-26T20:29:48,549 Stored in directory: /tmp/pip-ephem-wheel-cache-1ha24kz6/wheels/64/c1/61/9a21bc21b9cd144bcb376b4079b4a0f8e74825dede42c4e67e 2025-09-26T20:29:48,576 Successfully built crawlo 2025-09-26T20:29:48,591 Removed build tracker: '/tmp/pip-build-tracker-t7cc3q4_'