2025-09-28T13:52:56,234 Created temporary directory: /tmp/pip-ephem-wheel-cache-wsc0k58o 2025-09-28T13:52:56,236 Created temporary directory: /tmp/pip-build-tracker-mffafsa1 2025-09-28T13:52:56,236 Initialized build tracking at /tmp/pip-build-tracker-mffafsa1 2025-09-28T13:52:56,237 Created build tracker: /tmp/pip-build-tracker-mffafsa1 2025-09-28T13:52:56,237 Entered build tracker: /tmp/pip-build-tracker-mffafsa1 2025-09-28T13:52:56,238 Created temporary directory: /tmp/pip-wheel-wpma7n13 2025-09-28T13:52:56,241 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-09-28T13:52:56,244 Created temporary directory: /tmp/pip-ephem-wheel-cache-dkz9wwd7 2025-09-28T13:52:56,266 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-09-28T13:52:56,270 2 location(s) to search for versions of crawlo: 2025-09-28T13:52:56,270 * https://pypi.org/simple/crawlo/ 2025-09-28T13:52:56,270 * https://www.piwheels.org/simple/crawlo/ 2025-09-28T13:52:56,271 Fetching project page and analyzing links: https://pypi.org/simple/crawlo/ 2025-09-28T13:52:56,272 Getting page https://pypi.org/simple/crawlo/ 2025-09-28T13:52:56,273 Found index url https://pypi.org/simple 2025-09-28T13:52:56,490 Fetched page https://pypi.org/simple/crawlo/ as application/vnd.pypi.simple.v1+json 2025-09-28T13:52:56,493 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5e/f7/15da16c9e40a732d265b11ae6f392ba6e38c843eb1a3850e1202ba0e57fa/crawlo-1.3.9-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,494 Found link https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.3.9 2025-09-28T13:52:56,494 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/4a/9c/82aeeb0713f1125291ead74dff2f44b27fee8c876a5d58b5eb08bc8a3fec/crawlo-1.4.0-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,495 Found link https://files.pythonhosted.org/packages/8d/80/d3c003285cc6ae70e0b6e71800635eed0c00e9441d0ffe0b4e0f41db962d/crawlo-1.4.0.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.0 2025-09-28T13:52:56,496 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/c4/7e/00a3eecc7fbf7b34af6ae79e82666ee8d49b743ada85547ac407641333bf/crawlo-1.4.1-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,497 Found link https://files.pythonhosted.org/packages/5b/48/c8439c1cbd3b4b819afd6885f2829772542bcce98951c0acc73079aedb95/crawlo-1.4.1.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.1 2025-09-28T13:52:56,498 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/f2/31/a52238ece7a50d949f7985dc13fedfa9d34b0aa68a9834e3cb3b93438e78/crawlo-1.4.2-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,499 Found link https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.2 2025-09-28T13:52:56,500 Fetching project page and analyzing links: https://www.piwheels.org/simple/crawlo/ 2025-09-28T13:52:56,501 Getting page https://www.piwheels.org/simple/crawlo/ 2025-09-28T13:52:56,502 Found index url https://www.piwheels.org/simple 2025-09-28T13:52:56,668 Fetched page https://www.piwheels.org/simple/crawlo/ as text/html 2025-09-28T13:52:56,670 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.1-py3-none-any.whl#sha256=5f48469ed3fa98ef76f9e622b25cdb555df1a3193b563f219c7ee540ae97dca9 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,671 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.0-py3-none-any.whl#sha256=51340c538a39da052af5ab3194e0916b203090854e495eb7b78290861e427e72 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,671 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.3.9-py3-none-any.whl#sha256=4ba32e11ae2213a168d8623a104c31659733167cee87ef5a7cdbcdf05fb931c3 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-09-28T13:52:56,672 Skipping link: not a file: https://www.piwheels.org/simple/crawlo/ 2025-09-28T13:52:56,672 Skipping link: not a file: https://pypi.org/simple/crawlo/ 2025-09-28T13:52:56,691 Given no hashes to check 1 links for project 'crawlo': discarding no candidates 2025-09-28T13:52:56,709 Collecting crawlo==1.4.2 2025-09-28T13:52:56,712 Created temporary directory: /tmp/pip-unpack-2_k9lqxa 2025-09-28T13:52:56,927 Downloading crawlo-1.4.2.tar.gz (400 kB) 2025-09-28T13:52:57,627 Added crawlo==1.4.2 from https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz to build tracker '/tmp/pip-build-tracker-mffafsa1' 2025-09-28T13:52:57,631 Created temporary directory: /tmp/pip-build-env-dhwq7alg 2025-09-28T13:52:57,636 Installing build dependencies: started 2025-09-28T13:52:57,637 Running command pip subprocess to install build dependencies 2025-09-28T13:52:58,797 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-09-28T13:52:59,414 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-09-28T13:52:59,438 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-09-28T13:53:01,143 Collecting setuptools>=80.9.0 2025-09-28T13:53:01,279 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-09-28T13:53:01,583 Collecting wheel 2025-09-28T13:53:01,599 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2025-09-28T13:53:04,657 Installing collected packages: wheel, setuptools 2025-09-28T13:53:04,905 Creating /tmp/pip-build-env-dhwq7alg/overlay/local/bin 2025-09-28T13:53:04,907 changing mode of /tmp/pip-build-env-dhwq7alg/overlay/local/bin/wheel to 755 2025-09-28T13:53:08,546 Successfully installed setuptools-80.9.0 wheel-0.45.1 2025-09-28T13:53:08,816 Installing build dependencies: finished with status 'done' 2025-09-28T13:53:08,822 Getting requirements to build wheel: started 2025-09-28T13:53:08,823 Running command Getting requirements to build wheel 2025-09-28T13:53:09,434 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-28T13:53:09,435 !! 2025-09-28T13:53:09,436 ******************************************************************************** 2025-09-28T13:53:09,437 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-28T13:53:09,438 License :: OSI Approved :: MIT License 2025-09-28T13:53:09,439 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-28T13:53:09,440 ******************************************************************************** 2025-09-28T13:53:09,441 !! 2025-09-28T13:53:09,442 self._finalize_license_expression() 2025-09-28T13:53:09,507 running egg_info 2025-09-28T13:53:09,514 writing crawlo.egg-info/PKG-INFO 2025-09-28T13:53:09,524 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-09-28T13:53:09,526 writing entry points to crawlo.egg-info/entry_points.txt 2025-09-28T13:53:09,531 writing requirements to crawlo.egg-info/requires.txt 2025-09-28T13:53:09,533 writing top-level names to crawlo.egg-info/top_level.txt 2025-09-28T13:53:09,608 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:09,625 reading manifest template 'MANIFEST.in' 2025-09-28T13:53:09,627 warning: no files found matching 'VERSION' 2025-09-28T13:53:09,627 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-28T13:53:09,686 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-28T13:53:09,688 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-28T13:53:09,690 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-28T13:53:09,692 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-28T13:53:09,694 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-28T13:53:09,696 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-28T13:53:09,698 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-28T13:53:09,700 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-28T13:53:09,702 no previously-included directories found matching 'samples' 2025-09-28T13:53:09,703 no previously-included directories found matching 'docs' 2025-09-28T13:53:09,721 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:09,811 Getting requirements to build wheel: finished with status 'done' 2025-09-28T13:53:09,814 Created temporary directory: /tmp/pip-modern-metadata-_6df585m 2025-09-28T13:53:09,817 Preparing metadata (pyproject.toml): started 2025-09-28T13:53:09,818 Running command Preparing metadata (pyproject.toml) 2025-09-28T13:53:10,383 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-28T13:53:10,383 !! 2025-09-28T13:53:10,384 ******************************************************************************** 2025-09-28T13:53:10,385 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-28T13:53:10,386 License :: OSI Approved :: MIT License 2025-09-28T13:53:10,388 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-28T13:53:10,388 ******************************************************************************** 2025-09-28T13:53:10,389 !! 2025-09-28T13:53:10,390 self._finalize_license_expression() 2025-09-28T13:53:10,409 running dist_info 2025-09-28T13:53:10,421 creating /tmp/pip-modern-metadata-_6df585m/crawlo.egg-info 2025-09-28T13:53:10,422 writing /tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/PKG-INFO 2025-09-28T13:53:10,432 writing dependency_links to /tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/dependency_links.txt 2025-09-28T13:53:10,434 writing entry points to /tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/entry_points.txt 2025-09-28T13:53:10,439 writing requirements to /tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/requires.txt 2025-09-28T13:53:10,440 writing top-level names to /tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/top_level.txt 2025-09-28T13:53:10,442 writing manifest file '/tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:10,507 reading manifest file '/tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:10,510 reading manifest template 'MANIFEST.in' 2025-09-28T13:53:10,511 warning: no files found matching 'VERSION' 2025-09-28T13:53:10,511 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-28T13:53:10,571 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-28T13:53:10,572 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-28T13:53:10,573 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-28T13:53:10,575 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-28T13:53:10,576 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-28T13:53:10,577 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-28T13:53:10,579 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-28T13:53:10,580 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-28T13:53:10,581 no previously-included directories found matching 'samples' 2025-09-28T13:53:10,582 no previously-included directories found matching 'docs' 2025-09-28T13:53:10,596 writing manifest file '/tmp/pip-modern-metadata-_6df585m/crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:10,598 creating '/tmp/pip-modern-metadata-_6df585m/crawlo-1.4.2.dist-info' 2025-09-28T13:53:10,734 Preparing metadata (pyproject.toml): finished with status 'done' 2025-09-28T13:53:10,742 Source in /tmp/pip-wheel-wpma7n13/crawlo_9b99d9b8560a46f79d91cba4b34b6266 has version 1.4.2, which satisfies requirement crawlo==1.4.2 from https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz 2025-09-28T13:53:10,743 Removed crawlo==1.4.2 from https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz from build tracker '/tmp/pip-build-tracker-mffafsa1' 2025-09-28T13:53:10,754 Created temporary directory: /tmp/pip-unpack-t57qfgm8 2025-09-28T13:53:10,754 Building wheels for collected packages: crawlo 2025-09-28T13:53:10,759 Created temporary directory: /tmp/pip-wheel-2tncuyae 2025-09-28T13:53:10,760 Destination directory: /tmp/pip-wheel-2tncuyae 2025-09-28T13:53:10,762 Building wheel for crawlo (pyproject.toml): started 2025-09-28T13:53:10,764 Running command Building wheel for crawlo (pyproject.toml) 2025-09-28T13:53:11,311 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-09-28T13:53:11,312 !! 2025-09-28T13:53:11,313 ******************************************************************************** 2025-09-28T13:53:11,313 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-09-28T13:53:11,315 License :: OSI Approved :: MIT License 2025-09-28T13:53:11,316 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-09-28T13:53:11,317 ******************************************************************************** 2025-09-28T13:53:11,318 !! 2025-09-28T13:53:11,319 self._finalize_license_expression() 2025-09-28T13:53:11,342 running bdist_wheel 2025-09-28T13:53:11,373 running build 2025-09-28T13:53:11,374 running build_py 2025-09-28T13:53:11,383 creating build/lib/examples 2025-09-28T13:53:11,386 copying examples/__init__.py -> build/lib/examples 2025-09-28T13:53:11,389 creating build/lib/crawlo 2025-09-28T13:53:11,390 copying crawlo/subscriber.py -> build/lib/crawlo 2025-09-28T13:53:11,393 copying crawlo/task_manager.py -> build/lib/crawlo 2025-09-28T13:53:11,396 copying crawlo/event.py -> build/lib/crawlo 2025-09-28T13:53:11,398 copying crawlo/__version__.py -> build/lib/crawlo 2025-09-28T13:53:11,400 copying crawlo/config_validator.py -> build/lib/crawlo 2025-09-28T13:53:11,403 copying crawlo/framework.py -> build/lib/crawlo 2025-09-28T13:53:11,405 copying crawlo/cli.py -> build/lib/crawlo 2025-09-28T13:53:11,407 copying crawlo/__init__.py -> build/lib/crawlo 2025-09-28T13:53:11,409 copying crawlo/exceptions.py -> build/lib/crawlo 2025-09-28T13:53:11,411 copying crawlo/crawler.py -> build/lib/crawlo 2025-09-28T13:53:11,414 copying crawlo/stats_collector.py -> build/lib/crawlo 2025-09-28T13:53:11,416 copying crawlo/project.py -> build/lib/crawlo 2025-09-28T13:53:11,418 copying crawlo/mode_manager.py -> build/lib/crawlo 2025-09-28T13:53:11,421 copying crawlo/config.py -> build/lib/crawlo 2025-09-28T13:53:11,427 creating build/lib/tests 2025-09-28T13:53:11,428 copying tests/dynamic_loading_example.py -> build/lib/tests 2025-09-28T13:53:11,431 copying tests/test_enhanced_error_handler.py -> build/lib/tests 2025-09-28T13:53:11,433 copying tests/test_authenticated_proxy.py -> build/lib/tests 2025-09-28T13:53:11,436 copying tests/test_offsite_middleware.py -> build/lib/tests 2025-09-28T13:53:11,438 copying tests/verify_debug.py -> build/lib/tests 2025-09-28T13:53:11,440 copying tests/test_all_redis_key_configs.py -> build/lib/tests 2025-09-28T13:53:11,442 copying tests/test_dynamic_proxy.py -> build/lib/tests 2025-09-28T13:53:11,444 copying tests/test_redis_queue.py -> build/lib/tests 2025-09-28T13:53:11,446 copying tests/test_redis_key_naming.py -> build/lib/tests 2025-09-28T13:53:11,449 copying tests/simple_optimization_test.py -> build/lib/tests 2025-09-28T13:53:11,451 copying tests/test_config_validator.py -> build/lib/tests 2025-09-28T13:53:11,453 copying tests/test_framework_startup.py -> build/lib/tests 2025-09-28T13:53:11,455 copying tests/test_advanced_tools.py -> build/lib/tests 2025-09-28T13:53:11,457 copying tests/test_get_component_logger.py -> build/lib/tests 2025-09-28T13:53:11,459 copying tests/test_response_filter_middleware.py -> build/lib/tests 2025-09-28T13:53:11,462 copying tests/test_double_crawlo_fix.py -> build/lib/tests 2025-09-28T13:53:11,464 copying tests/test_config_consistency.py -> build/lib/tests 2025-09-28T13:53:11,466 copying tests/test_factories.py -> build/lib/tests 2025-09-28T13:53:11,469 copying tests/comprehensive_framework_test.py -> build/lib/tests 2025-09-28T13:53:11,471 copying tests/test_item_dedup_redis_key.py -> build/lib/tests 2025-09-28T13:53:11,473 copying tests/test_env_config.py -> build/lib/tests 2025-09-28T13:53:11,475 copying tests/log_generation_timing_test.py -> build/lib/tests 2025-09-28T13:53:11,477 copying tests/test_double_crawlo_fix_simple.py -> build/lib/tests 2025-09-28T13:53:11,480 copying tests/date_tools_example.py -> build/lib/tests 2025-09-28T13:53:11,482 copying tests/debug_configure.py -> build/lib/tests 2025-09-28T13:53:11,484 copying tests/test_proxy_strategies.py -> build/lib/tests 2025-09-28T13:53:11,486 copying tests/spider_log_timing_test.py -> build/lib/tests 2025-09-28T13:53:11,488 copying tests/test_redis_key_validator.py -> build/lib/tests 2025-09-28T13:53:11,491 copying tests/test_controlled_spider_mixin.py -> build/lib/tests 2025-09-28T13:53:11,493 copying tests/test_template_content.py -> build/lib/tests 2025-09-28T13:53:11,495 copying tests/test_performance.py -> build/lib/tests 2025-09-28T13:53:11,497 copying tests/test_framework_env_usage.py -> build/lib/tests 2025-09-28T13:53:11,500 copying tests/test_offsite_middleware_simple.py -> build/lib/tests 2025-09-28T13:53:11,502 copying tests/final_comprehensive_test.py -> build/lib/tests 2025-09-28T13:53:11,504 copying tests/test_user_agents.py -> build/lib/tests 2025-09-28T13:53:11,506 copying tests/queue_test.py -> build/lib/tests 2025-09-28T13:53:11,508 copying tests/test_redis_connection_pool.py -> build/lib/tests 2025-09-28T13:53:11,510 copying tests/test_queue_manager_redis_key.py -> build/lib/tests 2025-09-28T13:53:11,513 copying tests/test_download_delay_middleware.py -> build/lib/tests 2025-09-28T13:53:11,515 copying tests/test_dynamic_proxy_config.py -> build/lib/tests 2025-09-28T13:53:11,518 copying tests/optimized_performance_test.py -> build/lib/tests 2025-09-28T13:53:11,520 copying tests/detailed_log_test.py -> build/lib/tests 2025-09-28T13:53:11,522 copying tests/queue_blocking_test.py -> build/lib/tests 2025-09-28T13:53:11,524 copying tests/test_dedup_fix.py -> build/lib/tests 2025-09-28T13:53:11,526 copying tests/distributed_test_debug.py -> build/lib/tests 2025-09-28T13:53:11,528 copying tests/env_config_example.py -> build/lib/tests 2025-09-28T13:53:11,530 copying tests/test_real_scenario_proxy.py -> build/lib/tests 2025-09-28T13:53:11,532 copying tests/debug_framework_logger.py -> build/lib/tests 2025-09-28T13:53:11,534 copying tests/test_all_pipeline_fingerprints.py -> build/lib/tests 2025-09-28T13:53:11,537 copying tests/test_queue_type.py -> build/lib/tests 2025-09-28T13:53:11,539 copying tests/test_final_validation.py -> build/lib/tests 2025-09-28T13:53:11,541 copying tests/redis_key_validation_demo.py -> build/lib/tests 2025-09-28T13:53:11,543 copying tests/test_random_user_agent.py -> build/lib/tests 2025-09-28T13:53:11,545 copying tests/test_scheduler.py -> build/lib/tests 2025-09-28T13:53:11,547 copying tests/test_proxy_api.py -> build/lib/tests 2025-09-28T13:53:11,550 copying tests/simple_command_test.py -> build/lib/tests 2025-09-28T13:53:11,552 copying tests/controlled_spider_example.py -> build/lib/tests 2025-09-28T13:53:11,554 copying tests/test_distributed.py -> build/lib/tests 2025-09-28T13:53:11,556 copying tests/test_component_factory.py -> build/lib/tests 2025-09-28T13:53:11,558 copying tests/simple_test.py -> build/lib/tests 2025-09-28T13:53:11,560 copying tests/verify_log_fix.py -> build/lib/tests 2025-09-28T13:53:11,562 copying tests/test_mode_consistency.py -> build/lib/tests 2025-09-28T13:53:11,564 copying tests/test_integration.py -> build/lib/tests 2025-09-28T13:53:11,566 copying tests/debug_log_config.py -> build/lib/tests 2025-09-28T13:53:11,568 copying tests/final_log_test.py -> build/lib/tests 2025-09-28T13:53:11,571 copying tests/test_response_code_middleware.py -> build/lib/tests 2025-09-28T13:53:11,573 copying tests/tools_example.py -> build/lib/tests 2025-09-28T13:53:11,576 copying tests/request_params_example.py -> build/lib/tests 2025-09-28T13:53:11,578 copying tests/baidu_performance_test.py -> build/lib/tests 2025-09-28T13:53:11,580 copying tests/test_comprehensive.py -> build/lib/tests 2025-09-28T13:53:11,582 copying tests/config_validation_demo.py -> build/lib/tests 2025-09-28T13:53:11,584 copying tests/test_all_commands.py -> build/lib/tests 2025-09-28T13:53:11,587 copying tests/simple_log_test2.py -> build/lib/tests 2025-09-28T13:53:11,589 copying tests/test_logging_system.py -> build/lib/tests 2025-09-28T13:53:11,591 copying tests/dynamic_loading_test.py -> build/lib/tests 2025-09-28T13:53:11,593 copying tests/test_proxy_middleware_refactored.py -> build/lib/tests 2025-09-28T13:53:11,595 copying tests/error_handling_example.py -> build/lib/tests 2025-09-28T13:53:11,598 copying tests/test_downloader_proxy_compatibility.py -> build/lib/tests 2025-09-28T13:53:11,600 copying tests/authenticated_proxy_example.py -> build/lib/tests 2025-09-28T13:53:11,602 copying tests/test_error_handler_compatibility.py -> build/lib/tests 2025-09-28T13:53:11,604 copying tests/test_dynamic_downloaders_proxy.py -> build/lib/tests 2025-09-28T13:53:11,607 copying tests/test_tools.py -> build/lib/tests 2025-09-28T13:53:11,609 copying tests/test_fingerprint_simple.py -> build/lib/tests 2025-09-28T13:53:11,611 copying tests/test_enhanced_error_handler_comprehensive.py -> build/lib/tests 2025-09-28T13:53:11,613 copying tests/__init__.py -> build/lib/tests 2025-09-28T13:53:11,615 copying tests/test_queue_empty_check.py -> build/lib/tests 2025-09-28T13:53:11,617 copying tests/debug_log_levels.py -> build/lib/tests 2025-09-28T13:53:11,619 copying tests/test_request_params.py -> build/lib/tests 2025-09-28T13:53:11,622 copying tests/simple_log_test.py -> build/lib/tests 2025-09-28T13:53:11,624 copying tests/test_telecom_spider_redis_key.py -> build/lib/tests 2025-09-28T13:53:11,626 copying tests/baidu_test.py -> build/lib/tests 2025-09-28T13:53:11,628 copying tests/test_request_ignore_middleware.py -> build/lib/tests 2025-09-28T13:53:11,630 copying tests/debug_pipelines.py -> build/lib/tests 2025-09-28T13:53:11,632 copying tests/test_config_merge.py -> build/lib/tests 2025-09-28T13:53:11,635 copying tests/test_parsel.py -> build/lib/tests 2025-09-28T13:53:11,637 copying tests/test_date_tools.py -> build/lib/tests 2025-09-28T13:53:11,638 copying tests/test_scheduler_config_update.py -> build/lib/tests 2025-09-28T13:53:11,641 copying tests/simple_queue_type_test.py -> build/lib/tests 2025-09-28T13:53:11,642 copying tests/test_hash_performance.py -> build/lib/tests 2025-09-28T13:53:11,644 copying tests/framework_performance_test.py -> build/lib/tests 2025-09-28T13:53:11,647 copying tests/test_edge_cases.py -> build/lib/tests 2025-09-28T13:53:11,649 copying tests/simple_spider_test.py -> build/lib/tests 2025-09-28T13:53:11,651 copying tests/test_proxy_middleware_enhanced.py -> build/lib/tests 2025-09-28T13:53:11,653 copying tests/test_cleaners.py -> build/lib/tests 2025-09-28T13:53:11,655 copying tests/test_batch_processor.py -> build/lib/tests 2025-09-28T13:53:11,657 copying tests/test_template_redis_key.py -> build/lib/tests 2025-09-28T13:53:11,660 copying tests/log_buffering_test.py -> build/lib/tests 2025-09-28T13:53:11,661 copying tests/test_proxy_health_check.py -> build/lib/tests 2025-09-28T13:53:11,663 copying tests/response_improvements_example.py -> build/lib/tests 2025-09-28T13:53:11,666 copying tests/final_validation_test.py -> build/lib/tests 2025-09-28T13:53:11,668 copying tests/distributed_test.py -> build/lib/tests 2025-09-28T13:53:11,670 copying tests/test_mode_change.py -> build/lib/tests 2025-09-28T13:53:11,671 copying tests/test_large_scale_config.py -> build/lib/tests 2025-09-28T13:53:11,674 copying tests/test_framework_logger.py -> build/lib/tests 2025-09-28T13:53:11,676 copying tests/test_simple_response.py -> build/lib/tests 2025-09-28T13:53:11,678 copying tests/test_performance_monitor.py -> build/lib/tests 2025-09-28T13:53:11,680 copying tests/test_queue_manager_double_crawlo.py -> build/lib/tests 2025-09-28T13:53:11,682 copying tests/cleaners_example.py -> build/lib/tests 2025-09-28T13:53:11,684 copying tests/test_default_header_middleware.py -> build/lib/tests 2025-09-28T13:53:11,687 copying tests/simple_crawlo_test.py -> build/lib/tests 2025-09-28T13:53:11,689 copying tests/test_redis_config.py -> build/lib/tests 2025-09-28T13:53:11,691 copying tests/test_queue_naming.py -> build/lib/tests 2025-09-28T13:53:11,694 copying tests/test_redis_queue_name_fix.py -> build/lib/tests 2025-09-28T13:53:11,696 copying tests/verify_distributed.py -> build/lib/tests 2025-09-28T13:53:11,698 copying tests/advanced_tools_example.py -> build/lib/tests 2025-09-28T13:53:11,700 copying tests/test_retry_middleware.py -> build/lib/tests 2025-09-28T13:53:11,703 copying tests/test_large_scale_helper.py -> build/lib/tests 2025-09-28T13:53:11,705 copying tests/test_dynamic_proxy_real.py -> build/lib/tests 2025-09-28T13:53:11,707 copying tests/comprehensive_test.py -> build/lib/tests 2025-09-28T13:53:11,709 copying tests/test_proxy_middleware.py -> build/lib/tests 2025-09-28T13:53:11,711 copying tests/performance_comparison.py -> build/lib/tests 2025-09-28T13:53:11,714 copying tests/test_pipeline_fingerprint_consistency.py -> build/lib/tests 2025-09-28T13:53:11,716 copying tests/test_request_serialization.py -> build/lib/tests 2025-09-28T13:53:11,718 copying tests/fix_log_test.py -> build/lib/tests 2025-09-28T13:53:11,720 copying tests/test_crawlo_proxy_integration.py -> build/lib/tests 2025-09-28T13:53:11,722 copying tests/test_fingerprint_consistency.py -> build/lib/tests 2025-09-28T13:53:11,724 copying tests/test_proxy_stats.py -> build/lib/tests 2025-09-28T13:53:11,726 copying tests/test_proxy_middleware_integration.py -> build/lib/tests 2025-09-28T13:53:11,729 copying tests/test_proxy_providers.py -> build/lib/tests 2025-09-28T13:53:11,730 copying tests/test_response_improvements.py -> build/lib/tests 2025-09-28T13:53:11,733 creating build/lib/examples/test_project 2025-09-28T13:53:11,734 copying examples/test_project/__init__.py -> build/lib/examples/test_project 2025-09-28T13:53:11,736 copying examples/test_project/run.py -> build/lib/examples/test_project 2025-09-28T13:53:11,738 creating build/lib/examples/test_project/test_project 2025-09-28T13:53:11,739 copying examples/test_project/test_project/pipelines.py -> build/lib/examples/test_project/test_project 2025-09-28T13:53:11,741 copying examples/test_project/test_project/middlewares.py -> build/lib/examples/test_project/test_project 2025-09-28T13:53:11,743 copying examples/test_project/test_project/__init__.py -> build/lib/examples/test_project/test_project 2025-09-28T13:53:11,745 copying examples/test_project/test_project/settings.py -> build/lib/examples/test_project/test_project 2025-09-28T13:53:11,747 copying examples/test_project/test_project/items.py -> build/lib/examples/test_project/test_project 2025-09-28T13:53:11,750 creating build/lib/examples/test_project/test_project/spiders 2025-09-28T13:53:11,751 copying examples/test_project/test_project/spiders/of_week_dis.py -> build/lib/examples/test_project/test_project/spiders 2025-09-28T13:53:11,753 copying examples/test_project/test_project/spiders/__init__.py -> build/lib/examples/test_project/test_project/spiders 2025-09-28T13:53:11,755 creating build/lib/crawlo/pipelines 2025-09-28T13:53:11,757 copying crawlo/pipelines/json_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,759 copying crawlo/pipelines/bloom_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,761 copying crawlo/pipelines/redis_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,764 copying crawlo/pipelines/csv_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,766 copying crawlo/pipelines/__init__.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,768 copying crawlo/pipelines/mysql_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,771 copying crawlo/pipelines/mongo_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,773 copying crawlo/pipelines/pipeline_manager.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,775 copying crawlo/pipelines/memory_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,777 copying crawlo/pipelines/console_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,779 copying crawlo/pipelines/database_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-09-28T13:53:11,782 creating build/lib/crawlo/network 2025-09-28T13:53:11,783 copying crawlo/network/request.py -> build/lib/crawlo/network 2025-09-28T13:53:11,785 copying crawlo/network/__init__.py -> build/lib/crawlo/network 2025-09-28T13:53:11,787 copying crawlo/network/response.py -> build/lib/crawlo/network 2025-09-28T13:53:11,790 creating build/lib/crawlo/logging 2025-09-28T13:53:11,791 copying crawlo/logging/manager.py -> build/lib/crawlo/logging 2025-09-28T13:53:11,793 copying crawlo/logging/__init__.py -> build/lib/crawlo/logging 2025-09-28T13:53:11,795 copying crawlo/logging/config.py -> build/lib/crawlo/logging 2025-09-28T13:53:11,797 copying crawlo/logging/factory.py -> build/lib/crawlo/logging 2025-09-28T13:53:11,800 creating build/lib/crawlo/extension 2025-09-28T13:53:11,801 copying crawlo/extension/request_recorder.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,803 copying crawlo/extension/logging_extension.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,805 copying crawlo/extension/__init__.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,807 copying crawlo/extension/log_stats.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,809 copying crawlo/extension/log_interval.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,812 copying crawlo/extension/performance_profiler.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,814 copying crawlo/extension/health_check.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,816 copying crawlo/extension/memory_monitor.py -> build/lib/crawlo/extension 2025-09-28T13:53:11,819 creating build/lib/crawlo/utils 2025-09-28T13:53:11,820 copying crawlo/utils/large_scale_helper.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,823 copying crawlo/utils/error_handler.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,825 copying crawlo/utils/large_scale_config.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,827 copying crawlo/utils/request.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,830 copying crawlo/utils/queue_helper.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,832 copying crawlo/utils/log.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,834 copying crawlo/utils/request_serializer.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,836 copying crawlo/utils/url.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,838 copying crawlo/utils/func_tools.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,840 copying crawlo/utils/db_helper.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,842 copying crawlo/utils/redis_key_validator.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,844 copying crawlo/utils/class_loader.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,846 copying crawlo/utils/__init__.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,848 copying crawlo/utils/spider_loader.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,850 copying crawlo/utils/system.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,852 copying crawlo/utils/fingerprint.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,853 copying crawlo/utils/performance_monitor.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,856 copying crawlo/utils/env_config.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,858 copying crawlo/utils/enhanced_error_handler.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,860 copying crawlo/utils/batch_processor.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,863 copying crawlo/utils/redis_connection_pool.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,865 copying crawlo/utils/tools.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,867 copying crawlo/utils/controlled_spider_mixin.py -> build/lib/crawlo/utils 2025-09-28T13:53:11,870 creating build/lib/crawlo/commands 2025-09-28T13:53:11,871 copying crawlo/commands/genspider.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,873 copying crawlo/commands/help.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,876 copying crawlo/commands/list.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,878 copying crawlo/commands/check.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,881 copying crawlo/commands/stats.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,883 copying crawlo/commands/__init__.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,885 copying crawlo/commands/utils.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,887 copying crawlo/commands/startproject.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,890 copying crawlo/commands/run.py -> build/lib/crawlo/commands 2025-09-28T13:53:11,892 creating build/lib/crawlo/factories 2025-09-28T13:53:11,893 copying crawlo/factories/registry.py -> build/lib/crawlo/factories 2025-09-28T13:53:11,896 copying crawlo/factories/__init__.py -> build/lib/crawlo/factories 2025-09-28T13:53:11,898 copying crawlo/factories/base.py -> build/lib/crawlo/factories 2025-09-28T13:53:11,900 copying crawlo/factories/crawler.py -> build/lib/crawlo/factories 2025-09-28T13:53:11,902 creating build/lib/crawlo/tools 2025-09-28T13:53:11,903 copying crawlo/tools/data_validator.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,906 copying crawlo/tools/encoding_converter.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,907 copying crawlo/tools/authenticated_proxy.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,910 copying crawlo/tools/scenario_adapter.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,912 copying crawlo/tools/data_formatter.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,915 copying crawlo/tools/anti_crawler.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,917 copying crawlo/tools/__init__.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,919 copying crawlo/tools/retry_mechanism.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,921 copying crawlo/tools/network_diagnostic.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,923 copying crawlo/tools/distributed_coordinator.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,926 copying crawlo/tools/request_tools.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,928 copying crawlo/tools/text_cleaner.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,930 copying crawlo/tools/date_tools.py -> build/lib/crawlo/tools 2025-09-28T13:53:11,933 creating build/lib/crawlo/settings 2025-09-28T13:53:11,934 copying crawlo/settings/__init__.py -> build/lib/crawlo/settings 2025-09-28T13:53:11,935 copying crawlo/settings/setting_manager.py -> build/lib/crawlo/settings 2025-09-28T13:53:11,938 copying crawlo/settings/default_settings.py -> build/lib/crawlo/settings 2025-09-28T13:53:11,941 creating build/lib/crawlo/downloader 2025-09-28T13:53:11,941 copying crawlo/downloader/playwright_downloader.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,944 copying crawlo/downloader/cffi_downloader.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,947 copying crawlo/downloader/httpx_downloader.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,949 copying crawlo/downloader/hybrid_downloader.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,951 copying crawlo/downloader/__init__.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,954 copying crawlo/downloader/selenium_downloader.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,956 copying crawlo/downloader/aiohttp_downloader.py -> build/lib/crawlo/downloader 2025-09-28T13:53:11,959 creating build/lib/crawlo/spider 2025-09-28T13:53:11,960 copying crawlo/spider/__init__.py -> build/lib/crawlo/spider 2025-09-28T13:53:11,963 creating build/lib/crawlo/filters 2025-09-28T13:53:11,964 copying crawlo/filters/memory_filter.py -> build/lib/crawlo/filters 2025-09-28T13:53:11,967 copying crawlo/filters/__init__.py -> build/lib/crawlo/filters 2025-09-28T13:53:11,969 copying crawlo/filters/aioredis_filter.py -> build/lib/crawlo/filters 2025-09-28T13:53:11,972 creating build/lib/crawlo/initialization 2025-09-28T13:53:11,973 copying crawlo/initialization/built_in.py -> build/lib/crawlo/initialization 2025-09-28T13:53:11,975 copying crawlo/initialization/registry.py -> build/lib/crawlo/initialization 2025-09-28T13:53:11,978 copying crawlo/initialization/core.py -> build/lib/crawlo/initialization 2025-09-28T13:53:11,980 copying crawlo/initialization/phases.py -> build/lib/crawlo/initialization 2025-09-28T13:53:11,982 copying crawlo/initialization/__init__.py -> build/lib/crawlo/initialization 2025-09-28T13:53:11,984 copying crawlo/initialization/context.py -> build/lib/crawlo/initialization 2025-09-28T13:53:11,987 creating build/lib/crawlo/items 2025-09-28T13:53:11,988 copying crawlo/items/fields.py -> build/lib/crawlo/items 2025-09-28T13:53:11,990 copying crawlo/items/__init__.py -> build/lib/crawlo/items 2025-09-28T13:53:11,992 copying crawlo/items/base.py -> build/lib/crawlo/items 2025-09-28T13:53:11,994 copying crawlo/items/items.py -> build/lib/crawlo/items 2025-09-28T13:53:11,996 creating build/lib/crawlo/data 2025-09-28T13:53:11,997 copying crawlo/data/__init__.py -> build/lib/crawlo/data 2025-09-28T13:53:11,999 copying crawlo/data/user_agents.py -> build/lib/crawlo/data 2025-09-28T13:53:12,002 creating build/lib/crawlo/middleware 2025-09-28T13:53:12,003 copying crawlo/middleware/response_filter.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,006 copying crawlo/middleware/default_header.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,008 copying crawlo/middleware/response_code.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,010 copying crawlo/middleware/proxy.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,012 copying crawlo/middleware/middleware_manager.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,015 copying crawlo/middleware/offsite.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,017 copying crawlo/middleware/retry.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,019 copying crawlo/middleware/download_delay.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,021 copying crawlo/middleware/simple_proxy.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,023 copying crawlo/middleware/__init__.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,024 copying crawlo/middleware/request_ignore.py -> build/lib/crawlo/middleware 2025-09-28T13:53:12,027 creating build/lib/crawlo/core 2025-09-28T13:53:12,028 copying crawlo/core/processor.py -> build/lib/crawlo/core 2025-09-28T13:53:12,030 copying crawlo/core/scheduler.py -> build/lib/crawlo/core 2025-09-28T13:53:12,032 copying crawlo/core/engine.py -> build/lib/crawlo/core 2025-09-28T13:53:12,035 copying crawlo/core/__init__.py -> build/lib/crawlo/core 2025-09-28T13:53:12,037 creating build/lib/crawlo/queue 2025-09-28T13:53:12,038 copying crawlo/queue/redis_priority_queue.py -> build/lib/crawlo/queue 2025-09-28T13:53:12,040 copying crawlo/queue/queue_manager.py -> build/lib/crawlo/queue 2025-09-28T13:53:12,043 copying crawlo/queue/__init__.py -> build/lib/crawlo/queue 2025-09-28T13:53:12,044 copying crawlo/queue/pqueue.py -> build/lib/crawlo/queue 2025-09-28T13:53:12,046 running egg_info 2025-09-28T13:53:12,061 writing crawlo.egg-info/PKG-INFO 2025-09-28T13:53:12,070 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-09-28T13:53:12,071 writing entry points to crawlo.egg-info/entry_points.txt 2025-09-28T13:53:12,076 writing requirements to crawlo.egg-info/requires.txt 2025-09-28T13:53:12,077 writing top-level names to crawlo.egg-info/top_level.txt 2025-09-28T13:53:12,122 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:12,139 reading manifest template 'MANIFEST.in' 2025-09-28T13:53:12,140 warning: no files found matching 'VERSION' 2025-09-28T13:53:12,141 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-09-28T13:53:12,200 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-09-28T13:53:12,202 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-09-28T13:53:12,204 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-09-28T13:53:12,206 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-09-28T13:53:12,208 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-09-28T13:53:12,210 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-09-28T13:53:12,212 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-09-28T13:53:12,213 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-09-28T13:53:12,215 no previously-included directories found matching 'samples' 2025-09-28T13:53:12,216 no previously-included directories found matching 'docs' 2025-09-28T13:53:12,234 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-09-28T13:53:12,238 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates' is absent from the `packages` configuration. 2025-09-28T13:53:12,238 !! 2025-09-28T13:53:12,240 ******************************************************************************** 2025-09-28T13:53:12,240 ############################ 2025-09-28T13:53:12,241 # Package would be ignored # 2025-09-28T13:53:12,242 ############################ 2025-09-28T13:53:12,243 Python recognizes 'crawlo.templates' as an importable package[^1], 2025-09-28T13:53:12,243 but it is absent from setuptools' `packages` configuration. 2025-09-28T13:53:12,244 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-28T13:53:12,244 package, please make sure that 'crawlo.templates' is explicitly added 2025-09-28T13:53:12,245 to the `packages` configuration field. 2025-09-28T13:53:12,246 Alternatively, you can also rely on setuptools' discovery methods 2025-09-28T13:53:12,246 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-28T13:53:12,247 instead of `find_packages(...)`/`find:`). 2025-09-28T13:53:12,248 You can read more about "package discovery" on setuptools documentation page: 2025-09-28T13:53:12,248 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-28T13:53:12,249 If you don't want 'crawlo.templates' to be distributed and are 2025-09-28T13:53:12,250 already explicitly excluding 'crawlo.templates' via 2025-09-28T13:53:12,250 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-28T13:53:12,251 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-28T13:53:12,251 combination with a more fine grained `package-data` configuration. 2025-09-28T13:53:12,252 You can read more about "package data files" on setuptools documentation page: 2025-09-28T13:53:12,253 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-28T13:53:12,255 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-28T13:53:12,255 even if it does not contain any `.py` files. 2025-09-28T13:53:12,256 On the other hand, currently there is no concept of package data 2025-09-28T13:53:12,256 directory, all directories are treated like packages. 2025-09-28T13:53:12,257 ******************************************************************************** 2025-09-28T13:53:12,258 !! 2025-09-28T13:53:12,259 check.warn(importable) 2025-09-28T13:53:12,259 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project' is absent from the `packages` configuration. 2025-09-28T13:53:12,260 !! 2025-09-28T13:53:12,261 ******************************************************************************** 2025-09-28T13:53:12,261 ############################ 2025-09-28T13:53:12,262 # Package would be ignored # 2025-09-28T13:53:12,262 ############################ 2025-09-28T13:53:12,263 Python recognizes 'crawlo.templates.project' as an importable package[^1], 2025-09-28T13:53:12,264 but it is absent from setuptools' `packages` configuration. 2025-09-28T13:53:12,265 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-28T13:53:12,265 package, please make sure that 'crawlo.templates.project' is explicitly added 2025-09-28T13:53:12,266 to the `packages` configuration field. 2025-09-28T13:53:12,267 Alternatively, you can also rely on setuptools' discovery methods 2025-09-28T13:53:12,268 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-28T13:53:12,268 instead of `find_packages(...)`/`find:`). 2025-09-28T13:53:12,269 You can read more about "package discovery" on setuptools documentation page: 2025-09-28T13:53:12,270 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-28T13:53:12,272 If you don't want 'crawlo.templates.project' to be distributed and are 2025-09-28T13:53:12,272 already explicitly excluding 'crawlo.templates.project' via 2025-09-28T13:53:12,273 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-28T13:53:12,274 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-28T13:53:12,274 combination with a more fine grained `package-data` configuration. 2025-09-28T13:53:12,275 You can read more about "package data files" on setuptools documentation page: 2025-09-28T13:53:12,276 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-28T13:53:12,277 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-28T13:53:12,277 even if it does not contain any `.py` files. 2025-09-28T13:53:12,278 On the other hand, currently there is no concept of package data 2025-09-28T13:53:12,278 directory, all directories are treated like packages. 2025-09-28T13:53:12,278 ******************************************************************************** 2025-09-28T13:53:12,279 !! 2025-09-28T13:53:12,280 check.warn(importable) 2025-09-28T13:53:12,280 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project.spiders' is absent from the `packages` configuration. 2025-09-28T13:53:12,281 !! 2025-09-28T13:53:12,282 ******************************************************************************** 2025-09-28T13:53:12,282 ############################ 2025-09-28T13:53:12,283 # Package would be ignored # 2025-09-28T13:53:12,283 ############################ 2025-09-28T13:53:12,284 Python recognizes 'crawlo.templates.project.spiders' as an importable package[^1], 2025-09-28T13:53:12,284 but it is absent from setuptools' `packages` configuration. 2025-09-28T13:53:12,285 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-28T13:53:12,286 package, please make sure that 'crawlo.templates.project.spiders' is explicitly added 2025-09-28T13:53:12,286 to the `packages` configuration field. 2025-09-28T13:53:12,287 Alternatively, you can also rely on setuptools' discovery methods 2025-09-28T13:53:12,288 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-28T13:53:12,288 instead of `find_packages(...)`/`find:`). 2025-09-28T13:53:12,289 You can read more about "package discovery" on setuptools documentation page: 2025-09-28T13:53:12,290 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-28T13:53:12,291 If you don't want 'crawlo.templates.project.spiders' to be distributed and are 2025-09-28T13:53:12,292 already explicitly excluding 'crawlo.templates.project.spiders' via 2025-09-28T13:53:12,292 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-28T13:53:12,293 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-28T13:53:12,293 combination with a more fine grained `package-data` configuration. 2025-09-28T13:53:12,294 You can read more about "package data files" on setuptools documentation page: 2025-09-28T13:53:12,296 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-28T13:53:12,298 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-28T13:53:12,298 even if it does not contain any `.py` files. 2025-09-28T13:53:12,299 On the other hand, currently there is no concept of package data 2025-09-28T13:53:12,299 directory, all directories are treated like packages. 2025-09-28T13:53:12,300 ******************************************************************************** 2025-09-28T13:53:12,301 !! 2025-09-28T13:53:12,301 check.warn(importable) 2025-09-28T13:53:12,302 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.spider' is absent from the `packages` configuration. 2025-09-28T13:53:12,303 !! 2025-09-28T13:53:12,304 ******************************************************************************** 2025-09-28T13:53:12,304 ############################ 2025-09-28T13:53:12,304 # Package would be ignored # 2025-09-28T13:53:12,305 ############################ 2025-09-28T13:53:12,305 Python recognizes 'crawlo.templates.spider' as an importable package[^1], 2025-09-28T13:53:12,306 but it is absent from setuptools' `packages` configuration. 2025-09-28T13:53:12,307 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-28T13:53:12,307 package, please make sure that 'crawlo.templates.spider' is explicitly added 2025-09-28T13:53:12,308 to the `packages` configuration field. 2025-09-28T13:53:12,308 Alternatively, you can also rely on setuptools' discovery methods 2025-09-28T13:53:12,309 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-28T13:53:12,309 instead of `find_packages(...)`/`find:`). 2025-09-28T13:53:12,310 You can read more about "package discovery" on setuptools documentation page: 2025-09-28T13:53:12,311 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-28T13:53:12,312 If you don't want 'crawlo.templates.spider' to be distributed and are 2025-09-28T13:53:12,313 already explicitly excluding 'crawlo.templates.spider' via 2025-09-28T13:53:12,313 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-28T13:53:12,313 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-28T13:53:12,314 combination with a more fine grained `package-data` configuration. 2025-09-28T13:53:12,315 You can read more about "package data files" on setuptools documentation page: 2025-09-28T13:53:12,316 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-28T13:53:12,317 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-28T13:53:12,318 even if it does not contain any `.py` files. 2025-09-28T13:53:12,319 On the other hand, currently there is no concept of package data 2025-09-28T13:53:12,319 directory, all directories are treated like packages. 2025-09-28T13:53:12,320 ******************************************************************************** 2025-09-28T13:53:12,321 !! 2025-09-28T13:53:12,321 check.warn(importable) 2025-09-28T13:53:12,322 /tmp/pip-build-env-dhwq7alg/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.scrapy_comparison' is absent from the `packages` configuration. 2025-09-28T13:53:12,322 !! 2025-09-28T13:53:12,324 ******************************************************************************** 2025-09-28T13:53:12,324 ############################ 2025-09-28T13:53:12,325 # Package would be ignored # 2025-09-28T13:53:12,325 ############################ 2025-09-28T13:53:12,326 Python recognizes 'tests.scrapy_comparison' as an importable package[^1], 2025-09-28T13:53:12,326 but it is absent from setuptools' `packages` configuration. 2025-09-28T13:53:12,327 This leads to an ambiguous overall configuration. If you want to distribute this 2025-09-28T13:53:12,328 package, please make sure that 'tests.scrapy_comparison' is explicitly added 2025-09-28T13:53:12,328 to the `packages` configuration field. 2025-09-28T13:53:12,330 Alternatively, you can also rely on setuptools' discovery methods 2025-09-28T13:53:12,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-09-28T13:53:12,331 instead of `find_packages(...)`/`find:`). 2025-09-28T13:53:12,332 You can read more about "package discovery" on setuptools documentation page: 2025-09-28T13:53:12,333 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-09-28T13:53:12,334 If you don't want 'tests.scrapy_comparison' to be distributed and are 2025-09-28T13:53:12,334 already explicitly excluding 'tests.scrapy_comparison' via 2025-09-28T13:53:12,335 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-09-28T13:53:12,335 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-09-28T13:53:12,336 combination with a more fine grained `package-data` configuration. 2025-09-28T13:53:12,336 You can read more about "package data files" on setuptools documentation page: 2025-09-28T13:53:12,337 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-09-28T13:53:12,338 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-09-28T13:53:12,339 even if it does not contain any `.py` files. 2025-09-28T13:53:12,339 On the other hand, currently there is no concept of package data 2025-09-28T13:53:12,340 directory, all directories are treated like packages. 2025-09-28T13:53:12,340 ******************************************************************************** 2025-09-28T13:53:12,341 !! 2025-09-28T13:53:12,341 check.warn(importable) 2025-09-28T13:53:12,342 creating build/lib/crawlo/templates 2025-09-28T13:53:12,342 copying crawlo/templates/crawlo.cfg.tmpl -> build/lib/crawlo/templates 2025-09-28T13:53:12,343 copying crawlo/templates/run.py.tmpl -> build/lib/crawlo/templates 2025-09-28T13:53:12,343 copying crawlo/templates/spiders_init.py.tmpl -> build/lib/crawlo/templates 2025-09-28T13:53:12,344 creating build/lib/crawlo/templates/project 2025-09-28T13:53:12,344 copying crawlo/templates/project/__init__.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,345 copying crawlo/templates/project/items.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,346 copying crawlo/templates/project/middlewares.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,346 copying crawlo/templates/project/pipelines.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,347 copying crawlo/templates/project/settings.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,347 copying crawlo/templates/project/settings_distributed.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,348 copying crawlo/templates/project/settings_gentle.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,348 copying crawlo/templates/project/settings_high_performance.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,349 copying crawlo/templates/project/settings_minimal.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,349 copying crawlo/templates/project/settings_simple.py.tmpl -> build/lib/crawlo/templates/project 2025-09-28T13:53:12,350 creating build/lib/crawlo/templates/project/spiders 2025-09-28T13:53:12,350 copying crawlo/templates/project/spiders/__init__.py.tmpl -> build/lib/crawlo/templates/project/spiders 2025-09-28T13:53:12,351 creating build/lib/crawlo/templates/spider 2025-09-28T13:53:12,351 copying crawlo/templates/spider/spider.py.tmpl -> build/lib/crawlo/templates/spider 2025-09-28T13:53:12,352 copying tests/comprehensive_testing_summary.md -> build/lib/tests 2025-09-28T13:53:12,352 copying tests/final_command_test_report.md -> build/lib/tests 2025-09-28T13:53:12,353 copying tests/untested_features_report.md -> build/lib/tests 2025-09-28T13:53:12,353 creating build/lib/tests/scrapy_comparison 2025-09-28T13:53:12,354 copying tests/scrapy_comparison/ofweek_scrapy.py -> build/lib/tests/scrapy_comparison 2025-09-28T13:53:12,355 copying tests/scrapy_comparison/scrapy_test.py -> build/lib/tests/scrapy_comparison 2025-09-28T13:53:12,371 installing to build/bdist.linux-armv7l/wheel 2025-09-28T13:53:12,371 running install 2025-09-28T13:53:12,395 running install_lib 2025-09-28T13:53:12,403 creating build/bdist.linux-armv7l/wheel 2025-09-28T13:53:12,405 creating build/bdist.linux-armv7l/wheel/examples 2025-09-28T13:53:12,407 copying build/lib/examples/__init__.py -> build/bdist.linux-armv7l/wheel/./examples 2025-09-28T13:53:12,409 creating build/bdist.linux-armv7l/wheel/examples/test_project 2025-09-28T13:53:12,410 copying build/lib/examples/test_project/__init__.py -> build/bdist.linux-armv7l/wheel/./examples/test_project 2025-09-28T13:53:12,412 copying build/lib/examples/test_project/run.py -> build/bdist.linux-armv7l/wheel/./examples/test_project 2025-09-28T13:53:12,414 creating build/bdist.linux-armv7l/wheel/examples/test_project/test_project 2025-09-28T13:53:12,416 creating build/bdist.linux-armv7l/wheel/examples/test_project/test_project/spiders 2025-09-28T13:53:12,417 copying build/lib/examples/test_project/test_project/spiders/of_week_dis.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project/spiders 2025-09-28T13:53:12,420 copying build/lib/examples/test_project/test_project/spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project/spiders 2025-09-28T13:53:12,421 copying build/lib/examples/test_project/test_project/pipelines.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project 2025-09-28T13:53:12,423 copying build/lib/examples/test_project/test_project/middlewares.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project 2025-09-28T13:53:12,426 copying build/lib/examples/test_project/test_project/__init__.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project 2025-09-28T13:53:12,427 copying build/lib/examples/test_project/test_project/settings.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project 2025-09-28T13:53:12,430 copying build/lib/examples/test_project/test_project/items.py -> build/bdist.linux-armv7l/wheel/./examples/test_project/test_project 2025-09-28T13:53:12,432 creating build/bdist.linux-armv7l/wheel/crawlo 2025-09-28T13:53:12,434 creating build/bdist.linux-armv7l/wheel/crawlo/pipelines 2025-09-28T13:53:12,435 copying build/lib/crawlo/pipelines/json_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,438 copying build/lib/crawlo/pipelines/bloom_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,440 copying build/lib/crawlo/pipelines/redis_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,443 copying build/lib/crawlo/pipelines/csv_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,445 copying build/lib/crawlo/pipelines/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,447 copying build/lib/crawlo/pipelines/mysql_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,449 copying build/lib/crawlo/pipelines/mongo_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,452 copying build/lib/crawlo/pipelines/pipeline_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,454 copying build/lib/crawlo/pipelines/memory_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,456 copying build/lib/crawlo/pipelines/console_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,458 copying build/lib/crawlo/pipelines/database_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-09-28T13:53:12,460 copying build/lib/crawlo/subscriber.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,463 creating build/bdist.linux-armv7l/wheel/crawlo/network 2025-09-28T13:53:12,464 copying build/lib/crawlo/network/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-28T13:53:12,467 copying build/lib/crawlo/network/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-28T13:53:12,469 copying build/lib/crawlo/network/response.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-09-28T13:53:12,472 creating build/bdist.linux-armv7l/wheel/crawlo/logging 2025-09-28T13:53:12,473 copying build/lib/crawlo/logging/manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-28T13:53:12,475 copying build/lib/crawlo/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-28T13:53:12,477 copying build/lib/crawlo/logging/config.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-28T13:53:12,479 copying build/lib/crawlo/logging/factory.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-09-28T13:53:12,481 creating build/bdist.linux-armv7l/wheel/crawlo/extension 2025-09-28T13:53:12,482 copying build/lib/crawlo/extension/request_recorder.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,484 copying build/lib/crawlo/extension/logging_extension.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,486 copying build/lib/crawlo/extension/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,488 copying build/lib/crawlo/extension/log_stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,490 copying build/lib/crawlo/extension/log_interval.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,492 copying build/lib/crawlo/extension/performance_profiler.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,494 copying build/lib/crawlo/extension/health_check.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,497 copying build/lib/crawlo/extension/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-09-28T13:53:12,499 copying build/lib/crawlo/task_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,502 creating build/bdist.linux-armv7l/wheel/crawlo/utils 2025-09-28T13:53:12,503 copying build/lib/crawlo/utils/large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,506 copying build/lib/crawlo/utils/error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,508 copying build/lib/crawlo/utils/large_scale_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,511 copying build/lib/crawlo/utils/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,513 copying build/lib/crawlo/utils/queue_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,515 copying build/lib/crawlo/utils/log.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,517 copying build/lib/crawlo/utils/request_serializer.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,519 copying build/lib/crawlo/utils/url.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,521 copying build/lib/crawlo/utils/func_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,523 copying build/lib/crawlo/utils/db_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,526 copying build/lib/crawlo/utils/redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,528 copying build/lib/crawlo/utils/class_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,530 copying build/lib/crawlo/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,532 copying build/lib/crawlo/utils/spider_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,533 copying build/lib/crawlo/utils/system.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,535 copying build/lib/crawlo/utils/fingerprint.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,537 copying build/lib/crawlo/utils/performance_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,540 copying build/lib/crawlo/utils/env_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,542 copying build/lib/crawlo/utils/enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,544 copying build/lib/crawlo/utils/batch_processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,546 copying build/lib/crawlo/utils/redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,549 copying build/lib/crawlo/utils/tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,551 copying build/lib/crawlo/utils/controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-09-28T13:53:12,554 creating build/bdist.linux-armv7l/wheel/crawlo/commands 2025-09-28T13:53:12,555 copying build/lib/crawlo/commands/genspider.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,557 copying build/lib/crawlo/commands/help.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,559 copying build/lib/crawlo/commands/list.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,562 copying build/lib/crawlo/commands/check.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,564 copying build/lib/crawlo/commands/stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,566 copying build/lib/crawlo/commands/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,568 copying build/lib/crawlo/commands/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,571 copying build/lib/crawlo/commands/startproject.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,573 copying build/lib/crawlo/commands/run.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-09-28T13:53:12,575 copying build/lib/crawlo/event.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,577 creating build/bdist.linux-armv7l/wheel/crawlo/factories 2025-09-28T13:53:12,578 copying build/lib/crawlo/factories/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-28T13:53:12,580 copying build/lib/crawlo/factories/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-28T13:53:12,582 copying build/lib/crawlo/factories/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-28T13:53:12,584 copying build/lib/crawlo/factories/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-09-28T13:53:12,586 creating build/bdist.linux-armv7l/wheel/crawlo/tools 2025-09-28T13:53:12,587 copying build/lib/crawlo/tools/data_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,590 copying build/lib/crawlo/tools/encoding_converter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,592 copying build/lib/crawlo/tools/authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,594 copying build/lib/crawlo/tools/scenario_adapter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,596 copying build/lib/crawlo/tools/data_formatter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,598 copying build/lib/crawlo/tools/anti_crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,601 copying build/lib/crawlo/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,603 copying build/lib/crawlo/tools/retry_mechanism.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,605 copying build/lib/crawlo/tools/network_diagnostic.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,607 copying build/lib/crawlo/tools/distributed_coordinator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,610 copying build/lib/crawlo/tools/request_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,612 copying build/lib/crawlo/tools/text_cleaner.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,614 copying build/lib/crawlo/tools/date_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-09-28T13:53:12,616 copying build/lib/crawlo/__version__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,618 creating build/bdist.linux-armv7l/wheel/crawlo/settings 2025-09-28T13:53:12,619 copying build/lib/crawlo/settings/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-28T13:53:12,621 copying build/lib/crawlo/settings/setting_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-28T13:53:12,623 copying build/lib/crawlo/settings/default_settings.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-09-28T13:53:12,626 creating build/bdist.linux-armv7l/wheel/crawlo/downloader 2025-09-28T13:53:12,627 copying build/lib/crawlo/downloader/playwright_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,629 copying build/lib/crawlo/downloader/cffi_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,632 copying build/lib/crawlo/downloader/httpx_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,634 copying build/lib/crawlo/downloader/hybrid_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,636 copying build/lib/crawlo/downloader/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,638 copying build/lib/crawlo/downloader/selenium_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,641 copying build/lib/crawlo/downloader/aiohttp_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-09-28T13:53:12,643 copying build/lib/crawlo/config_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,645 copying build/lib/crawlo/framework.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,648 creating build/bdist.linux-armv7l/wheel/crawlo/spider 2025-09-28T13:53:12,649 copying build/lib/crawlo/spider/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/spider 2025-09-28T13:53:12,652 creating build/bdist.linux-armv7l/wheel/crawlo/filters 2025-09-28T13:53:12,653 copying build/lib/crawlo/filters/memory_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-28T13:53:12,656 copying build/lib/crawlo/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-28T13:53:12,658 copying build/lib/crawlo/filters/aioredis_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-09-28T13:53:12,660 copying build/lib/crawlo/cli.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,662 copying build/lib/crawlo/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,664 creating build/bdist.linux-armv7l/wheel/crawlo/initialization 2025-09-28T13:53:12,665 copying build/lib/crawlo/initialization/built_in.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-28T13:53:12,668 copying build/lib/crawlo/initialization/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-28T13:53:12,670 copying build/lib/crawlo/initialization/core.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-28T13:53:12,672 copying build/lib/crawlo/initialization/phases.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-28T13:53:12,674 copying build/lib/crawlo/initialization/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-28T13:53:12,676 copying build/lib/crawlo/initialization/context.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-09-28T13:53:12,679 creating build/bdist.linux-armv7l/wheel/crawlo/items 2025-09-28T13:53:12,680 copying build/lib/crawlo/items/fields.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-28T13:53:12,682 copying build/lib/crawlo/items/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-28T13:53:12,683 copying build/lib/crawlo/items/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-28T13:53:12,685 copying build/lib/crawlo/items/items.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-09-28T13:53:12,688 creating build/bdist.linux-armv7l/wheel/crawlo/templates 2025-09-28T13:53:12,689 copying build/lib/crawlo/templates/spiders_init.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-28T13:53:12,691 creating build/bdist.linux-armv7l/wheel/crawlo/templates/spider 2025-09-28T13:53:12,692 copying build/lib/crawlo/templates/spider/spider.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/spider 2025-09-28T13:53:12,694 copying build/lib/crawlo/templates/crawlo.cfg.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-28T13:53:12,696 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project 2025-09-28T13:53:12,697 copying build/lib/crawlo/templates/project/settings.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,700 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project/spiders 2025-09-28T13:53:12,701 copying build/lib/crawlo/templates/project/spiders/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project/spiders 2025-09-28T13:53:12,703 copying build/lib/crawlo/templates/project/items.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,705 copying build/lib/crawlo/templates/project/settings_simple.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,707 copying build/lib/crawlo/templates/project/settings_high_performance.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,709 copying build/lib/crawlo/templates/project/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,711 copying build/lib/crawlo/templates/project/settings_minimal.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,713 copying build/lib/crawlo/templates/project/settings_distributed.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,715 copying build/lib/crawlo/templates/project/pipelines.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,717 copying build/lib/crawlo/templates/project/settings_gentle.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,719 copying build/lib/crawlo/templates/project/middlewares.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-09-28T13:53:12,721 copying build/lib/crawlo/templates/run.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-09-28T13:53:12,723 creating build/bdist.linux-armv7l/wheel/crawlo/data 2025-09-28T13:53:12,724 copying build/lib/crawlo/data/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-09-28T13:53:12,726 copying build/lib/crawlo/data/user_agents.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-09-28T13:53:12,729 creating build/bdist.linux-armv7l/wheel/crawlo/middleware 2025-09-28T13:53:12,730 copying build/lib/crawlo/middleware/response_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,732 copying build/lib/crawlo/middleware/default_header.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,734 copying build/lib/crawlo/middleware/response_code.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,736 copying build/lib/crawlo/middleware/proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,739 copying build/lib/crawlo/middleware/middleware_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,741 copying build/lib/crawlo/middleware/offsite.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,743 copying build/lib/crawlo/middleware/retry.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,745 copying build/lib/crawlo/middleware/download_delay.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,746 copying build/lib/crawlo/middleware/simple_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,748 copying build/lib/crawlo/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,750 copying build/lib/crawlo/middleware/request_ignore.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-09-28T13:53:12,751 copying build/lib/crawlo/exceptions.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,753 copying build/lib/crawlo/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,756 copying build/lib/crawlo/stats_collector.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,758 creating build/bdist.linux-armv7l/wheel/crawlo/core 2025-09-28T13:53:12,759 copying build/lib/crawlo/core/processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-28T13:53:12,761 copying build/lib/crawlo/core/scheduler.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-28T13:53:12,763 copying build/lib/crawlo/core/engine.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-28T13:53:12,765 copying build/lib/crawlo/core/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-09-28T13:53:12,767 copying build/lib/crawlo/project.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,770 creating build/bdist.linux-armv7l/wheel/crawlo/queue 2025-09-28T13:53:12,771 copying build/lib/crawlo/queue/redis_priority_queue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-28T13:53:12,773 copying build/lib/crawlo/queue/queue_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-28T13:53:12,776 copying build/lib/crawlo/queue/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-28T13:53:12,777 copying build/lib/crawlo/queue/pqueue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-09-28T13:53:12,779 copying build/lib/crawlo/mode_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,782 copying build/lib/crawlo/config.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-09-28T13:53:12,787 creating build/bdist.linux-armv7l/wheel/tests 2025-09-28T13:53:12,788 copying build/lib/tests/dynamic_loading_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,791 copying build/lib/tests/test_enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,794 copying build/lib/tests/test_authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,796 copying build/lib/tests/test_offsite_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,798 copying build/lib/tests/verify_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,800 copying build/lib/tests/test_all_redis_key_configs.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,802 copying build/lib/tests/test_dynamic_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,804 copying build/lib/tests/test_redis_queue.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,806 copying build/lib/tests/test_redis_key_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,808 copying build/lib/tests/simple_optimization_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,810 copying build/lib/tests/test_config_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,813 copying build/lib/tests/test_framework_startup.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,814 copying build/lib/tests/test_advanced_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,817 copying build/lib/tests/test_get_component_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,819 copying build/lib/tests/test_response_filter_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,821 copying build/lib/tests/test_double_crawlo_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,824 copying build/lib/tests/test_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,825 copying build/lib/tests/test_factories.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,827 copying build/lib/tests/comprehensive_framework_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,830 copying build/lib/tests/test_item_dedup_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,832 copying build/lib/tests/test_env_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,834 copying build/lib/tests/log_generation_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,836 copying build/lib/tests/test_double_crawlo_fix_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,838 copying build/lib/tests/date_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,840 copying build/lib/tests/debug_configure.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,842 copying build/lib/tests/test_proxy_strategies.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,843 copying build/lib/tests/spider_log_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,846 copying build/lib/tests/test_redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,848 copying build/lib/tests/test_controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,850 copying build/lib/tests/test_template_content.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,852 copying build/lib/tests/test_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,854 copying build/lib/tests/test_framework_env_usage.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,856 copying build/lib/tests/test_offsite_middleware_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,859 copying build/lib/tests/final_comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,861 copying build/lib/tests/test_user_agents.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,863 copying build/lib/tests/queue_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,864 copying build/lib/tests/test_redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,867 copying build/lib/tests/test_queue_manager_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,869 copying build/lib/tests/test_download_delay_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,872 copying build/lib/tests/test_dynamic_proxy_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,874 copying build/lib/tests/optimized_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,876 copying build/lib/tests/detailed_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,879 copying build/lib/tests/queue_blocking_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,881 copying build/lib/tests/test_dedup_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,883 copying build/lib/tests/distributed_test_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,885 copying build/lib/tests/env_config_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,887 copying build/lib/tests/test_real_scenario_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,889 copying build/lib/tests/debug_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,891 copying build/lib/tests/test_all_pipeline_fingerprints.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,894 copying build/lib/tests/test_queue_type.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,896 copying build/lib/tests/test_final_validation.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,898 copying build/lib/tests/redis_key_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,900 copying build/lib/tests/test_random_user_agent.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,902 copying build/lib/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,904 copying build/lib/tests/test_proxy_api.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,907 copying build/lib/tests/simple_command_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,909 copying build/lib/tests/controlled_spider_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,911 copying build/lib/tests/test_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,913 copying build/lib/tests/test_component_factory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,915 copying build/lib/tests/simple_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,916 copying build/lib/tests/verify_log_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,918 copying build/lib/tests/test_mode_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,920 copying build/lib/tests/test_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,922 copying build/lib/tests/debug_log_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,924 copying build/lib/tests/final_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,927 copying build/lib/tests/test_response_code_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,929 copying build/lib/tests/tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,931 copying build/lib/tests/request_params_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,933 copying build/lib/tests/baidu_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,935 copying build/lib/tests/test_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,937 copying build/lib/tests/config_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,939 copying build/lib/tests/test_all_commands.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,942 copying build/lib/tests/simple_log_test2.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,944 creating build/bdist.linux-armv7l/wheel/tests/scrapy_comparison 2025-09-28T13:53:12,945 copying build/lib/tests/scrapy_comparison/scrapy_test.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-09-28T13:53:12,948 copying build/lib/tests/scrapy_comparison/ofweek_scrapy.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-09-28T13:53:12,950 copying build/lib/tests/test_logging_system.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,952 copying build/lib/tests/comprehensive_testing_summary.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,954 copying build/lib/tests/dynamic_loading_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,956 copying build/lib/tests/test_proxy_middleware_refactored.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,958 copying build/lib/tests/error_handling_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,961 copying build/lib/tests/test_downloader_proxy_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,963 copying build/lib/tests/authenticated_proxy_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,965 copying build/lib/tests/test_error_handler_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,967 copying build/lib/tests/test_dynamic_downloaders_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,969 copying build/lib/tests/test_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,971 copying build/lib/tests/test_fingerprint_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,973 copying build/lib/tests/test_enhanced_error_handler_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,975 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,977 copying build/lib/tests/test_queue_empty_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,978 copying build/lib/tests/debug_log_levels.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,980 copying build/lib/tests/test_request_params.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,982 copying build/lib/tests/simple_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,984 copying build/lib/tests/test_telecom_spider_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,986 copying build/lib/tests/baidu_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,987 copying build/lib/tests/test_request_ignore_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,990 copying build/lib/tests/debug_pipelines.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,991 copying build/lib/tests/test_config_merge.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,994 copying build/lib/tests/test_parsel.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,995 copying build/lib/tests/test_date_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,997 copying build/lib/tests/test_scheduler_config_update.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:12,999 copying build/lib/tests/simple_queue_type_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,001 copying build/lib/tests/test_hash_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,003 copying build/lib/tests/framework_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,005 copying build/lib/tests/test_edge_cases.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,008 copying build/lib/tests/simple_spider_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,010 copying build/lib/tests/test_proxy_middleware_enhanced.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,012 copying build/lib/tests/test_cleaners.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,014 copying build/lib/tests/test_batch_processor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,016 copying build/lib/tests/test_template_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,019 copying build/lib/tests/log_buffering_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,020 copying build/lib/tests/test_proxy_health_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,022 copying build/lib/tests/response_improvements_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,025 copying build/lib/tests/final_validation_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,027 copying build/lib/tests/distributed_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,029 copying build/lib/tests/test_mode_change.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,031 copying build/lib/tests/test_large_scale_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,033 copying build/lib/tests/test_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,035 copying build/lib/tests/test_simple_response.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,037 copying build/lib/tests/test_performance_monitor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,039 copying build/lib/tests/test_queue_manager_double_crawlo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,041 copying build/lib/tests/cleaners_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,044 copying build/lib/tests/test_default_header_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,046 copying build/lib/tests/simple_crawlo_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,048 copying build/lib/tests/test_redis_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,050 copying build/lib/tests/test_queue_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,052 copying build/lib/tests/test_redis_queue_name_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,054 copying build/lib/tests/verify_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,056 copying build/lib/tests/advanced_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,059 copying build/lib/tests/test_retry_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,061 copying build/lib/tests/test_large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,063 copying build/lib/tests/test_dynamic_proxy_real.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,065 copying build/lib/tests/comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,067 copying build/lib/tests/test_proxy_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,069 copying build/lib/tests/performance_comparison.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,071 copying build/lib/tests/test_pipeline_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,073 copying build/lib/tests/test_request_serialization.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,075 copying build/lib/tests/fix_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,077 copying build/lib/tests/test_crawlo_proxy_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,079 copying build/lib/tests/test_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,082 copying build/lib/tests/untested_features_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,084 copying build/lib/tests/final_command_test_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,085 copying build/lib/tests/test_proxy_stats.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,087 copying build/lib/tests/test_proxy_middleware_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,089 copying build/lib/tests/test_proxy_providers.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,091 copying build/lib/tests/test_response_improvements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-09-28T13:53:13,093 running install_egg_info 2025-09-28T13:53:13,107 Copying crawlo.egg-info to build/bdist.linux-armv7l/wheel/./crawlo-1.4.2-py3.11.egg-info 2025-09-28T13:53:13,121 running install_scripts 2025-09-28T13:53:13,131 creating build/bdist.linux-armv7l/wheel/crawlo-1.4.2.dist-info/WHEEL 2025-09-28T13:53:13,134 creating '/tmp/pip-wheel-2tncuyae/.tmp-o_cv_fam/crawlo-1.4.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-09-28T13:53:13,137 adding 'crawlo/__init__.py' 2025-09-28T13:53:13,138 adding 'crawlo/__version__.py' 2025-09-28T13:53:13,139 adding 'crawlo/cli.py' 2025-09-28T13:53:13,141 adding 'crawlo/config.py' 2025-09-28T13:53:13,143 adding 'crawlo/config_validator.py' 2025-09-28T13:53:13,146 adding 'crawlo/crawler.py' 2025-09-28T13:53:13,148 adding 'crawlo/event.py' 2025-09-28T13:53:13,149 adding 'crawlo/exceptions.py' 2025-09-28T13:53:13,151 adding 'crawlo/framework.py' 2025-09-28T13:53:13,153 adding 'crawlo/mode_manager.py' 2025-09-28T13:53:13,155 adding 'crawlo/project.py' 2025-09-28T13:53:13,156 adding 'crawlo/stats_collector.py' 2025-09-28T13:53:13,157 adding 'crawlo/subscriber.py' 2025-09-28T13:53:13,159 adding 'crawlo/task_manager.py' 2025-09-28T13:53:13,161 adding 'crawlo/commands/__init__.py' 2025-09-28T13:53:13,163 adding 'crawlo/commands/check.py' 2025-09-28T13:53:13,165 adding 'crawlo/commands/genspider.py' 2025-09-28T13:53:13,166 adding 'crawlo/commands/help.py' 2025-09-28T13:53:13,168 adding 'crawlo/commands/list.py' 2025-09-28T13:53:13,169 adding 'crawlo/commands/run.py' 2025-09-28T13:53:13,172 adding 'crawlo/commands/startproject.py' 2025-09-28T13:53:13,173 adding 'crawlo/commands/stats.py' 2025-09-28T13:53:13,175 adding 'crawlo/commands/utils.py' 2025-09-28T13:53:13,177 adding 'crawlo/core/__init__.py' 2025-09-28T13:53:13,179 adding 'crawlo/core/engine.py' 2025-09-28T13:53:13,181 adding 'crawlo/core/processor.py' 2025-09-28T13:53:13,182 adding 'crawlo/core/scheduler.py' 2025-09-28T13:53:13,184 adding 'crawlo/data/__init__.py' 2025-09-28T13:53:13,186 adding 'crawlo/data/user_agents.py' 2025-09-28T13:53:13,188 adding 'crawlo/downloader/__init__.py' 2025-09-28T13:53:13,190 adding 'crawlo/downloader/aiohttp_downloader.py' 2025-09-28T13:53:13,192 adding 'crawlo/downloader/cffi_downloader.py' 2025-09-28T13:53:13,194 adding 'crawlo/downloader/httpx_downloader.py' 2025-09-28T13:53:13,195 adding 'crawlo/downloader/hybrid_downloader.py' 2025-09-28T13:53:13,197 adding 'crawlo/downloader/playwright_downloader.py' 2025-09-28T13:53:13,200 adding 'crawlo/downloader/selenium_downloader.py' 2025-09-28T13:53:13,202 adding 'crawlo/extension/__init__.py' 2025-09-28T13:53:13,203 adding 'crawlo/extension/health_check.py' 2025-09-28T13:53:13,205 adding 'crawlo/extension/log_interval.py' 2025-09-28T13:53:13,206 adding 'crawlo/extension/log_stats.py' 2025-09-28T13:53:13,207 adding 'crawlo/extension/logging_extension.py' 2025-09-28T13:53:13,209 adding 'crawlo/extension/memory_monitor.py' 2025-09-28T13:53:13,210 adding 'crawlo/extension/performance_profiler.py' 2025-09-28T13:53:13,212 adding 'crawlo/extension/request_recorder.py' 2025-09-28T13:53:13,214 adding 'crawlo/factories/__init__.py' 2025-09-28T13:53:13,215 adding 'crawlo/factories/base.py' 2025-09-28T13:53:13,216 adding 'crawlo/factories/crawler.py' 2025-09-28T13:53:13,218 adding 'crawlo/factories/registry.py' 2025-09-28T13:53:13,220 adding 'crawlo/filters/__init__.py' 2025-09-28T13:53:13,221 adding 'crawlo/filters/aioredis_filter.py' 2025-09-28T13:53:13,223 adding 'crawlo/filters/memory_filter.py' 2025-09-28T13:53:13,225 adding 'crawlo/initialization/__init__.py' 2025-09-28T13:53:13,227 adding 'crawlo/initialization/built_in.py' 2025-09-28T13:53:13,229 adding 'crawlo/initialization/context.py' 2025-09-28T13:53:13,231 adding 'crawlo/initialization/core.py' 2025-09-28T13:53:13,232 adding 'crawlo/initialization/phases.py' 2025-09-28T13:53:13,234 adding 'crawlo/initialization/registry.py' 2025-09-28T13:53:13,236 adding 'crawlo/items/__init__.py' 2025-09-28T13:53:13,237 adding 'crawlo/items/base.py' 2025-09-28T13:53:13,238 adding 'crawlo/items/fields.py' 2025-09-28T13:53:13,240 adding 'crawlo/items/items.py' 2025-09-28T13:53:13,242 adding 'crawlo/logging/__init__.py' 2025-09-28T13:53:13,243 adding 'crawlo/logging/config.py' 2025-09-28T13:53:13,244 adding 'crawlo/logging/factory.py' 2025-09-28T13:53:13,246 adding 'crawlo/logging/manager.py' 2025-09-28T13:53:13,248 adding 'crawlo/middleware/__init__.py' 2025-09-28T13:53:13,249 adding 'crawlo/middleware/default_header.py' 2025-09-28T13:53:13,251 adding 'crawlo/middleware/download_delay.py' 2025-09-28T13:53:13,252 adding 'crawlo/middleware/middleware_manager.py' 2025-09-28T13:53:13,254 adding 'crawlo/middleware/offsite.py' 2025-09-28T13:53:13,256 adding 'crawlo/middleware/proxy.py' 2025-09-28T13:53:13,258 adding 'crawlo/middleware/request_ignore.py' 2025-09-28T13:53:13,259 adding 'crawlo/middleware/response_code.py' 2025-09-28T13:53:13,260 adding 'crawlo/middleware/response_filter.py' 2025-09-28T13:53:13,262 adding 'crawlo/middleware/retry.py' 2025-09-28T13:53:13,263 adding 'crawlo/middleware/simple_proxy.py' 2025-09-28T13:53:13,265 adding 'crawlo/network/__init__.py' 2025-09-28T13:53:13,267 adding 'crawlo/network/request.py' 2025-09-28T13:53:13,269 adding 'crawlo/network/response.py' 2025-09-28T13:53:13,271 adding 'crawlo/pipelines/__init__.py' 2025-09-28T13:53:13,272 adding 'crawlo/pipelines/bloom_dedup_pipeline.py' 2025-09-28T13:53:13,273 adding 'crawlo/pipelines/console_pipeline.py' 2025-09-28T13:53:13,275 adding 'crawlo/pipelines/csv_pipeline.py' 2025-09-28T13:53:13,277 adding 'crawlo/pipelines/database_dedup_pipeline.py' 2025-09-28T13:53:13,279 adding 'crawlo/pipelines/json_pipeline.py' 2025-09-28T13:53:13,280 adding 'crawlo/pipelines/memory_dedup_pipeline.py' 2025-09-28T13:53:13,282 adding 'crawlo/pipelines/mongo_pipeline.py' 2025-09-28T13:53:13,284 adding 'crawlo/pipelines/mysql_pipeline.py' 2025-09-28T13:53:13,285 adding 'crawlo/pipelines/pipeline_manager.py' 2025-09-28T13:53:13,287 adding 'crawlo/pipelines/redis_dedup_pipeline.py' 2025-09-28T13:53:13,288 adding 'crawlo/queue/__init__.py' 2025-09-28T13:53:13,290 adding 'crawlo/queue/pqueue.py' 2025-09-28T13:53:13,292 adding 'crawlo/queue/queue_manager.py' 2025-09-28T13:53:13,294 adding 'crawlo/queue/redis_priority_queue.py' 2025-09-28T13:53:13,296 adding 'crawlo/settings/__init__.py' 2025-09-28T13:53:13,298 adding 'crawlo/settings/default_settings.py' 2025-09-28T13:53:13,300 adding 'crawlo/settings/setting_manager.py' 2025-09-28T13:53:13,303 adding 'crawlo/spider/__init__.py' 2025-09-28T13:53:13,305 adding 'crawlo/templates/crawlo.cfg.tmpl' 2025-09-28T13:53:13,306 adding 'crawlo/templates/run.py.tmpl' 2025-09-28T13:53:13,307 adding 'crawlo/templates/spiders_init.py.tmpl' 2025-09-28T13:53:13,309 adding 'crawlo/templates/project/__init__.py.tmpl' 2025-09-28T13:53:13,310 adding 'crawlo/templates/project/items.py.tmpl' 2025-09-28T13:53:13,312 adding 'crawlo/templates/project/middlewares.py.tmpl' 2025-09-28T13:53:13,313 adding 'crawlo/templates/project/pipelines.py.tmpl' 2025-09-28T13:53:13,315 adding 'crawlo/templates/project/settings.py.tmpl' 2025-09-28T13:53:13,316 adding 'crawlo/templates/project/settings_distributed.py.tmpl' 2025-09-28T13:53:13,318 adding 'crawlo/templates/project/settings_gentle.py.tmpl' 2025-09-28T13:53:13,319 adding 'crawlo/templates/project/settings_high_performance.py.tmpl' 2025-09-28T13:53:13,321 adding 'crawlo/templates/project/settings_minimal.py.tmpl' 2025-09-28T13:53:13,322 adding 'crawlo/templates/project/settings_simple.py.tmpl' 2025-09-28T13:53:13,324 adding 'crawlo/templates/project/spiders/__init__.py.tmpl' 2025-09-28T13:53:13,326 adding 'crawlo/templates/spider/spider.py.tmpl' 2025-09-28T13:53:13,328 adding 'crawlo/tools/__init__.py' 2025-09-28T13:53:13,330 adding 'crawlo/tools/anti_crawler.py' 2025-09-28T13:53:13,332 adding 'crawlo/tools/authenticated_proxy.py' 2025-09-28T13:53:13,333 adding 'crawlo/tools/data_formatter.py' 2025-09-28T13:53:13,335 adding 'crawlo/tools/data_validator.py' 2025-09-28T13:53:13,337 adding 'crawlo/tools/date_tools.py' 2025-09-28T13:53:13,339 adding 'crawlo/tools/distributed_coordinator.py' 2025-09-28T13:53:13,341 adding 'crawlo/tools/encoding_converter.py' 2025-09-28T13:53:13,343 adding 'crawlo/tools/network_diagnostic.py' 2025-09-28T13:53:13,344 adding 'crawlo/tools/request_tools.py' 2025-09-28T13:53:13,346 adding 'crawlo/tools/retry_mechanism.py' 2025-09-28T13:53:13,347 adding 'crawlo/tools/scenario_adapter.py' 2025-09-28T13:53:13,349 adding 'crawlo/tools/text_cleaner.py' 2025-09-28T13:53:13,351 adding 'crawlo/utils/__init__.py' 2025-09-28T13:53:13,353 adding 'crawlo/utils/batch_processor.py' 2025-09-28T13:53:13,354 adding 'crawlo/utils/class_loader.py' 2025-09-28T13:53:13,356 adding 'crawlo/utils/controlled_spider_mixin.py' 2025-09-28T13:53:13,358 adding 'crawlo/utils/db_helper.py' 2025-09-28T13:53:13,360 adding 'crawlo/utils/enhanced_error_handler.py' 2025-09-28T13:53:13,361 adding 'crawlo/utils/env_config.py' 2025-09-28T13:53:13,363 adding 'crawlo/utils/error_handler.py' 2025-09-28T13:53:13,364 adding 'crawlo/utils/fingerprint.py' 2025-09-28T13:53:13,366 adding 'crawlo/utils/func_tools.py' 2025-09-28T13:53:13,367 adding 'crawlo/utils/large_scale_config.py' 2025-09-28T13:53:13,369 adding 'crawlo/utils/large_scale_helper.py' 2025-09-28T13:53:13,370 adding 'crawlo/utils/log.py' 2025-09-28T13:53:13,372 adding 'crawlo/utils/performance_monitor.py' 2025-09-28T13:53:13,373 adding 'crawlo/utils/queue_helper.py' 2025-09-28T13:53:13,375 adding 'crawlo/utils/redis_connection_pool.py' 2025-09-28T13:53:13,377 adding 'crawlo/utils/redis_key_validator.py' 2025-09-28T13:53:13,379 adding 'crawlo/utils/request.py' 2025-09-28T13:53:13,380 adding 'crawlo/utils/request_serializer.py' 2025-09-28T13:53:13,382 adding 'crawlo/utils/spider_loader.py' 2025-09-28T13:53:13,383 adding 'crawlo/utils/system.py' 2025-09-28T13:53:13,384 adding 'crawlo/utils/tools.py' 2025-09-28T13:53:13,385 adding 'crawlo/utils/url.py' 2025-09-28T13:53:13,387 adding 'examples/__init__.py' 2025-09-28T13:53:13,389 adding 'examples/test_project/__init__.py' 2025-09-28T13:53:13,390 adding 'examples/test_project/run.py' 2025-09-28T13:53:13,392 adding 'examples/test_project/test_project/__init__.py' 2025-09-28T13:53:13,393 adding 'examples/test_project/test_project/items.py' 2025-09-28T13:53:13,394 adding 'examples/test_project/test_project/middlewares.py' 2025-09-28T13:53:13,396 adding 'examples/test_project/test_project/pipelines.py' 2025-09-28T13:53:13,397 adding 'examples/test_project/test_project/settings.py' 2025-09-28T13:53:13,399 adding 'examples/test_project/test_project/spiders/__init__.py' 2025-09-28T13:53:13,400 adding 'examples/test_project/test_project/spiders/of_week_dis.py' 2025-09-28T13:53:13,405 adding 'tests/__init__.py' 2025-09-28T13:53:13,407 adding 'tests/advanced_tools_example.py' 2025-09-28T13:53:13,408 adding 'tests/authenticated_proxy_example.py' 2025-09-28T13:53:13,410 adding 'tests/baidu_performance_test.py' 2025-09-28T13:53:13,411 adding 'tests/baidu_test.py' 2025-09-28T13:53:13,413 adding 'tests/cleaners_example.py' 2025-09-28T13:53:13,414 adding 'tests/comprehensive_framework_test.py' 2025-09-28T13:53:13,416 adding 'tests/comprehensive_test.py' 2025-09-28T13:53:13,417 adding 'tests/comprehensive_testing_summary.md' 2025-09-28T13:53:13,419 adding 'tests/config_validation_demo.py' 2025-09-28T13:53:13,420 adding 'tests/controlled_spider_example.py' 2025-09-28T13:53:13,422 adding 'tests/date_tools_example.py' 2025-09-28T13:53:13,423 adding 'tests/debug_configure.py' 2025-09-28T13:53:13,424 adding 'tests/debug_framework_logger.py' 2025-09-28T13:53:13,426 adding 'tests/debug_log_config.py' 2025-09-28T13:53:13,427 adding 'tests/debug_log_levels.py' 2025-09-28T13:53:13,428 adding 'tests/debug_pipelines.py' 2025-09-28T13:53:13,430 adding 'tests/detailed_log_test.py' 2025-09-28T13:53:13,431 adding 'tests/distributed_test.py' 2025-09-28T13:53:13,433 adding 'tests/distributed_test_debug.py' 2025-09-28T13:53:13,435 adding 'tests/dynamic_loading_example.py' 2025-09-28T13:53:13,436 adding 'tests/dynamic_loading_test.py' 2025-09-28T13:53:13,438 adding 'tests/env_config_example.py' 2025-09-28T13:53:13,439 adding 'tests/error_handling_example.py' 2025-09-28T13:53:13,441 adding 'tests/final_command_test_report.md' 2025-09-28T13:53:13,442 adding 'tests/final_comprehensive_test.py' 2025-09-28T13:53:13,444 adding 'tests/final_log_test.py' 2025-09-28T13:53:13,446 adding 'tests/final_validation_test.py' 2025-09-28T13:53:13,447 adding 'tests/fix_log_test.py' 2025-09-28T13:53:13,449 adding 'tests/framework_performance_test.py' 2025-09-28T13:53:13,450 adding 'tests/log_buffering_test.py' 2025-09-28T13:53:13,451 adding 'tests/log_generation_timing_test.py' 2025-09-28T13:53:13,453 adding 'tests/optimized_performance_test.py' 2025-09-28T13:53:13,454 adding 'tests/performance_comparison.py' 2025-09-28T13:53:13,456 adding 'tests/queue_blocking_test.py' 2025-09-28T13:53:13,457 adding 'tests/queue_test.py' 2025-09-28T13:53:13,458 adding 'tests/redis_key_validation_demo.py' 2025-09-28T13:53:13,460 adding 'tests/request_params_example.py' 2025-09-28T13:53:13,461 adding 'tests/response_improvements_example.py' 2025-09-28T13:53:13,462 adding 'tests/simple_command_test.py' 2025-09-28T13:53:13,464 adding 'tests/simple_crawlo_test.py' 2025-09-28T13:53:13,465 adding 'tests/simple_log_test.py' 2025-09-28T13:53:13,467 adding 'tests/simple_log_test2.py' 2025-09-28T13:53:13,468 adding 'tests/simple_optimization_test.py' 2025-09-28T13:53:13,469 adding 'tests/simple_queue_type_test.py' 2025-09-28T13:53:13,471 adding 'tests/simple_spider_test.py' 2025-09-28T13:53:13,472 adding 'tests/simple_test.py' 2025-09-28T13:53:13,473 adding 'tests/spider_log_timing_test.py' 2025-09-28T13:53:13,476 adding 'tests/test_advanced_tools.py' 2025-09-28T13:53:13,478 adding 'tests/test_all_commands.py' 2025-09-28T13:53:13,479 adding 'tests/test_all_pipeline_fingerprints.py' 2025-09-28T13:53:13,481 adding 'tests/test_all_redis_key_configs.py' 2025-09-28T13:53:13,482 adding 'tests/test_authenticated_proxy.py' 2025-09-28T13:53:13,484 adding 'tests/test_batch_processor.py' 2025-09-28T13:53:13,485 adding 'tests/test_cleaners.py' 2025-09-28T13:53:13,486 adding 'tests/test_component_factory.py' 2025-09-28T13:53:13,488 adding 'tests/test_comprehensive.py' 2025-09-28T13:53:13,489 adding 'tests/test_config_consistency.py' 2025-09-28T13:53:13,490 adding 'tests/test_config_merge.py' 2025-09-28T13:53:13,492 adding 'tests/test_config_validator.py' 2025-09-28T13:53:13,493 adding 'tests/test_controlled_spider_mixin.py' 2025-09-28T13:53:13,494 adding 'tests/test_crawlo_proxy_integration.py' 2025-09-28T13:53:13,496 adding 'tests/test_date_tools.py' 2025-09-28T13:53:13,497 adding 'tests/test_dedup_fix.py' 2025-09-28T13:53:13,499 adding 'tests/test_default_header_middleware.py' 2025-09-28T13:53:13,500 adding 'tests/test_distributed.py' 2025-09-28T13:53:13,502 adding 'tests/test_double_crawlo_fix.py' 2025-09-28T13:53:13,503 adding 'tests/test_double_crawlo_fix_simple.py' 2025-09-28T13:53:13,505 adding 'tests/test_download_delay_middleware.py' 2025-09-28T13:53:13,506 adding 'tests/test_downloader_proxy_compatibility.py' 2025-09-28T13:53:13,508 adding 'tests/test_dynamic_downloaders_proxy.py' 2025-09-28T13:53:13,509 adding 'tests/test_dynamic_proxy.py' 2025-09-28T13:53:13,511 adding 'tests/test_dynamic_proxy_config.py' 2025-09-28T13:53:13,512 adding 'tests/test_dynamic_proxy_real.py' 2025-09-28T13:53:13,514 adding 'tests/test_edge_cases.py' 2025-09-28T13:53:13,516 adding 'tests/test_enhanced_error_handler.py' 2025-09-28T13:53:13,517 adding 'tests/test_enhanced_error_handler_comprehensive.py' 2025-09-28T13:53:13,519 adding 'tests/test_env_config.py' 2025-09-28T13:53:13,520 adding 'tests/test_error_handler_compatibility.py' 2025-09-28T13:53:13,522 adding 'tests/test_factories.py' 2025-09-28T13:53:13,523 adding 'tests/test_final_validation.py' 2025-09-28T13:53:13,525 adding 'tests/test_fingerprint_consistency.py' 2025-09-28T13:53:13,526 adding 'tests/test_fingerprint_simple.py' 2025-09-28T13:53:13,527 adding 'tests/test_framework_env_usage.py' 2025-09-28T13:53:13,529 adding 'tests/test_framework_logger.py' 2025-09-28T13:53:13,530 adding 'tests/test_framework_startup.py' 2025-09-28T13:53:13,531 adding 'tests/test_get_component_logger.py' 2025-09-28T13:53:13,533 adding 'tests/test_hash_performance.py' 2025-09-28T13:53:13,534 adding 'tests/test_integration.py' 2025-09-28T13:53:13,536 adding 'tests/test_item_dedup_redis_key.py' 2025-09-28T13:53:13,537 adding 'tests/test_large_scale_config.py' 2025-09-28T13:53:13,539 adding 'tests/test_large_scale_helper.py' 2025-09-28T13:53:13,540 adding 'tests/test_logging_system.py' 2025-09-28T13:53:13,542 adding 'tests/test_mode_change.py' 2025-09-28T13:53:13,543 adding 'tests/test_mode_consistency.py' 2025-09-28T13:53:13,544 adding 'tests/test_offsite_middleware.py' 2025-09-28T13:53:13,546 adding 'tests/test_offsite_middleware_simple.py' 2025-09-28T13:53:13,547 adding 'tests/test_parsel.py' 2025-09-28T13:53:13,548 adding 'tests/test_performance.py' 2025-09-28T13:53:13,550 adding 'tests/test_performance_monitor.py' 2025-09-28T13:53:13,551 adding 'tests/test_pipeline_fingerprint_consistency.py' 2025-09-28T13:53:13,553 adding 'tests/test_proxy_api.py' 2025-09-28T13:53:13,554 adding 'tests/test_proxy_health_check.py' 2025-09-28T13:53:13,555 adding 'tests/test_proxy_middleware.py' 2025-09-28T13:53:13,557 adding 'tests/test_proxy_middleware_enhanced.py' 2025-09-28T13:53:13,558 adding 'tests/test_proxy_middleware_integration.py' 2025-09-28T13:53:13,560 adding 'tests/test_proxy_middleware_refactored.py' 2025-09-28T13:53:13,561 adding 'tests/test_proxy_providers.py' 2025-09-28T13:53:13,562 adding 'tests/test_proxy_stats.py' 2025-09-28T13:53:13,564 adding 'tests/test_proxy_strategies.py' 2025-09-28T13:53:13,565 adding 'tests/test_queue_empty_check.py' 2025-09-28T13:53:13,566 adding 'tests/test_queue_manager_double_crawlo.py' 2025-09-28T13:53:13,568 adding 'tests/test_queue_manager_redis_key.py' 2025-09-28T13:53:13,569 adding 'tests/test_queue_naming.py' 2025-09-28T13:53:13,570 adding 'tests/test_queue_type.py' 2025-09-28T13:53:13,572 adding 'tests/test_random_user_agent.py' 2025-09-28T13:53:13,573 adding 'tests/test_real_scenario_proxy.py' 2025-09-28T13:53:13,575 adding 'tests/test_redis_config.py' 2025-09-28T13:53:13,576 adding 'tests/test_redis_connection_pool.py' 2025-09-28T13:53:13,578 adding 'tests/test_redis_key_naming.py' 2025-09-28T13:53:13,579 adding 'tests/test_redis_key_validator.py' 2025-09-28T13:53:13,581 adding 'tests/test_redis_queue.py' 2025-09-28T13:53:13,582 adding 'tests/test_redis_queue_name_fix.py' 2025-09-28T13:53:13,584 adding 'tests/test_request_ignore_middleware.py' 2025-09-28T13:53:13,585 adding 'tests/test_request_params.py' 2025-09-28T13:53:13,586 adding 'tests/test_request_serialization.py' 2025-09-28T13:53:13,588 adding 'tests/test_response_code_middleware.py' 2025-09-28T13:53:13,590 adding 'tests/test_response_filter_middleware.py' 2025-09-28T13:53:13,592 adding 'tests/test_response_improvements.py' 2025-09-28T13:53:13,593 adding 'tests/test_retry_middleware.py' 2025-09-28T13:53:13,595 adding 'tests/test_scheduler.py' 2025-09-28T13:53:13,596 adding 'tests/test_scheduler_config_update.py' 2025-09-28T13:53:13,598 adding 'tests/test_simple_response.py' 2025-09-28T13:53:13,599 adding 'tests/test_telecom_spider_redis_key.py' 2025-09-28T13:53:13,601 adding 'tests/test_template_content.py' 2025-09-28T13:53:13,602 adding 'tests/test_template_redis_key.py' 2025-09-28T13:53:13,603 adding 'tests/test_tools.py' 2025-09-28T13:53:13,605 adding 'tests/test_user_agents.py' 2025-09-28T13:53:13,607 adding 'tests/tools_example.py' 2025-09-28T13:53:13,608 adding 'tests/untested_features_report.md' 2025-09-28T13:53:13,609 adding 'tests/verify_debug.py' 2025-09-28T13:53:13,611 adding 'tests/verify_distributed.py' 2025-09-28T13:53:13,612 adding 'tests/verify_log_fix.py' 2025-09-28T13:53:13,614 adding 'tests/scrapy_comparison/ofweek_scrapy.py' 2025-09-28T13:53:13,616 adding 'tests/scrapy_comparison/scrapy_test.py' 2025-09-28T13:53:13,620 adding 'crawlo-1.4.2.dist-info/METADATA' 2025-09-28T13:53:13,621 adding 'crawlo-1.4.2.dist-info/WHEEL' 2025-09-28T13:53:13,622 adding 'crawlo-1.4.2.dist-info/entry_points.txt' 2025-09-28T13:53:13,623 adding 'crawlo-1.4.2.dist-info/top_level.txt' 2025-09-28T13:53:13,628 adding 'crawlo-1.4.2.dist-info/RECORD' 2025-09-28T13:53:13,638 removing build/bdist.linux-armv7l/wheel 2025-09-28T13:53:13,814 Building wheel for crawlo (pyproject.toml): finished with status 'done' 2025-09-28T13:53:13,829 Created wheel for crawlo: filename=crawlo-1.4.2-py3-none-any.whl size=566403 sha256=4f2a550553e1b2bac41ddf8f2b898fe64c49f19bb810301fa99fe1d632eeb1fd 2025-09-28T13:53:13,830 Stored in directory: /tmp/pip-ephem-wheel-cache-dkz9wwd7/wheels/8d/c5/ca/e954f399db4391bbdb7090a56b071c4565fd27bf569fa53473 2025-09-28T13:53:13,855 Successfully built crawlo 2025-09-28T13:53:13,870 Removed build tracker: '/tmp/pip-build-tracker-mffafsa1'