2025-10-10T02:07:52,399 Created temporary directory: /tmp/pip-ephem-wheel-cache-751e1h13 2025-10-10T02:07:52,401 Created temporary directory: /tmp/pip-build-tracker-sthg5_dn 2025-10-10T02:07:52,402 Initialized build tracking at /tmp/pip-build-tracker-sthg5_dn 2025-10-10T02:07:52,402 Created build tracker: /tmp/pip-build-tracker-sthg5_dn 2025-10-10T02:07:52,403 Entered build tracker: /tmp/pip-build-tracker-sthg5_dn 2025-10-10T02:07:52,404 Created temporary directory: /tmp/pip-wheel-v4j8f7jv 2025-10-10T02:07:52,407 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-10-10T02:07:52,409 Created temporary directory: /tmp/pip-ephem-wheel-cache-g7vrupc7 2025-10-10T02:07:52,433 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-10-10T02:07:52,437 2 location(s) to search for versions of crawlo: 2025-10-10T02:07:52,437 * https://pypi.org/simple/crawlo/ 2025-10-10T02:07:52,437 * https://www.piwheels.org/simple/crawlo/ 2025-10-10T02:07:52,437 Fetching project page and analyzing links: https://pypi.org/simple/crawlo/ 2025-10-10T02:07:52,438 Getting page https://pypi.org/simple/crawlo/ 2025-10-10T02:07:52,440 Found index url https://pypi.org/simple 2025-10-10T02:07:52,666 Fetched page https://pypi.org/simple/crawlo/ as application/vnd.pypi.simple.v1+json 2025-10-10T02:07:52,670 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5e/f7/15da16c9e40a732d265b11ae6f392ba6e38c843eb1a3850e1202ba0e57fa/crawlo-1.3.9-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,671 Found link https://files.pythonhosted.org/packages/64/6b/a0cb24c93fc96f125a8d0f6661f553d9729791763caf2660ca0f01af35c3/crawlo-1.3.9.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.3.9 2025-10-10T02:07:52,672 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/4a/9c/82aeeb0713f1125291ead74dff2f44b27fee8c876a5d58b5eb08bc8a3fec/crawlo-1.4.0-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,673 Found link https://files.pythonhosted.org/packages/8d/80/d3c003285cc6ae70e0b6e71800635eed0c00e9441d0ffe0b4e0f41db962d/crawlo-1.4.0.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.0 2025-10-10T02:07:52,674 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/c4/7e/00a3eecc7fbf7b34af6ae79e82666ee8d49b743ada85547ac407641333bf/crawlo-1.4.1-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,675 Found link https://files.pythonhosted.org/packages/5b/48/c8439c1cbd3b4b819afd6885f2829772542bcce98951c0acc73079aedb95/crawlo-1.4.1.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.1 2025-10-10T02:07:52,676 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/f2/31/a52238ece7a50d949f7985dc13fedfa9d34b0aa68a9834e3cb3b93438e78/crawlo-1.4.2-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,677 Found link https://files.pythonhosted.org/packages/1d/4a/7d47a15d093ce1352179685e5ef8e112c87ff74befa89a026149e9cb6ecd/crawlo-1.4.2.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.2 2025-10-10T02:07:52,678 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/bf/15/d5e3c82633a27f783fe238da06e9ccaeb64d14385bfdd4b879b1fe86af93/crawlo-1.4.3-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,679 Found link https://files.pythonhosted.org/packages/9e/f1/26060b36cf81bfa80cd01a53739484ff7cad9f88c99decb0f0fdfc7c3069/crawlo-1.4.3.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.3 2025-10-10T02:07:52,680 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/5c/0c/27b5fc6e81ddc802dec3c387a1517b6c51f9fa890811f449106bbe1ee49f/crawlo-1.4.4-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,681 Found link https://files.pythonhosted.org/packages/88/c8/6e9c00bed5250995ac9058338b5725c6312be4ce0e43a6a7da7e8ec28b65/crawlo-1.4.4.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.4 2025-10-10T02:07:52,682 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/8e/5e/78d5548bdc0911afcb3e49d372b7b0efd3384d11cc8d7904a32ef0c47359/crawlo-1.4.5-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,683 Found link https://files.pythonhosted.org/packages/79/59/23c7e418b027965bb7e79de626fb51e63c6bd0974b0e04ea4bd40dec19ba/crawlo-1.4.5.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.5 2025-10-10T02:07:52,683 Skipping link: No binaries permitted for crawlo: https://files.pythonhosted.org/packages/10/50/43b2b74b9eff28f4e841b7cf02fa19435b613ff04e3f4e58d8f1871ea504/crawlo-1.4.6-py3-none-any.whl (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,684 Found link https://files.pythonhosted.org/packages/4e/01/62b1a4c29d140a6c3adc5880a2e6beace3bc78275a06b17351be96bc6686/crawlo-1.4.6.tar.gz (from https://pypi.org/simple/crawlo/) (requires-python:>=3.6), version: 1.4.6 2025-10-10T02:07:52,685 Fetching project page and analyzing links: https://www.piwheels.org/simple/crawlo/ 2025-10-10T02:07:52,686 Getting page https://www.piwheels.org/simple/crawlo/ 2025-10-10T02:07:52,688 Found index url https://www.piwheels.org/simple 2025-10-10T02:07:52,866 Fetched page https://www.piwheels.org/simple/crawlo/ as text/html 2025-10-10T02:07:52,870 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.5-py3-none-any.whl#sha256=bf7577e3497593c0511dc3eb84857f8d0c751bdae053cf0dda37179224b39d4b (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,871 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.4-py3-none-any.whl#sha256=90be59ea0da9f7da93b7844325e05af5de647c9316deda8219e1940705f880ea (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,871 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.3-py3-none-any.whl#sha256=4b40e6520c22d1a464d883cd9a27d64d7fcbcf7c825bd8c84b344b04f91c9c97 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,872 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.2-py3-none-any.whl#sha256=4f2a550553e1b2bac41ddf8f2b898fe64c49f19bb810301fa99fe1d632eeb1fd (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,873 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.1-py3-none-any.whl#sha256=5f48469ed3fa98ef76f9e622b25cdb555df1a3193b563f219c7ee540ae97dca9 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,874 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.4.0-py3-none-any.whl#sha256=51340c538a39da052af5ab3194e0916b203090854e495eb7b78290861e427e72 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,874 Skipping link: No binaries permitted for crawlo: https://www.piwheels.org/simple/crawlo/crawlo-1.3.9-py3-none-any.whl#sha256=4ba32e11ae2213a168d8623a104c31659733167cee87ef5a7cdbcdf05fb931c3 (from https://www.piwheels.org/simple/crawlo/) (requires-python:>=3.6) 2025-10-10T02:07:52,875 Skipping link: not a file: https://www.piwheels.org/simple/crawlo/ 2025-10-10T02:07:52,876 Skipping link: not a file: https://pypi.org/simple/crawlo/ 2025-10-10T02:07:52,897 Given no hashes to check 1 links for project 'crawlo': discarding no candidates 2025-10-10T02:07:52,915 Collecting crawlo==1.4.6 2025-10-10T02:07:52,918 Created temporary directory: /tmp/pip-unpack-5n3avz7x 2025-10-10T02:07:53,148 Downloading crawlo-1.4.6.tar.gz (430 kB) 2025-10-10T02:07:54,045 Added crawlo==1.4.6 from https://files.pythonhosted.org/packages/4e/01/62b1a4c29d140a6c3adc5880a2e6beace3bc78275a06b17351be96bc6686/crawlo-1.4.6.tar.gz to build tracker '/tmp/pip-build-tracker-sthg5_dn' 2025-10-10T02:07:54,050 Created temporary directory: /tmp/pip-build-env-xu_fyjs0 2025-10-10T02:07:54,055 Installing build dependencies: started 2025-10-10T02:07:54,056 Running command pip subprocess to install build dependencies 2025-10-10T02:07:55,352 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2025-10-10T02:07:55,983 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-10-10T02:07:56,011 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-10-10T02:07:57,795 Collecting setuptools>=80.9.0 2025-10-10T02:07:57,907 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2025-10-10T02:07:58,186 Collecting wheel 2025-10-10T02:07:58,204 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2025-10-10T02:08:01,473 Installing collected packages: wheel, setuptools 2025-10-10T02:08:01,730 Creating /tmp/pip-build-env-xu_fyjs0/overlay/local/bin 2025-10-10T02:08:01,732 changing mode of /tmp/pip-build-env-xu_fyjs0/overlay/local/bin/wheel to 755 2025-10-10T02:08:05,491 Successfully installed setuptools-80.9.0 wheel-0.45.1 2025-10-10T02:08:05,790 Installing build dependencies: finished with status 'done' 2025-10-10T02:08:05,796 Getting requirements to build wheel: started 2025-10-10T02:08:05,798 Running command Getting requirements to build wheel 2025-10-10T02:08:06,422 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-10-10T02:08:06,422 !! 2025-10-10T02:08:06,424 ******************************************************************************** 2025-10-10T02:08:06,425 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-10-10T02:08:06,426 License :: OSI Approved :: MIT License 2025-10-10T02:08:06,427 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-10-10T02:08:06,428 ******************************************************************************** 2025-10-10T02:08:06,429 !! 2025-10-10T02:08:06,430 self._finalize_license_expression() 2025-10-10T02:08:06,490 running egg_info 2025-10-10T02:08:06,497 writing crawlo.egg-info/PKG-INFO 2025-10-10T02:08:06,508 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-10-10T02:08:06,511 writing entry points to crawlo.egg-info/entry_points.txt 2025-10-10T02:08:06,516 writing requirements to crawlo.egg-info/requires.txt 2025-10-10T02:08:06,517 writing top-level names to crawlo.egg-info/top_level.txt 2025-10-10T02:08:06,595 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:06,617 reading manifest template 'MANIFEST.in' 2025-10-10T02:08:06,619 warning: no files found matching 'VERSION' 2025-10-10T02:08:06,619 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-10-10T02:08:06,706 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-10-10T02:08:06,708 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-10-10T02:08:06,710 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-10-10T02:08:06,713 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-10-10T02:08:06,715 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-10-10T02:08:06,718 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-10-10T02:08:06,720 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-10-10T02:08:06,723 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-10-10T02:08:06,724 no previously-included directories found matching 'samples' 2025-10-10T02:08:06,725 no previously-included directories found matching 'docs' 2025-10-10T02:08:06,747 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:06,845 Getting requirements to build wheel: finished with status 'done' 2025-10-10T02:08:06,849 Created temporary directory: /tmp/pip-modern-metadata-k7m2xv9p 2025-10-10T02:08:06,852 Preparing metadata (pyproject.toml): started 2025-10-10T02:08:06,853 Running command Preparing metadata (pyproject.toml) 2025-10-10T02:08:07,446 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-10-10T02:08:07,446 !! 2025-10-10T02:08:07,447 ******************************************************************************** 2025-10-10T02:08:07,448 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-10-10T02:08:07,449 License :: OSI Approved :: MIT License 2025-10-10T02:08:07,450 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-10-10T02:08:07,451 ******************************************************************************** 2025-10-10T02:08:07,453 !! 2025-10-10T02:08:07,453 self._finalize_license_expression() 2025-10-10T02:08:07,475 running dist_info 2025-10-10T02:08:07,488 creating /tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info 2025-10-10T02:08:07,489 writing /tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/PKG-INFO 2025-10-10T02:08:07,500 writing dependency_links to /tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/dependency_links.txt 2025-10-10T02:08:07,503 writing entry points to /tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/entry_points.txt 2025-10-10T02:08:07,508 writing requirements to /tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/requires.txt 2025-10-10T02:08:07,509 writing top-level names to /tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/top_level.txt 2025-10-10T02:08:07,511 writing manifest file '/tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:07,580 reading manifest file '/tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:07,583 reading manifest template 'MANIFEST.in' 2025-10-10T02:08:07,584 warning: no files found matching 'VERSION' 2025-10-10T02:08:07,585 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-10-10T02:08:07,670 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-10-10T02:08:07,672 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-10-10T02:08:07,673 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-10-10T02:08:07,675 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-10-10T02:08:07,677 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-10-10T02:08:07,679 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-10-10T02:08:07,680 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-10-10T02:08:07,682 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-10-10T02:08:07,683 no previously-included directories found matching 'samples' 2025-10-10T02:08:07,684 no previously-included directories found matching 'docs' 2025-10-10T02:08:07,702 writing manifest file '/tmp/pip-modern-metadata-k7m2xv9p/crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:07,704 creating '/tmp/pip-modern-metadata-k7m2xv9p/crawlo-1.4.6.dist-info' 2025-10-10T02:08:07,849 Preparing metadata (pyproject.toml): finished with status 'done' 2025-10-10T02:08:07,855 Source in /tmp/pip-wheel-v4j8f7jv/crawlo_bebe8a52a0a242c5aef4cc1916797506 has version 1.4.6, which satisfies requirement crawlo==1.4.6 from https://files.pythonhosted.org/packages/4e/01/62b1a4c29d140a6c3adc5880a2e6beace3bc78275a06b17351be96bc6686/crawlo-1.4.6.tar.gz 2025-10-10T02:08:07,856 Removed crawlo==1.4.6 from https://files.pythonhosted.org/packages/4e/01/62b1a4c29d140a6c3adc5880a2e6beace3bc78275a06b17351be96bc6686/crawlo-1.4.6.tar.gz from build tracker '/tmp/pip-build-tracker-sthg5_dn' 2025-10-10T02:08:07,864 Created temporary directory: /tmp/pip-unpack-pvgo0ey0 2025-10-10T02:08:07,864 Building wheels for collected packages: crawlo 2025-10-10T02:08:07,870 Created temporary directory: /tmp/pip-wheel-wv_okuxt 2025-10-10T02:08:07,870 Destination directory: /tmp/pip-wheel-wv_okuxt 2025-10-10T02:08:07,873 Building wheel for crawlo (pyproject.toml): started 2025-10-10T02:08:07,874 Running command Building wheel for crawlo (pyproject.toml) 2025-10-10T02:08:08,452 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-10-10T02:08:08,452 !! 2025-10-10T02:08:08,454 ******************************************************************************** 2025-10-10T02:08:08,454 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-10-10T02:08:08,456 License :: OSI Approved :: MIT License 2025-10-10T02:08:08,457 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-10-10T02:08:08,458 ******************************************************************************** 2025-10-10T02:08:08,459 !! 2025-10-10T02:08:08,460 self._finalize_license_expression() 2025-10-10T02:08:08,484 running bdist_wheel 2025-10-10T02:08:08,516 running build 2025-10-10T02:08:08,517 running build_py 2025-10-10T02:08:08,528 creating build/lib/crawlo 2025-10-10T02:08:08,530 copying crawlo/config.py -> build/lib/crawlo 2025-10-10T02:08:08,533 copying crawlo/subscriber.py -> build/lib/crawlo 2025-10-10T02:08:08,535 copying crawlo/framework.py -> build/lib/crawlo 2025-10-10T02:08:08,538 copying crawlo/task_manager.py -> build/lib/crawlo 2025-10-10T02:08:08,540 copying crawlo/event.py -> build/lib/crawlo 2025-10-10T02:08:08,542 copying crawlo/config_validator.py -> build/lib/crawlo 2025-10-10T02:08:08,544 copying crawlo/crawler.py -> build/lib/crawlo 2025-10-10T02:08:08,547 copying crawlo/__init__.py -> build/lib/crawlo 2025-10-10T02:08:08,549 copying crawlo/mode_manager.py -> build/lib/crawlo 2025-10-10T02:08:08,551 copying crawlo/exceptions.py -> build/lib/crawlo 2025-10-10T02:08:08,553 copying crawlo/project.py -> build/lib/crawlo 2025-10-10T02:08:08,556 copying crawlo/stats_collector.py -> build/lib/crawlo 2025-10-10T02:08:08,558 copying crawlo/interfaces.py -> build/lib/crawlo 2025-10-10T02:08:08,560 copying crawlo/__version__.py -> build/lib/crawlo 2025-10-10T02:08:08,562 copying crawlo/cli.py -> build/lib/crawlo 2025-10-10T02:08:08,564 creating build/lib/examples 2025-10-10T02:08:08,565 copying examples/__init__.py -> build/lib/examples 2025-10-10T02:08:08,573 creating build/lib/tests 2025-10-10T02:08:08,574 copying tests/test_random_user_agent.py -> build/lib/tests 2025-10-10T02:08:08,576 copying tests/test_mysql_pipeline_init_log.py -> build/lib/tests 2025-10-10T02:08:08,578 copying tests/debug_log_levels.py -> build/lib/tests 2025-10-10T02:08:08,580 copying tests/test_proxy_health_check.py -> build/lib/tests 2025-10-10T02:08:08,582 copying tests/test_crawler_process_spider_modules.py -> build/lib/tests 2025-10-10T02:08:08,584 copying tests/log_buffering_test.py -> build/lib/tests 2025-10-10T02:08:08,586 copying tests/test_factories.py -> build/lib/tests 2025-10-10T02:08:08,588 copying tests/distributed_test_debug.py -> build/lib/tests 2025-10-10T02:08:08,590 copying tests/test_multi_directory.py -> build/lib/tests 2025-10-10T02:08:08,592 copying tests/dynamic_loading_example.py -> build/lib/tests 2025-10-10T02:08:08,594 copying tests/test_proxy_only.py -> build/lib/tests 2025-10-10T02:08:08,596 copying tests/test_response_filter_middleware.py -> build/lib/tests 2025-10-10T02:08:08,599 copying tests/response_improvements_example.py -> build/lib/tests 2025-10-10T02:08:08,601 copying tests/detailed_log_test.py -> build/lib/tests 2025-10-10T02:08:08,604 copying tests/test_error_handler_compatibility.py -> build/lib/tests 2025-10-10T02:08:08,606 copying tests/test_telecom_spider_redis_key.py -> build/lib/tests 2025-10-10T02:08:08,609 copying tests/test_queue_manager_double_crawlo.py -> build/lib/tests 2025-10-10T02:08:08,611 copying tests/test_all_commands.py -> build/lib/tests 2025-10-10T02:08:08,614 copying tests/test_optimized_selector_naming.py -> build/lib/tests 2025-10-10T02:08:08,616 copying tests/test_spider_loader.py -> build/lib/tests 2025-10-10T02:08:08,618 copying tests/test_queue_empty_check.py -> build/lib/tests 2025-10-10T02:08:08,620 copying tests/test_user_agent_randomness.py -> build/lib/tests 2025-10-10T02:08:08,622 copying tests/test_double_crawlo_fix_simple.py -> build/lib/tests 2025-10-10T02:08:08,625 copying tests/final_log_test.py -> build/lib/tests 2025-10-10T02:08:08,627 copying tests/test_mysql_pipeline_config.py -> build/lib/tests 2025-10-10T02:08:08,629 copying tests/test_dynamic_downloaders_proxy.py -> build/lib/tests 2025-10-10T02:08:08,632 copying tests/test_dynamic_proxy.py -> build/lib/tests 2025-10-10T02:08:08,634 copying tests/test_redis_connection_pool.py -> build/lib/tests 2025-10-10T02:08:08,636 copying tests/test_logging_final.py -> build/lib/tests 2025-10-10T02:08:08,639 copying tests/debug_log_config.py -> build/lib/tests 2025-10-10T02:08:08,641 copying tests/config_validation_demo.py -> build/lib/tests 2025-10-10T02:08:08,643 copying tests/test_performance_monitor.py -> build/lib/tests 2025-10-10T02:08:08,646 copying tests/test_real_scenario_proxy.py -> build/lib/tests 2025-10-10T02:08:08,648 copying tests/test_middleware_debug.py -> build/lib/tests 2025-10-10T02:08:08,651 copying tests/comprehensive_framework_test.py -> build/lib/tests 2025-10-10T02:08:08,653 copying tests/test_downloader_proxy_compatibility.py -> build/lib/tests 2025-10-10T02:08:08,656 copying tests/test_enhanced_error_handler_comprehensive.py -> build/lib/tests 2025-10-10T02:08:08,659 copying tests/test_config_merge.py -> build/lib/tests 2025-10-10T02:08:08,661 copying tests/test_retry_middleware.py -> build/lib/tests 2025-10-10T02:08:08,664 copying tests/fix_log_test.py -> build/lib/tests 2025-10-10T02:08:08,666 copying tests/debug_framework_logger.py -> build/lib/tests 2025-10-10T02:08:08,668 copying tests/final_comprehensive_test.py -> build/lib/tests 2025-10-10T02:08:08,670 copying tests/test_mode_consistency.py -> build/lib/tests 2025-10-10T02:08:08,672 copying tests/comprehensive_test.py -> build/lib/tests 2025-10-10T02:08:08,674 copying tests/test_queue_type.py -> build/lib/tests 2025-10-10T02:08:08,676 copying tests/test_comprehensive.py -> build/lib/tests 2025-10-10T02:08:08,679 copying tests/test_all_pipeline_fingerprints.py -> build/lib/tests 2025-10-10T02:08:08,681 copying tests/simple_selector_helper_test.py -> build/lib/tests 2025-10-10T02:08:08,684 copying tests/test_response_urljoin.py -> build/lib/tests 2025-10-10T02:08:08,686 copying tests/test_hash_performance.py -> build/lib/tests 2025-10-10T02:08:08,688 copying tests/test_response_selector_methods.py -> build/lib/tests 2025-10-10T02:08:08,690 copying tests/test_dynamic_proxy_real.py -> build/lib/tests 2025-10-10T02:08:08,692 copying tests/test_encoding_detection.py -> build/lib/tests 2025-10-10T02:08:08,695 copying tests/test_tools.py -> build/lib/tests 2025-10-10T02:08:08,698 copying tests/test_queue_manager_redis_key.py -> build/lib/tests 2025-10-10T02:08:08,700 copying tests/test_proxy_stats.py -> build/lib/tests 2025-10-10T02:08:08,702 copying tests/test_date_tools.py -> build/lib/tests 2025-10-10T02:08:08,705 copying tests/test_dedup_pipeline_consistency.py -> build/lib/tests 2025-10-10T02:08:08,707 copying tests/test_all_redis_key_configs.py -> build/lib/tests 2025-10-10T02:08:08,710 copying tests/test_integration.py -> build/lib/tests 2025-10-10T02:08:08,712 copying tests/test_multiple_spider_modules.py -> build/lib/tests 2025-10-10T02:08:08,714 copying tests/test_mysql_pipeline_refactor.py -> build/lib/tests 2025-10-10T02:08:08,716 copying tests/queue_blocking_test.py -> build/lib/tests 2025-10-10T02:08:08,719 copying tests/framework_performance_test.py -> build/lib/tests 2025-10-10T02:08:08,721 copying tests/test_template_redis_key.py -> build/lib/tests 2025-10-10T02:08:08,723 copying tests/simple_optimization_test.py -> build/lib/tests 2025-10-10T02:08:08,725 copying tests/cleaners_example.py -> build/lib/tests 2025-10-10T02:08:08,728 copying tests/test_offsite_middleware.py -> build/lib/tests 2025-10-10T02:08:08,730 copying tests/test_redis_key_naming.py -> build/lib/tests 2025-10-10T02:08:08,733 copying tests/verify_distributed.py -> build/lib/tests 2025-10-10T02:08:08,735 copying tests/test_proxy_middleware_enhanced.py -> build/lib/tests 2025-10-10T02:08:08,737 copying tests/log_generation_timing_test.py -> build/lib/tests 2025-10-10T02:08:08,740 copying tests/test_mysql_pipeline_refactor_simple.py -> build/lib/tests 2025-10-10T02:08:08,742 copying tests/test_logging_enhancements.py -> build/lib/tests 2025-10-10T02:08:08,744 copying tests/test_proxy_api.py -> build/lib/tests 2025-10-10T02:08:08,747 copying tests/request_params_example.py -> build/lib/tests 2025-10-10T02:08:08,749 copying tests/test_scheduler_config_update.py -> build/lib/tests 2025-10-10T02:08:08,752 copying tests/test_proxy_strategies.py -> build/lib/tests 2025-10-10T02:08:08,754 copying tests/test_cleaners.py -> build/lib/tests 2025-10-10T02:08:08,756 copying tests/test_crawler_process_import.py -> build/lib/tests 2025-10-10T02:08:08,758 copying tests/queue_test.py -> build/lib/tests 2025-10-10T02:08:08,760 copying tests/spider_log_timing_test.py -> build/lib/tests 2025-10-10T02:08:08,763 copying tests/optimized_performance_test.py -> build/lib/tests 2025-10-10T02:08:08,765 copying tests/dynamic_loading_test.py -> build/lib/tests 2025-10-10T02:08:08,767 copying tests/test_download_delay_middleware.py -> build/lib/tests 2025-10-10T02:08:08,770 copying tests/test_asyncmy_usage.py -> build/lib/tests 2025-10-10T02:08:08,772 copying tests/test_retry_middleware_realistic.py -> build/lib/tests 2025-10-10T02:08:08,775 copying tests/__init__.py -> build/lib/tests 2025-10-10T02:08:08,777 copying tests/test_fingerprint_consistency.py -> build/lib/tests 2025-10-10T02:08:08,779 copying tests/test_simple_response.py -> build/lib/tests 2025-10-10T02:08:08,782 copying tests/verify_mysql_warnings.py -> build/lib/tests 2025-10-10T02:08:08,784 copying tests/test_item_dedup_redis_key.py -> build/lib/tests 2025-10-10T02:08:08,786 copying tests/test_framework_env_usage.py -> build/lib/tests 2025-10-10T02:08:08,789 copying tests/test_response_url_methods.py -> build/lib/tests 2025-10-10T02:08:08,791 copying tests/test_authenticated_proxy.py -> build/lib/tests 2025-10-10T02:08:08,793 copying tests/test_large_scale_helper.py -> build/lib/tests 2025-10-10T02:08:08,796 copying tests/env_config_example.py -> build/lib/tests 2025-10-10T02:08:08,798 copying tests/simple_log_test2.py -> build/lib/tests 2025-10-10T02:08:08,800 copying tests/simple_crawlo_test.py -> build/lib/tests 2025-10-10T02:08:08,803 copying tests/test_factory_compatibility.py -> build/lib/tests 2025-10-10T02:08:08,805 copying tests/test_user_agents.py -> build/lib/tests 2025-10-10T02:08:08,807 copying tests/test_fingerprint_simple.py -> build/lib/tests 2025-10-10T02:08:08,809 copying tests/test_selector_optimizations.py -> build/lib/tests 2025-10-10T02:08:08,812 copying tests/controlled_spider_example.py -> build/lib/tests 2025-10-10T02:08:08,814 copying tests/simple_queue_type_test.py -> build/lib/tests 2025-10-10T02:08:08,816 copying tests/test_request_serialization.py -> build/lib/tests 2025-10-10T02:08:08,818 copying tests/test_priority_consistency_fixed.py -> build/lib/tests 2025-10-10T02:08:08,821 copying tests/distributed_test.py -> build/lib/tests 2025-10-10T02:08:08,823 copying tests/test_queue_type_redis_config_consistency.py -> build/lib/tests 2025-10-10T02:08:08,825 copying tests/baidu_test.py -> build/lib/tests 2025-10-10T02:08:08,827 copying tests/test_config_validator.py -> build/lib/tests 2025-10-10T02:08:08,829 copying tests/test_proxy_middleware_integration.py -> build/lib/tests 2025-10-10T02:08:08,832 copying tests/explain_mysql_update_behavior.py -> build/lib/tests 2025-10-10T02:08:08,834 copying tests/simulate_mysql_update_test.py -> build/lib/tests 2025-10-10T02:08:08,836 copying tests/test_crawlo_proxy_integration.py -> build/lib/tests 2025-10-10T02:08:08,838 copying tests/test_offsite_middleware_simple.py -> build/lib/tests 2025-10-10T02:08:08,841 copying tests/test_scheduler.py -> build/lib/tests 2025-10-10T02:08:08,843 copying tests/test_batch_processor.py -> build/lib/tests 2025-10-10T02:08:08,846 copying tests/test_advanced_tools.py -> build/lib/tests 2025-10-10T02:08:08,848 copying tests/test_spider_modules.py -> build/lib/tests 2025-10-10T02:08:08,851 copying tests/simple_follow_test.py -> build/lib/tests 2025-10-10T02:08:08,853 copying tests/test_mysql_pipeline_types.py -> build/lib/tests 2025-10-10T02:08:08,855 copying tests/verify_debug.py -> build/lib/tests 2025-10-10T02:08:08,857 copying tests/performance_comparison.py -> build/lib/tests 2025-10-10T02:08:08,859 copying tests/test_final_validation.py -> build/lib/tests 2025-10-10T02:08:08,862 copying tests/date_tools_example.py -> build/lib/tests 2025-10-10T02:08:08,864 copying tests/test_proxy_providers.py -> build/lib/tests 2025-10-10T02:08:08,866 copying tests/test_controlled_spider_mixin.py -> build/lib/tests 2025-10-10T02:08:08,869 copying tests/direct_selector_helper_test.py -> build/lib/tests 2025-10-10T02:08:08,871 copying tests/simple_command_test.py -> build/lib/tests 2025-10-10T02:08:08,873 copying tests/test_mysql_pipeline_error.py -> build/lib/tests 2025-10-10T02:08:08,875 copying tests/test_redis_queue_name_fix.py -> build/lib/tests 2025-10-10T02:08:08,877 copying tests/final_validation_test.py -> build/lib/tests 2025-10-10T02:08:08,880 copying tests/test_request_ignore_middleware.py -> build/lib/tests 2025-10-10T02:08:08,882 copying tests/test_dedup_fix.py -> build/lib/tests 2025-10-10T02:08:08,885 copying tests/test_parsel.py -> build/lib/tests 2025-10-10T02:08:08,887 copying tests/authenticated_proxy_example.py -> build/lib/tests 2025-10-10T02:08:08,889 copying tests/advanced_tools_example.py -> build/lib/tests 2025-10-10T02:08:08,891 copying tests/test_logging_system.py -> build/lib/tests 2025-10-10T02:08:08,894 copying tests/debug_configure.py -> build/lib/tests 2025-10-10T02:08:08,896 copying tests/test_mysql_pipeline_robustness.py -> build/lib/tests 2025-10-10T02:08:08,899 copying tests/test_random_headers_default.py -> build/lib/tests 2025-10-10T02:08:08,901 copying tests/test_config_consistency.py -> build/lib/tests 2025-10-10T02:08:08,903 copying tests/test_env_config.py -> build/lib/tests 2025-10-10T02:08:08,906 copying tests/test_request_params.py -> build/lib/tests 2025-10-10T02:08:08,908 copying tests/simple_url_test.py -> build/lib/tests 2025-10-10T02:08:08,910 copying tests/test_redis_key_validator.py -> build/lib/tests 2025-10-10T02:08:08,913 copying tests/test_dynamic_proxy_config.py -> build/lib/tests 2025-10-10T02:08:08,915 copying tests/test_proxy_middleware.py -> build/lib/tests 2025-10-10T02:08:08,917 copying tests/test_response_code_middleware.py -> build/lib/tests 2025-10-10T02:08:08,920 copying tests/test_component_factory.py -> build/lib/tests 2025-10-10T02:08:08,922 copying tests/test_template_content.py -> build/lib/tests 2025-10-10T02:08:08,924 copying tests/simple_response_selector_test.py -> build/lib/tests 2025-10-10T02:08:08,927 copying tests/test_selector_helper.py -> build/lib/tests 2025-10-10T02:08:08,929 copying tests/test_edge_cases.py -> build/lib/tests 2025-10-10T02:08:08,931 copying tests/test_distributed.py -> build/lib/tests 2025-10-10T02:08:08,933 copying tests/test_proxy_with_downloader.py -> build/lib/tests 2025-10-10T02:08:08,936 copying tests/test_spider_loader_comprehensive.py -> build/lib/tests 2025-10-10T02:08:08,938 copying tests/tools_example.py -> build/lib/tests 2025-10-10T02:08:08,941 copying tests/test_proxy_middleware_refactored.py -> build/lib/tests 2025-10-10T02:08:08,943 copying tests/verify_log_fix.py -> build/lib/tests 2025-10-10T02:08:08,946 copying tests/simple_spider_test.py -> build/lib/tests 2025-10-10T02:08:08,948 copying tests/error_handling_example.py -> build/lib/tests 2025-10-10T02:08:08,950 copying tests/test_pipeline_fingerprint_consistency.py -> build/lib/tests 2025-10-10T02:08:08,953 copying tests/test_mysql_pipeline_integration.py -> build/lib/tests 2025-10-10T02:08:08,955 copying tests/test_response_improvements.py -> build/lib/tests 2025-10-10T02:08:08,958 copying tests/test_priority_behavior.py -> build/lib/tests 2025-10-10T02:08:08,960 copying tests/test_scrapy_style_encoding.py -> build/lib/tests 2025-10-10T02:08:08,962 copying tests/test_response_follow.py -> build/lib/tests 2025-10-10T02:08:08,964 copying tests/simple_selector_test.py -> build/lib/tests 2025-10-10T02:08:08,967 copying tests/test_get_component_logger.py -> build/lib/tests 2025-10-10T02:08:08,969 copying tests/test_queue_naming.py -> build/lib/tests 2025-10-10T02:08:08,971 copying tests/test_double_crawlo_fix.py -> build/lib/tests 2025-10-10T02:08:08,974 copying tests/redis_key_validation_demo.py -> build/lib/tests 2025-10-10T02:08:08,976 copying tests/test_default_header_middleware.py -> build/lib/tests 2025-10-10T02:08:08,979 copying tests/baidu_performance_test.py -> build/lib/tests 2025-10-10T02:08:08,981 copying tests/test_redis_queue_type_fallback.py -> build/lib/tests 2025-10-10T02:08:08,984 copying tests/test_mysql_update_columns.py -> build/lib/tests 2025-10-10T02:08:08,986 copying tests/bug_check_test.py -> build/lib/tests 2025-10-10T02:08:08,988 copying tests/test_logging_integration.py -> build/lib/tests 2025-10-10T02:08:08,991 copying tests/test_random_headers_necessity.py -> build/lib/tests 2025-10-10T02:08:08,994 copying tests/test_performance.py -> build/lib/tests 2025-10-10T02:08:08,996 copying tests/test_priority_consistency.py -> build/lib/tests 2025-10-10T02:08:08,999 copying tests/debug_pipelines.py -> build/lib/tests 2025-10-10T02:08:09,001 copying tests/test_enhanced_error_handler.py -> build/lib/tests 2025-10-10T02:08:09,003 copying tests/test_redis_config.py -> build/lib/tests 2025-10-10T02:08:09,005 copying tests/test_large_scale_config.py -> build/lib/tests 2025-10-10T02:08:09,008 copying tests/test_encoding_core.py -> build/lib/tests 2025-10-10T02:08:09,010 copying tests/test_redis_queue.py -> build/lib/tests 2025-10-10T02:08:09,013 creating build/lib/crawlo/queue 2025-10-10T02:08:09,014 copying crawlo/queue/redis_priority_queue.py -> build/lib/crawlo/queue 2025-10-10T02:08:09,017 copying crawlo/queue/__init__.py -> build/lib/crawlo/queue 2025-10-10T02:08:09,019 copying crawlo/queue/pqueue.py -> build/lib/crawlo/queue 2025-10-10T02:08:09,021 copying crawlo/queue/queue_manager.py -> build/lib/crawlo/queue 2025-10-10T02:08:09,024 creating build/lib/crawlo/items 2025-10-10T02:08:09,025 copying crawlo/items/__init__.py -> build/lib/crawlo/items 2025-10-10T02:08:09,028 copying crawlo/items/items.py -> build/lib/crawlo/items 2025-10-10T02:08:09,030 copying crawlo/items/fields.py -> build/lib/crawlo/items 2025-10-10T02:08:09,032 copying crawlo/items/base.py -> build/lib/crawlo/items 2025-10-10T02:08:09,034 creating build/lib/crawlo/initialization 2025-10-10T02:08:09,035 copying crawlo/initialization/built_in.py -> build/lib/crawlo/initialization 2025-10-10T02:08:09,038 copying crawlo/initialization/phases.py -> build/lib/crawlo/initialization 2025-10-10T02:08:09,040 copying crawlo/initialization/__init__.py -> build/lib/crawlo/initialization 2025-10-10T02:08:09,042 copying crawlo/initialization/context.py -> build/lib/crawlo/initialization 2025-10-10T02:08:09,045 copying crawlo/initialization/core.py -> build/lib/crawlo/initialization 2025-10-10T02:08:09,047 copying crawlo/initialization/registry.py -> build/lib/crawlo/initialization 2025-10-10T02:08:09,050 creating build/lib/crawlo/extension 2025-10-10T02:08:09,051 copying crawlo/extension/log_stats.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,054 copying crawlo/extension/request_recorder.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,056 copying crawlo/extension/__init__.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,058 copying crawlo/extension/performance_profiler.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,061 copying crawlo/extension/log_interval.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,063 copying crawlo/extension/memory_monitor.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,066 copying crawlo/extension/health_check.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,068 copying crawlo/extension/logging_extension.py -> build/lib/crawlo/extension 2025-10-10T02:08:09,071 creating build/lib/crawlo/logging 2025-10-10T02:08:09,072 copying crawlo/logging/config.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,075 copying crawlo/logging/__init__.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,077 copying crawlo/logging/factory.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,079 copying crawlo/logging/async_handler.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,082 copying crawlo/logging/manager.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,084 copying crawlo/logging/sampler.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,087 copying crawlo/logging/monitor.py -> build/lib/crawlo/logging 2025-10-10T02:08:09,090 creating build/lib/crawlo/data 2025-10-10T02:08:09,091 copying crawlo/data/__init__.py -> build/lib/crawlo/data 2025-10-10T02:08:09,093 copying crawlo/data/user_agents.py -> build/lib/crawlo/data 2025-10-10T02:08:09,096 creating build/lib/crawlo/settings 2025-10-10T02:08:09,097 copying crawlo/settings/setting_manager.py -> build/lib/crawlo/settings 2025-10-10T02:08:09,100 copying crawlo/settings/__init__.py -> build/lib/crawlo/settings 2025-10-10T02:08:09,102 copying crawlo/settings/default_settings.py -> build/lib/crawlo/settings 2025-10-10T02:08:09,105 creating build/lib/crawlo/commands 2025-10-10T02:08:09,106 copying crawlo/commands/help.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,109 copying crawlo/commands/startproject.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,112 copying crawlo/commands/run.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,115 copying crawlo/commands/__init__.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,117 copying crawlo/commands/utils.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,119 copying crawlo/commands/list.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,122 copying crawlo/commands/check.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,125 copying crawlo/commands/genspider.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,127 copying crawlo/commands/stats.py -> build/lib/crawlo/commands 2025-10-10T02:08:09,131 creating build/lib/crawlo/tools 2025-10-10T02:08:09,132 copying crawlo/tools/text_cleaner.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,134 copying crawlo/tools/data_validator.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,137 copying crawlo/tools/date_tools.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,140 copying crawlo/tools/network_diagnostic.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,142 copying crawlo/tools/authenticated_proxy.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,145 copying crawlo/tools/data_formatter.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,147 copying crawlo/tools/scenario_adapter.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,150 copying crawlo/tools/encoding_converter.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,152 copying crawlo/tools/retry_mechanism.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,155 copying crawlo/tools/__init__.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,157 copying crawlo/tools/distributed_coordinator.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,159 copying crawlo/tools/request_tools.py -> build/lib/crawlo/tools 2025-10-10T02:08:09,162 creating build/lib/crawlo/pipelines 2025-10-10T02:08:09,163 copying crawlo/pipelines/database_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,166 copying crawlo/pipelines/pipeline_manager.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,168 copying crawlo/pipelines/console_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,170 copying crawlo/pipelines/csv_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,173 copying crawlo/pipelines/__init__.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,175 copying crawlo/pipelines/bloom_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,178 copying crawlo/pipelines/mongo_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,180 copying crawlo/pipelines/mysql_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,183 copying crawlo/pipelines/redis_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,185 copying crawlo/pipelines/memory_dedup_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,188 copying crawlo/pipelines/json_pipeline.py -> build/lib/crawlo/pipelines 2025-10-10T02:08:09,191 creating build/lib/crawlo/core 2025-10-10T02:08:09,192 copying crawlo/core/processor.py -> build/lib/crawlo/core 2025-10-10T02:08:09,194 copying crawlo/core/__init__.py -> build/lib/crawlo/core 2025-10-10T02:08:09,196 copying crawlo/core/engine.py -> build/lib/crawlo/core 2025-10-10T02:08:09,199 copying crawlo/core/scheduler.py -> build/lib/crawlo/core 2025-10-10T02:08:09,202 creating build/lib/crawlo/network 2025-10-10T02:08:09,203 copying crawlo/network/response.py -> build/lib/crawlo/network 2025-10-10T02:08:09,206 copying crawlo/network/request.py -> build/lib/crawlo/network 2025-10-10T02:08:09,209 copying crawlo/network/__init__.py -> build/lib/crawlo/network 2025-10-10T02:08:09,211 creating build/lib/crawlo/factories 2025-10-10T02:08:09,212 copying crawlo/factories/crawler.py -> build/lib/crawlo/factories 2025-10-10T02:08:09,214 copying crawlo/factories/__init__.py -> build/lib/crawlo/factories 2025-10-10T02:08:09,216 copying crawlo/factories/base.py -> build/lib/crawlo/factories 2025-10-10T02:08:09,219 copying crawlo/factories/registry.py -> build/lib/crawlo/factories 2025-10-10T02:08:09,222 creating build/lib/crawlo/middleware 2025-10-10T02:08:09,223 copying crawlo/middleware/request_ignore.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,225 copying crawlo/middleware/offsite.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,228 copying crawlo/middleware/response_filter.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,230 copying crawlo/middleware/retry.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,233 copying crawlo/middleware/middleware_manager.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,235 copying crawlo/middleware/__init__.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,237 copying crawlo/middleware/download_delay.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,239 copying crawlo/middleware/response_code.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,242 copying crawlo/middleware/default_header.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,244 copying crawlo/middleware/proxy.py -> build/lib/crawlo/middleware 2025-10-10T02:08:09,248 creating build/lib/crawlo/utils 2025-10-10T02:08:09,249 copying crawlo/utils/func_tools.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,251 copying crawlo/utils/tools.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,253 copying crawlo/utils/db_helper.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,256 copying crawlo/utils/large_scale_config.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,258 copying crawlo/utils/spider_loader.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,261 copying crawlo/utils/controlled_spider_mixin.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,263 copying crawlo/utils/queue_helper.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,266 copying crawlo/utils/selector_helper.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,268 copying crawlo/utils/performance_monitor.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,271 copying crawlo/utils/large_scale_helper.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,273 copying crawlo/utils/fingerprint.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,275 copying crawlo/utils/request.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,278 copying crawlo/utils/text_helper.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,280 copying crawlo/utils/__init__.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,282 copying crawlo/utils/log.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,284 copying crawlo/utils/url.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,286 copying crawlo/utils/batch_processor.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,289 copying crawlo/utils/misc.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,291 copying crawlo/utils/env_config.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,293 copying crawlo/utils/error_handler.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,296 copying crawlo/utils/redis_key_validator.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,299 copying crawlo/utils/request_serializer.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,301 copying crawlo/utils/redis_connection_pool.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,304 copying crawlo/utils/system.py -> build/lib/crawlo/utils 2025-10-10T02:08:09,307 creating build/lib/crawlo/filters 2025-10-10T02:08:09,308 copying crawlo/filters/__init__.py -> build/lib/crawlo/filters 2025-10-10T02:08:09,311 copying crawlo/filters/aioredis_filter.py -> build/lib/crawlo/filters 2025-10-10T02:08:09,313 copying crawlo/filters/memory_filter.py -> build/lib/crawlo/filters 2025-10-10T02:08:09,316 creating build/lib/crawlo/spider 2025-10-10T02:08:09,318 copying crawlo/spider/__init__.py -> build/lib/crawlo/spider 2025-10-10T02:08:09,321 creating build/lib/crawlo/downloader 2025-10-10T02:08:09,322 copying crawlo/downloader/playwright_downloader.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,325 copying crawlo/downloader/__init__.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,328 copying crawlo/downloader/selenium_downloader.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,331 copying crawlo/downloader/cffi_downloader.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,334 copying crawlo/downloader/aiohttp_downloader.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,336 copying crawlo/downloader/httpx_downloader.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,339 copying crawlo/downloader/hybrid_downloader.py -> build/lib/crawlo/downloader 2025-10-10T02:08:09,342 creating build/lib/tests/test_spiders 2025-10-10T02:08:09,343 copying tests/test_spiders/__init__.py -> build/lib/tests/test_spiders 2025-10-10T02:08:09,346 copying tests/test_spiders/test_spider.py -> build/lib/tests/test_spiders 2025-10-10T02:08:09,348 running egg_info 2025-10-10T02:08:09,363 writing crawlo.egg-info/PKG-INFO 2025-10-10T02:08:09,372 writing dependency_links to crawlo.egg-info/dependency_links.txt 2025-10-10T02:08:09,373 writing entry points to crawlo.egg-info/entry_points.txt 2025-10-10T02:08:09,379 writing requirements to crawlo.egg-info/requires.txt 2025-10-10T02:08:09,380 writing top-level names to crawlo.egg-info/top_level.txt 2025-10-10T02:08:09,430 reading manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:09,450 reading manifest template 'MANIFEST.in' 2025-10-10T02:08:09,451 warning: no files found matching 'VERSION' 2025-10-10T02:08:09,451 warning: no files found matching '*' under directory 'crawlo/utils/js' 2025-10-10T02:08:09,533 warning: no previously-included files matching '__pycache__' found anywhere in distribution 2025-10-10T02:08:09,536 warning: no previously-included files matching '*.py[cod]' found anywhere in distribution 2025-10-10T02:08:09,538 warning: no previously-included files matching '.DS_Store' found anywhere in distribution 2025-10-10T02:08:09,540 warning: no previously-included files matching '*.so' found anywhere in distribution 2025-10-10T02:08:09,543 warning: no previously-included files matching '*.bak' found anywhere in distribution 2025-10-10T02:08:09,545 warning: no previously-included files matching '*.swp' found anywhere in distribution 2025-10-10T02:08:09,547 warning: no previously-included files matching '*.orig' found anywhere in distribution 2025-10-10T02:08:09,549 warning: no previously-included files matching '*.rej' found anywhere in distribution 2025-10-10T02:08:09,551 no previously-included directories found matching 'samples' 2025-10-10T02:08:09,552 no previously-included directories found matching 'docs' 2025-10-10T02:08:09,575 writing manifest file 'crawlo.egg-info/SOURCES.txt' 2025-10-10T02:08:09,579 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates' is absent from the `packages` configuration. 2025-10-10T02:08:09,580 !! 2025-10-10T02:08:09,581 ******************************************************************************** 2025-10-10T02:08:09,582 ############################ 2025-10-10T02:08:09,583 # Package would be ignored # 2025-10-10T02:08:09,583 ############################ 2025-10-10T02:08:09,584 Python recognizes 'crawlo.templates' as an importable package[^1], 2025-10-10T02:08:09,585 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,586 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,587 package, please make sure that 'crawlo.templates' is explicitly added 2025-10-10T02:08:09,587 to the `packages` configuration field. 2025-10-10T02:08:09,589 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,589 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,590 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,591 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,592 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,593 If you don't want 'crawlo.templates' to be distributed and are 2025-10-10T02:08:09,594 already explicitly excluding 'crawlo.templates' via 2025-10-10T02:08:09,594 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,595 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,596 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,597 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,598 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,600 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,600 even if it does not contain any `.py` files. 2025-10-10T02:08:09,600 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,601 directory, all directories are treated like packages. 2025-10-10T02:08:09,602 ******************************************************************************** 2025-10-10T02:08:09,603 !! 2025-10-10T02:08:09,603 check.warn(importable) 2025-10-10T02:08:09,604 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project' is absent from the `packages` configuration. 2025-10-10T02:08:09,604 !! 2025-10-10T02:08:09,605 ******************************************************************************** 2025-10-10T02:08:09,606 ############################ 2025-10-10T02:08:09,606 # Package would be ignored # 2025-10-10T02:08:09,607 ############################ 2025-10-10T02:08:09,607 Python recognizes 'crawlo.templates.project' as an importable package[^1], 2025-10-10T02:08:09,608 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,609 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,609 package, please make sure that 'crawlo.templates.project' is explicitly added 2025-10-10T02:08:09,610 to the `packages` configuration field. 2025-10-10T02:08:09,611 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,612 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,612 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,613 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,614 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,615 If you don't want 'crawlo.templates.project' to be distributed and are 2025-10-10T02:08:09,616 already explicitly excluding 'crawlo.templates.project' via 2025-10-10T02:08:09,617 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,617 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,618 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,619 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,620 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,622 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,622 even if it does not contain any `.py` files. 2025-10-10T02:08:09,623 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,623 directory, all directories are treated like packages. 2025-10-10T02:08:09,624 ******************************************************************************** 2025-10-10T02:08:09,625 !! 2025-10-10T02:08:09,626 check.warn(importable) 2025-10-10T02:08:09,626 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.project.spiders' is absent from the `packages` configuration. 2025-10-10T02:08:09,627 !! 2025-10-10T02:08:09,628 ******************************************************************************** 2025-10-10T02:08:09,629 ############################ 2025-10-10T02:08:09,630 # Package would be ignored # 2025-10-10T02:08:09,630 ############################ 2025-10-10T02:08:09,630 Python recognizes 'crawlo.templates.project.spiders' as an importable package[^1], 2025-10-10T02:08:09,631 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,632 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,632 package, please make sure that 'crawlo.templates.project.spiders' is explicitly added 2025-10-10T02:08:09,633 to the `packages` configuration field. 2025-10-10T02:08:09,634 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,634 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,635 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,636 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,637 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,638 If you don't want 'crawlo.templates.project.spiders' to be distributed and are 2025-10-10T02:08:09,638 already explicitly excluding 'crawlo.templates.project.spiders' via 2025-10-10T02:08:09,639 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,639 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,640 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,641 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,642 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,644 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,644 even if it does not contain any `.py` files. 2025-10-10T02:08:09,645 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,645 directory, all directories are treated like packages. 2025-10-10T02:08:09,646 ******************************************************************************** 2025-10-10T02:08:09,647 !! 2025-10-10T02:08:09,648 check.warn(importable) 2025-10-10T02:08:09,648 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'crawlo.templates.spider' is absent from the `packages` configuration. 2025-10-10T02:08:09,649 !! 2025-10-10T02:08:09,650 ******************************************************************************** 2025-10-10T02:08:09,651 ############################ 2025-10-10T02:08:09,651 # Package would be ignored # 2025-10-10T02:08:09,652 ############################ 2025-10-10T02:08:09,652 Python recognizes 'crawlo.templates.spider' as an importable package[^1], 2025-10-10T02:08:09,653 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,654 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,655 package, please make sure that 'crawlo.templates.spider' is explicitly added 2025-10-10T02:08:09,655 to the `packages` configuration field. 2025-10-10T02:08:09,656 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,657 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,658 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,659 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,660 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,661 If you don't want 'crawlo.templates.spider' to be distributed and are 2025-10-10T02:08:09,662 already explicitly excluding 'crawlo.templates.spider' via 2025-10-10T02:08:09,662 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,663 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,663 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,664 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,665 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,667 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,667 even if it does not contain any `.py` files. 2025-10-10T02:08:09,668 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,668 directory, all directories are treated like packages. 2025-10-10T02:08:09,669 ******************************************************************************** 2025-10-10T02:08:09,670 !! 2025-10-10T02:08:09,670 check.warn(importable) 2025-10-10T02:08:09,671 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy' is absent from the `packages` configuration. 2025-10-10T02:08:09,671 !! 2025-10-10T02:08:09,672 ******************************************************************************** 2025-10-10T02:08:09,673 ############################ 2025-10-10T02:08:09,673 # Package would be ignored # 2025-10-10T02:08:09,674 ############################ 2025-10-10T02:08:09,674 Python recognizes 'tests.ofweek_scrapy' as an importable package[^1], 2025-10-10T02:08:09,675 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,676 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,676 package, please make sure that 'tests.ofweek_scrapy' is explicitly added 2025-10-10T02:08:09,677 to the `packages` configuration field. 2025-10-10T02:08:09,678 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,678 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,679 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,680 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,681 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,683 If you don't want 'tests.ofweek_scrapy' to be distributed and are 2025-10-10T02:08:09,683 already explicitly excluding 'tests.ofweek_scrapy' via 2025-10-10T02:08:09,684 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,684 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,685 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,686 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,688 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,690 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,690 even if it does not contain any `.py` files. 2025-10-10T02:08:09,691 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,691 directory, all directories are treated like packages. 2025-10-10T02:08:09,692 ******************************************************************************** 2025-10-10T02:08:09,694 !! 2025-10-10T02:08:09,694 check.warn(importable) 2025-10-10T02:08:09,695 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy.ofweek_scrapy' is absent from the `packages` configuration. 2025-10-10T02:08:09,695 !! 2025-10-10T02:08:09,696 ******************************************************************************** 2025-10-10T02:08:09,696 ############################ 2025-10-10T02:08:09,697 # Package would be ignored # 2025-10-10T02:08:09,698 ############################ 2025-10-10T02:08:09,698 Python recognizes 'tests.ofweek_scrapy.ofweek_scrapy' as an importable package[^1], 2025-10-10T02:08:09,699 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,700 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,700 package, please make sure that 'tests.ofweek_scrapy.ofweek_scrapy' is explicitly added 2025-10-10T02:08:09,701 to the `packages` configuration field. 2025-10-10T02:08:09,702 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,702 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,703 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,704 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,705 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,706 If you don't want 'tests.ofweek_scrapy.ofweek_scrapy' to be distributed and are 2025-10-10T02:08:09,706 already explicitly excluding 'tests.ofweek_scrapy.ofweek_scrapy' via 2025-10-10T02:08:09,707 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,707 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,708 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,709 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,711 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,712 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,713 even if it does not contain any `.py` files. 2025-10-10T02:08:09,714 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,714 directory, all directories are treated like packages. 2025-10-10T02:08:09,715 ******************************************************************************** 2025-10-10T02:08:09,716 !! 2025-10-10T02:08:09,717 check.warn(importable) 2025-10-10T02:08:09,717 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.ofweek_scrapy.ofweek_scrapy.spiders' is absent from the `packages` configuration. 2025-10-10T02:08:09,718 !! 2025-10-10T02:08:09,719 ******************************************************************************** 2025-10-10T02:08:09,720 ############################ 2025-10-10T02:08:09,720 # Package would be ignored # 2025-10-10T02:08:09,721 ############################ 2025-10-10T02:08:09,721 Python recognizes 'tests.ofweek_scrapy.ofweek_scrapy.spiders' as an importable package[^1], 2025-10-10T02:08:09,722 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,723 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,724 package, please make sure that 'tests.ofweek_scrapy.ofweek_scrapy.spiders' is explicitly added 2025-10-10T02:08:09,725 to the `packages` configuration field. 2025-10-10T02:08:09,726 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,727 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,727 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,728 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,729 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,730 If you don't want 'tests.ofweek_scrapy.ofweek_scrapy.spiders' to be distributed and are 2025-10-10T02:08:09,731 already explicitly excluding 'tests.ofweek_scrapy.ofweek_scrapy.spiders' via 2025-10-10T02:08:09,731 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,732 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,732 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,734 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,735 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,736 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,737 even if it does not contain any `.py` files. 2025-10-10T02:08:09,737 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,738 directory, all directories are treated like packages. 2025-10-10T02:08:09,738 ******************************************************************************** 2025-10-10T02:08:09,740 !! 2025-10-10T02:08:09,740 check.warn(importable) 2025-10-10T02:08:09,741 /tmp/pip-build-env-xu_fyjs0/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'tests.scrapy_comparison' is absent from the `packages` configuration. 2025-10-10T02:08:09,742 !! 2025-10-10T02:08:09,743 ******************************************************************************** 2025-10-10T02:08:09,743 ############################ 2025-10-10T02:08:09,744 # Package would be ignored # 2025-10-10T02:08:09,745 ############################ 2025-10-10T02:08:09,745 Python recognizes 'tests.scrapy_comparison' as an importable package[^1], 2025-10-10T02:08:09,746 but it is absent from setuptools' `packages` configuration. 2025-10-10T02:08:09,748 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-10T02:08:09,748 package, please make sure that 'tests.scrapy_comparison' is explicitly added 2025-10-10T02:08:09,749 to the `packages` configuration field. 2025-10-10T02:08:09,750 Alternatively, you can also rely on setuptools' discovery methods 2025-10-10T02:08:09,751 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-10T02:08:09,751 instead of `find_packages(...)`/`find:`). 2025-10-10T02:08:09,752 You can read more about "package discovery" on setuptools documentation page: 2025-10-10T02:08:09,754 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-10T02:08:09,755 If you don't want 'tests.scrapy_comparison' to be distributed and are 2025-10-10T02:08:09,756 already explicitly excluding 'tests.scrapy_comparison' via 2025-10-10T02:08:09,756 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-10T02:08:09,757 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-10T02:08:09,758 combination with a more fine grained `package-data` configuration. 2025-10-10T02:08:09,759 You can read more about "package data files" on setuptools documentation page: 2025-10-10T02:08:09,761 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-10T02:08:09,762 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-10T02:08:09,762 even if it does not contain any `.py` files. 2025-10-10T02:08:09,763 On the other hand, currently there is no concept of package data 2025-10-10T02:08:09,763 directory, all directories are treated like packages. 2025-10-10T02:08:09,764 ******************************************************************************** 2025-10-10T02:08:09,765 !! 2025-10-10T02:08:09,765 check.warn(importable) 2025-10-10T02:08:09,766 creating build/lib/crawlo/templates 2025-10-10T02:08:09,766 copying crawlo/templates/crawlo.cfg.tmpl -> build/lib/crawlo/templates 2025-10-10T02:08:09,767 copying crawlo/templates/run.py.tmpl -> build/lib/crawlo/templates 2025-10-10T02:08:09,767 copying crawlo/templates/spiders_init.py.tmpl -> build/lib/crawlo/templates 2025-10-10T02:08:09,768 creating build/lib/crawlo/templates/project 2025-10-10T02:08:09,768 copying crawlo/templates/project/__init__.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,769 copying crawlo/templates/project/items.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,769 copying crawlo/templates/project/middlewares.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,770 copying crawlo/templates/project/pipelines.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,770 copying crawlo/templates/project/settings.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,771 copying crawlo/templates/project/settings_distributed.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,771 copying crawlo/templates/project/settings_gentle.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,772 copying crawlo/templates/project/settings_high_performance.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,772 copying crawlo/templates/project/settings_minimal.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,773 copying crawlo/templates/project/settings_simple.py.tmpl -> build/lib/crawlo/templates/project 2025-10-10T02:08:09,774 creating build/lib/crawlo/templates/project/spiders 2025-10-10T02:08:09,775 copying crawlo/templates/project/spiders/__init__.py.tmpl -> build/lib/crawlo/templates/project/spiders 2025-10-10T02:08:09,775 creating build/lib/crawlo/templates/spider 2025-10-10T02:08:09,776 copying crawlo/templates/spider/spider.py.tmpl -> build/lib/crawlo/templates/spider 2025-10-10T02:08:09,777 copying tests/comprehensive_testing_summary.md -> build/lib/tests 2025-10-10T02:08:09,778 copying tests/untested_features_report.md -> build/lib/tests 2025-10-10T02:08:09,778 creating build/lib/tests/ofweek_scrapy 2025-10-10T02:08:09,779 copying tests/ofweek_scrapy/scrapy.cfg -> build/lib/tests/ofweek_scrapy 2025-10-10T02:08:09,780 creating build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:09,780 copying tests/ofweek_scrapy/ofweek_scrapy/__init__.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:09,781 copying tests/ofweek_scrapy/ofweek_scrapy/items.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:09,782 copying tests/ofweek_scrapy/ofweek_scrapy/middlewares.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:09,782 copying tests/ofweek_scrapy/ofweek_scrapy/pipelines.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:09,783 copying tests/ofweek_scrapy/ofweek_scrapy/settings.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:09,783 creating build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-10T02:08:09,784 copying tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-10T02:08:09,785 copying tests/ofweek_scrapy/ofweek_scrapy/spiders/ofweek_spider.py -> build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-10T02:08:09,786 creating build/lib/tests/scrapy_comparison 2025-10-10T02:08:09,786 copying tests/scrapy_comparison/ofweek_scrapy.py -> build/lib/tests/scrapy_comparison 2025-10-10T02:08:09,787 copying tests/scrapy_comparison/scrapy_test.py -> build/lib/tests/scrapy_comparison 2025-10-10T02:08:09,787 installing to build/bdist.linux-armv7l/wheel 2025-10-10T02:08:09,788 running install 2025-10-10T02:08:09,788 running install_lib 2025-10-10T02:08:09,789 creating build/bdist.linux-armv7l/wheel 2025-10-10T02:08:09,791 creating build/bdist.linux-armv7l/wheel/crawlo 2025-10-10T02:08:09,793 creating build/bdist.linux-armv7l/wheel/crawlo/queue 2025-10-10T02:08:09,794 copying build/lib/crawlo/queue/redis_priority_queue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-10T02:08:09,796 copying build/lib/crawlo/queue/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-10T02:08:09,798 copying build/lib/crawlo/queue/pqueue.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-10T02:08:09,800 copying build/lib/crawlo/queue/queue_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/queue 2025-10-10T02:08:09,803 creating build/bdist.linux-armv7l/wheel/crawlo/items 2025-10-10T02:08:09,804 copying build/lib/crawlo/items/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-10T02:08:09,806 copying build/lib/crawlo/items/items.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-10T02:08:09,809 copying build/lib/crawlo/items/fields.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-10T02:08:09,811 copying build/lib/crawlo/items/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/items 2025-10-10T02:08:09,814 creating build/bdist.linux-armv7l/wheel/crawlo/initialization 2025-10-10T02:08:09,815 copying build/lib/crawlo/initialization/built_in.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-10T02:08:09,818 copying build/lib/crawlo/initialization/phases.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-10T02:08:09,821 copying build/lib/crawlo/initialization/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-10T02:08:09,823 copying build/lib/crawlo/initialization/context.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-10T02:08:09,825 copying build/lib/crawlo/initialization/core.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-10T02:08:09,828 copying build/lib/crawlo/initialization/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/initialization 2025-10-10T02:08:09,830 copying build/lib/crawlo/config.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:09,834 creating build/bdist.linux-armv7l/wheel/crawlo/extension 2025-10-10T02:08:09,835 copying build/lib/crawlo/extension/log_stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,837 copying build/lib/crawlo/extension/request_recorder.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,839 copying build/lib/crawlo/extension/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,842 copying build/lib/crawlo/extension/performance_profiler.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,844 copying build/lib/crawlo/extension/log_interval.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,847 copying build/lib/crawlo/extension/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,850 copying build/lib/crawlo/extension/health_check.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,852 copying build/lib/crawlo/extension/logging_extension.py -> build/bdist.linux-armv7l/wheel/./crawlo/extension 2025-10-10T02:08:09,855 creating build/bdist.linux-armv7l/wheel/crawlo/logging 2025-10-10T02:08:09,856 copying build/lib/crawlo/logging/config.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,859 copying build/lib/crawlo/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,862 copying build/lib/crawlo/logging/factory.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,864 copying build/lib/crawlo/logging/async_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,866 copying build/lib/crawlo/logging/manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,868 copying build/lib/crawlo/logging/sampler.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,871 copying build/lib/crawlo/logging/monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/logging 2025-10-10T02:08:09,873 copying build/lib/crawlo/subscriber.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:09,876 creating build/bdist.linux-armv7l/wheel/crawlo/data 2025-10-10T02:08:09,878 copying build/lib/crawlo/data/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-10-10T02:08:09,880 copying build/lib/crawlo/data/user_agents.py -> build/bdist.linux-armv7l/wheel/./crawlo/data 2025-10-10T02:08:09,883 creating build/bdist.linux-armv7l/wheel/crawlo/settings 2025-10-10T02:08:09,884 copying build/lib/crawlo/settings/setting_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-10-10T02:08:09,887 copying build/lib/crawlo/settings/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-10-10T02:08:09,889 copying build/lib/crawlo/settings/default_settings.py -> build/bdist.linux-armv7l/wheel/./crawlo/settings 2025-10-10T02:08:09,892 creating build/bdist.linux-armv7l/wheel/crawlo/commands 2025-10-10T02:08:09,893 copying build/lib/crawlo/commands/help.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,897 copying build/lib/crawlo/commands/startproject.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,899 copying build/lib/crawlo/commands/run.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,902 copying build/lib/crawlo/commands/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,904 copying build/lib/crawlo/commands/utils.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,907 copying build/lib/crawlo/commands/list.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,910 copying build/lib/crawlo/commands/check.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,912 copying build/lib/crawlo/commands/genspider.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,915 copying build/lib/crawlo/commands/stats.py -> build/bdist.linux-armv7l/wheel/./crawlo/commands 2025-10-10T02:08:09,917 copying build/lib/crawlo/framework.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:09,921 creating build/bdist.linux-armv7l/wheel/crawlo/tools 2025-10-10T02:08:09,922 copying build/lib/crawlo/tools/text_cleaner.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,924 copying build/lib/crawlo/tools/data_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,927 copying build/lib/crawlo/tools/date_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,930 copying build/lib/crawlo/tools/network_diagnostic.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,932 copying build/lib/crawlo/tools/authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,935 copying build/lib/crawlo/tools/data_formatter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,937 copying build/lib/crawlo/tools/scenario_adapter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,940 copying build/lib/crawlo/tools/encoding_converter.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,943 copying build/lib/crawlo/tools/retry_mechanism.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,945 copying build/lib/crawlo/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,948 copying build/lib/crawlo/tools/distributed_coordinator.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,951 copying build/lib/crawlo/tools/request_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/tools 2025-10-10T02:08:09,953 copying build/lib/crawlo/task_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:09,955 copying build/lib/crawlo/event.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:09,958 creating build/bdist.linux-armv7l/wheel/crawlo/pipelines 2025-10-10T02:08:09,959 copying build/lib/crawlo/pipelines/database_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,961 copying build/lib/crawlo/pipelines/pipeline_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,964 copying build/lib/crawlo/pipelines/console_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,966 copying build/lib/crawlo/pipelines/csv_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,969 copying build/lib/crawlo/pipelines/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,971 copying build/lib/crawlo/pipelines/bloom_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,973 copying build/lib/crawlo/pipelines/mongo_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,975 copying build/lib/crawlo/pipelines/mysql_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,979 copying build/lib/crawlo/pipelines/redis_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,981 copying build/lib/crawlo/pipelines/memory_dedup_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,983 copying build/lib/crawlo/pipelines/json_pipeline.py -> build/bdist.linux-armv7l/wheel/./crawlo/pipelines 2025-10-10T02:08:09,986 creating build/bdist.linux-armv7l/wheel/crawlo/core 2025-10-10T02:08:09,988 copying build/lib/crawlo/core/processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-10T02:08:09,990 copying build/lib/crawlo/core/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-10T02:08:09,992 copying build/lib/crawlo/core/engine.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-10T02:08:09,995 copying build/lib/crawlo/core/scheduler.py -> build/bdist.linux-armv7l/wheel/./crawlo/core 2025-10-10T02:08:09,998 creating build/bdist.linux-armv7l/wheel/crawlo/network 2025-10-10T02:08:09,999 copying build/lib/crawlo/network/response.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-10-10T02:08:10,002 copying build/lib/crawlo/network/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-10-10T02:08:10,004 copying build/lib/crawlo/network/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/network 2025-10-10T02:08:10,006 copying build/lib/crawlo/config_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,009 copying build/lib/crawlo/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,012 creating build/bdist.linux-armv7l/wheel/crawlo/templates 2025-10-10T02:08:10,013 copying build/lib/crawlo/templates/spiders_init.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-10-10T02:08:10,016 copying build/lib/crawlo/templates/crawlo.cfg.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-10-10T02:08:10,018 copying build/lib/crawlo/templates/run.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates 2025-10-10T02:08:10,020 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project 2025-10-10T02:08:10,022 creating build/bdist.linux-armv7l/wheel/crawlo/templates/project/spiders 2025-10-10T02:08:10,024 copying build/lib/crawlo/templates/project/spiders/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project/spiders 2025-10-10T02:08:10,026 copying build/lib/crawlo/templates/project/settings_distributed.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,029 copying build/lib/crawlo/templates/project/middlewares.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,031 copying build/lib/crawlo/templates/project/items.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,033 copying build/lib/crawlo/templates/project/settings_high_performance.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,035 copying build/lib/crawlo/templates/project/settings.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,037 copying build/lib/crawlo/templates/project/__init__.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,039 copying build/lib/crawlo/templates/project/pipelines.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,041 copying build/lib/crawlo/templates/project/settings_gentle.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,044 copying build/lib/crawlo/templates/project/settings_simple.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,047 copying build/lib/crawlo/templates/project/settings_minimal.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/project 2025-10-10T02:08:10,049 creating build/bdist.linux-armv7l/wheel/crawlo/templates/spider 2025-10-10T02:08:10,050 copying build/lib/crawlo/templates/spider/spider.py.tmpl -> build/bdist.linux-armv7l/wheel/./crawlo/templates/spider 2025-10-10T02:08:10,053 copying build/lib/crawlo/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,055 copying build/lib/crawlo/mode_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,058 creating build/bdist.linux-armv7l/wheel/crawlo/factories 2025-10-10T02:08:10,059 copying build/lib/crawlo/factories/crawler.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-10T02:08:10,061 copying build/lib/crawlo/factories/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-10T02:08:10,064 copying build/lib/crawlo/factories/base.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-10T02:08:10,066 copying build/lib/crawlo/factories/registry.py -> build/bdist.linux-armv7l/wheel/./crawlo/factories 2025-10-10T02:08:10,068 creating build/bdist.linux-armv7l/wheel/crawlo/middleware 2025-10-10T02:08:10,070 copying build/lib/crawlo/middleware/request_ignore.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,072 copying build/lib/crawlo/middleware/offsite.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,074 copying build/lib/crawlo/middleware/response_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,077 copying build/lib/crawlo/middleware/retry.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,080 copying build/lib/crawlo/middleware/middleware_manager.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,082 copying build/lib/crawlo/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,084 copying build/lib/crawlo/middleware/download_delay.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,086 copying build/lib/crawlo/middleware/response_code.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,089 copying build/lib/crawlo/middleware/default_header.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,092 copying build/lib/crawlo/middleware/proxy.py -> build/bdist.linux-armv7l/wheel/./crawlo/middleware 2025-10-10T02:08:10,095 copying build/lib/crawlo/exceptions.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,097 copying build/lib/crawlo/project.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,099 copying build/lib/crawlo/stats_collector.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,102 creating build/bdist.linux-armv7l/wheel/crawlo/utils 2025-10-10T02:08:10,103 copying build/lib/crawlo/utils/func_tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,106 copying build/lib/crawlo/utils/tools.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,108 copying build/lib/crawlo/utils/db_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,110 copying build/lib/crawlo/utils/large_scale_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,113 copying build/lib/crawlo/utils/spider_loader.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,115 copying build/lib/crawlo/utils/controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,118 copying build/lib/crawlo/utils/queue_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,121 copying build/lib/crawlo/utils/selector_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,123 copying build/lib/crawlo/utils/performance_monitor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,126 copying build/lib/crawlo/utils/large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,128 copying build/lib/crawlo/utils/fingerprint.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,130 copying build/lib/crawlo/utils/request.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,133 copying build/lib/crawlo/utils/text_helper.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,135 copying build/lib/crawlo/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,137 copying build/lib/crawlo/utils/log.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,139 copying build/lib/crawlo/utils/url.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,141 copying build/lib/crawlo/utils/batch_processor.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,144 copying build/lib/crawlo/utils/misc.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,146 copying build/lib/crawlo/utils/env_config.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,148 copying build/lib/crawlo/utils/error_handler.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,151 copying build/lib/crawlo/utils/redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,153 copying build/lib/crawlo/utils/request_serializer.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,156 copying build/lib/crawlo/utils/redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,159 copying build/lib/crawlo/utils/system.py -> build/bdist.linux-armv7l/wheel/./crawlo/utils 2025-10-10T02:08:10,161 creating build/bdist.linux-armv7l/wheel/crawlo/filters 2025-10-10T02:08:10,163 copying build/lib/crawlo/filters/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-10-10T02:08:10,165 copying build/lib/crawlo/filters/aioredis_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-10-10T02:08:10,168 copying build/lib/crawlo/filters/memory_filter.py -> build/bdist.linux-armv7l/wheel/./crawlo/filters 2025-10-10T02:08:10,171 copying build/lib/crawlo/interfaces.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,173 copying build/lib/crawlo/__version__.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,175 copying build/lib/crawlo/cli.py -> build/bdist.linux-armv7l/wheel/./crawlo 2025-10-10T02:08:10,178 creating build/bdist.linux-armv7l/wheel/crawlo/spider 2025-10-10T02:08:10,179 copying build/lib/crawlo/spider/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/spider 2025-10-10T02:08:10,183 creating build/bdist.linux-armv7l/wheel/crawlo/downloader 2025-10-10T02:08:10,184 copying build/lib/crawlo/downloader/playwright_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,187 copying build/lib/crawlo/downloader/__init__.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,189 copying build/lib/crawlo/downloader/selenium_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,192 copying build/lib/crawlo/downloader/cffi_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,195 copying build/lib/crawlo/downloader/aiohttp_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,197 copying build/lib/crawlo/downloader/httpx_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,201 copying build/lib/crawlo/downloader/hybrid_downloader.py -> build/bdist.linux-armv7l/wheel/./crawlo/downloader 2025-10-10T02:08:10,204 creating build/bdist.linux-armv7l/wheel/examples 2025-10-10T02:08:10,205 copying build/lib/examples/__init__.py -> build/bdist.linux-armv7l/wheel/./examples 2025-10-10T02:08:10,211 creating build/bdist.linux-armv7l/wheel/tests 2025-10-10T02:08:10,213 copying build/lib/tests/untested_features_report.md -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,215 copying build/lib/tests/test_random_user_agent.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,217 copying build/lib/tests/test_mysql_pipeline_init_log.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,219 copying build/lib/tests/debug_log_levels.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,221 copying build/lib/tests/test_proxy_health_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,223 copying build/lib/tests/test_crawler_process_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,226 copying build/lib/tests/log_buffering_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,228 copying build/lib/tests/test_factories.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,230 copying build/lib/tests/distributed_test_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,232 copying build/lib/tests/test_multi_directory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,235 copying build/lib/tests/dynamic_loading_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,237 copying build/lib/tests/test_proxy_only.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,240 creating build/bdist.linux-armv7l/wheel/tests/scrapy_comparison 2025-10-10T02:08:10,241 copying build/lib/tests/scrapy_comparison/scrapy_test.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-10-10T02:08:10,244 copying build/lib/tests/scrapy_comparison/ofweek_scrapy.py -> build/bdist.linux-armv7l/wheel/./tests/scrapy_comparison 2025-10-10T02:08:10,247 copying build/lib/tests/test_response_filter_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,249 copying build/lib/tests/response_improvements_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,252 copying build/lib/tests/detailed_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,255 copying build/lib/tests/test_error_handler_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,257 copying build/lib/tests/test_telecom_spider_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,260 copying build/lib/tests/test_queue_manager_double_crawlo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,262 copying build/lib/tests/test_all_commands.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,265 copying build/lib/tests/test_optimized_selector_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,268 copying build/lib/tests/test_spider_loader.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,270 copying build/lib/tests/test_queue_empty_check.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,272 copying build/lib/tests/test_user_agent_randomness.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,275 copying build/lib/tests/test_double_crawlo_fix_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,277 copying build/lib/tests/final_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,280 copying build/lib/tests/test_mysql_pipeline_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,282 copying build/lib/tests/test_dynamic_downloaders_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,285 copying build/lib/tests/test_dynamic_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,287 copying build/lib/tests/test_redis_connection_pool.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,290 copying build/lib/tests/test_logging_final.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,292 copying build/lib/tests/debug_log_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,294 copying build/lib/tests/config_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,297 copying build/lib/tests/test_performance_monitor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,299 copying build/lib/tests/test_real_scenario_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,301 copying build/lib/tests/test_middleware_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,304 copying build/lib/tests/comprehensive_framework_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,306 copying build/lib/tests/test_downloader_proxy_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,309 copying build/lib/tests/test_enhanced_error_handler_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,312 copying build/lib/tests/test_config_merge.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,314 copying build/lib/tests/test_retry_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,317 copying build/lib/tests/fix_log_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,319 copying build/lib/tests/debug_framework_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,321 copying build/lib/tests/final_comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,324 copying build/lib/tests/test_mode_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,326 copying build/lib/tests/comprehensive_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,328 copying build/lib/tests/test_queue_type.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,330 copying build/lib/tests/test_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,332 copying build/lib/tests/test_all_pipeline_fingerprints.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,335 copying build/lib/tests/comprehensive_testing_summary.md -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,337 copying build/lib/tests/simple_selector_helper_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,340 copying build/lib/tests/test_response_urljoin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,342 copying build/lib/tests/test_hash_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,344 copying build/lib/tests/test_response_selector_methods.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,346 copying build/lib/tests/test_dynamic_proxy_real.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,348 copying build/lib/tests/test_encoding_detection.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,351 copying build/lib/tests/test_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,353 copying build/lib/tests/test_queue_manager_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,356 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy 2025-10-10T02:08:10,358 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:10,359 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/settings.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:10,362 creating build/bdist.linux-armv7l/wheel/tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-10T02:08:10,363 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-10T02:08:10,365 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/spiders/ofweek_spider.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy/spiders 2025-10-10T02:08:10,368 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:10,370 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/items.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:10,372 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/pipelines.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:10,374 copying build/lib/tests/ofweek_scrapy/ofweek_scrapy/middlewares.py -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy/ofweek_scrapy 2025-10-10T02:08:10,376 copying build/lib/tests/ofweek_scrapy/scrapy.cfg -> build/bdist.linux-armv7l/wheel/./tests/ofweek_scrapy 2025-10-10T02:08:10,378 copying build/lib/tests/test_proxy_stats.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,380 copying build/lib/tests/test_date_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,382 copying build/lib/tests/test_dedup_pipeline_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,384 copying build/lib/tests/test_all_redis_key_configs.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,387 copying build/lib/tests/test_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,389 copying build/lib/tests/test_multiple_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,391 copying build/lib/tests/test_mysql_pipeline_refactor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,394 copying build/lib/tests/queue_blocking_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,396 copying build/lib/tests/framework_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,398 copying build/lib/tests/test_template_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,401 copying build/lib/tests/simple_optimization_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,403 copying build/lib/tests/cleaners_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,406 copying build/lib/tests/test_offsite_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,409 copying build/lib/tests/test_redis_key_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,411 copying build/lib/tests/verify_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,413 copying build/lib/tests/test_proxy_middleware_enhanced.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,416 copying build/lib/tests/log_generation_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,418 copying build/lib/tests/test_mysql_pipeline_refactor_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,420 copying build/lib/tests/test_logging_enhancements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,423 copying build/lib/tests/test_proxy_api.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,426 copying build/lib/tests/request_params_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,429 copying build/lib/tests/test_scheduler_config_update.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,431 copying build/lib/tests/test_proxy_strategies.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,433 copying build/lib/tests/test_cleaners.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,435 copying build/lib/tests/test_crawler_process_import.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,437 copying build/lib/tests/queue_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,439 copying build/lib/tests/spider_log_timing_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,442 copying build/lib/tests/optimized_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,445 copying build/lib/tests/dynamic_loading_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,447 copying build/lib/tests/test_download_delay_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,449 copying build/lib/tests/test_asyncmy_usage.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,451 copying build/lib/tests/test_retry_middleware_realistic.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,454 copying build/lib/tests/__init__.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,456 copying build/lib/tests/test_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,458 copying build/lib/tests/test_simple_response.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,460 copying build/lib/tests/verify_mysql_warnings.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,463 copying build/lib/tests/test_item_dedup_redis_key.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,465 copying build/lib/tests/test_framework_env_usage.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,468 copying build/lib/tests/test_response_url_methods.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,470 creating build/bdist.linux-armv7l/wheel/tests/test_spiders 2025-10-10T02:08:10,472 copying build/lib/tests/test_spiders/__init__.py -> build/bdist.linux-armv7l/wheel/./tests/test_spiders 2025-10-10T02:08:10,474 copying build/lib/tests/test_spiders/test_spider.py -> build/bdist.linux-armv7l/wheel/./tests/test_spiders 2025-10-10T02:08:10,476 copying build/lib/tests/test_authenticated_proxy.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,478 copying build/lib/tests/test_large_scale_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,481 copying build/lib/tests/env_config_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,483 copying build/lib/tests/simple_log_test2.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,485 copying build/lib/tests/simple_crawlo_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,488 copying build/lib/tests/test_factory_compatibility.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,491 copying build/lib/tests/test_user_agents.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,493 copying build/lib/tests/test_fingerprint_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,495 copying build/lib/tests/test_selector_optimizations.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,498 copying build/lib/tests/controlled_spider_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,501 copying build/lib/tests/simple_queue_type_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,503 copying build/lib/tests/test_request_serialization.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,505 copying build/lib/tests/test_priority_consistency_fixed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,508 copying build/lib/tests/distributed_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,510 copying build/lib/tests/test_queue_type_redis_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,512 copying build/lib/tests/baidu_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,514 copying build/lib/tests/test_config_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,517 copying build/lib/tests/test_proxy_middleware_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,520 copying build/lib/tests/explain_mysql_update_behavior.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,522 copying build/lib/tests/simulate_mysql_update_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,524 copying build/lib/tests/test_crawlo_proxy_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,526 copying build/lib/tests/test_offsite_middleware_simple.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,529 copying build/lib/tests/test_scheduler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,531 copying build/lib/tests/test_batch_processor.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,534 copying build/lib/tests/test_advanced_tools.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,536 copying build/lib/tests/test_spider_modules.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,539 copying build/lib/tests/simple_follow_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,541 copying build/lib/tests/test_mysql_pipeline_types.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,543 copying build/lib/tests/verify_debug.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,545 copying build/lib/tests/performance_comparison.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,548 copying build/lib/tests/test_final_validation.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,551 copying build/lib/tests/date_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,553 copying build/lib/tests/test_proxy_providers.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,555 copying build/lib/tests/test_controlled_spider_mixin.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,557 copying build/lib/tests/direct_selector_helper_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,560 copying build/lib/tests/simple_command_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,562 copying build/lib/tests/test_mysql_pipeline_error.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,564 copying build/lib/tests/test_redis_queue_name_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,566 copying build/lib/tests/final_validation_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,569 copying build/lib/tests/test_request_ignore_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,571 copying build/lib/tests/test_dedup_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,574 copying build/lib/tests/test_parsel.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,576 copying build/lib/tests/authenticated_proxy_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,579 copying build/lib/tests/advanced_tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,581 copying build/lib/tests/test_logging_system.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,584 copying build/lib/tests/debug_configure.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,586 copying build/lib/tests/test_mysql_pipeline_robustness.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,588 copying build/lib/tests/test_random_headers_default.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,591 copying build/lib/tests/test_config_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,593 copying build/lib/tests/test_env_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,595 copying build/lib/tests/test_request_params.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,598 copying build/lib/tests/simple_url_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,600 copying build/lib/tests/test_redis_key_validator.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,602 copying build/lib/tests/test_dynamic_proxy_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,605 copying build/lib/tests/test_proxy_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,608 copying build/lib/tests/test_response_code_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,610 copying build/lib/tests/test_component_factory.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,613 copying build/lib/tests/test_template_content.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,615 copying build/lib/tests/simple_response_selector_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,617 copying build/lib/tests/test_selector_helper.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,619 copying build/lib/tests/test_edge_cases.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,622 copying build/lib/tests/test_distributed.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,624 copying build/lib/tests/test_proxy_with_downloader.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,626 copying build/lib/tests/test_spider_loader_comprehensive.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,629 copying build/lib/tests/tools_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,631 copying build/lib/tests/test_proxy_middleware_refactored.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,634 copying build/lib/tests/verify_log_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,636 copying build/lib/tests/simple_spider_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,638 copying build/lib/tests/error_handling_example.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,641 copying build/lib/tests/test_pipeline_fingerprint_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,643 copying build/lib/tests/test_mysql_pipeline_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,646 copying build/lib/tests/test_response_improvements.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,649 copying build/lib/tests/test_priority_behavior.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,652 copying build/lib/tests/test_scrapy_style_encoding.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,654 copying build/lib/tests/test_response_follow.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,656 copying build/lib/tests/simple_selector_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,659 copying build/lib/tests/test_get_component_logger.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,661 copying build/lib/tests/test_queue_naming.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,664 copying build/lib/tests/test_double_crawlo_fix.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,666 copying build/lib/tests/redis_key_validation_demo.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,669 copying build/lib/tests/test_default_header_middleware.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,672 copying build/lib/tests/baidu_performance_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,674 copying build/lib/tests/test_redis_queue_type_fallback.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,677 copying build/lib/tests/test_mysql_update_columns.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,679 copying build/lib/tests/bug_check_test.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,681 copying build/lib/tests/test_logging_integration.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,683 copying build/lib/tests/test_random_headers_necessity.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,686 copying build/lib/tests/test_performance.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,688 copying build/lib/tests/test_priority_consistency.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,691 copying build/lib/tests/debug_pipelines.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,693 copying build/lib/tests/test_enhanced_error_handler.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,696 copying build/lib/tests/test_redis_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,698 copying build/lib/tests/test_large_scale_config.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,700 copying build/lib/tests/test_encoding_core.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,702 copying build/lib/tests/test_redis_queue.py -> build/bdist.linux-armv7l/wheel/./tests 2025-10-10T02:08:10,704 running install_egg_info 2025-10-10T02:08:10,720 Copying crawlo.egg-info to build/bdist.linux-armv7l/wheel/./crawlo-1.4.6-py3.11.egg-info 2025-10-10T02:08:10,734 running install_scripts 2025-10-10T02:08:10,745 creating build/bdist.linux-armv7l/wheel/crawlo-1.4.6.dist-info/WHEEL 2025-10-10T02:08:10,748 creating '/tmp/pip-wheel-wv_okuxt/.tmp-f0jb4oii/crawlo-1.4.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-10-10T02:08:10,751 adding 'crawlo/__init__.py' 2025-10-10T02:08:10,753 adding 'crawlo/__version__.py' 2025-10-10T02:08:10,754 adding 'crawlo/cli.py' 2025-10-10T02:08:10,756 adding 'crawlo/config.py' 2025-10-10T02:08:10,758 adding 'crawlo/config_validator.py' 2025-10-10T02:08:10,762 adding 'crawlo/crawler.py' 2025-10-10T02:08:10,763 adding 'crawlo/event.py' 2025-10-10T02:08:10,764 adding 'crawlo/exceptions.py' 2025-10-10T02:08:10,766 adding 'crawlo/framework.py' 2025-10-10T02:08:10,767 adding 'crawlo/interfaces.py' 2025-10-10T02:08:10,769 adding 'crawlo/mode_manager.py' 2025-10-10T02:08:10,771 adding 'crawlo/project.py' 2025-10-10T02:08:10,773 adding 'crawlo/stats_collector.py' 2025-10-10T02:08:10,774 adding 'crawlo/subscriber.py' 2025-10-10T02:08:10,776 adding 'crawlo/task_manager.py' 2025-10-10T02:08:10,778 adding 'crawlo/commands/__init__.py' 2025-10-10T02:08:10,781 adding 'crawlo/commands/check.py' 2025-10-10T02:08:10,783 adding 'crawlo/commands/genspider.py' 2025-10-10T02:08:10,784 adding 'crawlo/commands/help.py' 2025-10-10T02:08:10,786 adding 'crawlo/commands/list.py' 2025-10-10T02:08:10,788 adding 'crawlo/commands/run.py' 2025-10-10T02:08:10,791 adding 'crawlo/commands/startproject.py' 2025-10-10T02:08:10,793 adding 'crawlo/commands/stats.py' 2025-10-10T02:08:10,795 adding 'crawlo/commands/utils.py' 2025-10-10T02:08:10,797 adding 'crawlo/core/__init__.py' 2025-10-10T02:08:10,799 adding 'crawlo/core/engine.py' 2025-10-10T02:08:10,801 adding 'crawlo/core/processor.py' 2025-10-10T02:08:10,803 adding 'crawlo/core/scheduler.py' 2025-10-10T02:08:10,805 adding 'crawlo/data/__init__.py' 2025-10-10T02:08:10,807 adding 'crawlo/data/user_agents.py' 2025-10-10T02:08:10,809 adding 'crawlo/downloader/__init__.py' 2025-10-10T02:08:10,811 adding 'crawlo/downloader/aiohttp_downloader.py' 2025-10-10T02:08:10,813 adding 'crawlo/downloader/cffi_downloader.py' 2025-10-10T02:08:10,815 adding 'crawlo/downloader/httpx_downloader.py' 2025-10-10T02:08:10,817 adding 'crawlo/downloader/hybrid_downloader.py' 2025-10-10T02:08:10,820 adding 'crawlo/downloader/playwright_downloader.py' 2025-10-10T02:08:10,822 adding 'crawlo/downloader/selenium_downloader.py' 2025-10-10T02:08:10,824 adding 'crawlo/extension/__init__.py' 2025-10-10T02:08:10,826 adding 'crawlo/extension/health_check.py' 2025-10-10T02:08:10,827 adding 'crawlo/extension/log_interval.py' 2025-10-10T02:08:10,829 adding 'crawlo/extension/log_stats.py' 2025-10-10T02:08:10,830 adding 'crawlo/extension/logging_extension.py' 2025-10-10T02:08:10,832 adding 'crawlo/extension/memory_monitor.py' 2025-10-10T02:08:10,833 adding 'crawlo/extension/performance_profiler.py' 2025-10-10T02:08:10,835 adding 'crawlo/extension/request_recorder.py' 2025-10-10T02:08:10,837 adding 'crawlo/factories/__init__.py' 2025-10-10T02:08:10,838 adding 'crawlo/factories/base.py' 2025-10-10T02:08:10,840 adding 'crawlo/factories/crawler.py' 2025-10-10T02:08:10,841 adding 'crawlo/factories/registry.py' 2025-10-10T02:08:10,843 adding 'crawlo/filters/__init__.py' 2025-10-10T02:08:10,845 adding 'crawlo/filters/aioredis_filter.py' 2025-10-10T02:08:10,847 adding 'crawlo/filters/memory_filter.py' 2025-10-10T02:08:10,849 adding 'crawlo/initialization/__init__.py' 2025-10-10T02:08:10,851 adding 'crawlo/initialization/built_in.py' 2025-10-10T02:08:10,853 adding 'crawlo/initialization/context.py' 2025-10-10T02:08:10,855 adding 'crawlo/initialization/core.py' 2025-10-10T02:08:10,856 adding 'crawlo/initialization/phases.py' 2025-10-10T02:08:10,858 adding 'crawlo/initialization/registry.py' 2025-10-10T02:08:10,860 adding 'crawlo/items/__init__.py' 2025-10-10T02:08:10,861 adding 'crawlo/items/base.py' 2025-10-10T02:08:10,863 adding 'crawlo/items/fields.py' 2025-10-10T02:08:10,864 adding 'crawlo/items/items.py' 2025-10-10T02:08:10,866 adding 'crawlo/logging/__init__.py' 2025-10-10T02:08:10,868 adding 'crawlo/logging/async_handler.py' 2025-10-10T02:08:10,870 adding 'crawlo/logging/config.py' 2025-10-10T02:08:10,871 adding 'crawlo/logging/factory.py' 2025-10-10T02:08:10,873 adding 'crawlo/logging/manager.py' 2025-10-10T02:08:10,875 adding 'crawlo/logging/monitor.py' 2025-10-10T02:08:10,876 adding 'crawlo/logging/sampler.py' 2025-10-10T02:08:10,878 adding 'crawlo/middleware/__init__.py' 2025-10-10T02:08:10,880 adding 'crawlo/middleware/default_header.py' 2025-10-10T02:08:10,881 adding 'crawlo/middleware/download_delay.py' 2025-10-10T02:08:10,883 adding 'crawlo/middleware/middleware_manager.py' 2025-10-10T02:08:10,885 adding 'crawlo/middleware/offsite.py' 2025-10-10T02:08:10,887 adding 'crawlo/middleware/proxy.py' 2025-10-10T02:08:10,888 adding 'crawlo/middleware/request_ignore.py' 2025-10-10T02:08:10,890 adding 'crawlo/middleware/response_code.py' 2025-10-10T02:08:10,891 adding 'crawlo/middleware/response_filter.py' 2025-10-10T02:08:10,893 adding 'crawlo/middleware/retry.py' 2025-10-10T02:08:10,895 adding 'crawlo/network/__init__.py' 2025-10-10T02:08:10,897 adding 'crawlo/network/request.py' 2025-10-10T02:08:10,900 adding 'crawlo/network/response.py' 2025-10-10T02:08:10,902 adding 'crawlo/pipelines/__init__.py' 2025-10-10T02:08:10,904 adding 'crawlo/pipelines/bloom_dedup_pipeline.py' 2025-10-10T02:08:10,905 adding 'crawlo/pipelines/console_pipeline.py' 2025-10-10T02:08:10,907 adding 'crawlo/pipelines/csv_pipeline.py' 2025-10-10T02:08:10,909 adding 'crawlo/pipelines/database_dedup_pipeline.py' 2025-10-10T02:08:10,911 adding 'crawlo/pipelines/json_pipeline.py' 2025-10-10T02:08:10,913 adding 'crawlo/pipelines/memory_dedup_pipeline.py' 2025-10-10T02:08:10,914 adding 'crawlo/pipelines/mongo_pipeline.py' 2025-10-10T02:08:10,917 adding 'crawlo/pipelines/mysql_pipeline.py' 2025-10-10T02:08:10,919 adding 'crawlo/pipelines/pipeline_manager.py' 2025-10-10T02:08:10,920 adding 'crawlo/pipelines/redis_dedup_pipeline.py' 2025-10-10T02:08:10,922 adding 'crawlo/queue/__init__.py' 2025-10-10T02:08:10,923 adding 'crawlo/queue/pqueue.py' 2025-10-10T02:08:10,926 adding 'crawlo/queue/queue_manager.py' 2025-10-10T02:08:10,928 adding 'crawlo/queue/redis_priority_queue.py' 2025-10-10T02:08:10,930 adding 'crawlo/settings/__init__.py' 2025-10-10T02:08:10,932 adding 'crawlo/settings/default_settings.py' 2025-10-10T02:08:10,934 adding 'crawlo/settings/setting_manager.py' 2025-10-10T02:08:10,937 adding 'crawlo/spider/__init__.py' 2025-10-10T02:08:10,939 adding 'crawlo/templates/crawlo.cfg.tmpl' 2025-10-10T02:08:10,940 adding 'crawlo/templates/run.py.tmpl' 2025-10-10T02:08:10,942 adding 'crawlo/templates/spiders_init.py.tmpl' 2025-10-10T02:08:10,943 adding 'crawlo/templates/project/__init__.py.tmpl' 2025-10-10T02:08:10,945 adding 'crawlo/templates/project/items.py.tmpl' 2025-10-10T02:08:10,946 adding 'crawlo/templates/project/middlewares.py.tmpl' 2025-10-10T02:08:10,948 adding 'crawlo/templates/project/pipelines.py.tmpl' 2025-10-10T02:08:10,949 adding 'crawlo/templates/project/settings.py.tmpl' 2025-10-10T02:08:10,951 adding 'crawlo/templates/project/settings_distributed.py.tmpl' 2025-10-10T02:08:10,953 adding 'crawlo/templates/project/settings_gentle.py.tmpl' 2025-10-10T02:08:10,954 adding 'crawlo/templates/project/settings_high_performance.py.tmpl' 2025-10-10T02:08:10,956 adding 'crawlo/templates/project/settings_minimal.py.tmpl' 2025-10-10T02:08:10,957 adding 'crawlo/templates/project/settings_simple.py.tmpl' 2025-10-10T02:08:10,959 adding 'crawlo/templates/project/spiders/__init__.py.tmpl' 2025-10-10T02:08:10,961 adding 'crawlo/templates/spider/spider.py.tmpl' 2025-10-10T02:08:10,963 adding 'crawlo/tools/__init__.py' 2025-10-10T02:08:10,965 adding 'crawlo/tools/authenticated_proxy.py' 2025-10-10T02:08:10,967 adding 'crawlo/tools/data_formatter.py' 2025-10-10T02:08:10,969 adding 'crawlo/tools/data_validator.py' 2025-10-10T02:08:10,971 adding 'crawlo/tools/date_tools.py' 2025-10-10T02:08:10,973 adding 'crawlo/tools/distributed_coordinator.py' 2025-10-10T02:08:10,974 adding 'crawlo/tools/encoding_converter.py' 2025-10-10T02:08:10,976 adding 'crawlo/tools/network_diagnostic.py' 2025-10-10T02:08:10,978 adding 'crawlo/tools/request_tools.py' 2025-10-10T02:08:10,979 adding 'crawlo/tools/retry_mechanism.py' 2025-10-10T02:08:10,981 adding 'crawlo/tools/scenario_adapter.py' 2025-10-10T02:08:10,983 adding 'crawlo/tools/text_cleaner.py' 2025-10-10T02:08:10,985 adding 'crawlo/utils/__init__.py' 2025-10-10T02:08:10,987 adding 'crawlo/utils/batch_processor.py' 2025-10-10T02:08:10,990 adding 'crawlo/utils/controlled_spider_mixin.py' 2025-10-10T02:08:10,992 adding 'crawlo/utils/db_helper.py' 2025-10-10T02:08:10,993 adding 'crawlo/utils/env_config.py' 2025-10-10T02:08:10,995 adding 'crawlo/utils/error_handler.py' 2025-10-10T02:08:10,997 adding 'crawlo/utils/fingerprint.py' 2025-10-10T02:08:10,999 adding 'crawlo/utils/func_tools.py' 2025-10-10T02:08:11,000 adding 'crawlo/utils/large_scale_config.py' 2025-10-10T02:08:11,002 adding 'crawlo/utils/large_scale_helper.py' 2025-10-10T02:08:11,004 adding 'crawlo/utils/log.py' 2025-10-10T02:08:11,005 adding 'crawlo/utils/misc.py' 2025-10-10T02:08:11,007 adding 'crawlo/utils/performance_monitor.py' 2025-10-10T02:08:11,009 adding 'crawlo/utils/queue_helper.py' 2025-10-10T02:08:11,011 adding 'crawlo/utils/redis_connection_pool.py' 2025-10-10T02:08:11,013 adding 'crawlo/utils/redis_key_validator.py' 2025-10-10T02:08:11,016 adding 'crawlo/utils/request.py' 2025-10-10T02:08:11,018 adding 'crawlo/utils/request_serializer.py' 2025-10-10T02:08:11,020 adding 'crawlo/utils/selector_helper.py' 2025-10-10T02:08:11,021 adding 'crawlo/utils/spider_loader.py' 2025-10-10T02:08:11,023 adding 'crawlo/utils/system.py' 2025-10-10T02:08:11,024 adding 'crawlo/utils/text_helper.py' 2025-10-10T02:08:11,026 adding 'crawlo/utils/tools.py' 2025-10-10T02:08:11,027 adding 'crawlo/utils/url.py' 2025-10-10T02:08:11,030 adding 'examples/__init__.py' 2025-10-10T02:08:11,036 adding 'tests/__init__.py' 2025-10-10T02:08:11,038 adding 'tests/advanced_tools_example.py' 2025-10-10T02:08:11,039 adding 'tests/authenticated_proxy_example.py' 2025-10-10T02:08:11,041 adding 'tests/baidu_performance_test.py' 2025-10-10T02:08:11,042 adding 'tests/baidu_test.py' 2025-10-10T02:08:11,044 adding 'tests/bug_check_test.py' 2025-10-10T02:08:11,045 adding 'tests/cleaners_example.py' 2025-10-10T02:08:11,047 adding 'tests/comprehensive_framework_test.py' 2025-10-10T02:08:11,049 adding 'tests/comprehensive_test.py' 2025-10-10T02:08:11,051 adding 'tests/comprehensive_testing_summary.md' 2025-10-10T02:08:11,052 adding 'tests/config_validation_demo.py' 2025-10-10T02:08:11,054 adding 'tests/controlled_spider_example.py' 2025-10-10T02:08:11,056 adding 'tests/date_tools_example.py' 2025-10-10T02:08:11,058 adding 'tests/debug_configure.py' 2025-10-10T02:08:11,059 adding 'tests/debug_framework_logger.py' 2025-10-10T02:08:11,061 adding 'tests/debug_log_config.py' 2025-10-10T02:08:11,063 adding 'tests/debug_log_levels.py' 2025-10-10T02:08:11,064 adding 'tests/debug_pipelines.py' 2025-10-10T02:08:11,066 adding 'tests/detailed_log_test.py' 2025-10-10T02:08:11,068 adding 'tests/direct_selector_helper_test.py' 2025-10-10T02:08:11,069 adding 'tests/distributed_test.py' 2025-10-10T02:08:11,070 adding 'tests/distributed_test_debug.py' 2025-10-10T02:08:11,072 adding 'tests/dynamic_loading_example.py' 2025-10-10T02:08:11,074 adding 'tests/dynamic_loading_test.py' 2025-10-10T02:08:11,076 adding 'tests/env_config_example.py' 2025-10-10T02:08:11,077 adding 'tests/error_handling_example.py' 2025-10-10T02:08:11,079 adding 'tests/explain_mysql_update_behavior.py' 2025-10-10T02:08:11,080 adding 'tests/final_comprehensive_test.py' 2025-10-10T02:08:11,082 adding 'tests/final_log_test.py' 2025-10-10T02:08:11,084 adding 'tests/final_validation_test.py' 2025-10-10T02:08:11,085 adding 'tests/fix_log_test.py' 2025-10-10T02:08:11,087 adding 'tests/framework_performance_test.py' 2025-10-10T02:08:11,089 adding 'tests/log_buffering_test.py' 2025-10-10T02:08:11,090 adding 'tests/log_generation_timing_test.py' 2025-10-10T02:08:11,092 adding 'tests/optimized_performance_test.py' 2025-10-10T02:08:11,094 adding 'tests/performance_comparison.py' 2025-10-10T02:08:11,096 adding 'tests/queue_blocking_test.py' 2025-10-10T02:08:11,097 adding 'tests/queue_test.py' 2025-10-10T02:08:11,099 adding 'tests/redis_key_validation_demo.py' 2025-10-10T02:08:11,101 adding 'tests/request_params_example.py' 2025-10-10T02:08:11,103 adding 'tests/response_improvements_example.py' 2025-10-10T02:08:11,104 adding 'tests/simple_command_test.py' 2025-10-10T02:08:11,106 adding 'tests/simple_crawlo_test.py' 2025-10-10T02:08:11,107 adding 'tests/simple_follow_test.py' 2025-10-10T02:08:11,109 adding 'tests/simple_log_test2.py' 2025-10-10T02:08:11,111 adding 'tests/simple_optimization_test.py' 2025-10-10T02:08:11,112 adding 'tests/simple_queue_type_test.py' 2025-10-10T02:08:11,113 adding 'tests/simple_response_selector_test.py' 2025-10-10T02:08:11,115 adding 'tests/simple_selector_helper_test.py' 2025-10-10T02:08:11,117 adding 'tests/simple_selector_test.py' 2025-10-10T02:08:11,118 adding 'tests/simple_spider_test.py' 2025-10-10T02:08:11,120 adding 'tests/simple_url_test.py' 2025-10-10T02:08:11,121 adding 'tests/simulate_mysql_update_test.py' 2025-10-10T02:08:11,123 adding 'tests/spider_log_timing_test.py' 2025-10-10T02:08:11,124 adding 'tests/test_advanced_tools.py' 2025-10-10T02:08:11,126 adding 'tests/test_all_commands.py' 2025-10-10T02:08:11,128 adding 'tests/test_all_pipeline_fingerprints.py' 2025-10-10T02:08:11,130 adding 'tests/test_all_redis_key_configs.py' 2025-10-10T02:08:11,131 adding 'tests/test_asyncmy_usage.py' 2025-10-10T02:08:11,133 adding 'tests/test_authenticated_proxy.py' 2025-10-10T02:08:11,134 adding 'tests/test_batch_processor.py' 2025-10-10T02:08:11,136 adding 'tests/test_cleaners.py' 2025-10-10T02:08:11,137 adding 'tests/test_component_factory.py' 2025-10-10T02:08:11,139 adding 'tests/test_comprehensive.py' 2025-10-10T02:08:11,140 adding 'tests/test_config_consistency.py' 2025-10-10T02:08:11,142 adding 'tests/test_config_merge.py' 2025-10-10T02:08:11,143 adding 'tests/test_config_validator.py' 2025-10-10T02:08:11,145 adding 'tests/test_controlled_spider_mixin.py' 2025-10-10T02:08:11,146 adding 'tests/test_crawler_process_import.py' 2025-10-10T02:08:11,147 adding 'tests/test_crawler_process_spider_modules.py' 2025-10-10T02:08:11,149 adding 'tests/test_crawlo_proxy_integration.py' 2025-10-10T02:08:11,150 adding 'tests/test_date_tools.py' 2025-10-10T02:08:11,152 adding 'tests/test_dedup_fix.py' 2025-10-10T02:08:11,154 adding 'tests/test_dedup_pipeline_consistency.py' 2025-10-10T02:08:11,155 adding 'tests/test_default_header_middleware.py' 2025-10-10T02:08:11,157 adding 'tests/test_distributed.py' 2025-10-10T02:08:11,159 adding 'tests/test_double_crawlo_fix.py' 2025-10-10T02:08:11,160 adding 'tests/test_double_crawlo_fix_simple.py' 2025-10-10T02:08:11,162 adding 'tests/test_download_delay_middleware.py' 2025-10-10T02:08:11,164 adding 'tests/test_downloader_proxy_compatibility.py' 2025-10-10T02:08:11,165 adding 'tests/test_dynamic_downloaders_proxy.py' 2025-10-10T02:08:11,167 adding 'tests/test_dynamic_proxy.py' 2025-10-10T02:08:11,168 adding 'tests/test_dynamic_proxy_config.py' 2025-10-10T02:08:11,170 adding 'tests/test_dynamic_proxy_real.py' 2025-10-10T02:08:11,172 adding 'tests/test_edge_cases.py' 2025-10-10T02:08:11,173 adding 'tests/test_encoding_core.py' 2025-10-10T02:08:11,174 adding 'tests/test_encoding_detection.py' 2025-10-10T02:08:11,176 adding 'tests/test_enhanced_error_handler.py' 2025-10-10T02:08:11,178 adding 'tests/test_enhanced_error_handler_comprehensive.py' 2025-10-10T02:08:11,180 adding 'tests/test_env_config.py' 2025-10-10T02:08:11,181 adding 'tests/test_error_handler_compatibility.py' 2025-10-10T02:08:11,183 adding 'tests/test_factories.py' 2025-10-10T02:08:11,184 adding 'tests/test_factory_compatibility.py' 2025-10-10T02:08:11,186 adding 'tests/test_final_validation.py' 2025-10-10T02:08:11,187 adding 'tests/test_fingerprint_consistency.py' 2025-10-10T02:08:11,189 adding 'tests/test_fingerprint_simple.py' 2025-10-10T02:08:11,190 adding 'tests/test_framework_env_usage.py' 2025-10-10T02:08:11,192 adding 'tests/test_get_component_logger.py' 2025-10-10T02:08:11,193 adding 'tests/test_hash_performance.py' 2025-10-10T02:08:11,195 adding 'tests/test_integration.py' 2025-10-10T02:08:11,197 adding 'tests/test_item_dedup_redis_key.py' 2025-10-10T02:08:11,198 adding 'tests/test_large_scale_config.py' 2025-10-10T02:08:11,200 adding 'tests/test_large_scale_helper.py' 2025-10-10T02:08:11,202 adding 'tests/test_logging_enhancements.py' 2025-10-10T02:08:11,204 adding 'tests/test_logging_final.py' 2025-10-10T02:08:11,205 adding 'tests/test_logging_integration.py' 2025-10-10T02:08:11,207 adding 'tests/test_logging_system.py' 2025-10-10T02:08:11,209 adding 'tests/test_middleware_debug.py' 2025-10-10T02:08:11,210 adding 'tests/test_mode_consistency.py' 2025-10-10T02:08:11,212 adding 'tests/test_multi_directory.py' 2025-10-10T02:08:11,213 adding 'tests/test_multiple_spider_modules.py' 2025-10-10T02:08:11,215 adding 'tests/test_mysql_pipeline_config.py' 2025-10-10T02:08:11,216 adding 'tests/test_mysql_pipeline_error.py' 2025-10-10T02:08:11,218 adding 'tests/test_mysql_pipeline_init_log.py' 2025-10-10T02:08:11,219 adding 'tests/test_mysql_pipeline_integration.py' 2025-10-10T02:08:11,221 adding 'tests/test_mysql_pipeline_refactor.py' 2025-10-10T02:08:11,222 adding 'tests/test_mysql_pipeline_refactor_simple.py' 2025-10-10T02:08:11,224 adding 'tests/test_mysql_pipeline_robustness.py' 2025-10-10T02:08:11,225 adding 'tests/test_mysql_pipeline_types.py' 2025-10-10T02:08:11,227 adding 'tests/test_mysql_update_columns.py' 2025-10-10T02:08:11,229 adding 'tests/test_offsite_middleware.py' 2025-10-10T02:08:11,230 adding 'tests/test_offsite_middleware_simple.py' 2025-10-10T02:08:11,232 adding 'tests/test_optimized_selector_naming.py' 2025-10-10T02:08:11,233 adding 'tests/test_parsel.py' 2025-10-10T02:08:11,234 adding 'tests/test_performance.py' 2025-10-10T02:08:11,236 adding 'tests/test_performance_monitor.py' 2025-10-10T02:08:11,237 adding 'tests/test_pipeline_fingerprint_consistency.py' 2025-10-10T02:08:11,239 adding 'tests/test_priority_behavior.py' 2025-10-10T02:08:11,241 adding 'tests/test_priority_consistency.py' 2025-10-10T02:08:11,242 adding 'tests/test_priority_consistency_fixed.py' 2025-10-10T02:08:11,244 adding 'tests/test_proxy_api.py' 2025-10-10T02:08:11,246 adding 'tests/test_proxy_health_check.py' 2025-10-10T02:08:11,247 adding 'tests/test_proxy_middleware.py' 2025-10-10T02:08:11,249 adding 'tests/test_proxy_middleware_enhanced.py' 2025-10-10T02:08:11,251 adding 'tests/test_proxy_middleware_integration.py' 2025-10-10T02:08:11,252 adding 'tests/test_proxy_middleware_refactored.py' 2025-10-10T02:08:11,254 adding 'tests/test_proxy_only.py' 2025-10-10T02:08:11,255 adding 'tests/test_proxy_providers.py' 2025-10-10T02:08:11,257 adding 'tests/test_proxy_stats.py' 2025-10-10T02:08:11,258 adding 'tests/test_proxy_strategies.py' 2025-10-10T02:08:11,259 adding 'tests/test_proxy_with_downloader.py' 2025-10-10T02:08:11,261 adding 'tests/test_queue_empty_check.py' 2025-10-10T02:08:11,262 adding 'tests/test_queue_manager_double_crawlo.py' 2025-10-10T02:08:11,264 adding 'tests/test_queue_manager_redis_key.py' 2025-10-10T02:08:11,266 adding 'tests/test_queue_naming.py' 2025-10-10T02:08:11,267 adding 'tests/test_queue_type.py' 2025-10-10T02:08:11,269 adding 'tests/test_queue_type_redis_config_consistency.py' 2025-10-10T02:08:11,271 adding 'tests/test_random_headers_default.py' 2025-10-10T02:08:11,273 adding 'tests/test_random_headers_necessity.py' 2025-10-10T02:08:11,274 adding 'tests/test_random_user_agent.py' 2025-10-10T02:08:11,276 adding 'tests/test_real_scenario_proxy.py' 2025-10-10T02:08:11,277 adding 'tests/test_redis_config.py' 2025-10-10T02:08:11,279 adding 'tests/test_redis_connection_pool.py' 2025-10-10T02:08:11,280 adding 'tests/test_redis_key_naming.py' 2025-10-10T02:08:11,282 adding 'tests/test_redis_key_validator.py' 2025-10-10T02:08:11,284 adding 'tests/test_redis_queue.py' 2025-10-10T02:08:11,285 adding 'tests/test_redis_queue_name_fix.py' 2025-10-10T02:08:11,287 adding 'tests/test_redis_queue_type_fallback.py' 2025-10-10T02:08:11,288 adding 'tests/test_request_ignore_middleware.py' 2025-10-10T02:08:11,290 adding 'tests/test_request_params.py' 2025-10-10T02:08:11,291 adding 'tests/test_request_serialization.py' 2025-10-10T02:08:11,293 adding 'tests/test_response_code_middleware.py' 2025-10-10T02:08:11,295 adding 'tests/test_response_filter_middleware.py' 2025-10-10T02:08:11,297 adding 'tests/test_response_follow.py' 2025-10-10T02:08:11,299 adding 'tests/test_response_improvements.py' 2025-10-10T02:08:11,300 adding 'tests/test_response_selector_methods.py' 2025-10-10T02:08:11,302 adding 'tests/test_response_url_methods.py' 2025-10-10T02:08:11,303 adding 'tests/test_response_urljoin.py' 2025-10-10T02:08:11,305 adding 'tests/test_retry_middleware.py' 2025-10-10T02:08:11,307 adding 'tests/test_retry_middleware_realistic.py' 2025-10-10T02:08:11,308 adding 'tests/test_scheduler.py' 2025-10-10T02:08:11,310 adding 'tests/test_scheduler_config_update.py' 2025-10-10T02:08:11,312 adding 'tests/test_scrapy_style_encoding.py' 2025-10-10T02:08:11,313 adding 'tests/test_selector_helper.py' 2025-10-10T02:08:11,315 adding 'tests/test_selector_optimizations.py' 2025-10-10T02:08:11,316 adding 'tests/test_simple_response.py' 2025-10-10T02:08:11,318 adding 'tests/test_spider_loader.py' 2025-10-10T02:08:11,319 adding 'tests/test_spider_loader_comprehensive.py' 2025-10-10T02:08:11,320 adding 'tests/test_spider_modules.py' 2025-10-10T02:08:11,322 adding 'tests/test_telecom_spider_redis_key.py' 2025-10-10T02:08:11,324 adding 'tests/test_template_content.py' 2025-10-10T02:08:11,325 adding 'tests/test_template_redis_key.py' 2025-10-10T02:08:11,327 adding 'tests/test_tools.py' 2025-10-10T02:08:11,328 adding 'tests/test_user_agent_randomness.py' 2025-10-10T02:08:11,330 adding 'tests/test_user_agents.py' 2025-10-10T02:08:11,331 adding 'tests/tools_example.py' 2025-10-10T02:08:11,333 adding 'tests/untested_features_report.md' 2025-10-10T02:08:11,334 adding 'tests/verify_debug.py' 2025-10-10T02:08:11,336 adding 'tests/verify_distributed.py' 2025-10-10T02:08:11,337 adding 'tests/verify_log_fix.py' 2025-10-10T02:08:11,339 adding 'tests/verify_mysql_warnings.py' 2025-10-10T02:08:11,341 adding 'tests/ofweek_scrapy/scrapy.cfg' 2025-10-10T02:08:11,342 adding 'tests/ofweek_scrapy/ofweek_scrapy/__init__.py' 2025-10-10T02:08:11,344 adding 'tests/ofweek_scrapy/ofweek_scrapy/items.py' 2025-10-10T02:08:11,345 adding 'tests/ofweek_scrapy/ofweek_scrapy/middlewares.py' 2025-10-10T02:08:11,346 adding 'tests/ofweek_scrapy/ofweek_scrapy/pipelines.py' 2025-10-10T02:08:11,348 adding 'tests/ofweek_scrapy/ofweek_scrapy/settings.py' 2025-10-10T02:08:11,350 adding 'tests/ofweek_scrapy/ofweek_scrapy/spiders/__init__.py' 2025-10-10T02:08:11,352 adding 'tests/ofweek_scrapy/ofweek_scrapy/spiders/ofweek_spider.py' 2025-10-10T02:08:11,354 adding 'tests/scrapy_comparison/ofweek_scrapy.py' 2025-10-10T02:08:11,355 adding 'tests/scrapy_comparison/scrapy_test.py' 2025-10-10T02:08:11,357 adding 'tests/test_spiders/__init__.py' 2025-10-10T02:08:11,359 adding 'tests/test_spiders/test_spider.py' 2025-10-10T02:08:11,360 adding 'crawlo-1.4.6.dist-info/METADATA' 2025-10-10T02:08:11,361 adding 'crawlo-1.4.6.dist-info/WHEEL' 2025-10-10T02:08:11,362 adding 'crawlo-1.4.6.dist-info/entry_points.txt' 2025-10-10T02:08:11,363 adding 'crawlo-1.4.6.dist-info/top_level.txt' 2025-10-10T02:08:11,369 adding 'crawlo-1.4.6.dist-info/RECORD' 2025-10-10T02:08:11,384 removing build/bdist.linux-armv7l/wheel 2025-10-10T02:08:11,586 Building wheel for crawlo (pyproject.toml): finished with status 'done' 2025-10-10T02:08:11,605 Created wheel for crawlo: filename=crawlo-1.4.6-py3-none-any.whl size=647738 sha256=f15eba91005d4f2cd583499d8c36d1881f75e9ef02d85ce00427b50818dcaea8 2025-10-10T02:08:11,606 Stored in directory: /tmp/pip-ephem-wheel-cache-g7vrupc7/wheels/25/c5/69/2238974364c7fa9faa5c7a35135a30ee10380bc04aa1356dab 2025-10-10T02:08:11,631 Successfully built crawlo 2025-10-10T02:08:11,651 Removed build tracker: '/tmp/pip-build-tracker-sthg5_dn'