2024-11-28T17:07:27,044 Created temporary directory: /tmp/pip-build-tracker-t7kf4ox9 2024-11-28T17:07:27,045 Initialized build tracking at /tmp/pip-build-tracker-t7kf4ox9 2024-11-28T17:07:27,046 Created build tracker: /tmp/pip-build-tracker-t7kf4ox9 2024-11-28T17:07:27,046 Entered build tracker: /tmp/pip-build-tracker-t7kf4ox9 2024-11-28T17:07:27,047 Created temporary directory: /tmp/pip-wheel-6fc9vhpg 2024-11-28T17:07:27,051 Created temporary directory: /tmp/pip-ephem-wheel-cache-6hw83bhj 2024-11-28T17:07:27,095 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-11-28T17:07:27,098 2 location(s) to search for versions of py-data-juicer: 2024-11-28T17:07:27,098 * https://pypi.org/simple/py-data-juicer/ 2024-11-28T17:07:27,098 * https://www.piwheels.org/simple/py-data-juicer/ 2024-11-28T17:07:27,099 Fetching project page and analyzing links: https://pypi.org/simple/py-data-juicer/ 2024-11-28T17:07:27,100 Getting page https://pypi.org/simple/py-data-juicer/ 2024-11-28T17:07:27,101 Found index url https://pypi.org/simple/ 2024-11-28T17:07:27,359 Fetched page https://pypi.org/simple/py-data-juicer/ as application/vnd.pypi.simple.v1+json 2024-11-28T17:07:27,363 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/e3/d3/d0724d922e7c55a0664485fdf642124bdcd801df2697e29c9463c4360958/py_data_juicer-0.1.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2024-11-28T17:07:27,364 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/fd/c6/e1428310bf534319ddc2e362c6eee21985f097e70cedc0e9cd3e914de826/py_data_juicer-0.1.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2024-11-28T17:07:27,364 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/67/70/731e349d2a92bf59a767230b956665dd27ea24a7a948d4a1710154d77a24/py_data_juicer-0.1.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2024-11-28T17:07:27,365 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/66/08/f584efbdf8277a061ce73c9befc33fec813cbd08020761af2380dd331692/py_data_juicer-0.1.3-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2024-11-28T17:07:27,366 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/69/20/9862dfe7a94f10caa0e6387834d1265420613345c7adadd41a3ced7230e8/py_data_juicer-0.2.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2024-11-28T17:07:27,366 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/05/34/33fb401d350f1a66cdaefc224419f9d01484722829f5b0c71ef59a8365a4/py_data_juicer-1.0.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2024-11-28T17:07:27,367 Found link https://files.pythonhosted.org/packages/49/e9/cfb994255490c36554048e0b3956858e61f5a75ffacfde20849f31f04ef8/py_data_juicer-1.0.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.0 2024-11-28T17:07:27,368 Fetching project page and analyzing links: https://www.piwheels.org/simple/py-data-juicer/ 2024-11-28T17:07:27,369 Getting page https://www.piwheels.org/simple/py-data-juicer/ 2024-11-28T17:07:27,370 Found index url https://www.piwheels.org/simple/ 2024-11-28T17:07:27,581 Fetched page https://www.piwheels.org/simple/py-data-juicer/ as text/html 2024-11-28T17:07:27,583 Skipping link: not a file: https://www.piwheels.org/simple/py-data-juicer/ 2024-11-28T17:07:27,583 Skipping link: not a file: https://pypi.org/simple/py-data-juicer/ 2024-11-28T17:07:27,601 Given no hashes to check 1 links for project 'py-data-juicer': discarding no candidates 2024-11-28T17:07:27,602 Collecting py-data-juicer==1.0.0 2024-11-28T17:07:27,605 Created temporary directory: /tmp/pip-unpack-h_g74tk1 2024-11-28T17:07:27,822 Downloading py_data_juicer-1.0.0.tar.gz (221 kB) 2024-11-28T17:07:28,278 Added py-data-juicer==1.0.0 from https://files.pythonhosted.org/packages/49/e9/cfb994255490c36554048e0b3956858e61f5a75ffacfde20849f31f04ef8/py_data_juicer-1.0.0.tar.gz to build tracker '/tmp/pip-build-tracker-t7kf4ox9' 2024-11-28T17:07:28,280 Running setup.py (path:/tmp/pip-wheel-6fc9vhpg/py-data-juicer_6ba9a491e0f342c3b53bea4dffeac3eb/setup.py) egg_info for package py-data-juicer 2024-11-28T17:07:28,282 Created temporary directory: /tmp/pip-pip-egg-info-sc7fhiwc 2024-11-28T17:07:28,282 Preparing metadata (setup.py): started 2024-11-28T17:07:28,284 Running command python setup.py egg_info 2024-11-28T17:07:28,785 WARNING:root:target file does not exist: environments/minimal_requires.txt 2024-11-28T17:07:28,786 WARNING:root:target file does not exist: environments/science_requires.txt 2024-11-28T17:07:28,786 WARNING:root:target file does not exist: environments/dist_requires.txt 2024-11-28T17:07:28,787 WARNING:root:target file does not exist: environments/dev_requires.txt 2024-11-28T17:07:28,787 WARNING:root:target file does not exist: environments/preprocess_requires.txt 2024-11-28T17:07:28,788 WARNING:root:target file does not exist: environments/quality_classifier_requires.txt 2024-11-28T17:07:28,789 WARNING:root:target file does not exist: environments/sandbox_requires.txt 2024-11-28T17:07:29,412 INFO:root:running egg_info 2024-11-28T17:07:29,441 INFO:root:creating /tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info 2024-11-28T17:07:29,443 INFO:root:writing /tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/PKG-INFO 2024-11-28T17:07:29,446 INFO:root:writing dependency_links to /tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/dependency_links.txt 2024-11-28T17:07:29,448 INFO:root:writing entry points to /tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/entry_points.txt 2024-11-28T17:07:29,450 INFO:root:writing requirements to /tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/requires.txt 2024-11-28T17:07:29,451 INFO:root:writing top-level names to /tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/top_level.txt 2024-11-28T17:07:29,452 INFO:root:writing manifest file '/tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/SOURCES.txt' 2024-11-28T17:07:29,558 INFO:root:reading manifest file '/tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/SOURCES.txt' 2024-11-28T17:07:29,560 INFO:root:adding license file 'LICENSE' 2024-11-28T17:07:29,567 INFO:root:writing manifest file '/tmp/pip-pip-egg-info-sc7fhiwc/py_data_juicer.egg-info/SOURCES.txt' 2024-11-28T17:07:29,661 Preparing metadata (setup.py): finished with status 'done' 2024-11-28T17:07:29,667 Source in /tmp/pip-wheel-6fc9vhpg/py-data-juicer_6ba9a491e0f342c3b53bea4dffeac3eb has version 1.0.0, which satisfies requirement py-data-juicer==1.0.0 from https://files.pythonhosted.org/packages/49/e9/cfb994255490c36554048e0b3956858e61f5a75ffacfde20849f31f04ef8/py_data_juicer-1.0.0.tar.gz 2024-11-28T17:07:29,668 Removed py-data-juicer==1.0.0 from https://files.pythonhosted.org/packages/49/e9/cfb994255490c36554048e0b3956858e61f5a75ffacfde20849f31f04ef8/py_data_juicer-1.0.0.tar.gz from build tracker '/tmp/pip-build-tracker-t7kf4ox9' 2024-11-28T17:07:29,675 Created temporary directory: /tmp/pip-unpack-5zkiru2r 2024-11-28T17:07:29,676 Created temporary directory: /tmp/pip-unpack-r2qr73wx 2024-11-28T17:07:29,677 Building wheels for collected packages: py-data-juicer 2024-11-28T17:07:29,681 Created temporary directory: /tmp/pip-wheel-0vwx61so 2024-11-28T17:07:29,682 Building wheel for py-data-juicer (setup.py): started 2024-11-28T17:07:29,683 Destination directory: /tmp/pip-wheel-0vwx61so 2024-11-28T17:07:29,684 Running command python setup.py bdist_wheel 2024-11-28T17:07:30,143 WARNING:root:target file does not exist: environments/minimal_requires.txt 2024-11-28T17:07:30,144 WARNING:root:target file does not exist: environments/science_requires.txt 2024-11-28T17:07:30,144 WARNING:root:target file does not exist: environments/dist_requires.txt 2024-11-28T17:07:30,145 WARNING:root:target file does not exist: environments/dev_requires.txt 2024-11-28T17:07:30,146 WARNING:root:target file does not exist: environments/preprocess_requires.txt 2024-11-28T17:07:30,146 WARNING:root:target file does not exist: environments/quality_classifier_requires.txt 2024-11-28T17:07:30,147 WARNING:root:target file does not exist: environments/sandbox_requires.txt 2024-11-28T17:07:30,729 INFO:root:running bdist_wheel 2024-11-28T17:07:30,868 INFO:root:running build 2024-11-28T17:07:30,869 INFO:root:running build_py 2024-11-28T17:07:30,899 INFO:root:creating build/lib/data_juicer 2024-11-28T17:07:30,901 INFO:root:copying data_juicer/__init__.py -> build/lib/data_juicer 2024-11-28T17:07:30,904 INFO:root:creating build/lib/data_juicer/format 2024-11-28T17:07:30,905 INFO:root:copying data_juicer/format/load.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,907 INFO:root:copying data_juicer/format/empty_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,909 INFO:root:copying data_juicer/format/formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,912 INFO:root:copying data_juicer/format/tsv_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,914 INFO:root:copying data_juicer/format/csv_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,916 INFO:root:copying data_juicer/format/mixture_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,918 INFO:root:copying data_juicer/format/parquet_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,920 INFO:root:copying data_juicer/format/json_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,923 INFO:root:copying data_juicer/format/__init__.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,926 INFO:root:copying data_juicer/format/text_formatter.py -> build/lib/data_juicer/format 2024-11-28T17:07:30,931 INFO:root:creating build/lib/data_juicer/analysis 2024-11-28T17:07:30,933 INFO:root:copying data_juicer/analysis/collector.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,937 INFO:root:copying data_juicer/analysis/draw.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,940 INFO:root:copying data_juicer/analysis/diversity_analysis.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,942 INFO:root:copying data_juicer/analysis/overall_analysis.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,944 INFO:root:copying data_juicer/analysis/__init__.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,946 INFO:root:copying data_juicer/analysis/measure.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,948 INFO:root:copying data_juicer/analysis/column_wise_analysis.py -> build/lib/data_juicer/analysis 2024-11-28T17:07:30,951 INFO:root:creating build/lib/data_juicer/utils 2024-11-28T17:07:30,953 INFO:root:copying data_juicer/utils/registry.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,955 INFO:root:copying data_juicer/utils/availability_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,957 INFO:root:copying data_juicer/utils/logger_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,959 INFO:root:copying data_juicer/utils/resource_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,961 INFO:root:copying data_juicer/utils/constant.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,964 INFO:root:copying data_juicer/utils/__init__.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,965 INFO:root:copying data_juicer/utils/ckpt_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,967 INFO:root:copying data_juicer/utils/file_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,970 INFO:root:copying data_juicer/utils/unittest_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,972 INFO:root:copying data_juicer/utils/asset_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,974 INFO:root:copying data_juicer/utils/model_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,977 INFO:root:copying data_juicer/utils/auto_install_mapping.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,979 INFO:root:copying data_juicer/utils/mm_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,982 INFO:root:copying data_juicer/utils/fingerprint_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,984 INFO:root:copying data_juicer/utils/auto_install_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,986 INFO:root:copying data_juicer/utils/compress.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,989 INFO:root:copying data_juicer/utils/process_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,991 INFO:root:copying data_juicer/utils/common_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,992 INFO:root:copying data_juicer/utils/cache_utils.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,994 INFO:root:copying data_juicer/utils/lazy_loader.py -> build/lib/data_juicer/utils 2024-11-28T17:07:30,997 INFO:root:creating build/lib/data_juicer/config 2024-11-28T17:07:30,998 INFO:root:copying data_juicer/config/config.py -> build/lib/data_juicer/config 2024-11-28T17:07:31,000 INFO:root:copying data_juicer/config/__init__.py -> build/lib/data_juicer/config 2024-11-28T17:07:31,003 INFO:root:creating build/lib/data_juicer/ops 2024-11-28T17:07:31,004 INFO:root:copying data_juicer/ops/load.py -> build/lib/data_juicer/ops 2024-11-28T17:07:31,007 INFO:root:copying data_juicer/ops/__init__.py -> build/lib/data_juicer/ops 2024-11-28T17:07:31,008 INFO:root:copying data_juicer/ops/op_fusion.py -> build/lib/data_juicer/ops 2024-11-28T17:07:31,011 INFO:root:copying data_juicer/ops/base_op.py -> build/lib/data_juicer/ops 2024-11-28T17:07:31,014 INFO:root:creating build/lib/data_juicer/core 2024-11-28T17:07:31,015 INFO:root:copying data_juicer/core/executor.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,017 INFO:root:copying data_juicer/core/tracer.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,020 INFO:root:copying data_juicer/core/data.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,022 INFO:root:copying data_juicer/core/exporter.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,025 INFO:root:copying data_juicer/core/__init__.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,027 INFO:root:copying data_juicer/core/ray_executor.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,029 INFO:root:copying data_juicer/core/monitor.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,031 INFO:root:copying data_juicer/core/adapter.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,034 INFO:root:copying data_juicer/core/ray_data.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,036 INFO:root:copying data_juicer/core/analyzer.py -> build/lib/data_juicer/core 2024-11-28T17:07:31,040 INFO:root:creating build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,041 INFO:root:copying data_juicer/ops/deduplicator/document_simhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,044 INFO:root:copying data_juicer/ops/deduplicator/ray_video_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,046 INFO:root:copying data_juicer/ops/deduplicator/ray_image_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,048 INFO:root:copying data_juicer/ops/deduplicator/ray_basic_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,050 INFO:root:copying data_juicer/ops/deduplicator/__init__.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,052 INFO:root:copying data_juicer/ops/deduplicator/document_minhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,054 INFO:root:copying data_juicer/ops/deduplicator/ray_document_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,056 INFO:root:copying data_juicer/ops/deduplicator/video_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,058 INFO:root:copying data_juicer/ops/deduplicator/document_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,060 INFO:root:copying data_juicer/ops/deduplicator/image_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2024-11-28T17:07:31,063 INFO:root:creating build/lib/data_juicer/ops/common 2024-11-28T17:07:31,064 INFO:root:copying data_juicer/ops/common/helper_func.py -> build/lib/data_juicer/ops/common 2024-11-28T17:07:31,066 INFO:root:copying data_juicer/ops/common/__init__.py -> build/lib/data_juicer/ops/common 2024-11-28T17:07:31,068 INFO:root:copying data_juicer/ops/common/special_characters.py -> build/lib/data_juicer/ops/common 2024-11-28T17:07:31,072 INFO:root:creating build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,073 INFO:root:copying data_juicer/ops/mapper/remove_repeat_sentences_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,075 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,077 INFO:root:copying data_juicer/ops/mapper/clean_copyright_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,079 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_video_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,082 INFO:root:copying data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,083 INFO:root:copying data_juicer/ops/mapper/chinese_convert_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,085 INFO:root:copying data_juicer/ops/mapper/remove_bibliography_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,087 INFO:root:copying data_juicer/ops/mapper/punctuation_normalization_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,089 INFO:root:copying data_juicer/ops/mapper/image_diffusion_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,091 INFO:root:copying data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,094 INFO:root:copying data_juicer/ops/mapper/remove_comments_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,095 INFO:root:copying data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,098 INFO:root:copying data_juicer/ops/mapper/remove_header_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,099 INFO:root:copying data_juicer/ops/mapper/clean_links_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,101 INFO:root:copying data_juicer/ops/mapper/optimize_query_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,103 INFO:root:copying data_juicer/ops/mapper/extract_entity_relation_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,106 INFO:root:copying data_juicer/ops/mapper/clean_html_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,108 INFO:root:copying data_juicer/ops/mapper/remove_table_text_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,110 INFO:root:copying data_juicer/ops/mapper/video_resize_resolution_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,112 INFO:root:copying data_juicer/ops/mapper/clean_ip_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,114 INFO:root:copying data_juicer/ops/mapper/optimize_response_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,116 INFO:root:copying data_juicer/ops/mapper/remove_non_chinese_character_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,118 INFO:root:copying data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,120 INFO:root:copying data_juicer/ops/mapper/whitespace_normalization_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,122 INFO:root:copying data_juicer/ops/mapper/clean_email_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,124 INFO:root:copying data_juicer/ops/mapper/image_face_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,126 INFO:root:copying data_juicer/ops/mapper/video_split_by_key_frame_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,129 INFO:root:copying data_juicer/ops/mapper/video_split_by_scene_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,131 INFO:root:copying data_juicer/ops/mapper/image_captioning_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,133 INFO:root:copying data_juicer/ops/mapper/extract_entity_attribute_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,135 INFO:root:copying data_juicer/ops/mapper/replace_content_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,137 INFO:root:copying data_juicer/ops/mapper/image_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,139 INFO:root:copying data_juicer/ops/mapper/__init__.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,141 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,144 INFO:root:copying data_juicer/ops/mapper/extract_event_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,146 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_audio_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,150 INFO:root:copying data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,152 INFO:root:copying data_juicer/ops/mapper/extract_nickname_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,154 INFO:root:copying data_juicer/ops/mapper/video_split_by_duration_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,156 INFO:root:copying data_juicer/ops/mapper/sentence_split_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,158 INFO:root:copying data_juicer/ops/mapper/calibrate_response_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,160 INFO:root:copying data_juicer/ops/mapper/calibrate_qa_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,162 INFO:root:copying data_juicer/ops/mapper/generate_qa_from_text_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,165 INFO:root:copying data_juicer/ops/mapper/nlpcda_zh_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,167 INFO:root:copying data_juicer/ops/mapper/fix_unicode_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,169 INFO:root:copying data_juicer/ops/mapper/extract_keyword_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,172 INFO:root:copying data_juicer/ops/mapper/generate_qa_from_examples_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,174 INFO:root:copying data_juicer/ops/mapper/remove_specific_chars_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,176 INFO:root:copying data_juicer/ops/mapper/calibrate_query_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,178 INFO:root:copying data_juicer/ops/mapper/optimize_qa_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,181 INFO:root:copying data_juicer/ops/mapper/video_remove_watermark_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,183 INFO:root:copying data_juicer/ops/mapper/video_face_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,186 INFO:root:copying data_juicer/ops/mapper/remove_long_words_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,188 INFO:root:copying data_juicer/ops/mapper/image_tagging_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,196 INFO:root:copying data_juicer/ops/mapper/nlpaug_en_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,203 INFO:root:copying data_juicer/ops/mapper/video_tagging_from_audio_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,206 INFO:root:copying data_juicer/ops/mapper/expand_macro_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,208 INFO:root:copying data_juicer/ops/mapper/text_chunk_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,211 INFO:root:copying data_juicer/ops/mapper/video_tagging_from_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2024-11-28T17:07:31,215 INFO:root:creating build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,216 INFO:root:copying data_juicer/ops/filter/image_nsfw_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,218 INFO:root:copying data_juicer/ops/filter/perplexity_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,220 INFO:root:copying data_juicer/ops/filter/image_shape_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,222 INFO:root:copying data_juicer/ops/filter/image_size_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,224 INFO:root:copying data_juicer/ops/filter/audio_duration_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,226 INFO:root:copying data_juicer/ops/filter/phrase_grounding_recall_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,228 INFO:root:copying data_juicer/ops/filter/image_face_count_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,230 INFO:root:copying data_juicer/ops/filter/stopwords_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,232 INFO:root:copying data_juicer/ops/filter/specified_field_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,236 INFO:root:copying data_juicer/ops/filter/language_id_score_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,245 INFO:root:copying data_juicer/ops/filter/video_motion_score_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,254 INFO:root:copying data_juicer/ops/filter/token_num_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,263 INFO:root:copying data_juicer/ops/filter/character_repetition_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,271 INFO:root:copying data_juicer/ops/filter/average_line_length_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,274 INFO:root:copying data_juicer/ops/filter/text_action_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,276 INFO:root:copying data_juicer/ops/filter/image_pair_similarity_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,278 INFO:root:copying data_juicer/ops/filter/image_aspect_ratio_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,280 INFO:root:copying data_juicer/ops/filter/image_aesthetics_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,282 INFO:root:copying data_juicer/ops/filter/suffix_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,284 INFO:root:copying data_juicer/ops/filter/__init__.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,286 INFO:root:copying data_juicer/ops/filter/words_num_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,288 INFO:root:copying data_juicer/ops/filter/special_characters_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,290 INFO:root:copying data_juicer/ops/filter/text_entity_dependency_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,292 INFO:root:copying data_juicer/ops/filter/video_ocr_area_ratio_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,295 INFO:root:copying data_juicer/ops/filter/audio_nmf_snr_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,297 INFO:root:copying data_juicer/ops/filter/specified_numeric_field_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,299 INFO:root:copying data_juicer/ops/filter/video_duration_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,301 INFO:root:copying data_juicer/ops/filter/video_tagging_from_frames_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,304 INFO:root:copying data_juicer/ops/filter/image_watermark_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,306 INFO:root:copying data_juicer/ops/filter/image_text_similarity_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,308 INFO:root:copying data_juicer/ops/filter/video_aspect_ratio_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,310 INFO:root:copying data_juicer/ops/filter/video_aesthetics_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,312 INFO:root:copying data_juicer/ops/filter/word_repetition_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,314 INFO:root:copying data_juicer/ops/filter/audio_size_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,316 INFO:root:copying data_juicer/ops/filter/video_motion_score_raft_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,318 INFO:root:copying data_juicer/ops/filter/image_text_matching_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,320 INFO:root:copying data_juicer/ops/filter/maximum_line_length_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,322 INFO:root:copying data_juicer/ops/filter/alphanumeric_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,324 INFO:root:copying data_juicer/ops/filter/image_face_ratio_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,326 INFO:root:copying data_juicer/ops/filter/text_length_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,328 INFO:root:copying data_juicer/ops/filter/video_resolution_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,330 INFO:root:copying data_juicer/ops/filter/flagged_words_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,332 INFO:root:copying data_juicer/ops/filter/video_watermark_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,335 INFO:root:copying data_juicer/ops/filter/video_frames_text_similarity_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,337 INFO:root:copying data_juicer/ops/filter/video_nsfw_filter.py -> build/lib/data_juicer/ops/filter 2024-11-28T17:07:31,340 INFO:root:creating build/lib/data_juicer/ops/selector 2024-11-28T17:07:31,341 INFO:root:copying data_juicer/ops/selector/random_selector.py -> build/lib/data_juicer/ops/selector 2024-11-28T17:07:31,343 INFO:root:copying data_juicer/ops/selector/__init__.py -> build/lib/data_juicer/ops/selector 2024-11-28T17:07:31,345 INFO:root:copying data_juicer/ops/selector/frequency_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2024-11-28T17:07:31,347 INFO:root:copying data_juicer/ops/selector/range_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2024-11-28T17:07:31,349 INFO:root:copying data_juicer/ops/selector/topk_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2024-11-28T17:07:31,352 INFO:root:creating build/lib/data_juicer/tools 2024-11-28T17:07:31,353 INFO:root:copying tools/sandbox_starter.py -> build/lib/data_juicer/tools 2024-11-28T17:07:31,355 INFO:root:copying tools/__init__.py -> build/lib/data_juicer/tools 2024-11-28T17:07:31,357 INFO:root:copying tools/process_data.py -> build/lib/data_juicer/tools 2024-11-28T17:07:31,359 INFO:root:copying tools/analyze_data.py -> build/lib/data_juicer/tools 2024-11-28T17:07:31,408 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-11-28T17:07:31,409 !! 2024-11-28T17:07:31,410 ******************************************************************************** 2024-11-28T17:07:31,410 Please avoid running ``setup.py`` directly. 2024-11-28T17:07:31,411 Instead, use pypa/build, pypa/installer or other 2024-11-28T17:07:31,411 standards-based tools. 2024-11-28T17:07:31,412 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-11-28T17:07:31,413 ******************************************************************************** 2024-11-28T17:07:31,414 !! 2024-11-28T17:07:31,415 self.initialize_options() 2024-11-28T17:07:31,436 INFO:root:installing to build/bdist.linux-armv7l/wheel 2024-11-28T17:07:31,436 INFO:root:running install 2024-11-28T17:07:31,461 INFO:root:running install_lib 2024-11-28T17:07:31,488 INFO:root:creating build/bdist.linux-armv7l/wheel 2024-11-28T17:07:31,491 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer 2024-11-28T17:07:31,492 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/format 2024-11-28T17:07:31,494 INFO:root:copying build/lib/data_juicer/format/load.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,495 INFO:root:copying build/lib/data_juicer/format/empty_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,497 INFO:root:copying build/lib/data_juicer/format/formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,500 INFO:root:copying build/lib/data_juicer/format/tsv_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,501 INFO:root:copying build/lib/data_juicer/format/csv_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,503 INFO:root:copying build/lib/data_juicer/format/mixture_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,505 INFO:root:copying build/lib/data_juicer/format/parquet_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,507 INFO:root:copying build/lib/data_juicer/format/json_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,508 INFO:root:copying build/lib/data_juicer/format/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,510 INFO:root:copying build/lib/data_juicer/format/text_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2024-11-28T17:07:31,513 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/analysis 2024-11-28T17:07:31,514 INFO:root:copying build/lib/data_juicer/analysis/collector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,516 INFO:root:copying build/lib/data_juicer/analysis/draw.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,518 INFO:root:copying build/lib/data_juicer/analysis/diversity_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,520 INFO:root:copying build/lib/data_juicer/analysis/overall_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,522 INFO:root:copying build/lib/data_juicer/analysis/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,524 INFO:root:copying build/lib/data_juicer/analysis/measure.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,526 INFO:root:copying build/lib/data_juicer/analysis/column_wise_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2024-11-28T17:07:31,529 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/utils 2024-11-28T17:07:31,530 INFO:root:copying build/lib/data_juicer/utils/registry.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,533 INFO:root:copying build/lib/data_juicer/utils/availability_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,534 INFO:root:copying build/lib/data_juicer/utils/logger_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,537 INFO:root:copying build/lib/data_juicer/utils/resource_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,539 INFO:root:copying build/lib/data_juicer/utils/constant.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,541 INFO:root:copying build/lib/data_juicer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,542 INFO:root:copying build/lib/data_juicer/utils/ckpt_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,545 INFO:root:copying build/lib/data_juicer/utils/file_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,547 INFO:root:copying build/lib/data_juicer/utils/unittest_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,549 INFO:root:copying build/lib/data_juicer/utils/asset_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,551 INFO:root:copying build/lib/data_juicer/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,554 INFO:root:copying build/lib/data_juicer/utils/auto_install_mapping.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,556 INFO:root:copying build/lib/data_juicer/utils/mm_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,559 INFO:root:copying build/lib/data_juicer/utils/fingerprint_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,561 INFO:root:copying build/lib/data_juicer/utils/auto_install_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,563 INFO:root:copying build/lib/data_juicer/utils/compress.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,565 INFO:root:copying build/lib/data_juicer/utils/process_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,567 INFO:root:copying build/lib/data_juicer/utils/common_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,569 INFO:root:copying build/lib/data_juicer/utils/cache_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,571 INFO:root:copying build/lib/data_juicer/utils/lazy_loader.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2024-11-28T17:07:31,573 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/config 2024-11-28T17:07:31,574 INFO:root:copying build/lib/data_juicer/config/config.py -> build/bdist.linux-armv7l/wheel/./data_juicer/config 2024-11-28T17:07:31,577 INFO:root:copying build/lib/data_juicer/config/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/config 2024-11-28T17:07:31,580 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops 2024-11-28T17:07:31,581 INFO:root:copying build/lib/data_juicer/ops/load.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2024-11-28T17:07:31,584 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/deduplicator 2024-11-28T17:07:31,585 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_simhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,587 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_video_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,589 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_image_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,591 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_basic_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,593 INFO:root:copying build/lib/data_juicer/ops/deduplicator/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,594 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_minhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,597 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_document_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,599 INFO:root:copying build/lib/data_juicer/ops/deduplicator/video_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,601 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,603 INFO:root:copying build/lib/data_juicer/ops/deduplicator/image_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2024-11-28T17:07:31,606 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/common 2024-11-28T17:07:31,607 INFO:root:copying build/lib/data_juicer/ops/common/helper_func.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2024-11-28T17:07:31,610 INFO:root:copying build/lib/data_juicer/ops/common/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2024-11-28T17:07:31,612 INFO:root:copying build/lib/data_juicer/ops/common/special_characters.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2024-11-28T17:07:31,615 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/mapper 2024-11-28T17:07:31,616 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_repeat_sentences_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,618 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,620 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_copyright_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,622 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_video_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,624 INFO:root:copying build/lib/data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,626 INFO:root:copying build/lib/data_juicer/ops/mapper/chinese_convert_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,628 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_bibliography_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,630 INFO:root:copying build/lib/data_juicer/ops/mapper/punctuation_normalization_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,632 INFO:root:copying build/lib/data_juicer/ops/mapper/image_diffusion_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,634 INFO:root:copying build/lib/data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,636 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_comments_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,638 INFO:root:copying build/lib/data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,641 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_header_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,643 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_links_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,645 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_query_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,647 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_entity_relation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,650 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_html_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,652 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_table_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,654 INFO:root:copying build/lib/data_juicer/ops/mapper/video_resize_resolution_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,656 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_ip_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,658 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_response_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,660 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_non_chinese_character_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,662 INFO:root:copying build/lib/data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,665 INFO:root:copying build/lib/data_juicer/ops/mapper/whitespace_normalization_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,666 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_email_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,668 INFO:root:copying build/lib/data_juicer/ops/mapper/image_face_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,670 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_key_frame_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,672 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_scene_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,675 INFO:root:copying build/lib/data_juicer/ops/mapper/image_captioning_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,677 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_entity_attribute_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,679 INFO:root:copying build/lib/data_juicer/ops/mapper/replace_content_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,681 INFO:root:copying build/lib/data_juicer/ops/mapper/image_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,684 INFO:root:copying build/lib/data_juicer/ops/mapper/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,687 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,690 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_event_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,694 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_audio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,697 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,699 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_nickname_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,702 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_duration_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,705 INFO:root:copying build/lib/data_juicer/ops/mapper/sentence_split_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,707 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_response_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,709 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_qa_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,712 INFO:root:copying build/lib/data_juicer/ops/mapper/generate_qa_from_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,715 INFO:root:copying build/lib/data_juicer/ops/mapper/nlpcda_zh_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,717 INFO:root:copying build/lib/data_juicer/ops/mapper/fix_unicode_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,719 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_keyword_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,722 INFO:root:copying build/lib/data_juicer/ops/mapper/generate_qa_from_examples_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,725 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_specific_chars_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,727 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_query_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,730 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_qa_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,732 INFO:root:copying build/lib/data_juicer/ops/mapper/video_remove_watermark_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,735 INFO:root:copying build/lib/data_juicer/ops/mapper/video_face_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,738 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_long_words_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,740 INFO:root:copying build/lib/data_juicer/ops/mapper/image_tagging_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,742 INFO:root:copying build/lib/data_juicer/ops/mapper/nlpaug_en_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,745 INFO:root:copying build/lib/data_juicer/ops/mapper/video_tagging_from_audio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,747 INFO:root:copying build/lib/data_juicer/ops/mapper/expand_macro_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,749 INFO:root:copying build/lib/data_juicer/ops/mapper/text_chunk_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,752 INFO:root:copying build/lib/data_juicer/ops/mapper/video_tagging_from_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2024-11-28T17:07:31,756 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/filter 2024-11-28T17:07:31,758 INFO:root:copying build/lib/data_juicer/ops/filter/image_nsfw_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,760 INFO:root:copying build/lib/data_juicer/ops/filter/perplexity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,762 INFO:root:copying build/lib/data_juicer/ops/filter/image_shape_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,765 INFO:root:copying build/lib/data_juicer/ops/filter/image_size_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,767 INFO:root:copying build/lib/data_juicer/ops/filter/audio_duration_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,769 INFO:root:copying build/lib/data_juicer/ops/filter/phrase_grounding_recall_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,773 INFO:root:copying build/lib/data_juicer/ops/filter/image_face_count_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,779 INFO:root:copying build/lib/data_juicer/ops/filter/stopwords_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,782 INFO:root:copying build/lib/data_juicer/ops/filter/specified_field_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,785 INFO:root:copying build/lib/data_juicer/ops/filter/language_id_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,787 INFO:root:copying build/lib/data_juicer/ops/filter/video_motion_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,791 INFO:root:copying build/lib/data_juicer/ops/filter/token_num_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,793 INFO:root:copying build/lib/data_juicer/ops/filter/character_repetition_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,796 INFO:root:copying build/lib/data_juicer/ops/filter/average_line_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,798 INFO:root:copying build/lib/data_juicer/ops/filter/text_action_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,800 INFO:root:copying build/lib/data_juicer/ops/filter/image_pair_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,802 INFO:root:copying build/lib/data_juicer/ops/filter/image_aspect_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,805 INFO:root:copying build/lib/data_juicer/ops/filter/image_aesthetics_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,807 INFO:root:copying build/lib/data_juicer/ops/filter/suffix_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,809 INFO:root:copying build/lib/data_juicer/ops/filter/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,811 INFO:root:copying build/lib/data_juicer/ops/filter/words_num_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,814 INFO:root:copying build/lib/data_juicer/ops/filter/special_characters_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,816 INFO:root:copying build/lib/data_juicer/ops/filter/text_entity_dependency_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,818 INFO:root:copying build/lib/data_juicer/ops/filter/video_ocr_area_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,821 INFO:root:copying build/lib/data_juicer/ops/filter/audio_nmf_snr_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,824 INFO:root:copying build/lib/data_juicer/ops/filter/specified_numeric_field_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,826 INFO:root:copying build/lib/data_juicer/ops/filter/video_duration_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,828 INFO:root:copying build/lib/data_juicer/ops/filter/video_tagging_from_frames_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,831 INFO:root:copying build/lib/data_juicer/ops/filter/image_watermark_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,833 INFO:root:copying build/lib/data_juicer/ops/filter/image_text_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,835 INFO:root:copying build/lib/data_juicer/ops/filter/video_aspect_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,838 INFO:root:copying build/lib/data_juicer/ops/filter/video_aesthetics_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,841 INFO:root:copying build/lib/data_juicer/ops/filter/word_repetition_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,843 INFO:root:copying build/lib/data_juicer/ops/filter/audio_size_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,845 INFO:root:copying build/lib/data_juicer/ops/filter/video_motion_score_raft_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,848 INFO:root:copying build/lib/data_juicer/ops/filter/image_text_matching_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,850 INFO:root:copying build/lib/data_juicer/ops/filter/maximum_line_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,852 INFO:root:copying build/lib/data_juicer/ops/filter/alphanumeric_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,855 INFO:root:copying build/lib/data_juicer/ops/filter/image_face_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,857 INFO:root:copying build/lib/data_juicer/ops/filter/text_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,859 INFO:root:copying build/lib/data_juicer/ops/filter/video_resolution_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,861 INFO:root:copying build/lib/data_juicer/ops/filter/flagged_words_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,864 INFO:root:copying build/lib/data_juicer/ops/filter/video_watermark_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,866 INFO:root:copying build/lib/data_juicer/ops/filter/video_frames_text_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,869 INFO:root:copying build/lib/data_juicer/ops/filter/video_nsfw_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2024-11-28T17:07:31,872 INFO:root:copying build/lib/data_juicer/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2024-11-28T17:07:31,874 INFO:root:copying build/lib/data_juicer/ops/op_fusion.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2024-11-28T17:07:31,877 INFO:root:copying build/lib/data_juicer/ops/base_op.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2024-11-28T17:07:31,881 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/selector 2024-11-28T17:07:31,882 INFO:root:copying build/lib/data_juicer/ops/selector/random_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2024-11-28T17:07:31,884 INFO:root:copying build/lib/data_juicer/ops/selector/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2024-11-28T17:07:31,886 INFO:root:copying build/lib/data_juicer/ops/selector/frequency_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2024-11-28T17:07:31,888 INFO:root:copying build/lib/data_juicer/ops/selector/range_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2024-11-28T17:07:31,890 INFO:root:copying build/lib/data_juicer/ops/selector/topk_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2024-11-28T17:07:31,892 INFO:root:copying build/lib/data_juicer/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer 2024-11-28T17:07:31,895 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/core 2024-11-28T17:07:31,896 INFO:root:copying build/lib/data_juicer/core/executor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,898 INFO:root:copying build/lib/data_juicer/core/tracer.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,900 INFO:root:copying build/lib/data_juicer/core/data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,903 INFO:root:copying build/lib/data_juicer/core/exporter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,905 INFO:root:copying build/lib/data_juicer/core/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,907 INFO:root:copying build/lib/data_juicer/core/ray_executor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,909 INFO:root:copying build/lib/data_juicer/core/monitor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,911 INFO:root:copying build/lib/data_juicer/core/adapter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,914 INFO:root:copying build/lib/data_juicer/core/ray_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,916 INFO:root:copying build/lib/data_juicer/core/analyzer.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2024-11-28T17:07:31,919 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/tools 2024-11-28T17:07:31,920 INFO:root:copying build/lib/data_juicer/tools/sandbox_starter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2024-11-28T17:07:31,922 INFO:root:copying build/lib/data_juicer/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2024-11-28T17:07:31,923 INFO:root:copying build/lib/data_juicer/tools/process_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2024-11-28T17:07:31,925 INFO:root:copying build/lib/data_juicer/tools/analyze_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2024-11-28T17:07:31,927 INFO:root:running install_egg_info 2024-11-28T17:07:31,959 INFO:root:running egg_info 2024-11-28T17:07:31,986 INFO:root:writing py_data_juicer.egg-info/PKG-INFO 2024-11-28T17:07:31,990 INFO:root:writing dependency_links to py_data_juicer.egg-info/dependency_links.txt 2024-11-28T17:07:31,991 INFO:root:writing entry points to py_data_juicer.egg-info/entry_points.txt 2024-11-28T17:07:31,992 INFO:root:writing requirements to py_data_juicer.egg-info/requires.txt 2024-11-28T17:07:31,994 INFO:root:writing top-level names to py_data_juicer.egg-info/top_level.txt 2024-11-28T17:07:32,038 INFO:root:reading manifest file 'py_data_juicer.egg-info/SOURCES.txt' 2024-11-28T17:07:32,049 INFO:root:adding license file 'LICENSE' 2024-11-28T17:07:32,060 INFO:root:writing manifest file 'py_data_juicer.egg-info/SOURCES.txt' 2024-11-28T17:07:32,062 INFO:root:Copying py_data_juicer.egg-info to build/bdist.linux-armv7l/wheel/./py_data_juicer-1.0.0-py3.11.egg-info 2024-11-28T17:07:32,074 INFO:root:running install_scripts 2024-11-28T17:07:32,093 INFO:root:creating build/bdist.linux-armv7l/wheel/py_data_juicer-1.0.0.dist-info/WHEEL 2024-11-28T17:07:32,095 INFO:wheel:creating '/tmp/pip-wheel-0vwx61so/py_data_juicer-1.0.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-11-28T17:07:32,098 INFO:wheel:adding 'data_juicer/__init__.py' 2024-11-28T17:07:32,100 INFO:wheel:adding 'data_juicer/analysis/__init__.py' 2024-11-28T17:07:32,101 INFO:wheel:adding 'data_juicer/analysis/collector.py' 2024-11-28T17:07:32,103 INFO:wheel:adding 'data_juicer/analysis/column_wise_analysis.py' 2024-11-28T17:07:32,105 INFO:wheel:adding 'data_juicer/analysis/diversity_analysis.py' 2024-11-28T17:07:32,106 INFO:wheel:adding 'data_juicer/analysis/draw.py' 2024-11-28T17:07:32,107 INFO:wheel:adding 'data_juicer/analysis/measure.py' 2024-11-28T17:07:32,109 INFO:wheel:adding 'data_juicer/analysis/overall_analysis.py' 2024-11-28T17:07:32,111 INFO:wheel:adding 'data_juicer/config/__init__.py' 2024-11-28T17:07:32,115 INFO:wheel:adding 'data_juicer/config/config.py' 2024-11-28T17:07:32,118 INFO:wheel:adding 'data_juicer/core/__init__.py' 2024-11-28T17:07:32,119 INFO:wheel:adding 'data_juicer/core/adapter.py' 2024-11-28T17:07:32,121 INFO:wheel:adding 'data_juicer/core/analyzer.py' 2024-11-28T17:07:32,123 INFO:wheel:adding 'data_juicer/core/data.py' 2024-11-28T17:07:32,125 INFO:wheel:adding 'data_juicer/core/executor.py' 2024-11-28T17:07:32,127 INFO:wheel:adding 'data_juicer/core/exporter.py' 2024-11-28T17:07:32,129 INFO:wheel:adding 'data_juicer/core/monitor.py' 2024-11-28T17:07:32,130 INFO:wheel:adding 'data_juicer/core/ray_data.py' 2024-11-28T17:07:32,132 INFO:wheel:adding 'data_juicer/core/ray_executor.py' 2024-11-28T17:07:32,133 INFO:wheel:adding 'data_juicer/core/tracer.py' 2024-11-28T17:07:32,135 INFO:wheel:adding 'data_juicer/format/__init__.py' 2024-11-28T17:07:32,136 INFO:wheel:adding 'data_juicer/format/csv_formatter.py' 2024-11-28T17:07:32,138 INFO:wheel:adding 'data_juicer/format/empty_formatter.py' 2024-11-28T17:07:32,140 INFO:wheel:adding 'data_juicer/format/formatter.py' 2024-11-28T17:07:32,142 INFO:wheel:adding 'data_juicer/format/json_formatter.py' 2024-11-28T17:07:32,143 INFO:wheel:adding 'data_juicer/format/load.py' 2024-11-28T17:07:32,144 INFO:wheel:adding 'data_juicer/format/mixture_formatter.py' 2024-11-28T17:07:32,145 INFO:wheel:adding 'data_juicer/format/parquet_formatter.py' 2024-11-28T17:07:32,147 INFO:wheel:adding 'data_juicer/format/text_formatter.py' 2024-11-28T17:07:32,148 INFO:wheel:adding 'data_juicer/format/tsv_formatter.py' 2024-11-28T17:07:32,150 INFO:wheel:adding 'data_juicer/ops/__init__.py' 2024-11-28T17:07:32,152 INFO:wheel:adding 'data_juicer/ops/base_op.py' 2024-11-28T17:07:32,153 INFO:wheel:adding 'data_juicer/ops/load.py' 2024-11-28T17:07:32,155 INFO:wheel:adding 'data_juicer/ops/op_fusion.py' 2024-11-28T17:07:32,156 INFO:wheel:adding 'data_juicer/ops/common/__init__.py' 2024-11-28T17:07:32,158 INFO:wheel:adding 'data_juicer/ops/common/helper_func.py' 2024-11-28T17:07:32,159 INFO:wheel:adding 'data_juicer/ops/common/special_characters.py' 2024-11-28T17:07:32,161 INFO:wheel:adding 'data_juicer/ops/deduplicator/__init__.py' 2024-11-28T17:07:32,162 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_deduplicator.py' 2024-11-28T17:07:32,164 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_minhash_deduplicator.py' 2024-11-28T17:07:32,166 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_simhash_deduplicator.py' 2024-11-28T17:07:32,168 INFO:wheel:adding 'data_juicer/ops/deduplicator/image_deduplicator.py' 2024-11-28T17:07:32,169 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_basic_deduplicator.py' 2024-11-28T17:07:32,170 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_document_deduplicator.py' 2024-11-28T17:07:32,172 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_image_deduplicator.py' 2024-11-28T17:07:32,173 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_video_deduplicator.py' 2024-11-28T17:07:32,174 INFO:wheel:adding 'data_juicer/ops/deduplicator/video_deduplicator.py' 2024-11-28T17:07:32,177 INFO:wheel:adding 'data_juicer/ops/filter/__init__.py' 2024-11-28T17:07:32,178 INFO:wheel:adding 'data_juicer/ops/filter/alphanumeric_filter.py' 2024-11-28T17:07:32,180 INFO:wheel:adding 'data_juicer/ops/filter/audio_duration_filter.py' 2024-11-28T17:07:32,181 INFO:wheel:adding 'data_juicer/ops/filter/audio_nmf_snr_filter.py' 2024-11-28T17:07:32,183 INFO:wheel:adding 'data_juicer/ops/filter/audio_size_filter.py' 2024-11-28T17:07:32,184 INFO:wheel:adding 'data_juicer/ops/filter/average_line_length_filter.py' 2024-11-28T17:07:32,185 INFO:wheel:adding 'data_juicer/ops/filter/character_repetition_filter.py' 2024-11-28T17:07:32,187 INFO:wheel:adding 'data_juicer/ops/filter/flagged_words_filter.py' 2024-11-28T17:07:32,188 INFO:wheel:adding 'data_juicer/ops/filter/image_aesthetics_filter.py' 2024-11-28T17:07:32,190 INFO:wheel:adding 'data_juicer/ops/filter/image_aspect_ratio_filter.py' 2024-11-28T17:07:32,191 INFO:wheel:adding 'data_juicer/ops/filter/image_face_count_filter.py' 2024-11-28T17:07:32,193 INFO:wheel:adding 'data_juicer/ops/filter/image_face_ratio_filter.py' 2024-11-28T17:07:32,195 INFO:wheel:adding 'data_juicer/ops/filter/image_nsfw_filter.py' 2024-11-28T17:07:32,196 INFO:wheel:adding 'data_juicer/ops/filter/image_pair_similarity_filter.py' 2024-11-28T17:07:32,198 INFO:wheel:adding 'data_juicer/ops/filter/image_shape_filter.py' 2024-11-28T17:07:32,199 INFO:wheel:adding 'data_juicer/ops/filter/image_size_filter.py' 2024-11-28T17:07:32,201 INFO:wheel:adding 'data_juicer/ops/filter/image_text_matching_filter.py' 2024-11-28T17:07:32,202 INFO:wheel:adding 'data_juicer/ops/filter/image_text_similarity_filter.py' 2024-11-28T17:07:32,204 INFO:wheel:adding 'data_juicer/ops/filter/image_watermark_filter.py' 2024-11-28T17:07:32,205 INFO:wheel:adding 'data_juicer/ops/filter/language_id_score_filter.py' 2024-11-28T17:07:32,207 INFO:wheel:adding 'data_juicer/ops/filter/maximum_line_length_filter.py' 2024-11-28T17:07:32,208 INFO:wheel:adding 'data_juicer/ops/filter/perplexity_filter.py' 2024-11-28T17:07:32,210 INFO:wheel:adding 'data_juicer/ops/filter/phrase_grounding_recall_filter.py' 2024-11-28T17:07:32,211 INFO:wheel:adding 'data_juicer/ops/filter/special_characters_filter.py' 2024-11-28T17:07:32,212 INFO:wheel:adding 'data_juicer/ops/filter/specified_field_filter.py' 2024-11-28T17:07:32,214 INFO:wheel:adding 'data_juicer/ops/filter/specified_numeric_field_filter.py' 2024-11-28T17:07:32,215 INFO:wheel:adding 'data_juicer/ops/filter/stopwords_filter.py' 2024-11-28T17:07:32,216 INFO:wheel:adding 'data_juicer/ops/filter/suffix_filter.py' 2024-11-28T17:07:32,217 INFO:wheel:adding 'data_juicer/ops/filter/text_action_filter.py' 2024-11-28T17:07:32,219 INFO:wheel:adding 'data_juicer/ops/filter/text_entity_dependency_filter.py' 2024-11-28T17:07:32,220 INFO:wheel:adding 'data_juicer/ops/filter/text_length_filter.py' 2024-11-28T17:07:32,221 INFO:wheel:adding 'data_juicer/ops/filter/token_num_filter.py' 2024-11-28T17:07:32,223 INFO:wheel:adding 'data_juicer/ops/filter/video_aesthetics_filter.py' 2024-11-28T17:07:32,224 INFO:wheel:adding 'data_juicer/ops/filter/video_aspect_ratio_filter.py' 2024-11-28T17:07:32,226 INFO:wheel:adding 'data_juicer/ops/filter/video_duration_filter.py' 2024-11-28T17:07:32,227 INFO:wheel:adding 'data_juicer/ops/filter/video_frames_text_similarity_filter.py' 2024-11-28T17:07:32,229 INFO:wheel:adding 'data_juicer/ops/filter/video_motion_score_filter.py' 2024-11-28T17:07:32,231 INFO:wheel:adding 'data_juicer/ops/filter/video_motion_score_raft_filter.py' 2024-11-28T17:07:32,232 INFO:wheel:adding 'data_juicer/ops/filter/video_nsfw_filter.py' 2024-11-28T17:07:32,234 INFO:wheel:adding 'data_juicer/ops/filter/video_ocr_area_ratio_filter.py' 2024-11-28T17:07:32,235 INFO:wheel:adding 'data_juicer/ops/filter/video_resolution_filter.py' 2024-11-28T17:07:32,237 INFO:wheel:adding 'data_juicer/ops/filter/video_tagging_from_frames_filter.py' 2024-11-28T17:07:32,238 INFO:wheel:adding 'data_juicer/ops/filter/video_watermark_filter.py' 2024-11-28T17:07:32,240 INFO:wheel:adding 'data_juicer/ops/filter/word_repetition_filter.py' 2024-11-28T17:07:32,241 INFO:wheel:adding 'data_juicer/ops/filter/words_num_filter.py' 2024-11-28T17:07:32,244 INFO:wheel:adding 'data_juicer/ops/mapper/__init__.py' 2024-11-28T17:07:32,245 INFO:wheel:adding 'data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py' 2024-11-28T17:07:32,247 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_qa_mapper.py' 2024-11-28T17:07:32,248 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_query_mapper.py' 2024-11-28T17:07:32,249 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_response_mapper.py' 2024-11-28T17:07:32,251 INFO:wheel:adding 'data_juicer/ops/mapper/chinese_convert_mapper.py' 2024-11-28T17:07:32,252 INFO:wheel:adding 'data_juicer/ops/mapper/clean_copyright_mapper.py' 2024-11-28T17:07:32,253 INFO:wheel:adding 'data_juicer/ops/mapper/clean_email_mapper.py' 2024-11-28T17:07:32,254 INFO:wheel:adding 'data_juicer/ops/mapper/clean_html_mapper.py' 2024-11-28T17:07:32,256 INFO:wheel:adding 'data_juicer/ops/mapper/clean_ip_mapper.py' 2024-11-28T17:07:32,257 INFO:wheel:adding 'data_juicer/ops/mapper/clean_links_mapper.py' 2024-11-28T17:07:32,258 INFO:wheel:adding 'data_juicer/ops/mapper/expand_macro_mapper.py' 2024-11-28T17:07:32,260 INFO:wheel:adding 'data_juicer/ops/mapper/extract_entity_attribute_mapper.py' 2024-11-28T17:07:32,263 INFO:wheel:adding 'data_juicer/ops/mapper/extract_entity_relation_mapper.py' 2024-11-28T17:07:32,264 INFO:wheel:adding 'data_juicer/ops/mapper/extract_event_mapper.py' 2024-11-28T17:07:32,266 INFO:wheel:adding 'data_juicer/ops/mapper/extract_keyword_mapper.py' 2024-11-28T17:07:32,268 INFO:wheel:adding 'data_juicer/ops/mapper/extract_nickname_mapper.py' 2024-11-28T17:07:32,269 INFO:wheel:adding 'data_juicer/ops/mapper/fix_unicode_mapper.py' 2024-11-28T17:07:32,271 INFO:wheel:adding 'data_juicer/ops/mapper/generate_qa_from_examples_mapper.py' 2024-11-28T17:07:32,273 INFO:wheel:adding 'data_juicer/ops/mapper/generate_qa_from_text_mapper.py' 2024-11-28T17:07:32,274 INFO:wheel:adding 'data_juicer/ops/mapper/image_blur_mapper.py' 2024-11-28T17:07:32,276 INFO:wheel:adding 'data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py' 2024-11-28T17:07:32,278 INFO:wheel:adding 'data_juicer/ops/mapper/image_captioning_mapper.py' 2024-11-28T17:07:32,280 INFO:wheel:adding 'data_juicer/ops/mapper/image_diffusion_mapper.py' 2024-11-28T17:07:32,281 INFO:wheel:adding 'data_juicer/ops/mapper/image_face_blur_mapper.py' 2024-11-28T17:07:32,282 INFO:wheel:adding 'data_juicer/ops/mapper/image_tagging_mapper.py' 2024-11-28T17:07:32,284 INFO:wheel:adding 'data_juicer/ops/mapper/nlpaug_en_mapper.py' 2024-11-28T17:07:32,286 INFO:wheel:adding 'data_juicer/ops/mapper/nlpcda_zh_mapper.py' 2024-11-28T17:07:32,287 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_qa_mapper.py' 2024-11-28T17:07:32,288 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_query_mapper.py' 2024-11-28T17:07:32,289 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_response_mapper.py' 2024-11-28T17:07:32,291 INFO:wheel:adding 'data_juicer/ops/mapper/punctuation_normalization_mapper.py' 2024-11-28T17:07:32,292 INFO:wheel:adding 'data_juicer/ops/mapper/remove_bibliography_mapper.py' 2024-11-28T17:07:32,293 INFO:wheel:adding 'data_juicer/ops/mapper/remove_comments_mapper.py' 2024-11-28T17:07:32,294 INFO:wheel:adding 'data_juicer/ops/mapper/remove_header_mapper.py' 2024-11-28T17:07:32,296 INFO:wheel:adding 'data_juicer/ops/mapper/remove_long_words_mapper.py' 2024-11-28T17:07:32,297 INFO:wheel:adding 'data_juicer/ops/mapper/remove_non_chinese_character_mapper.py' 2024-11-28T17:07:32,298 INFO:wheel:adding 'data_juicer/ops/mapper/remove_repeat_sentences_mapper.py' 2024-11-28T17:07:32,300 INFO:wheel:adding 'data_juicer/ops/mapper/remove_specific_chars_mapper.py' 2024-11-28T17:07:32,301 INFO:wheel:adding 'data_juicer/ops/mapper/remove_table_text_mapper.py' 2024-11-28T17:07:32,302 INFO:wheel:adding 'data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py' 2024-11-28T17:07:32,303 INFO:wheel:adding 'data_juicer/ops/mapper/replace_content_mapper.py' 2024-11-28T17:07:32,305 INFO:wheel:adding 'data_juicer/ops/mapper/sentence_split_mapper.py' 2024-11-28T17:07:32,306 INFO:wheel:adding 'data_juicer/ops/mapper/text_chunk_mapper.py' 2024-11-28T17:07:32,308 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_audio_mapper.py' 2024-11-28T17:07:32,310 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_frames_mapper.py' 2024-11-28T17:07:32,312 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py' 2024-11-28T17:07:32,314 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_video_mapper.py' 2024-11-28T17:07:32,316 INFO:wheel:adding 'data_juicer/ops/mapper/video_face_blur_mapper.py' 2024-11-28T17:07:32,317 INFO:wheel:adding 'data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py' 2024-11-28T17:07:32,319 INFO:wheel:adding 'data_juicer/ops/mapper/video_remove_watermark_mapper.py' 2024-11-28T17:07:32,321 INFO:wheel:adding 'data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py' 2024-11-28T17:07:32,323 INFO:wheel:adding 'data_juicer/ops/mapper/video_resize_resolution_mapper.py' 2024-11-28T17:07:32,325 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_duration_mapper.py' 2024-11-28T17:07:32,326 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_key_frame_mapper.py' 2024-11-28T17:07:32,328 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_scene_mapper.py' 2024-11-28T17:07:32,330 INFO:wheel:adding 'data_juicer/ops/mapper/video_tagging_from_audio_mapper.py' 2024-11-28T17:07:32,331 INFO:wheel:adding 'data_juicer/ops/mapper/video_tagging_from_frames_mapper.py' 2024-11-28T17:07:32,333 INFO:wheel:adding 'data_juicer/ops/mapper/whitespace_normalization_mapper.py' 2024-11-28T17:07:32,334 INFO:wheel:adding 'data_juicer/ops/selector/__init__.py' 2024-11-28T17:07:32,336 INFO:wheel:adding 'data_juicer/ops/selector/frequency_specified_field_selector.py' 2024-11-28T17:07:32,337 INFO:wheel:adding 'data_juicer/ops/selector/random_selector.py' 2024-11-28T17:07:32,338 INFO:wheel:adding 'data_juicer/ops/selector/range_specified_field_selector.py' 2024-11-28T17:07:32,340 INFO:wheel:adding 'data_juicer/ops/selector/topk_specified_field_selector.py' 2024-11-28T17:07:32,341 INFO:wheel:adding 'data_juicer/tools/__init__.py' 2024-11-28T17:07:32,342 INFO:wheel:adding 'data_juicer/tools/analyze_data.py' 2024-11-28T17:07:32,343 INFO:wheel:adding 'data_juicer/tools/process_data.py' 2024-11-28T17:07:32,344 INFO:wheel:adding 'data_juicer/tools/sandbox_starter.py' 2024-11-28T17:07:32,346 INFO:wheel:adding 'data_juicer/utils/__init__.py' 2024-11-28T17:07:32,347 INFO:wheel:adding 'data_juicer/utils/asset_utils.py' 2024-11-28T17:07:32,348 INFO:wheel:adding 'data_juicer/utils/auto_install_mapping.py' 2024-11-28T17:07:32,350 INFO:wheel:adding 'data_juicer/utils/auto_install_utils.py' 2024-11-28T17:07:32,351 INFO:wheel:adding 'data_juicer/utils/availability_utils.py' 2024-11-28T17:07:32,352 INFO:wheel:adding 'data_juicer/utils/cache_utils.py' 2024-11-28T17:07:32,354 INFO:wheel:adding 'data_juicer/utils/ckpt_utils.py' 2024-11-28T17:07:32,355 INFO:wheel:adding 'data_juicer/utils/common_utils.py' 2024-11-28T17:07:32,357 INFO:wheel:adding 'data_juicer/utils/compress.py' 2024-11-28T17:07:32,359 INFO:wheel:adding 'data_juicer/utils/constant.py' 2024-11-28T17:07:32,361 INFO:wheel:adding 'data_juicer/utils/file_utils.py' 2024-11-28T17:07:32,362 INFO:wheel:adding 'data_juicer/utils/fingerprint_utils.py' 2024-11-28T17:07:32,363 INFO:wheel:adding 'data_juicer/utils/lazy_loader.py' 2024-11-28T17:07:32,365 INFO:wheel:adding 'data_juicer/utils/logger_utils.py' 2024-11-28T17:07:32,368 INFO:wheel:adding 'data_juicer/utils/mm_utils.py' 2024-11-28T17:07:32,372 INFO:wheel:adding 'data_juicer/utils/model_utils.py' 2024-11-28T17:07:32,374 INFO:wheel:adding 'data_juicer/utils/process_utils.py' 2024-11-28T17:07:32,375 INFO:wheel:adding 'data_juicer/utils/registry.py' 2024-11-28T17:07:32,376 INFO:wheel:adding 'data_juicer/utils/resource_utils.py' 2024-11-28T17:07:32,377 INFO:wheel:adding 'data_juicer/utils/unittest_utils.py' 2024-11-28T17:07:32,381 INFO:wheel:adding 'py_data_juicer-1.0.0.dist-info/LICENSE' 2024-11-28T17:07:32,385 INFO:wheel:adding 'py_data_juicer-1.0.0.dist-info/METADATA' 2024-11-28T17:07:32,386 INFO:wheel:adding 'py_data_juicer-1.0.0.dist-info/WHEEL' 2024-11-28T17:07:32,387 INFO:wheel:adding 'py_data_juicer-1.0.0.dist-info/entry_points.txt' 2024-11-28T17:07:32,388 INFO:wheel:adding 'py_data_juicer-1.0.0.dist-info/top_level.txt' 2024-11-28T17:07:32,391 INFO:wheel:adding 'py_data_juicer-1.0.0.dist-info/RECORD' 2024-11-28T17:07:32,398 INFO:root:removing build/bdist.linux-armv7l/wheel 2024-11-28T17:07:32,534 Building wheel for py-data-juicer (setup.py): finished with status 'done' 2024-11-28T17:07:32,540 Created wheel for py-data-juicer: filename=py_data_juicer-1.0.0-py3-none-any.whl size=324771 sha256=7cd007456933447474ec9faf5357b741a63e7a0c0dc6230e40bf4498eb1ef554 2024-11-28T17:07:32,541 Stored in directory: /tmp/pip-ephem-wheel-cache-6hw83bhj/wheels/1e/9f/5b/f86a49e352017ac507e785cdf29fa2b423ff5bf08feafebda6 2024-11-28T17:07:32,562 Successfully built py-data-juicer 2024-11-28T17:07:32,573 Removed build tracker: '/tmp/pip-build-tracker-t7kf4ox9'