2025-03-14T11:10:43,962 Created temporary directory: /tmp/pip-build-tracker-46onb4pg 2025-03-14T11:10:43,963 Initialized build tracking at /tmp/pip-build-tracker-46onb4pg 2025-03-14T11:10:43,964 Created build tracker: /tmp/pip-build-tracker-46onb4pg 2025-03-14T11:10:43,964 Entered build tracker: /tmp/pip-build-tracker-46onb4pg 2025-03-14T11:10:43,965 Created temporary directory: /tmp/pip-wheel-c35kaupb 2025-03-14T11:10:43,969 Created temporary directory: /tmp/pip-ephem-wheel-cache-v7ziqq_i 2025-03-14T11:10:44,016 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-03-14T11:10:44,019 2 location(s) to search for versions of py-data-juicer: 2025-03-14T11:10:44,019 * https://pypi.org/simple/py-data-juicer/ 2025-03-14T11:10:44,019 * https://www.piwheels.org/simple/py-data-juicer/ 2025-03-14T11:10:44,020 Fetching project page and analyzing links: https://pypi.org/simple/py-data-juicer/ 2025-03-14T11:10:44,020 Getting page https://pypi.org/simple/py-data-juicer/ 2025-03-14T11:10:44,022 Found index url https://pypi.org/simple/ 2025-03-14T11:10:44,241 Fetched page https://pypi.org/simple/py-data-juicer/ as application/vnd.pypi.simple.v1+json 2025-03-14T11:10:44,247 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/e3/d3/d0724d922e7c55a0664485fdf642124bdcd801df2697e29c9463c4360958/py_data_juicer-0.1.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,248 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/fd/c6/e1428310bf534319ddc2e362c6eee21985f097e70cedc0e9cd3e914de826/py_data_juicer-0.1.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,248 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/67/70/731e349d2a92bf59a767230b956665dd27ea24a7a948d4a1710154d77a24/py_data_juicer-0.1.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,249 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/66/08/f584efbdf8277a061ce73c9befc33fec813cbd08020761af2380dd331692/py_data_juicer-0.1.3-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,249 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/69/20/9862dfe7a94f10caa0e6387834d1265420613345c7adadd41a3ced7230e8/py_data_juicer-0.2.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,250 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/05/34/33fb401d350f1a66cdaefc224419f9d01484722829f5b0c71ef59a8365a4/py_data_juicer-1.0.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,250 Found link https://files.pythonhosted.org/packages/49/e9/cfb994255490c36554048e0b3956858e61f5a75ffacfde20849f31f04ef8/py_data_juicer-1.0.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.0 2025-03-14T11:10:44,251 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/27/37/150e2198f14349fdd6b647a63feaede809e21dbfc4617aba487f18049828/py_data_juicer-1.0.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,252 Found link https://files.pythonhosted.org/packages/4a/60/dadcbe4337a76d8f98022b60d142ac31073d568c9e06a5461b3014d16fc6/py_data_juicer-1.0.1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.1 2025-03-14T11:10:44,253 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/10/dd/f9cadd6ed2f19c4f94e61a3fd4bb5bb2029c20b2cf61ec86c3a05f89f74b/py_data_juicer-1.0.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,253 Found link https://files.pythonhosted.org/packages/95/8f/c0447ce091ca0b86283e8074a3cb350572a5436ca13dceb288887a0de332/py_data_juicer-1.0.2.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.2 2025-03-14T11:10:44,254 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/1f/dd/0f1804c5cfce50c52c8b60a1b710f30d893f681e42a6acc41bfd29a20059/py_data_juicer-1.0.3-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,255 Found link https://files.pythonhosted.org/packages/6e/d0/eefb1ca00cd4c8e62c0e8f62a1b5357b961ce50c5d2647107f51f68bf128/py_data_juicer-1.0.3.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.3 2025-03-14T11:10:44,255 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/5b/06/5df5581f724d49731b91db0b7c65fdde739358617af9e7ba9916c43f2a76/py_data_juicer-1.1.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,256 Found link https://files.pythonhosted.org/packages/69/43/f20a50fdbfc0ba44a4816d3c7f9bfcfaf55682ffebf78a10eeff6b40feeb/py_data_juicer-1.1.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.1.0 2025-03-14T11:10:44,257 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/a0/90/a95bb5b60200125b9cbb29bf1c39b706c3e5f50b247d3599386f7be973ea/py_data_juicer-1.1.0.post1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,257 Found link https://files.pythonhosted.org/packages/79/f8/3e29fb4eeeda4413bc746b0a661bc61d5786f8bf67ae9071976550fd0b41/py_data_juicer-1.1.0.post1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.1.0.post1 2025-03-14T11:10:44,258 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/9d/ca/e32ecfafde96a367dcb63a4c4ee104bc5e952205c55169fd1120df0e86ee/py_data_juicer-1.2.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,258 Found link https://files.pythonhosted.org/packages/3d/bc/607884c148a0b6bf2198960166743e95818d230e970cbcdbd69d02758541/py_data_juicer-1.2.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.2.0 2025-03-14T11:10:44,259 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/80/a2/4788daf084637e94c05615f237298e1d7fe13753f7622907ce0904a4b18c/py_data_juicer-1.2.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,259 Found link https://files.pythonhosted.org/packages/df/b6/0ca40521ecc5d3a79f8e3614af2974f4a50ae0c175fee658c8f2b091eb6b/py_data_juicer-1.2.1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.2.1 2025-03-14T11:10:44,260 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/2d/ec/75b61b05a4b19fe2e425f10b0e7f023c13d404be4ec7aa7b39ad85f18e3f/py_data_juicer-1.2.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-03-14T11:10:44,260 Found link https://files.pythonhosted.org/packages/8e/01/e4ad384e1c25acb029fd433f6bcc5d0c146cf729bd3801308cc681354ac1/py_data_juicer-1.2.2.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.2.2 2025-03-14T11:10:44,261 Fetching project page and analyzing links: https://www.piwheels.org/simple/py-data-juicer/ 2025-03-14T11:10:44,262 Getting page https://www.piwheels.org/simple/py-data-juicer/ 2025-03-14T11:10:44,263 Found index url https://www.piwheels.org/simple/ 2025-03-14T11:10:44,428 Fetched page https://www.piwheels.org/simple/py-data-juicer/ as text/html 2025-03-14T11:10:44,432 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.2.1-py3-none-any.whl#sha256=ddf1558f432f3ba201ed207faa7a45ac9c9008c15240f4495c315b11c72b8872 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,432 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.2.0-py3-none-any.whl#sha256=91f27adcba48929c9c2f59ff369a2712a2386dc8795e51481069dcd4793b2754 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,433 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.1.0.post1-py3-none-any.whl#sha256=dc638ddb7c2a90b1970855a7393432a06b8bc214943edf76ed0aa55fb3ba8b76 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,434 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.1.0-py3-none-any.whl#sha256=d2994ed187dd328adc3b4751b862a32f4847197a82b9ddd5dd4ed97960aac8d1 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,435 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.0.3-py3-none-any.whl#sha256=ec09d1fb68352b5fb204a2cab5cac661f02323ef0cbc6a52833ea83418e55a3a (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,436 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.0.2-py3-none-any.whl#sha256=69bc91a28885bd8df218510cd9c0198397f76eaab0c7fbf9726181da70734781 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,436 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.0.1-py3-none-any.whl#sha256=2396c39923ab13a9fe17fe6523734f2ff41b3edb2c97fcc70539a5761e0465f8 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,437 Skipping link: No binaries permitted for py-data-juicer: https://www.piwheels.org/simple/py-data-juicer/py_data_juicer-1.0.0-py3-none-any.whl#sha256=7cd007456933447474ec9faf5357b741a63e7a0c0dc6230e40bf4498eb1ef554 (from https://www.piwheels.org/simple/py-data-juicer/) 2025-03-14T11:10:44,438 Skipping link: not a file: https://www.piwheels.org/simple/py-data-juicer/ 2025-03-14T11:10:44,439 Skipping link: not a file: https://pypi.org/simple/py-data-juicer/ 2025-03-14T11:10:44,459 Given no hashes to check 1 links for project 'py-data-juicer': discarding no candidates 2025-03-14T11:10:44,461 Collecting py-data-juicer==1.2.2 2025-03-14T11:10:44,464 Created temporary directory: /tmp/pip-unpack-pa3umhsx 2025-03-14T11:10:44,687 Downloading py_data_juicer-1.2.2.tar.gz (293 kB) 2025-03-14T11:10:45,195 Added py-data-juicer==1.2.2 from https://files.pythonhosted.org/packages/8e/01/e4ad384e1c25acb029fd433f6bcc5d0c146cf729bd3801308cc681354ac1/py_data_juicer-1.2.2.tar.gz to build tracker '/tmp/pip-build-tracker-46onb4pg' 2025-03-14T11:10:45,197 Running setup.py (path:/tmp/pip-wheel-c35kaupb/py-data-juicer_fb0bd6f91ab44a13a457113e0cd11920/setup.py) egg_info for package py-data-juicer 2025-03-14T11:10:45,198 Created temporary directory: /tmp/pip-pip-egg-info-sqroi8mh 2025-03-14T11:10:45,199 Preparing metadata (setup.py): started 2025-03-14T11:10:45,201 Running command python setup.py egg_info 2025-03-14T11:10:45,672 WARNING:root:target file does not exist: environments/minimal_requires.txt 2025-03-14T11:10:45,672 WARNING:root:target file does not exist: environments/science_requires.txt 2025-03-14T11:10:45,672 WARNING:root:target file does not exist: environments/dist_requires.txt 2025-03-14T11:10:45,673 WARNING:root:target file does not exist: environments/dev_requires.txt 2025-03-14T11:10:45,674 WARNING:root:target file does not exist: environments/preprocess_requires.txt 2025-03-14T11:10:45,674 WARNING:root:target file does not exist: environments/quality_classifier_requires.txt 2025-03-14T11:10:45,675 WARNING:root:target file does not exist: environments/sandbox_requires.txt 2025-03-14T11:10:46,294 INFO:root:running egg_info 2025-03-14T11:10:46,324 INFO:root:creating /tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info 2025-03-14T11:10:46,325 INFO:root:writing /tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/PKG-INFO 2025-03-14T11:10:46,330 INFO:root:writing dependency_links to /tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/dependency_links.txt 2025-03-14T11:10:46,331 INFO:root:writing entry points to /tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/entry_points.txt 2025-03-14T11:10:46,333 INFO:root:writing requirements to /tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/requires.txt 2025-03-14T11:10:46,334 INFO:root:writing top-level names to /tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/top_level.txt 2025-03-14T11:10:46,335 INFO:root:writing manifest file '/tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/SOURCES.txt' 2025-03-14T11:10:46,446 INFO:root:reading manifest file '/tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/SOURCES.txt' 2025-03-14T11:10:46,448 INFO:root:adding license file 'LICENSE' 2025-03-14T11:10:46,457 INFO:root:writing manifest file '/tmp/pip-pip-egg-info-sqroi8mh/py_data_juicer.egg-info/SOURCES.txt' 2025-03-14T11:10:46,550 Preparing metadata (setup.py): finished with status 'done' 2025-03-14T11:10:46,557 Source in /tmp/pip-wheel-c35kaupb/py-data-juicer_fb0bd6f91ab44a13a457113e0cd11920 has version 1.2.2, which satisfies requirement py-data-juicer==1.2.2 from https://files.pythonhosted.org/packages/8e/01/e4ad384e1c25acb029fd433f6bcc5d0c146cf729bd3801308cc681354ac1/py_data_juicer-1.2.2.tar.gz 2025-03-14T11:10:46,558 Removed py-data-juicer==1.2.2 from https://files.pythonhosted.org/packages/8e/01/e4ad384e1c25acb029fd433f6bcc5d0c146cf729bd3801308cc681354ac1/py_data_juicer-1.2.2.tar.gz from build tracker '/tmp/pip-build-tracker-46onb4pg' 2025-03-14T11:10:46,566 Created temporary directory: /tmp/pip-unpack-muyt1avo 2025-03-14T11:10:46,567 Created temporary directory: /tmp/pip-unpack-f_i1mlx4 2025-03-14T11:10:46,567 Building wheels for collected packages: py-data-juicer 2025-03-14T11:10:46,571 Created temporary directory: /tmp/pip-wheel-ze62vpun 2025-03-14T11:10:46,572 Building wheel for py-data-juicer (setup.py): started 2025-03-14T11:10:46,573 Destination directory: /tmp/pip-wheel-ze62vpun 2025-03-14T11:10:46,573 Running command python setup.py bdist_wheel 2025-03-14T11:10:47,033 WARNING:root:target file does not exist: environments/minimal_requires.txt 2025-03-14T11:10:47,033 WARNING:root:target file does not exist: environments/science_requires.txt 2025-03-14T11:10:47,033 WARNING:root:target file does not exist: environments/dist_requires.txt 2025-03-14T11:10:47,034 WARNING:root:target file does not exist: environments/dev_requires.txt 2025-03-14T11:10:47,035 WARNING:root:target file does not exist: environments/preprocess_requires.txt 2025-03-14T11:10:47,035 WARNING:root:target file does not exist: environments/quality_classifier_requires.txt 2025-03-14T11:10:47,036 WARNING:root:target file does not exist: environments/sandbox_requires.txt 2025-03-14T11:10:47,653 INFO:root:running bdist_wheel 2025-03-14T11:10:47,794 INFO:root:running build 2025-03-14T11:10:47,794 INFO:root:running build_py 2025-03-14T11:10:47,825 INFO:root:creating build/lib/data_juicer 2025-03-14T11:10:47,827 INFO:root:copying data_juicer/__init__.py -> build/lib/data_juicer 2025-03-14T11:10:47,830 INFO:root:creating build/lib/data_juicer/core 2025-03-14T11:10:47,831 INFO:root:copying data_juicer/core/ray_executor.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,833 INFO:root:copying data_juicer/core/executor.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,835 INFO:root:copying data_juicer/core/tracer.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,838 INFO:root:copying data_juicer/core/analyzer.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,840 INFO:root:copying data_juicer/core/exporter.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,842 INFO:root:copying data_juicer/core/adapter.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,845 INFO:root:copying data_juicer/core/data.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,847 INFO:root:copying data_juicer/core/__init__.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,849 INFO:root:copying data_juicer/core/monitor.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,852 INFO:root:copying data_juicer/core/ray_data.py -> build/lib/data_juicer/core 2025-03-14T11:10:47,855 INFO:root:creating build/lib/data_juicer/analysis 2025-03-14T11:10:47,856 INFO:root:copying data_juicer/analysis/diversity_analysis.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,859 INFO:root:copying data_juicer/analysis/measure.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,861 INFO:root:copying data_juicer/analysis/overall_analysis.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,863 INFO:root:copying data_juicer/analysis/draw.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,864 INFO:root:copying data_juicer/analysis/collector.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,866 INFO:root:copying data_juicer/analysis/__init__.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,868 INFO:root:copying data_juicer/analysis/column_wise_analysis.py -> build/lib/data_juicer/analysis 2025-03-14T11:10:47,871 INFO:root:creating build/lib/data_juicer/ops 2025-03-14T11:10:47,872 INFO:root:copying data_juicer/ops/op_fusion.py -> build/lib/data_juicer/ops 2025-03-14T11:10:47,875 INFO:root:copying data_juicer/ops/load.py -> build/lib/data_juicer/ops 2025-03-14T11:10:47,877 INFO:root:copying data_juicer/ops/base_op.py -> build/lib/data_juicer/ops 2025-03-14T11:10:47,879 INFO:root:copying data_juicer/ops/__init__.py -> build/lib/data_juicer/ops 2025-03-14T11:10:47,882 INFO:root:creating build/lib/data_juicer/utils 2025-03-14T11:10:47,883 INFO:root:copying data_juicer/utils/auto_install_mapping.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,885 INFO:root:copying data_juicer/utils/ckpt_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,887 INFO:root:copying data_juicer/utils/common_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,889 INFO:root:copying data_juicer/utils/cache_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,891 INFO:root:copying data_juicer/utils/unittest_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,893 INFO:root:copying data_juicer/utils/mm_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,896 INFO:root:copying data_juicer/utils/process_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,898 INFO:root:copying data_juicer/utils/asset_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,900 INFO:root:copying data_juicer/utils/auto_install_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,902 INFO:root:copying data_juicer/utils/resource_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,904 INFO:root:copying data_juicer/utils/availability_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,906 INFO:root:copying data_juicer/utils/lazy_loader.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,907 INFO:root:copying data_juicer/utils/__init__.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,909 INFO:root:copying data_juicer/utils/logger_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,911 INFO:root:copying data_juicer/utils/constant.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,913 INFO:root:copying data_juicer/utils/registry.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,915 INFO:root:copying data_juicer/utils/file_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,918 INFO:root:copying data_juicer/utils/compress.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,920 INFO:root:copying data_juicer/utils/fingerprint_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,922 INFO:root:copying data_juicer/utils/model_utils.py -> build/lib/data_juicer/utils 2025-03-14T11:10:47,926 INFO:root:creating build/lib/data_juicer/format 2025-03-14T11:10:47,927 INFO:root:copying data_juicer/format/load.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,929 INFO:root:copying data_juicer/format/text_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,932 INFO:root:copying data_juicer/format/__init__.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,934 INFO:root:copying data_juicer/format/parquet_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,936 INFO:root:copying data_juicer/format/formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,938 INFO:root:copying data_juicer/format/json_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,940 INFO:root:copying data_juicer/format/empty_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,942 INFO:root:copying data_juicer/format/mixture_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,944 INFO:root:copying data_juicer/format/csv_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,945 INFO:root:copying data_juicer/format/tsv_formatter.py -> build/lib/data_juicer/format 2025-03-14T11:10:47,948 INFO:root:creating build/lib/data_juicer/config 2025-03-14T11:10:47,949 INFO:root:copying data_juicer/config/__init__.py -> build/lib/data_juicer/config 2025-03-14T11:10:47,950 INFO:root:copying data_juicer/config/config.py -> build/lib/data_juicer/config 2025-03-14T11:10:47,954 INFO:root:creating build/lib/data_juicer/ops/common 2025-03-14T11:10:47,955 INFO:root:copying data_juicer/ops/common/prompt2prompt_pipeline.py -> build/lib/data_juicer/ops/common 2025-03-14T11:10:47,959 INFO:root:copying data_juicer/ops/common/special_characters.py -> build/lib/data_juicer/ops/common 2025-03-14T11:10:47,960 INFO:root:copying data_juicer/ops/common/__init__.py -> build/lib/data_juicer/ops/common 2025-03-14T11:10:47,962 INFO:root:copying data_juicer/ops/common/helper_func.py -> build/lib/data_juicer/ops/common 2025-03-14T11:10:47,965 INFO:root:creating build/lib/data_juicer/ops/aggregator 2025-03-14T11:10:47,966 INFO:root:copying data_juicer/ops/aggregator/__init__.py -> build/lib/data_juicer/ops/aggregator 2025-03-14T11:10:47,968 INFO:root:copying data_juicer/ops/aggregator/entity_attribute_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-03-14T11:10:47,970 INFO:root:copying data_juicer/ops/aggregator/nested_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-03-14T11:10:47,972 INFO:root:copying data_juicer/ops/aggregator/most_relevant_entities_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-03-14T11:10:47,975 INFO:root:copying data_juicer/ops/aggregator/meta_tags_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-03-14T11:10:47,977 INFO:root:creating build/lib/data_juicer/ops/grouper 2025-03-14T11:10:47,978 INFO:root:copying data_juicer/ops/grouper/key_value_grouper.py -> build/lib/data_juicer/ops/grouper 2025-03-14T11:10:47,980 INFO:root:copying data_juicer/ops/grouper/naive_grouper.py -> build/lib/data_juicer/ops/grouper 2025-03-14T11:10:47,982 INFO:root:copying data_juicer/ops/grouper/__init__.py -> build/lib/data_juicer/ops/grouper 2025-03-14T11:10:47,984 INFO:root:copying data_juicer/ops/grouper/naive_reverse_grouper.py -> build/lib/data_juicer/ops/grouper 2025-03-14T11:10:47,987 INFO:root:creating build/lib/data_juicer/ops/selector 2025-03-14T11:10:47,988 INFO:root:copying data_juicer/ops/selector/tags_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-03-14T11:10:47,990 INFO:root:copying data_juicer/ops/selector/topk_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-03-14T11:10:47,992 INFO:root:copying data_juicer/ops/selector/__init__.py -> build/lib/data_juicer/ops/selector 2025-03-14T11:10:47,994 INFO:root:copying data_juicer/ops/selector/range_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-03-14T11:10:47,996 INFO:root:copying data_juicer/ops/selector/random_selector.py -> build/lib/data_juicer/ops/selector 2025-03-14T11:10:47,998 INFO:root:copying data_juicer/ops/selector/frequency_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-03-14T11:10:48,001 INFO:root:creating build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,002 INFO:root:copying data_juicer/ops/filter/video_resolution_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,004 INFO:root:copying data_juicer/ops/filter/video_duration_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,006 INFO:root:copying data_juicer/ops/filter/maximum_line_length_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,008 INFO:root:copying data_juicer/ops/filter/image_nsfw_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,010 INFO:root:copying data_juicer/ops/filter/flagged_words_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,013 INFO:root:copying data_juicer/ops/filter/specified_field_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,015 INFO:root:copying data_juicer/ops/filter/specified_numeric_field_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,017 INFO:root:copying data_juicer/ops/filter/image_text_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,019 INFO:root:copying data_juicer/ops/filter/text_length_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,021 INFO:root:copying data_juicer/ops/filter/llm_quality_score_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,024 INFO:root:copying data_juicer/ops/filter/image_text_matching_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,026 INFO:root:copying data_juicer/ops/filter/llm_difficulty_score_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,029 INFO:root:copying data_juicer/ops/filter/image_face_count_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,031 INFO:root:copying data_juicer/ops/filter/audio_nmf_snr_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,034 INFO:root:copying data_juicer/ops/filter/image_aspect_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,036 INFO:root:copying data_juicer/ops/filter/video_tagging_from_frames_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,039 INFO:root:copying data_juicer/ops/filter/special_characters_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,041 INFO:root:copying data_juicer/ops/filter/alphanumeric_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,043 INFO:root:copying data_juicer/ops/filter/video_frames_text_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,045 INFO:root:copying data_juicer/ops/filter/stopwords_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,048 INFO:root:copying data_juicer/ops/filter/image_aesthetics_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,050 INFO:root:copying data_juicer/ops/filter/image_size_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,053 INFO:root:copying data_juicer/ops/filter/image_pair_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,055 INFO:root:copying data_juicer/ops/filter/image_face_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,058 INFO:root:copying data_juicer/ops/filter/character_repetition_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,060 INFO:root:copying data_juicer/ops/filter/text_pair_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,062 INFO:root:copying data_juicer/ops/filter/audio_duration_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,064 INFO:root:copying data_juicer/ops/filter/text_action_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,066 INFO:root:copying data_juicer/ops/filter/video_aesthetics_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,068 INFO:root:copying data_juicer/ops/filter/__init__.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,071 INFO:root:copying data_juicer/ops/filter/image_watermark_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,073 INFO:root:copying data_juicer/ops/filter/language_id_score_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,075 INFO:root:copying data_juicer/ops/filter/image_shape_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,077 INFO:root:copying data_juicer/ops/filter/video_ocr_area_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,080 INFO:root:copying data_juicer/ops/filter/video_motion_score_raft_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,082 INFO:root:copying data_juicer/ops/filter/words_num_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,084 INFO:root:copying data_juicer/ops/filter/audio_size_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,086 INFO:root:copying data_juicer/ops/filter/text_entity_dependency_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,088 INFO:root:copying data_juicer/ops/filter/video_motion_score_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,090 INFO:root:copying data_juicer/ops/filter/token_num_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,092 INFO:root:copying data_juicer/ops/filter/phrase_grounding_recall_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,095 INFO:root:copying data_juicer/ops/filter/video_aspect_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,097 INFO:root:copying data_juicer/ops/filter/average_line_length_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,099 INFO:root:copying data_juicer/ops/filter/video_nsfw_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,102 INFO:root:copying data_juicer/ops/filter/word_repetition_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,104 INFO:root:copying data_juicer/ops/filter/perplexity_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,106 INFO:root:copying data_juicer/ops/filter/suffix_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,108 INFO:root:copying data_juicer/ops/filter/video_watermark_filter.py -> build/lib/data_juicer/ops/filter 2025-03-14T11:10:48,111 INFO:root:creating build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,113 INFO:root:copying data_juicer/ops/deduplicator/ray_document_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,115 INFO:root:copying data_juicer/ops/deduplicator/ray_basic_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,117 INFO:root:copying data_juicer/ops/deduplicator/document_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,120 INFO:root:copying data_juicer/ops/deduplicator/ray_bts_minhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,122 INFO:root:copying data_juicer/ops/deduplicator/ray_video_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,125 INFO:root:copying data_juicer/ops/deduplicator/__init__.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,127 INFO:root:copying data_juicer/ops/deduplicator/document_simhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,130 INFO:root:copying data_juicer/ops/deduplicator/document_minhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,132 INFO:root:copying data_juicer/ops/deduplicator/ray_image_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,134 INFO:root:copying data_juicer/ops/deduplicator/video_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,137 INFO:root:copying data_juicer/ops/deduplicator/image_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-03-14T11:10:48,141 INFO:root:creating build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,143 INFO:root:copying data_juicer/ops/mapper/relation_identity_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,145 INFO:root:copying data_juicer/ops/mapper/clean_html_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,148 INFO:root:copying data_juicer/ops/mapper/extract_nickname_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,151 INFO:root:copying data_juicer/ops/mapper/video_tagging_from_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,154 INFO:root:copying data_juicer/ops/mapper/chinese_convert_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,157 INFO:root:copying data_juicer/ops/mapper/video_split_by_scene_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,160 INFO:root:copying data_juicer/ops/mapper/python_lambda_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,163 INFO:root:copying data_juicer/ops/mapper/video_resize_resolution_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,165 INFO:root:copying data_juicer/ops/mapper/calibrate_qa_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,169 INFO:root:copying data_juicer/ops/mapper/remove_bibliography_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,171 INFO:root:copying data_juicer/ops/mapper/calibrate_response_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,174 INFO:root:copying data_juicer/ops/mapper/nlpaug_en_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,177 INFO:root:copying data_juicer/ops/mapper/clean_links_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,179 INFO:root:copying data_juicer/ops/mapper/query_topic_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,182 INFO:root:copying data_juicer/ops/mapper/image_diffusion_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,185 INFO:root:copying data_juicer/ops/mapper/remove_header_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,187 INFO:root:copying data_juicer/ops/mapper/image_face_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,190 INFO:root:copying data_juicer/ops/mapper/calibrate_query_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,193 INFO:root:copying data_juicer/ops/mapper/sentence_split_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,195 INFO:root:copying data_juicer/ops/mapper/text_chunk_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,198 INFO:root:copying data_juicer/ops/mapper/fix_unicode_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,200 INFO:root:copying data_juicer/ops/mapper/query_intent_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,202 INFO:root:copying data_juicer/ops/mapper/image_segment_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,205 INFO:root:copying data_juicer/ops/mapper/remove_table_text_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,207 INFO:root:copying data_juicer/ops/mapper/clean_copyright_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,209 INFO:root:copying data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,211 INFO:root:copying data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,214 INFO:root:copying data_juicer/ops/mapper/video_split_by_key_frame_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,217 INFO:root:copying data_juicer/ops/mapper/video_remove_watermark_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,220 INFO:root:copying data_juicer/ops/mapper/video_face_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,222 INFO:root:copying data_juicer/ops/mapper/sdxl_prompt2prompt_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,226 INFO:root:copying data_juicer/ops/mapper/remove_comments_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,228 INFO:root:copying data_juicer/ops/mapper/replace_content_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,230 INFO:root:copying data_juicer/ops/mapper/clean_email_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,233 INFO:root:copying data_juicer/ops/mapper/video_extract_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,235 INFO:root:copying data_juicer/ops/mapper/punctuation_normalization_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,238 INFO:root:copying data_juicer/ops/mapper/generate_qa_from_text_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,241 INFO:root:copying data_juicer/ops/mapper/optimize_query_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,242 INFO:root:copying data_juicer/ops/mapper/remove_long_words_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,245 INFO:root:copying data_juicer/ops/mapper/image_captioning_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,247 INFO:root:copying data_juicer/ops/mapper/optimize_response_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,249 INFO:root:copying data_juicer/ops/mapper/extract_event_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,252 INFO:root:copying data_juicer/ops/mapper/__init__.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,254 INFO:root:copying data_juicer/ops/mapper/clean_ip_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,256 INFO:root:copying data_juicer/ops/mapper/nlpcda_zh_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,259 INFO:root:copying data_juicer/ops/mapper/extract_keyword_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,263 INFO:root:copying data_juicer/ops/mapper/dialog_sentiment_intensity_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,265 INFO:root:copying data_juicer/ops/mapper/image_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,268 INFO:root:copying data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,270 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_audio_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,274 INFO:root:copying data_juicer/ops/mapper/expand_macro_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,276 INFO:root:copying data_juicer/ops/mapper/generate_qa_from_examples_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,279 INFO:root:copying data_juicer/ops/mapper/dialog_intent_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,282 INFO:root:copying data_juicer/ops/mapper/optimize_qa_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,284 INFO:root:copying data_juicer/ops/mapper/remove_non_chinese_character_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,287 INFO:root:copying data_juicer/ops/mapper/pair_preference_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,289 INFO:root:copying data_juicer/ops/mapper/whitespace_normalization_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,291 INFO:root:copying data_juicer/ops/mapper/extract_support_text_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,294 INFO:root:copying data_juicer/ops/mapper/mllm_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,297 INFO:root:copying data_juicer/ops/mapper/extract_entity_attribute_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,299 INFO:root:copying data_juicer/ops/mapper/remove_repeat_sentences_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,302 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,304 INFO:root:copying data_juicer/ops/mapper/python_file_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,307 INFO:root:copying data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,309 INFO:root:copying data_juicer/ops/mapper/remove_specific_chars_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,312 INFO:root:copying data_juicer/ops/mapper/video_split_by_duration_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,314 INFO:root:copying data_juicer/ops/mapper/dialog_sentiment_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,318 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_video_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,321 INFO:root:copying data_juicer/ops/mapper/dialog_topic_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,323 INFO:root:copying data_juicer/ops/mapper/extract_entity_relation_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,327 INFO:root:copying data_juicer/ops/mapper/query_sentiment_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,328 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,331 INFO:root:copying data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,333 INFO:root:copying data_juicer/ops/mapper/sentence_augmentation_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,335 INFO:root:copying data_juicer/ops/mapper/image_remove_background_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,338 INFO:root:copying data_juicer/ops/mapper/video_tagging_from_audio_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,340 INFO:root:copying data_juicer/ops/mapper/image_tagging_mapper.py -> build/lib/data_juicer/ops/mapper 2025-03-14T11:10:48,343 INFO:root:creating build/lib/data_juicer/tools 2025-03-14T11:10:48,344 INFO:root:copying tools/sandbox_starter.py -> build/lib/data_juicer/tools 2025-03-14T11:10:48,347 INFO:root:copying tools/process_data.py -> build/lib/data_juicer/tools 2025-03-14T11:10:48,349 INFO:root:copying tools/analyze_data.py -> build/lib/data_juicer/tools 2025-03-14T11:10:48,351 INFO:root:copying tools/__init__.py -> build/lib/data_juicer/tools 2025-03-14T11:10:48,353 INFO:root:copying tools/dj_install.py -> build/lib/data_juicer/tools 2025-03-14T11:10:48,355 INFO:root:copying tools/data_resplit.py -> build/lib/data_juicer/tools 2025-03-14T11:10:48,409 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-03-14T11:10:48,410 !! 2025-03-14T11:10:48,411 ******************************************************************************** 2025-03-14T11:10:48,411 Please avoid running ``setup.py`` directly. 2025-03-14T11:10:48,412 Instead, use pypa/build, pypa/installer or other 2025-03-14T11:10:48,413 standards-based tools. 2025-03-14T11:10:48,414 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-03-14T11:10:48,415 ******************************************************************************** 2025-03-14T11:10:48,417 !! 2025-03-14T11:10:48,417 self.initialize_options() 2025-03-14T11:10:48,441 INFO:root:installing to build/bdist.linux-armv7l/wheel 2025-03-14T11:10:48,441 INFO:root:running install 2025-03-14T11:10:48,476 INFO:root:running install_lib 2025-03-14T11:10:48,519 INFO:root:creating build/bdist.linux-armv7l/wheel 2025-03-14T11:10:48,523 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer 2025-03-14T11:10:48,526 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/tools 2025-03-14T11:10:48,527 INFO:root:copying build/lib/data_juicer/tools/sandbox_starter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-03-14T11:10:48,531 INFO:root:copying build/lib/data_juicer/tools/process_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-03-14T11:10:48,534 INFO:root:copying build/lib/data_juicer/tools/analyze_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-03-14T11:10:48,537 INFO:root:copying build/lib/data_juicer/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-03-14T11:10:48,539 INFO:root:copying build/lib/data_juicer/tools/dj_install.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-03-14T11:10:48,542 INFO:root:copying build/lib/data_juicer/tools/data_resplit.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-03-14T11:10:48,546 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/core 2025-03-14T11:10:48,547 INFO:root:copying build/lib/data_juicer/core/ray_executor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,550 INFO:root:copying build/lib/data_juicer/core/executor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,553 INFO:root:copying build/lib/data_juicer/core/tracer.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,555 INFO:root:copying build/lib/data_juicer/core/analyzer.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,558 INFO:root:copying build/lib/data_juicer/core/exporter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,561 INFO:root:copying build/lib/data_juicer/core/adapter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,564 INFO:root:copying build/lib/data_juicer/core/data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,567 INFO:root:copying build/lib/data_juicer/core/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,569 INFO:root:copying build/lib/data_juicer/core/monitor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,572 INFO:root:copying build/lib/data_juicer/core/ray_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-03-14T11:10:48,575 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/analysis 2025-03-14T11:10:48,577 INFO:root:copying build/lib/data_juicer/analysis/diversity_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,579 INFO:root:copying build/lib/data_juicer/analysis/measure.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,582 INFO:root:copying build/lib/data_juicer/analysis/overall_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,584 INFO:root:copying build/lib/data_juicer/analysis/draw.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,586 INFO:root:copying build/lib/data_juicer/analysis/collector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,588 INFO:root:copying build/lib/data_juicer/analysis/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,590 INFO:root:copying build/lib/data_juicer/analysis/column_wise_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-03-14T11:10:48,593 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops 2025-03-14T11:10:48,594 INFO:root:copying build/lib/data_juicer/ops/op_fusion.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-03-14T11:10:48,597 INFO:root:copying build/lib/data_juicer/ops/load.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-03-14T11:10:48,599 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/common 2025-03-14T11:10:48,601 INFO:root:copying build/lib/data_juicer/ops/common/prompt2prompt_pipeline.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-03-14T11:10:48,604 INFO:root:copying build/lib/data_juicer/ops/common/special_characters.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-03-14T11:10:48,606 INFO:root:copying build/lib/data_juicer/ops/common/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-03-14T11:10:48,608 INFO:root:copying build/lib/data_juicer/ops/common/helper_func.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-03-14T11:10:48,611 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/aggregator 2025-03-14T11:10:48,612 INFO:root:copying build/lib/data_juicer/ops/aggregator/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-03-14T11:10:48,614 INFO:root:copying build/lib/data_juicer/ops/aggregator/entity_attribute_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-03-14T11:10:48,617 INFO:root:copying build/lib/data_juicer/ops/aggregator/nested_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-03-14T11:10:48,619 INFO:root:copying build/lib/data_juicer/ops/aggregator/most_relevant_entities_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-03-14T11:10:48,621 INFO:root:copying build/lib/data_juicer/ops/aggregator/meta_tags_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-03-14T11:10:48,624 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/grouper 2025-03-14T11:10:48,625 INFO:root:copying build/lib/data_juicer/ops/grouper/key_value_grouper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-03-14T11:10:48,627 INFO:root:copying build/lib/data_juicer/ops/grouper/naive_grouper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-03-14T11:10:48,629 INFO:root:copying build/lib/data_juicer/ops/grouper/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-03-14T11:10:48,631 INFO:root:copying build/lib/data_juicer/ops/grouper/naive_reverse_grouper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-03-14T11:10:48,634 INFO:root:copying build/lib/data_juicer/ops/base_op.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-03-14T11:10:48,637 INFO:root:copying build/lib/data_juicer/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-03-14T11:10:48,640 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/selector 2025-03-14T11:10:48,641 INFO:root:copying build/lib/data_juicer/ops/selector/tags_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-03-14T11:10:48,643 INFO:root:copying build/lib/data_juicer/ops/selector/topk_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-03-14T11:10:48,645 INFO:root:copying build/lib/data_juicer/ops/selector/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-03-14T11:10:48,648 INFO:root:copying build/lib/data_juicer/ops/selector/range_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-03-14T11:10:48,650 INFO:root:copying build/lib/data_juicer/ops/selector/random_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-03-14T11:10:48,652 INFO:root:copying build/lib/data_juicer/ops/selector/frequency_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-03-14T11:10:48,656 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/filter 2025-03-14T11:10:48,657 INFO:root:copying build/lib/data_juicer/ops/filter/video_resolution_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,659 INFO:root:copying build/lib/data_juicer/ops/filter/video_duration_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,662 INFO:root:copying build/lib/data_juicer/ops/filter/maximum_line_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,664 INFO:root:copying build/lib/data_juicer/ops/filter/image_nsfw_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,667 INFO:root:copying build/lib/data_juicer/ops/filter/flagged_words_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,669 INFO:root:copying build/lib/data_juicer/ops/filter/specified_field_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,671 INFO:root:copying build/lib/data_juicer/ops/filter/specified_numeric_field_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,674 INFO:root:copying build/lib/data_juicer/ops/filter/image_text_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,676 INFO:root:copying build/lib/data_juicer/ops/filter/text_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,678 INFO:root:copying build/lib/data_juicer/ops/filter/llm_quality_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,681 INFO:root:copying build/lib/data_juicer/ops/filter/image_text_matching_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,683 INFO:root:copying build/lib/data_juicer/ops/filter/llm_difficulty_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,686 INFO:root:copying build/lib/data_juicer/ops/filter/image_face_count_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,688 INFO:root:copying build/lib/data_juicer/ops/filter/audio_nmf_snr_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,690 INFO:root:copying build/lib/data_juicer/ops/filter/image_aspect_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,692 INFO:root:copying build/lib/data_juicer/ops/filter/video_tagging_from_frames_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,695 INFO:root:copying build/lib/data_juicer/ops/filter/special_characters_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,697 INFO:root:copying build/lib/data_juicer/ops/filter/alphanumeric_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,700 INFO:root:copying build/lib/data_juicer/ops/filter/video_frames_text_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,703 INFO:root:copying build/lib/data_juicer/ops/filter/stopwords_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,706 INFO:root:copying build/lib/data_juicer/ops/filter/image_aesthetics_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,708 INFO:root:copying build/lib/data_juicer/ops/filter/image_size_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,710 INFO:root:copying build/lib/data_juicer/ops/filter/image_pair_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,713 INFO:root:copying build/lib/data_juicer/ops/filter/image_face_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,715 INFO:root:copying build/lib/data_juicer/ops/filter/character_repetition_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,718 INFO:root:copying build/lib/data_juicer/ops/filter/text_pair_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,720 INFO:root:copying build/lib/data_juicer/ops/filter/audio_duration_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,722 INFO:root:copying build/lib/data_juicer/ops/filter/text_action_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,724 INFO:root:copying build/lib/data_juicer/ops/filter/video_aesthetics_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,727 INFO:root:copying build/lib/data_juicer/ops/filter/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,729 INFO:root:copying build/lib/data_juicer/ops/filter/image_watermark_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,731 INFO:root:copying build/lib/data_juicer/ops/filter/language_id_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,734 INFO:root:copying build/lib/data_juicer/ops/filter/image_shape_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,736 INFO:root:copying build/lib/data_juicer/ops/filter/video_ocr_area_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,739 INFO:root:copying build/lib/data_juicer/ops/filter/video_motion_score_raft_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,741 INFO:root:copying build/lib/data_juicer/ops/filter/words_num_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,743 INFO:root:copying build/lib/data_juicer/ops/filter/audio_size_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,745 INFO:root:copying build/lib/data_juicer/ops/filter/text_entity_dependency_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,747 INFO:root:copying build/lib/data_juicer/ops/filter/video_motion_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,750 INFO:root:copying build/lib/data_juicer/ops/filter/token_num_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,751 INFO:root:copying build/lib/data_juicer/ops/filter/phrase_grounding_recall_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,754 INFO:root:copying build/lib/data_juicer/ops/filter/video_aspect_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,756 INFO:root:copying build/lib/data_juicer/ops/filter/average_line_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,758 INFO:root:copying build/lib/data_juicer/ops/filter/video_nsfw_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,761 INFO:root:copying build/lib/data_juicer/ops/filter/word_repetition_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,763 INFO:root:copying build/lib/data_juicer/ops/filter/perplexity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,765 INFO:root:copying build/lib/data_juicer/ops/filter/suffix_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,767 INFO:root:copying build/lib/data_juicer/ops/filter/video_watermark_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-03-14T11:10:48,771 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/deduplicator 2025-03-14T11:10:48,772 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_document_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,774 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_basic_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,776 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,778 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_bts_minhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,781 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_video_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,783 INFO:root:copying build/lib/data_juicer/ops/deduplicator/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,785 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_simhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,787 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_minhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,789 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_image_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,791 INFO:root:copying build/lib/data_juicer/ops/deduplicator/video_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,793 INFO:root:copying build/lib/data_juicer/ops/deduplicator/image_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-03-14T11:10:48,798 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/mapper 2025-03-14T11:10:48,799 INFO:root:copying build/lib/data_juicer/ops/mapper/relation_identity_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,802 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_html_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,803 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_nickname_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,806 INFO:root:copying build/lib/data_juicer/ops/mapper/video_tagging_from_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,808 INFO:root:copying build/lib/data_juicer/ops/mapper/chinese_convert_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,810 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_scene_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,813 INFO:root:copying build/lib/data_juicer/ops/mapper/python_lambda_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,815 INFO:root:copying build/lib/data_juicer/ops/mapper/video_resize_resolution_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,817 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_qa_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,820 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_bibliography_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,822 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_response_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,824 INFO:root:copying build/lib/data_juicer/ops/mapper/nlpaug_en_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,826 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_links_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,828 INFO:root:copying build/lib/data_juicer/ops/mapper/query_topic_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,831 INFO:root:copying build/lib/data_juicer/ops/mapper/image_diffusion_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,834 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_header_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,836 INFO:root:copying build/lib/data_juicer/ops/mapper/image_face_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,839 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_query_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,841 INFO:root:copying build/lib/data_juicer/ops/mapper/sentence_split_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,843 INFO:root:copying build/lib/data_juicer/ops/mapper/text_chunk_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,846 INFO:root:copying build/lib/data_juicer/ops/mapper/fix_unicode_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,848 INFO:root:copying build/lib/data_juicer/ops/mapper/query_intent_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,850 INFO:root:copying build/lib/data_juicer/ops/mapper/image_segment_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,852 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_table_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,854 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_copyright_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,856 INFO:root:copying build/lib/data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,858 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,860 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_key_frame_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,863 INFO:root:copying build/lib/data_juicer/ops/mapper/video_remove_watermark_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,865 INFO:root:copying build/lib/data_juicer/ops/mapper/video_face_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,868 INFO:root:copying build/lib/data_juicer/ops/mapper/sdxl_prompt2prompt_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,870 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_comments_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,873 INFO:root:copying build/lib/data_juicer/ops/mapper/replace_content_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,875 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_email_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,877 INFO:root:copying build/lib/data_juicer/ops/mapper/video_extract_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,880 INFO:root:copying build/lib/data_juicer/ops/mapper/punctuation_normalization_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,882 INFO:root:copying build/lib/data_juicer/ops/mapper/generate_qa_from_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,885 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_query_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,887 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_long_words_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,889 INFO:root:copying build/lib/data_juicer/ops/mapper/image_captioning_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,892 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_response_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,894 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_event_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,897 INFO:root:copying build/lib/data_juicer/ops/mapper/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,900 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_ip_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,902 INFO:root:copying build/lib/data_juicer/ops/mapper/nlpcda_zh_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,905 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_keyword_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,908 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_sentiment_intensity_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,910 INFO:root:copying build/lib/data_juicer/ops/mapper/image_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,912 INFO:root:copying build/lib/data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,915 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_audio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,918 INFO:root:copying build/lib/data_juicer/ops/mapper/expand_macro_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,921 INFO:root:copying build/lib/data_juicer/ops/mapper/generate_qa_from_examples_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,923 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_intent_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,926 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_qa_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,929 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_non_chinese_character_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,931 INFO:root:copying build/lib/data_juicer/ops/mapper/pair_preference_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,934 INFO:root:copying build/lib/data_juicer/ops/mapper/whitespace_normalization_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,936 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_support_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,939 INFO:root:copying build/lib/data_juicer/ops/mapper/mllm_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,941 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_entity_attribute_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,944 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_repeat_sentences_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,946 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,949 INFO:root:copying build/lib/data_juicer/ops/mapper/python_file_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,951 INFO:root:copying build/lib/data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,954 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_specific_chars_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,956 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_duration_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,959 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_sentiment_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,962 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_video_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,965 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_topic_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,967 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_entity_relation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,970 INFO:root:copying build/lib/data_juicer/ops/mapper/query_sentiment_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,973 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,975 INFO:root:copying build/lib/data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,978 INFO:root:copying build/lib/data_juicer/ops/mapper/sentence_augmentation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,980 INFO:root:copying build/lib/data_juicer/ops/mapper/image_remove_background_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,983 INFO:root:copying build/lib/data_juicer/ops/mapper/video_tagging_from_audio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,985 INFO:root:copying build/lib/data_juicer/ops/mapper/image_tagging_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-03-14T11:10:48,987 INFO:root:copying build/lib/data_juicer/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer 2025-03-14T11:10:48,990 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/utils 2025-03-14T11:10:48,992 INFO:root:copying build/lib/data_juicer/utils/auto_install_mapping.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:48,994 INFO:root:copying build/lib/data_juicer/utils/ckpt_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:48,997 INFO:root:copying build/lib/data_juicer/utils/common_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:48,999 INFO:root:copying build/lib/data_juicer/utils/cache_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,002 INFO:root:copying build/lib/data_juicer/utils/unittest_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,004 INFO:root:copying build/lib/data_juicer/utils/mm_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,007 INFO:root:copying build/lib/data_juicer/utils/process_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,010 INFO:root:copying build/lib/data_juicer/utils/asset_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,012 INFO:root:copying build/lib/data_juicer/utils/auto_install_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,014 INFO:root:copying build/lib/data_juicer/utils/resource_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,016 INFO:root:copying build/lib/data_juicer/utils/availability_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,019 INFO:root:copying build/lib/data_juicer/utils/lazy_loader.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,021 INFO:root:copying build/lib/data_juicer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,022 INFO:root:copying build/lib/data_juicer/utils/logger_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,025 INFO:root:copying build/lib/data_juicer/utils/constant.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,028 INFO:root:copying build/lib/data_juicer/utils/registry.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,030 INFO:root:copying build/lib/data_juicer/utils/file_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,033 INFO:root:copying build/lib/data_juicer/utils/compress.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,036 INFO:root:copying build/lib/data_juicer/utils/fingerprint_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,038 INFO:root:copying build/lib/data_juicer/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-03-14T11:10:49,042 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/format 2025-03-14T11:10:49,043 INFO:root:copying build/lib/data_juicer/format/load.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,046 INFO:root:copying build/lib/data_juicer/format/text_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,049 INFO:root:copying build/lib/data_juicer/format/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,051 INFO:root:copying build/lib/data_juicer/format/parquet_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,053 INFO:root:copying build/lib/data_juicer/format/formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,055 INFO:root:copying build/lib/data_juicer/format/json_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,057 INFO:root:copying build/lib/data_juicer/format/empty_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,059 INFO:root:copying build/lib/data_juicer/format/mixture_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,062 INFO:root:copying build/lib/data_juicer/format/csv_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,064 INFO:root:copying build/lib/data_juicer/format/tsv_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-03-14T11:10:49,067 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/config 2025-03-14T11:10:49,068 INFO:root:copying build/lib/data_juicer/config/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/config 2025-03-14T11:10:49,070 INFO:root:copying build/lib/data_juicer/config/config.py -> build/bdist.linux-armv7l/wheel/./data_juicer/config 2025-03-14T11:10:49,073 INFO:root:running install_egg_info 2025-03-14T11:10:49,108 INFO:root:running egg_info 2025-03-14T11:10:49,136 INFO:root:writing py_data_juicer.egg-info/PKG-INFO 2025-03-14T11:10:49,140 INFO:root:writing dependency_links to py_data_juicer.egg-info/dependency_links.txt 2025-03-14T11:10:49,142 INFO:root:writing entry points to py_data_juicer.egg-info/entry_points.txt 2025-03-14T11:10:49,143 INFO:root:writing requirements to py_data_juicer.egg-info/requires.txt 2025-03-14T11:10:49,145 INFO:root:writing top-level names to py_data_juicer.egg-info/top_level.txt 2025-03-14T11:10:49,194 INFO:root:reading manifest file 'py_data_juicer.egg-info/SOURCES.txt' 2025-03-14T11:10:49,210 INFO:root:adding license file 'LICENSE' 2025-03-14T11:10:49,222 INFO:root:writing manifest file 'py_data_juicer.egg-info/SOURCES.txt' 2025-03-14T11:10:49,223 INFO:root:Copying py_data_juicer.egg-info to build/bdist.linux-armv7l/wheel/./py_data_juicer-1.2.2-py3.11.egg-info 2025-03-14T11:10:49,237 INFO:root:running install_scripts 2025-03-14T11:10:49,261 INFO:root:creating build/bdist.linux-armv7l/wheel/py_data_juicer-1.2.2.dist-info/WHEEL 2025-03-14T11:10:49,265 INFO:wheel:creating '/tmp/pip-wheel-ze62vpun/py_data_juicer-1.2.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-03-14T11:10:49,268 INFO:wheel:adding 'data_juicer/__init__.py' 2025-03-14T11:10:49,271 INFO:wheel:adding 'data_juicer/analysis/__init__.py' 2025-03-14T11:10:49,273 INFO:wheel:adding 'data_juicer/analysis/collector.py' 2025-03-14T11:10:49,276 INFO:wheel:adding 'data_juicer/analysis/column_wise_analysis.py' 2025-03-14T11:10:49,279 INFO:wheel:adding 'data_juicer/analysis/diversity_analysis.py' 2025-03-14T11:10:49,280 INFO:wheel:adding 'data_juicer/analysis/draw.py' 2025-03-14T11:10:49,283 INFO:wheel:adding 'data_juicer/analysis/measure.py' 2025-03-14T11:10:49,285 INFO:wheel:adding 'data_juicer/analysis/overall_analysis.py' 2025-03-14T11:10:49,288 INFO:wheel:adding 'data_juicer/config/__init__.py' 2025-03-14T11:10:49,295 INFO:wheel:adding 'data_juicer/config/config.py' 2025-03-14T11:10:49,297 INFO:wheel:adding 'data_juicer/core/__init__.py' 2025-03-14T11:10:49,300 INFO:wheel:adding 'data_juicer/core/adapter.py' 2025-03-14T11:10:49,303 INFO:wheel:adding 'data_juicer/core/analyzer.py' 2025-03-14T11:10:49,307 INFO:wheel:adding 'data_juicer/core/data.py' 2025-03-14T11:10:49,310 INFO:wheel:adding 'data_juicer/core/executor.py' 2025-03-14T11:10:49,312 INFO:wheel:adding 'data_juicer/core/exporter.py' 2025-03-14T11:10:49,315 INFO:wheel:adding 'data_juicer/core/monitor.py' 2025-03-14T11:10:49,317 INFO:wheel:adding 'data_juicer/core/ray_data.py' 2025-03-14T11:10:49,320 INFO:wheel:adding 'data_juicer/core/ray_executor.py' 2025-03-14T11:10:49,322 INFO:wheel:adding 'data_juicer/core/tracer.py' 2025-03-14T11:10:49,324 INFO:wheel:adding 'data_juicer/format/__init__.py' 2025-03-14T11:10:49,326 INFO:wheel:adding 'data_juicer/format/csv_formatter.py' 2025-03-14T11:10:49,328 INFO:wheel:adding 'data_juicer/format/empty_formatter.py' 2025-03-14T11:10:49,331 INFO:wheel:adding 'data_juicer/format/formatter.py' 2025-03-14T11:10:49,333 INFO:wheel:adding 'data_juicer/format/json_formatter.py' 2025-03-14T11:10:49,335 INFO:wheel:adding 'data_juicer/format/load.py' 2025-03-14T11:10:49,337 INFO:wheel:adding 'data_juicer/format/mixture_formatter.py' 2025-03-14T11:10:49,339 INFO:wheel:adding 'data_juicer/format/parquet_formatter.py' 2025-03-14T11:10:49,341 INFO:wheel:adding 'data_juicer/format/text_formatter.py' 2025-03-14T11:10:49,343 INFO:wheel:adding 'data_juicer/format/tsv_formatter.py' 2025-03-14T11:10:49,345 INFO:wheel:adding 'data_juicer/ops/__init__.py' 2025-03-14T11:10:49,349 INFO:wheel:adding 'data_juicer/ops/base_op.py' 2025-03-14T11:10:49,351 INFO:wheel:adding 'data_juicer/ops/load.py' 2025-03-14T11:10:49,353 INFO:wheel:adding 'data_juicer/ops/op_fusion.py' 2025-03-14T11:10:49,355 INFO:wheel:adding 'data_juicer/ops/aggregator/__init__.py' 2025-03-14T11:10:49,356 INFO:wheel:adding 'data_juicer/ops/aggregator/entity_attribute_aggregator.py' 2025-03-14T11:10:49,358 INFO:wheel:adding 'data_juicer/ops/aggregator/meta_tags_aggregator.py' 2025-03-14T11:10:49,360 INFO:wheel:adding 'data_juicer/ops/aggregator/most_relevant_entities_aggregator.py' 2025-03-14T11:10:49,362 INFO:wheel:adding 'data_juicer/ops/aggregator/nested_aggregator.py' 2025-03-14T11:10:49,363 INFO:wheel:adding 'data_juicer/ops/common/__init__.py' 2025-03-14T11:10:49,365 INFO:wheel:adding 'data_juicer/ops/common/helper_func.py' 2025-03-14T11:10:49,371 INFO:wheel:adding 'data_juicer/ops/common/prompt2prompt_pipeline.py' 2025-03-14T11:10:49,372 INFO:wheel:adding 'data_juicer/ops/common/special_characters.py' 2025-03-14T11:10:49,374 INFO:wheel:adding 'data_juicer/ops/deduplicator/__init__.py' 2025-03-14T11:10:49,375 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_deduplicator.py' 2025-03-14T11:10:49,378 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_minhash_deduplicator.py' 2025-03-14T11:10:49,379 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_simhash_deduplicator.py' 2025-03-14T11:10:49,381 INFO:wheel:adding 'data_juicer/ops/deduplicator/image_deduplicator.py' 2025-03-14T11:10:49,382 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_basic_deduplicator.py' 2025-03-14T11:10:49,385 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_bts_minhash_deduplicator.py' 2025-03-14T11:10:49,387 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_document_deduplicator.py' 2025-03-14T11:10:49,388 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_image_deduplicator.py' 2025-03-14T11:10:49,389 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_video_deduplicator.py' 2025-03-14T11:10:49,391 INFO:wheel:adding 'data_juicer/ops/deduplicator/video_deduplicator.py' 2025-03-14T11:10:49,394 INFO:wheel:adding 'data_juicer/ops/filter/__init__.py' 2025-03-14T11:10:49,395 INFO:wheel:adding 'data_juicer/ops/filter/alphanumeric_filter.py' 2025-03-14T11:10:49,396 INFO:wheel:adding 'data_juicer/ops/filter/audio_duration_filter.py' 2025-03-14T11:10:49,398 INFO:wheel:adding 'data_juicer/ops/filter/audio_nmf_snr_filter.py' 2025-03-14T11:10:49,399 INFO:wheel:adding 'data_juicer/ops/filter/audio_size_filter.py' 2025-03-14T11:10:49,400 INFO:wheel:adding 'data_juicer/ops/filter/average_line_length_filter.py' 2025-03-14T11:10:49,402 INFO:wheel:adding 'data_juicer/ops/filter/character_repetition_filter.py' 2025-03-14T11:10:49,403 INFO:wheel:adding 'data_juicer/ops/filter/flagged_words_filter.py' 2025-03-14T11:10:49,405 INFO:wheel:adding 'data_juicer/ops/filter/image_aesthetics_filter.py' 2025-03-14T11:10:49,406 INFO:wheel:adding 'data_juicer/ops/filter/image_aspect_ratio_filter.py' 2025-03-14T11:10:49,407 INFO:wheel:adding 'data_juicer/ops/filter/image_face_count_filter.py' 2025-03-14T11:10:49,408 INFO:wheel:adding 'data_juicer/ops/filter/image_face_ratio_filter.py' 2025-03-14T11:10:49,410 INFO:wheel:adding 'data_juicer/ops/filter/image_nsfw_filter.py' 2025-03-14T11:10:49,411 INFO:wheel:adding 'data_juicer/ops/filter/image_pair_similarity_filter.py' 2025-03-14T11:10:49,412 INFO:wheel:adding 'data_juicer/ops/filter/image_shape_filter.py' 2025-03-14T11:10:49,413 INFO:wheel:adding 'data_juicer/ops/filter/image_size_filter.py' 2025-03-14T11:10:49,415 INFO:wheel:adding 'data_juicer/ops/filter/image_text_matching_filter.py' 2025-03-14T11:10:49,416 INFO:wheel:adding 'data_juicer/ops/filter/image_text_similarity_filter.py' 2025-03-14T11:10:49,418 INFO:wheel:adding 'data_juicer/ops/filter/image_watermark_filter.py' 2025-03-14T11:10:49,419 INFO:wheel:adding 'data_juicer/ops/filter/language_id_score_filter.py' 2025-03-14T11:10:49,421 INFO:wheel:adding 'data_juicer/ops/filter/llm_difficulty_score_filter.py' 2025-03-14T11:10:49,423 INFO:wheel:adding 'data_juicer/ops/filter/llm_quality_score_filter.py' 2025-03-14T11:10:49,424 INFO:wheel:adding 'data_juicer/ops/filter/maximum_line_length_filter.py' 2025-03-14T11:10:49,425 INFO:wheel:adding 'data_juicer/ops/filter/perplexity_filter.py' 2025-03-14T11:10:49,427 INFO:wheel:adding 'data_juicer/ops/filter/phrase_grounding_recall_filter.py' 2025-03-14T11:10:49,428 INFO:wheel:adding 'data_juicer/ops/filter/special_characters_filter.py' 2025-03-14T11:10:49,430 INFO:wheel:adding 'data_juicer/ops/filter/specified_field_filter.py' 2025-03-14T11:10:49,431 INFO:wheel:adding 'data_juicer/ops/filter/specified_numeric_field_filter.py' 2025-03-14T11:10:49,432 INFO:wheel:adding 'data_juicer/ops/filter/stopwords_filter.py' 2025-03-14T11:10:49,434 INFO:wheel:adding 'data_juicer/ops/filter/suffix_filter.py' 2025-03-14T11:10:49,435 INFO:wheel:adding 'data_juicer/ops/filter/text_action_filter.py' 2025-03-14T11:10:49,436 INFO:wheel:adding 'data_juicer/ops/filter/text_entity_dependency_filter.py' 2025-03-14T11:10:49,438 INFO:wheel:adding 'data_juicer/ops/filter/text_length_filter.py' 2025-03-14T11:10:49,439 INFO:wheel:adding 'data_juicer/ops/filter/text_pair_similarity_filter.py' 2025-03-14T11:10:49,440 INFO:wheel:adding 'data_juicer/ops/filter/token_num_filter.py' 2025-03-14T11:10:49,442 INFO:wheel:adding 'data_juicer/ops/filter/video_aesthetics_filter.py' 2025-03-14T11:10:49,443 INFO:wheel:adding 'data_juicer/ops/filter/video_aspect_ratio_filter.py' 2025-03-14T11:10:49,445 INFO:wheel:adding 'data_juicer/ops/filter/video_duration_filter.py' 2025-03-14T11:10:49,447 INFO:wheel:adding 'data_juicer/ops/filter/video_frames_text_similarity_filter.py' 2025-03-14T11:10:49,449 INFO:wheel:adding 'data_juicer/ops/filter/video_motion_score_filter.py' 2025-03-14T11:10:49,450 INFO:wheel:adding 'data_juicer/ops/filter/video_motion_score_raft_filter.py' 2025-03-14T11:10:49,451 INFO:wheel:adding 'data_juicer/ops/filter/video_nsfw_filter.py' 2025-03-14T11:10:49,453 INFO:wheel:adding 'data_juicer/ops/filter/video_ocr_area_ratio_filter.py' 2025-03-14T11:10:49,455 INFO:wheel:adding 'data_juicer/ops/filter/video_resolution_filter.py' 2025-03-14T11:10:49,456 INFO:wheel:adding 'data_juicer/ops/filter/video_tagging_from_frames_filter.py' 2025-03-14T11:10:49,458 INFO:wheel:adding 'data_juicer/ops/filter/video_watermark_filter.py' 2025-03-14T11:10:49,459 INFO:wheel:adding 'data_juicer/ops/filter/word_repetition_filter.py' 2025-03-14T11:10:49,461 INFO:wheel:adding 'data_juicer/ops/filter/words_num_filter.py' 2025-03-14T11:10:49,463 INFO:wheel:adding 'data_juicer/ops/grouper/__init__.py' 2025-03-14T11:10:49,464 INFO:wheel:adding 'data_juicer/ops/grouper/key_value_grouper.py' 2025-03-14T11:10:49,465 INFO:wheel:adding 'data_juicer/ops/grouper/naive_grouper.py' 2025-03-14T11:10:49,466 INFO:wheel:adding 'data_juicer/ops/grouper/naive_reverse_grouper.py' 2025-03-14T11:10:49,469 INFO:wheel:adding 'data_juicer/ops/mapper/__init__.py' 2025-03-14T11:10:49,471 INFO:wheel:adding 'data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py' 2025-03-14T11:10:49,472 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_qa_mapper.py' 2025-03-14T11:10:49,473 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_query_mapper.py' 2025-03-14T11:10:49,474 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_response_mapper.py' 2025-03-14T11:10:49,476 INFO:wheel:adding 'data_juicer/ops/mapper/chinese_convert_mapper.py' 2025-03-14T11:10:49,477 INFO:wheel:adding 'data_juicer/ops/mapper/clean_copyright_mapper.py' 2025-03-14T11:10:49,478 INFO:wheel:adding 'data_juicer/ops/mapper/clean_email_mapper.py' 2025-03-14T11:10:49,479 INFO:wheel:adding 'data_juicer/ops/mapper/clean_html_mapper.py' 2025-03-14T11:10:49,481 INFO:wheel:adding 'data_juicer/ops/mapper/clean_ip_mapper.py' 2025-03-14T11:10:49,482 INFO:wheel:adding 'data_juicer/ops/mapper/clean_links_mapper.py' 2025-03-14T11:10:49,484 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_intent_detection_mapper.py' 2025-03-14T11:10:49,486 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_sentiment_detection_mapper.py' 2025-03-14T11:10:49,487 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_sentiment_intensity_mapper.py' 2025-03-14T11:10:49,489 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_topic_detection_mapper.py' 2025-03-14T11:10:49,491 INFO:wheel:adding 'data_juicer/ops/mapper/expand_macro_mapper.py' 2025-03-14T11:10:49,492 INFO:wheel:adding 'data_juicer/ops/mapper/extract_entity_attribute_mapper.py' 2025-03-14T11:10:49,495 INFO:wheel:adding 'data_juicer/ops/mapper/extract_entity_relation_mapper.py' 2025-03-14T11:10:49,497 INFO:wheel:adding 'data_juicer/ops/mapper/extract_event_mapper.py' 2025-03-14T11:10:49,499 INFO:wheel:adding 'data_juicer/ops/mapper/extract_keyword_mapper.py' 2025-03-14T11:10:49,500 INFO:wheel:adding 'data_juicer/ops/mapper/extract_nickname_mapper.py' 2025-03-14T11:10:49,502 INFO:wheel:adding 'data_juicer/ops/mapper/extract_support_text_mapper.py' 2025-03-14T11:10:49,503 INFO:wheel:adding 'data_juicer/ops/mapper/fix_unicode_mapper.py' 2025-03-14T11:10:49,505 INFO:wheel:adding 'data_juicer/ops/mapper/generate_qa_from_examples_mapper.py' 2025-03-14T11:10:49,507 INFO:wheel:adding 'data_juicer/ops/mapper/generate_qa_from_text_mapper.py' 2025-03-14T11:10:49,508 INFO:wheel:adding 'data_juicer/ops/mapper/image_blur_mapper.py' 2025-03-14T11:10:49,510 INFO:wheel:adding 'data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py' 2025-03-14T11:10:49,512 INFO:wheel:adding 'data_juicer/ops/mapper/image_captioning_mapper.py' 2025-03-14T11:10:49,514 INFO:wheel:adding 'data_juicer/ops/mapper/image_diffusion_mapper.py' 2025-03-14T11:10:49,516 INFO:wheel:adding 'data_juicer/ops/mapper/image_face_blur_mapper.py' 2025-03-14T11:10:49,517 INFO:wheel:adding 'data_juicer/ops/mapper/image_remove_background_mapper.py' 2025-03-14T11:10:49,519 INFO:wheel:adding 'data_juicer/ops/mapper/image_segment_mapper.py' 2025-03-14T11:10:49,520 INFO:wheel:adding 'data_juicer/ops/mapper/image_tagging_mapper.py' 2025-03-14T11:10:49,521 INFO:wheel:adding 'data_juicer/ops/mapper/mllm_mapper.py' 2025-03-14T11:10:49,523 INFO:wheel:adding 'data_juicer/ops/mapper/nlpaug_en_mapper.py' 2025-03-14T11:10:49,524 INFO:wheel:adding 'data_juicer/ops/mapper/nlpcda_zh_mapper.py' 2025-03-14T11:10:49,526 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_qa_mapper.py' 2025-03-14T11:10:49,527 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_query_mapper.py' 2025-03-14T11:10:49,529 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_response_mapper.py' 2025-03-14T11:10:49,530 INFO:wheel:adding 'data_juicer/ops/mapper/pair_preference_mapper.py' 2025-03-14T11:10:49,532 INFO:wheel:adding 'data_juicer/ops/mapper/punctuation_normalization_mapper.py' 2025-03-14T11:10:49,533 INFO:wheel:adding 'data_juicer/ops/mapper/python_file_mapper.py' 2025-03-14T11:10:49,534 INFO:wheel:adding 'data_juicer/ops/mapper/python_lambda_mapper.py' 2025-03-14T11:10:49,536 INFO:wheel:adding 'data_juicer/ops/mapper/query_intent_detection_mapper.py' 2025-03-14T11:10:49,537 INFO:wheel:adding 'data_juicer/ops/mapper/query_sentiment_detection_mapper.py' 2025-03-14T11:10:49,539 INFO:wheel:adding 'data_juicer/ops/mapper/query_topic_detection_mapper.py' 2025-03-14T11:10:49,540 INFO:wheel:adding 'data_juicer/ops/mapper/relation_identity_mapper.py' 2025-03-14T11:10:49,541 INFO:wheel:adding 'data_juicer/ops/mapper/remove_bibliography_mapper.py' 2025-03-14T11:10:49,543 INFO:wheel:adding 'data_juicer/ops/mapper/remove_comments_mapper.py' 2025-03-14T11:10:49,544 INFO:wheel:adding 'data_juicer/ops/mapper/remove_header_mapper.py' 2025-03-14T11:10:49,545 INFO:wheel:adding 'data_juicer/ops/mapper/remove_long_words_mapper.py' 2025-03-14T11:10:49,546 INFO:wheel:adding 'data_juicer/ops/mapper/remove_non_chinese_character_mapper.py' 2025-03-14T11:10:49,548 INFO:wheel:adding 'data_juicer/ops/mapper/remove_repeat_sentences_mapper.py' 2025-03-14T11:10:49,549 INFO:wheel:adding 'data_juicer/ops/mapper/remove_specific_chars_mapper.py' 2025-03-14T11:10:49,550 INFO:wheel:adding 'data_juicer/ops/mapper/remove_table_text_mapper.py' 2025-03-14T11:10:49,552 INFO:wheel:adding 'data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py' 2025-03-14T11:10:49,553 INFO:wheel:adding 'data_juicer/ops/mapper/replace_content_mapper.py' 2025-03-14T11:10:49,554 INFO:wheel:adding 'data_juicer/ops/mapper/sdxl_prompt2prompt_mapper.py' 2025-03-14T11:10:49,556 INFO:wheel:adding 'data_juicer/ops/mapper/sentence_augmentation_mapper.py' 2025-03-14T11:10:49,557 INFO:wheel:adding 'data_juicer/ops/mapper/sentence_split_mapper.py' 2025-03-14T11:10:49,559 INFO:wheel:adding 'data_juicer/ops/mapper/text_chunk_mapper.py' 2025-03-14T11:10:49,560 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_audio_mapper.py' 2025-03-14T11:10:49,562 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_frames_mapper.py' 2025-03-14T11:10:49,564 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py' 2025-03-14T11:10:49,567 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_video_mapper.py' 2025-03-14T11:10:49,569 INFO:wheel:adding 'data_juicer/ops/mapper/video_extract_frames_mapper.py' 2025-03-14T11:10:49,570 INFO:wheel:adding 'data_juicer/ops/mapper/video_face_blur_mapper.py' 2025-03-14T11:10:49,572 INFO:wheel:adding 'data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py' 2025-03-14T11:10:49,574 INFO:wheel:adding 'data_juicer/ops/mapper/video_remove_watermark_mapper.py' 2025-03-14T11:10:49,575 INFO:wheel:adding 'data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py' 2025-03-14T11:10:49,577 INFO:wheel:adding 'data_juicer/ops/mapper/video_resize_resolution_mapper.py' 2025-03-14T11:10:49,579 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_duration_mapper.py' 2025-03-14T11:10:49,580 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_key_frame_mapper.py' 2025-03-14T11:10:49,582 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_scene_mapper.py' 2025-03-14T11:10:49,584 INFO:wheel:adding 'data_juicer/ops/mapper/video_tagging_from_audio_mapper.py' 2025-03-14T11:10:49,585 INFO:wheel:adding 'data_juicer/ops/mapper/video_tagging_from_frames_mapper.py' 2025-03-14T11:10:49,587 INFO:wheel:adding 'data_juicer/ops/mapper/whitespace_normalization_mapper.py' 2025-03-14T11:10:49,589 INFO:wheel:adding 'data_juicer/ops/selector/__init__.py' 2025-03-14T11:10:49,591 INFO:wheel:adding 'data_juicer/ops/selector/frequency_specified_field_selector.py' 2025-03-14T11:10:49,592 INFO:wheel:adding 'data_juicer/ops/selector/random_selector.py' 2025-03-14T11:10:49,594 INFO:wheel:adding 'data_juicer/ops/selector/range_specified_field_selector.py' 2025-03-14T11:10:49,595 INFO:wheel:adding 'data_juicer/ops/selector/tags_specified_field_selector.py' 2025-03-14T11:10:49,596 INFO:wheel:adding 'data_juicer/ops/selector/topk_specified_field_selector.py' 2025-03-14T11:10:49,598 INFO:wheel:adding 'data_juicer/tools/__init__.py' 2025-03-14T11:10:49,599 INFO:wheel:adding 'data_juicer/tools/analyze_data.py' 2025-03-14T11:10:49,600 INFO:wheel:adding 'data_juicer/tools/data_resplit.py' 2025-03-14T11:10:49,602 INFO:wheel:adding 'data_juicer/tools/dj_install.py' 2025-03-14T11:10:49,603 INFO:wheel:adding 'data_juicer/tools/process_data.py' 2025-03-14T11:10:49,604 INFO:wheel:adding 'data_juicer/tools/sandbox_starter.py' 2025-03-14T11:10:49,605 INFO:wheel:adding 'data_juicer/utils/__init__.py' 2025-03-14T11:10:49,607 INFO:wheel:adding 'data_juicer/utils/asset_utils.py' 2025-03-14T11:10:49,608 INFO:wheel:adding 'data_juicer/utils/auto_install_mapping.py' 2025-03-14T11:10:49,609 INFO:wheel:adding 'data_juicer/utils/auto_install_utils.py' 2025-03-14T11:10:49,611 INFO:wheel:adding 'data_juicer/utils/availability_utils.py' 2025-03-14T11:10:49,612 INFO:wheel:adding 'data_juicer/utils/cache_utils.py' 2025-03-14T11:10:49,613 INFO:wheel:adding 'data_juicer/utils/ckpt_utils.py' 2025-03-14T11:10:49,615 INFO:wheel:adding 'data_juicer/utils/common_utils.py' 2025-03-14T11:10:49,617 INFO:wheel:adding 'data_juicer/utils/compress.py' 2025-03-14T11:10:49,619 INFO:wheel:adding 'data_juicer/utils/constant.py' 2025-03-14T11:10:49,621 INFO:wheel:adding 'data_juicer/utils/file_utils.py' 2025-03-14T11:10:49,622 INFO:wheel:adding 'data_juicer/utils/fingerprint_utils.py' 2025-03-14T11:10:49,623 INFO:wheel:adding 'data_juicer/utils/lazy_loader.py' 2025-03-14T11:10:49,625 INFO:wheel:adding 'data_juicer/utils/logger_utils.py' 2025-03-14T11:10:49,629 INFO:wheel:adding 'data_juicer/utils/mm_utils.py' 2025-03-14T11:10:49,633 INFO:wheel:adding 'data_juicer/utils/model_utils.py' 2025-03-14T11:10:49,635 INFO:wheel:adding 'data_juicer/utils/process_utils.py' 2025-03-14T11:10:49,637 INFO:wheel:adding 'data_juicer/utils/registry.py' 2025-03-14T11:10:49,638 INFO:wheel:adding 'data_juicer/utils/resource_utils.py' 2025-03-14T11:10:49,639 INFO:wheel:adding 'data_juicer/utils/unittest_utils.py' 2025-03-14T11:10:49,644 INFO:wheel:adding 'py_data_juicer-1.2.2.dist-info/LICENSE' 2025-03-14T11:10:49,649 INFO:wheel:adding 'py_data_juicer-1.2.2.dist-info/METADATA' 2025-03-14T11:10:49,650 INFO:wheel:adding 'py_data_juicer-1.2.2.dist-info/WHEEL' 2025-03-14T11:10:49,651 INFO:wheel:adding 'py_data_juicer-1.2.2.dist-info/entry_points.txt' 2025-03-14T11:10:49,652 INFO:wheel:adding 'py_data_juicer-1.2.2.dist-info/top_level.txt' 2025-03-14T11:10:49,655 INFO:wheel:adding 'py_data_juicer-1.2.2.dist-info/RECORD' 2025-03-14T11:10:49,663 INFO:root:removing build/bdist.linux-armv7l/wheel 2025-03-14T11:10:49,812 Building wheel for py-data-juicer (setup.py): finished with status 'done' 2025-03-14T11:10:49,819 Created wheel for py-data-juicer: filename=py_data_juicer-1.2.2-py3-none-any.whl size=424382 sha256=7cb9219b41ba63aaeee2dda88f3303d1e05ed75733902a76d62bedb845406f87 2025-03-14T11:10:49,820 Stored in directory: /tmp/pip-ephem-wheel-cache-v7ziqq_i/wheels/f7/96/18/7d65c8a3655ee67b99e707ce69356da0b182f7eea4d0024a4b 2025-03-14T11:10:49,849 Successfully built py-data-juicer 2025-03-14T11:10:49,861 Removed build tracker: '/tmp/pip-build-tracker-46onb4pg'