2025-06-07T04:14:16,075 Created temporary directory: /tmp/pip-build-tracker-r7jbsrt5 2025-06-07T04:14:16,076 Initialized build tracking at /tmp/pip-build-tracker-r7jbsrt5 2025-06-07T04:14:16,077 Created build tracker: /tmp/pip-build-tracker-r7jbsrt5 2025-06-07T04:14:16,077 Entered build tracker: /tmp/pip-build-tracker-r7jbsrt5 2025-06-07T04:14:16,078 Created temporary directory: /tmp/pip-wheel-ngk0msv3 2025-06-07T04:14:16,082 Created temporary directory: /tmp/pip-ephem-wheel-cache-4s85ttgp 2025-06-07T04:14:16,130 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-06-07T04:14:16,132 2 location(s) to search for versions of py-data-juicer: 2025-06-07T04:14:16,132 * https://pypi.org/simple/py-data-juicer/ 2025-06-07T04:14:16,132 * https://www.piwheels.org/simple/py-data-juicer/ 2025-06-07T04:14:16,133 Fetching project page and analyzing links: https://pypi.org/simple/py-data-juicer/ 2025-06-07T04:14:16,134 Getting page https://pypi.org/simple/py-data-juicer/ 2025-06-07T04:14:16,136 Found index url https://pypi.org/simple/ 2025-06-07T04:14:16,356 Fetched page https://pypi.org/simple/py-data-juicer/ as application/vnd.pypi.simple.v1+json 2025-06-07T04:14:16,361 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/e3/d3/d0724d922e7c55a0664485fdf642124bdcd801df2697e29c9463c4360958/py_data_juicer-0.1.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,361 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/fd/c6/e1428310bf534319ddc2e362c6eee21985f097e70cedc0e9cd3e914de826/py_data_juicer-0.1.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,362 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/67/70/731e349d2a92bf59a767230b956665dd27ea24a7a948d4a1710154d77a24/py_data_juicer-0.1.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,362 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/66/08/f584efbdf8277a061ce73c9befc33fec813cbd08020761af2380dd331692/py_data_juicer-0.1.3-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,363 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/69/20/9862dfe7a94f10caa0e6387834d1265420613345c7adadd41a3ced7230e8/py_data_juicer-0.2.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,364 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/05/34/33fb401d350f1a66cdaefc224419f9d01484722829f5b0c71ef59a8365a4/py_data_juicer-1.0.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,364 Found link https://files.pythonhosted.org/packages/49/e9/cfb994255490c36554048e0b3956858e61f5a75ffacfde20849f31f04ef8/py_data_juicer-1.0.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.0 2025-06-07T04:14:16,365 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/27/37/150e2198f14349fdd6b647a63feaede809e21dbfc4617aba487f18049828/py_data_juicer-1.0.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,366 Found link https://files.pythonhosted.org/packages/4a/60/dadcbe4337a76d8f98022b60d142ac31073d568c9e06a5461b3014d16fc6/py_data_juicer-1.0.1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.1 2025-06-07T04:14:16,366 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/10/dd/f9cadd6ed2f19c4f94e61a3fd4bb5bb2029c20b2cf61ec86c3a05f89f74b/py_data_juicer-1.0.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,367 Found link https://files.pythonhosted.org/packages/95/8f/c0447ce091ca0b86283e8074a3cb350572a5436ca13dceb288887a0de332/py_data_juicer-1.0.2.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.2 2025-06-07T04:14:16,368 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/1f/dd/0f1804c5cfce50c52c8b60a1b710f30d893f681e42a6acc41bfd29a20059/py_data_juicer-1.0.3-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,368 Found link https://files.pythonhosted.org/packages/6e/d0/eefb1ca00cd4c8e62c0e8f62a1b5357b961ce50c5d2647107f51f68bf128/py_data_juicer-1.0.3.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.0.3 2025-06-07T04:14:16,369 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/5b/06/5df5581f724d49731b91db0b7c65fdde739358617af9e7ba9916c43f2a76/py_data_juicer-1.1.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,370 Found link https://files.pythonhosted.org/packages/69/43/f20a50fdbfc0ba44a4816d3c7f9bfcfaf55682ffebf78a10eeff6b40feeb/py_data_juicer-1.1.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.1.0 2025-06-07T04:14:16,370 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/a0/90/a95bb5b60200125b9cbb29bf1c39b706c3e5f50b247d3599386f7be973ea/py_data_juicer-1.1.0.post1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,371 Found link https://files.pythonhosted.org/packages/79/f8/3e29fb4eeeda4413bc746b0a661bc61d5786f8bf67ae9071976550fd0b41/py_data_juicer-1.1.0.post1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.1.0.post1 2025-06-07T04:14:16,371 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/9d/ca/e32ecfafde96a367dcb63a4c4ee104bc5e952205c55169fd1120df0e86ee/py_data_juicer-1.2.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,372 Found link https://files.pythonhosted.org/packages/3d/bc/607884c148a0b6bf2198960166743e95818d230e970cbcdbd69d02758541/py_data_juicer-1.2.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.2.0 2025-06-07T04:14:16,372 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/80/a2/4788daf084637e94c05615f237298e1d7fe13753f7622907ce0904a4b18c/py_data_juicer-1.2.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,373 Found link https://files.pythonhosted.org/packages/df/b6/0ca40521ecc5d3a79f8e3614af2974f4a50ae0c175fee658c8f2b091eb6b/py_data_juicer-1.2.1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.2.1 2025-06-07T04:14:16,373 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/2d/ec/75b61b05a4b19fe2e425f10b0e7f023c13d404be4ec7aa7b39ad85f18e3f/py_data_juicer-1.2.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,374 Found link https://files.pythonhosted.org/packages/8e/01/e4ad384e1c25acb029fd433f6bcc5d0c146cf729bd3801308cc681354ac1/py_data_juicer-1.2.2.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.2.2 2025-06-07T04:14:16,375 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/a6/3a/6b6ec164c0b6270a2dde6c03c449387f21e3f72d98ecc2e1bb98d7c6224f/py_data_juicer-1.3.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,375 Found link https://files.pythonhosted.org/packages/6c/56/b2fccdf35cfbc8bd34f90baa136bd86a81205f35e4ed1057503fb33a1ce8/py_data_juicer-1.3.0.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.3.0 2025-06-07T04:14:16,376 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/f7/b5/a43d80e76bc0c728fe1a380b24d5d9c4566bfc867c29191075be6cd03f1c/py_data_juicer-1.3.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,377 Found link https://files.pythonhosted.org/packages/78/dd/71fd69f0652b12c930f7cd5d72b99e36fb32a923fdae0ec393c5bf2033a8/py_data_juicer-1.3.1.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.3.1 2025-06-07T04:14:16,377 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/28/2b/f5005649d29bbff5235ada3c1465fc972fcc59816a874f04bcaf4963f58e/py_data_juicer-1.3.2-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,378 Found link https://files.pythonhosted.org/packages/b0/17/0a05201a5190476b0e9ea9483f3406769f2155da6c9ff1d99d78b783b621/py_data_juicer-1.3.2.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.3.2 2025-06-07T04:14:16,379 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/85/42/6ac1b8d0dd752bd5d4e156c1ccc6452e6f483481e1826aa923932fba7a6e/py_data_juicer-1.3.3-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) 2025-06-07T04:14:16,379 Found link https://files.pythonhosted.org/packages/22/f8/30a56cc7fd809a4892234b3cb39696013bd22e6a0ce35e52207a7951b87d/py_data_juicer-1.3.3.tar.gz (from https://pypi.org/simple/py-data-juicer/), version: 1.3.3 2025-06-07T04:14:16,380 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/44/5c/a550f1dc80743cda2513177b4d8f5a50ffdcbd320efe20078380ce2d2e0c/py_data_juicer-1.4.0-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) (requires-python:>=3.10) 2025-06-07T04:14:16,381 Found link https://files.pythonhosted.org/packages/cb/de/07edb7f56fea68160c4107b6df3e1affe79a19f6ac64b7545a070860c130/py_data_juicer-1.4.0.tar.gz (from https://pypi.org/simple/py-data-juicer/) (requires-python:>=3.10), version: 1.4.0 2025-06-07T04:14:16,382 Skipping link: No binaries permitted for py-data-juicer: https://files.pythonhosted.org/packages/ca/09/ea50d9a6dbc5d00b4979d52a8ac8da1b4fa7332567a043048ac58c4cfb3e/py_data_juicer-1.4.1-py3-none-any.whl (from https://pypi.org/simple/py-data-juicer/) (requires-python:>=3.10) 2025-06-07T04:14:16,382 Found link https://files.pythonhosted.org/packages/c5/6f/df7cee4e71b590d05b2f935fa02f4a077cd109674561818ddca24a4c0779/py_data_juicer-1.4.1.tar.gz (from https://pypi.org/simple/py-data-juicer/) (requires-python:>=3.10), version: 1.4.1 2025-06-07T04:14:16,383 Fetching project page and analyzing links: https://www.piwheels.org/simple/py-data-juicer/ 2025-06-07T04:14:16,384 Getting page https://www.piwheels.org/simple/py-data-juicer/ 2025-06-07T04:14:16,385 Found index url https://www.piwheels.org/simple/ 2025-06-07T04:14:16,539 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/py-data-juicer/ 2025-06-07T04:14:17,188 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/py-data-juicer/ 2025-06-07T04:14:18,344 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/py-data-juicer/ 2025-06-07T04:14:20,557 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/py-data-juicer/ 2025-06-07T04:14:24,769 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/py-data-juicer/ 2025-06-07T04:14:24,956 Could not fetch URL https://www.piwheels.org/simple/py-data-juicer/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/py-data-juicer/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping 2025-06-07T04:14:24,957 Skipping link: not a file: https://www.piwheels.org/simple/py-data-juicer/ 2025-06-07T04:14:24,958 Skipping link: not a file: https://pypi.org/simple/py-data-juicer/ 2025-06-07T04:14:24,978 Given no hashes to check 1 links for project 'py-data-juicer': discarding no candidates 2025-06-07T04:14:24,980 Collecting py-data-juicer==1.3.3 2025-06-07T04:14:24,982 Created temporary directory: /tmp/pip-unpack-t7n6g6m5 2025-06-07T04:14:25,202 Downloading py_data_juicer-1.3.3.tar.gz (352 kB) 2025-06-07T04:14:25,801 Added py-data-juicer==1.3.3 from https://files.pythonhosted.org/packages/22/f8/30a56cc7fd809a4892234b3cb39696013bd22e6a0ce35e52207a7951b87d/py_data_juicer-1.3.3.tar.gz to build tracker '/tmp/pip-build-tracker-r7jbsrt5' 2025-06-07T04:14:25,803 Running setup.py (path:/tmp/pip-wheel-ngk0msv3/py-data-juicer_cfc740a95cba424991d1b981921c2e71/setup.py) egg_info for package py-data-juicer 2025-06-07T04:14:25,803 Created temporary directory: /tmp/pip-pip-egg-info-2ll7io92 2025-06-07T04:14:25,804 Preparing metadata (setup.py): started 2025-06-07T04:14:25,805 Running command python setup.py egg_info 2025-06-07T04:14:26,313 WARNING:root:target file does not exist: environments/minimal_requires.txt 2025-06-07T04:14:26,313 WARNING:root:target file does not exist: environments/science_requires.txt 2025-06-07T04:14:26,313 WARNING:root:target file does not exist: environments/dist_requires.txt 2025-06-07T04:14:26,314 WARNING:root:target file does not exist: environments/dev_requires.txt 2025-06-07T04:14:26,315 WARNING:root:target file does not exist: environments/preprocess_requires.txt 2025-06-07T04:14:26,315 WARNING:root:target file does not exist: environments/quality_classifier_requires.txt 2025-06-07T04:14:26,316 WARNING:root:target file does not exist: environments/sandbox_requires.txt 2025-06-07T04:14:26,709 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-06-07T04:14:26,710 !! 2025-06-07T04:14:26,711 ******************************************************************************** 2025-06-07T04:14:26,711 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-06-07T04:14:26,712 License :: OSI Approved :: Apache Software License 2025-06-07T04:14:26,713 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-06-07T04:14:26,714 ******************************************************************************** 2025-06-07T04:14:26,715 !! 2025-06-07T04:14:26,715 self._finalize_license_expression() 2025-06-07T04:14:26,739 INFO:root:running egg_info 2025-06-07T04:14:26,769 INFO:root:creating /tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info 2025-06-07T04:14:26,770 INFO:root:writing /tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/PKG-INFO 2025-06-07T04:14:26,774 INFO:root:writing dependency_links to /tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/dependency_links.txt 2025-06-07T04:14:26,776 INFO:root:writing entry points to /tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/entry_points.txt 2025-06-07T04:14:26,778 INFO:root:writing requirements to /tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/requires.txt 2025-06-07T04:14:26,779 INFO:root:writing top-level names to /tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/top_level.txt 2025-06-07T04:14:26,780 INFO:root:writing manifest file '/tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/SOURCES.txt' 2025-06-07T04:14:26,894 INFO:root:reading manifest file '/tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/SOURCES.txt' 2025-06-07T04:14:26,896 INFO:root:adding license file 'LICENSE' 2025-06-07T04:14:26,905 INFO:root:writing manifest file '/tmp/pip-pip-egg-info-2ll7io92/py_data_juicer.egg-info/SOURCES.txt' 2025-06-07T04:14:26,995 Preparing metadata (setup.py): finished with status 'done' 2025-06-07T04:14:27,001 Source in /tmp/pip-wheel-ngk0msv3/py-data-juicer_cfc740a95cba424991d1b981921c2e71 has version 1.3.3, which satisfies requirement py-data-juicer==1.3.3 from https://files.pythonhosted.org/packages/22/f8/30a56cc7fd809a4892234b3cb39696013bd22e6a0ce35e52207a7951b87d/py_data_juicer-1.3.3.tar.gz 2025-06-07T04:14:27,002 Removed py-data-juicer==1.3.3 from https://files.pythonhosted.org/packages/22/f8/30a56cc7fd809a4892234b3cb39696013bd22e6a0ce35e52207a7951b87d/py_data_juicer-1.3.3.tar.gz from build tracker '/tmp/pip-build-tracker-r7jbsrt5' 2025-06-07T04:14:27,010 Created temporary directory: /tmp/pip-unpack-zy2ne9n1 2025-06-07T04:14:27,011 Created temporary directory: /tmp/pip-unpack-mito6lqf 2025-06-07T04:14:27,011 Building wheels for collected packages: py-data-juicer 2025-06-07T04:14:27,015 Created temporary directory: /tmp/pip-wheel-7yy9_fn1 2025-06-07T04:14:27,016 DEPRECATION: Building 'py-data-juicer' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'py-data-juicer'. Discussion can be found at https://github.com/pypa/pip/issues/6334 2025-06-07T04:14:27,017 Building wheel for py-data-juicer (setup.py): started 2025-06-07T04:14:27,018 Destination directory: /tmp/pip-wheel-7yy9_fn1 2025-06-07T04:14:27,019 Running command python setup.py bdist_wheel 2025-06-07T04:14:27,481 WARNING:root:target file does not exist: environments/minimal_requires.txt 2025-06-07T04:14:27,482 WARNING:root:target file does not exist: environments/science_requires.txt 2025-06-07T04:14:27,482 WARNING:root:target file does not exist: environments/dist_requires.txt 2025-06-07T04:14:27,483 WARNING:root:target file does not exist: environments/dev_requires.txt 2025-06-07T04:14:27,483 WARNING:root:target file does not exist: environments/preprocess_requires.txt 2025-06-07T04:14:27,484 WARNING:root:target file does not exist: environments/quality_classifier_requires.txt 2025-06-07T04:14:27,484 WARNING:root:target file does not exist: environments/sandbox_requires.txt 2025-06-07T04:14:27,851 /usr/local/lib/python3.11/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. 2025-06-07T04:14:27,852 !! 2025-06-07T04:14:27,853 ******************************************************************************** 2025-06-07T04:14:27,853 Please consider removing the following classifiers in favor of a SPDX license expression: 2025-06-07T04:14:27,854 License :: OSI Approved :: Apache Software License 2025-06-07T04:14:27,855 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2025-06-07T04:14:27,856 ******************************************************************************** 2025-06-07T04:14:27,857 !! 2025-06-07T04:14:27,857 self._finalize_license_expression() 2025-06-07T04:14:27,858 INFO:root:running bdist_wheel 2025-06-07T04:14:27,986 INFO:root:running build 2025-06-07T04:14:27,987 INFO:root:running build_py 2025-06-07T04:14:28,016 INFO:root:creating build/lib/data_juicer 2025-06-07T04:14:28,018 INFO:root:copying data_juicer/__init__.py -> build/lib/data_juicer 2025-06-07T04:14:28,021 INFO:root:creating build/lib/data_juicer/ops 2025-06-07T04:14:28,022 INFO:root:copying data_juicer/ops/mixins.py -> build/lib/data_juicer/ops 2025-06-07T04:14:28,024 INFO:root:copying data_juicer/ops/load.py -> build/lib/data_juicer/ops 2025-06-07T04:14:28,026 INFO:root:copying data_juicer/ops/op_fusion.py -> build/lib/data_juicer/ops 2025-06-07T04:14:28,029 INFO:root:copying data_juicer/ops/__init__.py -> build/lib/data_juicer/ops 2025-06-07T04:14:28,031 INFO:root:copying data_juicer/ops/base_op.py -> build/lib/data_juicer/ops 2025-06-07T04:14:28,034 INFO:root:creating build/lib/data_juicer/core 2025-06-07T04:14:28,035 INFO:root:copying data_juicer/core/analyzer.py -> build/lib/data_juicer/core 2025-06-07T04:14:28,037 INFO:root:copying data_juicer/core/exporter.py -> build/lib/data_juicer/core 2025-06-07T04:14:28,040 INFO:root:copying data_juicer/core/__init__.py -> build/lib/data_juicer/core 2025-06-07T04:14:28,041 INFO:root:copying data_juicer/core/tracer.py -> build/lib/data_juicer/core 2025-06-07T04:14:28,044 INFO:root:copying data_juicer/core/monitor.py -> build/lib/data_juicer/core 2025-06-07T04:14:28,046 INFO:root:copying data_juicer/core/adapter.py -> build/lib/data_juicer/core 2025-06-07T04:14:28,049 INFO:root:creating build/lib/data_juicer/config 2025-06-07T04:14:28,050 INFO:root:copying data_juicer/config/config.py -> build/lib/data_juicer/config 2025-06-07T04:14:28,053 INFO:root:copying data_juicer/config/__init__.py -> build/lib/data_juicer/config 2025-06-07T04:14:28,055 INFO:root:creating build/lib/data_juicer/analysis 2025-06-07T04:14:28,056 INFO:root:copying data_juicer/analysis/measure.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,058 INFO:root:copying data_juicer/analysis/collector.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,060 INFO:root:copying data_juicer/analysis/__init__.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,062 INFO:root:copying data_juicer/analysis/overall_analysis.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,063 INFO:root:copying data_juicer/analysis/draw.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,065 INFO:root:copying data_juicer/analysis/column_wise_analysis.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,068 INFO:root:copying data_juicer/analysis/diversity_analysis.py -> build/lib/data_juicer/analysis 2025-06-07T04:14:28,071 INFO:root:creating build/lib/data_juicer/utils 2025-06-07T04:14:28,072 INFO:root:copying data_juicer/utils/resource_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,074 INFO:root:copying data_juicer/utils/auto_install_mapping.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,076 INFO:root:copying data_juicer/utils/ckpt_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,078 INFO:root:copying data_juicer/utils/lazy_loader.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,080 INFO:root:copying data_juicer/utils/compress.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,082 INFO:root:copying data_juicer/utils/constant.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,084 INFO:root:copying data_juicer/utils/process_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,086 INFO:root:copying data_juicer/utils/file_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,089 INFO:root:copying data_juicer/utils/__init__.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,090 INFO:root:copying data_juicer/utils/mm_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,093 INFO:root:copying data_juicer/utils/unittest_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,095 INFO:root:copying data_juicer/utils/model_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,098 INFO:root:copying data_juicer/utils/availability_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,100 INFO:root:copying data_juicer/utils/nltk_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,102 INFO:root:copying data_juicer/utils/auto_install_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,104 INFO:root:copying data_juicer/utils/asset_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,106 INFO:root:copying data_juicer/utils/logger_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,108 INFO:root:copying data_juicer/utils/cache_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,110 INFO:root:copying data_juicer/utils/sample.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,112 INFO:root:copying data_juicer/utils/registry.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,114 INFO:root:copying data_juicer/utils/common_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,116 INFO:root:copying data_juicer/utils/fingerprint_utils.py -> build/lib/data_juicer/utils 2025-06-07T04:14:28,118 INFO:root:creating build/lib/data_juicer/format 2025-06-07T04:14:28,119 INFO:root:copying data_juicer/format/load.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,121 INFO:root:copying data_juicer/format/text_formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,123 INFO:root:copying data_juicer/format/__init__.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,125 INFO:root:copying data_juicer/format/empty_formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,127 INFO:root:copying data_juicer/format/formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,129 INFO:root:copying data_juicer/format/json_formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,131 INFO:root:copying data_juicer/format/csv_formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,132 INFO:root:copying data_juicer/format/tsv_formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,134 INFO:root:copying data_juicer/format/parquet_formatter.py -> build/lib/data_juicer/format 2025-06-07T04:14:28,136 INFO:root:creating build/lib/data_juicer/download 2025-06-07T04:14:28,137 INFO:root:copying data_juicer/download/arxiv.py -> build/lib/data_juicer/download 2025-06-07T04:14:28,140 INFO:root:copying data_juicer/download/downloader.py -> build/lib/data_juicer/download 2025-06-07T04:14:28,142 INFO:root:copying data_juicer/download/wikipedia.py -> build/lib/data_juicer/download 2025-06-07T04:14:28,145 INFO:root:copying data_juicer/download/commoncrawl.py -> build/lib/data_juicer/download 2025-06-07T04:14:28,146 INFO:root:copying data_juicer/download/__init__.py -> build/lib/data_juicer/download 2025-06-07T04:14:28,148 INFO:root:creating build/lib/data_juicer/ops/common 2025-06-07T04:14:28,149 INFO:root:copying data_juicer/ops/common/special_characters.py -> build/lib/data_juicer/ops/common 2025-06-07T04:14:28,151 INFO:root:copying data_juicer/ops/common/__init__.py -> build/lib/data_juicer/ops/common 2025-06-07T04:14:28,153 INFO:root:copying data_juicer/ops/common/helper_func.py -> build/lib/data_juicer/ops/common 2025-06-07T04:14:28,155 INFO:root:copying data_juicer/ops/common/prompt2prompt_pipeline.py -> build/lib/data_juicer/ops/common 2025-06-07T04:14:28,159 INFO:root:creating build/lib/data_juicer/ops/grouper 2025-06-07T04:14:28,160 INFO:root:copying data_juicer/ops/grouper/naive_reverse_grouper.py -> build/lib/data_juicer/ops/grouper 2025-06-07T04:14:28,162 INFO:root:copying data_juicer/ops/grouper/key_value_grouper.py -> build/lib/data_juicer/ops/grouper 2025-06-07T04:14:28,164 INFO:root:copying data_juicer/ops/grouper/naive_grouper.py -> build/lib/data_juicer/ops/grouper 2025-06-07T04:14:28,166 INFO:root:copying data_juicer/ops/grouper/__init__.py -> build/lib/data_juicer/ops/grouper 2025-06-07T04:14:28,168 INFO:root:creating build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,169 INFO:root:copying data_juicer/ops/deduplicator/image_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,172 INFO:root:copying data_juicer/ops/deduplicator/document_minhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,174 INFO:root:copying data_juicer/ops/deduplicator/ray_video_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,176 INFO:root:copying data_juicer/ops/deduplicator/__init__.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,178 INFO:root:copying data_juicer/ops/deduplicator/document_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,180 INFO:root:copying data_juicer/ops/deduplicator/ray_bts_minhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,183 INFO:root:copying data_juicer/ops/deduplicator/ray_basic_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,185 INFO:root:copying data_juicer/ops/deduplicator/ray_image_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,187 INFO:root:copying data_juicer/ops/deduplicator/ray_document_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,188 INFO:root:copying data_juicer/ops/deduplicator/document_simhash_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,190 INFO:root:copying data_juicer/ops/deduplicator/video_deduplicator.py -> build/lib/data_juicer/ops/deduplicator 2025-06-07T04:14:28,195 INFO:root:creating build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,196 INFO:root:copying data_juicer/ops/mapper/dialog_topic_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,198 INFO:root:copying data_juicer/ops/mapper/remove_bibliography_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,200 INFO:root:copying data_juicer/ops/mapper/text_chunk_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,202 INFO:root:copying data_juicer/ops/mapper/expand_macro_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,204 INFO:root:copying data_juicer/ops/mapper/remove_table_text_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,206 INFO:root:copying data_juicer/ops/mapper/clean_html_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,207 INFO:root:copying data_juicer/ops/mapper/calibrate_response_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,209 INFO:root:copying data_juicer/ops/mapper/dialog_intent_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,211 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_video_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,214 INFO:root:copying data_juicer/ops/mapper/replace_content_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,216 INFO:root:copying data_juicer/ops/mapper/remove_header_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,217 INFO:root:copying data_juicer/ops/mapper/dialog_sentiment_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,220 INFO:root:copying data_juicer/ops/mapper/extract_entity_attribute_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,222 INFO:root:copying data_juicer/ops/mapper/optimize_qa_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,224 INFO:root:copying data_juicer/ops/mapper/video_split_by_scene_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,226 INFO:root:copying data_juicer/ops/mapper/chinese_convert_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,228 INFO:root:copying data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,230 INFO:root:copying data_juicer/ops/mapper/dialog_sentiment_intensity_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,232 INFO:root:copying data_juicer/ops/mapper/remove_comments_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,234 INFO:root:copying data_juicer/ops/mapper/nlpcda_zh_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,236 INFO:root:copying data_juicer/ops/mapper/clean_ip_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,238 INFO:root:copying data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,240 INFO:root:copying data_juicer/ops/mapper/image_remove_background_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,242 INFO:root:copying data_juicer/ops/mapper/clean_email_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,244 INFO:root:copying data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,246 INFO:root:copying data_juicer/ops/mapper/calibrate_qa_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,248 INFO:root:copying data_juicer/ops/mapper/generate_qa_from_examples_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,251 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_audio_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,253 INFO:root:copying data_juicer/ops/mapper/__init__.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,255 INFO:root:copying data_juicer/ops/mapper/sentence_split_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,257 INFO:root:copying data_juicer/ops/mapper/query_topic_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,259 INFO:root:copying data_juicer/ops/mapper/imgdiff_difference_caption_generator_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,261 INFO:root:copying data_juicer/ops/mapper/pair_preference_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,263 INFO:root:copying data_juicer/ops/mapper/query_intent_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,265 INFO:root:copying data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,267 INFO:root:copying data_juicer/ops/mapper/video_split_by_duration_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,269 INFO:root:copying data_juicer/ops/mapper/whitespace_normalization_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,271 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,274 INFO:root:copying data_juicer/ops/mapper/video_remove_watermark_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,276 INFO:root:copying data_juicer/ops/mapper/punctuation_normalization_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,278 INFO:root:copying data_juicer/ops/mapper/nlpaug_en_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,280 INFO:root:copying data_juicer/ops/mapper/video_tagging_from_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,282 INFO:root:copying data_juicer/ops/mapper/python_file_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,284 INFO:root:copying data_juicer/ops/mapper/mllm_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,286 INFO:root:copying data_juicer/ops/mapper/clean_copyright_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,288 INFO:root:copying data_juicer/ops/mapper/imgdiff_difference_area_generator_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,290 INFO:root:copying data_juicer/ops/mapper/remove_non_chinese_character_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,292 INFO:root:copying data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,294 INFO:root:copying data_juicer/ops/mapper/audio_add_gaussian_noise_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,296 INFO:root:copying data_juicer/ops/mapper/video_split_by_key_frame_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,298 INFO:root:copying data_juicer/ops/mapper/fix_unicode_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,300 INFO:root:copying data_juicer/ops/mapper/video_tagging_from_audio_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,302 INFO:root:copying data_juicer/ops/mapper/video_resize_resolution_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,304 INFO:root:copying data_juicer/ops/mapper/extract_nickname_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,306 INFO:root:copying data_juicer/ops/mapper/sdxl_prompt2prompt_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,308 INFO:root:copying data_juicer/ops/mapper/remove_long_words_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,310 INFO:root:copying data_juicer/ops/mapper/image_segment_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,312 INFO:root:copying data_juicer/ops/mapper/remove_repeat_sentences_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,314 INFO:root:copying data_juicer/ops/mapper/image_captioning_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,316 INFO:root:copying data_juicer/ops/mapper/video_extract_frames_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,318 INFO:root:copying data_juicer/ops/mapper/image_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,320 INFO:root:copying data_juicer/ops/mapper/sentence_augmentation_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,322 INFO:root:copying data_juicer/ops/mapper/relation_identity_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,324 INFO:root:copying data_juicer/ops/mapper/image_tagging_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,326 INFO:root:copying data_juicer/ops/mapper/extract_tables_from_html_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,328 INFO:root:copying data_juicer/ops/mapper/image_diffusion_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,330 INFO:root:copying data_juicer/ops/mapper/video_face_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,332 INFO:root:copying data_juicer/ops/mapper/extract_event_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,334 INFO:root:copying data_juicer/ops/mapper/optimize_query_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,336 INFO:root:copying data_juicer/ops/mapper/clean_links_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,338 INFO:root:copying data_juicer/ops/mapper/python_lambda_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,340 INFO:root:copying data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,342 INFO:root:copying data_juicer/ops/mapper/remove_specific_chars_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,344 INFO:root:copying data_juicer/ops/mapper/extract_keyword_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,346 INFO:root:copying data_juicer/ops/mapper/generate_qa_from_text_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,349 INFO:root:copying data_juicer/ops/mapper/calibrate_query_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,350 INFO:root:copying data_juicer/ops/mapper/extract_support_text_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,353 INFO:root:copying data_juicer/ops/mapper/optimize_response_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,354 INFO:root:copying data_juicer/ops/mapper/query_sentiment_detection_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,356 INFO:root:copying data_juicer/ops/mapper/extract_entity_relation_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,359 INFO:root:copying data_juicer/ops/mapper/image_face_blur_mapper.py -> build/lib/data_juicer/ops/mapper 2025-06-07T04:14:28,362 INFO:root:creating build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,363 INFO:root:copying data_juicer/ops/selector/__init__.py -> build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,365 INFO:root:copying data_juicer/ops/selector/range_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,367 INFO:root:copying data_juicer/ops/selector/random_selector.py -> build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,369 INFO:root:copying data_juicer/ops/selector/topk_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,371 INFO:root:copying data_juicer/ops/selector/tags_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,373 INFO:root:copying data_juicer/ops/selector/frequency_specified_field_selector.py -> build/lib/data_juicer/ops/selector 2025-06-07T04:14:28,375 INFO:root:creating build/lib/data_juicer/ops/aggregator 2025-06-07T04:14:28,376 INFO:root:copying data_juicer/ops/aggregator/__init__.py -> build/lib/data_juicer/ops/aggregator 2025-06-07T04:14:28,378 INFO:root:copying data_juicer/ops/aggregator/entity_attribute_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-06-07T04:14:28,380 INFO:root:copying data_juicer/ops/aggregator/most_relevant_entities_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-06-07T04:14:28,382 INFO:root:copying data_juicer/ops/aggregator/meta_tags_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-06-07T04:14:28,385 INFO:root:copying data_juicer/ops/aggregator/nested_aggregator.py -> build/lib/data_juicer/ops/aggregator 2025-06-07T04:14:28,388 INFO:root:creating build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,389 INFO:root:copying data_juicer/ops/filter/audio_duration_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,391 INFO:root:copying data_juicer/ops/filter/language_id_score_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,393 INFO:root:copying data_juicer/ops/filter/video_aspect_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,395 INFO:root:copying data_juicer/ops/filter/maximum_line_length_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,397 INFO:root:copying data_juicer/ops/filter/video_ocr_area_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,399 INFO:root:copying data_juicer/ops/filter/word_repetition_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,401 INFO:root:copying data_juicer/ops/filter/stopwords_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,403 INFO:root:copying data_juicer/ops/filter/text_action_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,405 INFO:root:copying data_juicer/ops/filter/llm_difficulty_score_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,407 INFO:root:copying data_juicer/ops/filter/special_characters_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,409 INFO:root:copying data_juicer/ops/filter/suffix_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,411 INFO:root:copying data_juicer/ops/filter/token_num_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,413 INFO:root:copying data_juicer/ops/filter/image_nsfw_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,415 INFO:root:copying data_juicer/ops/filter/text_pair_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,417 INFO:root:copying data_juicer/ops/filter/__init__.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,419 INFO:root:copying data_juicer/ops/filter/video_tagging_from_frames_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,421 INFO:root:copying data_juicer/ops/filter/character_repetition_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,423 INFO:root:copying data_juicer/ops/filter/audio_nmf_snr_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,425 INFO:root:copying data_juicer/ops/filter/video_aesthetics_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,427 INFO:root:copying data_juicer/ops/filter/image_text_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,429 INFO:root:copying data_juicer/ops/filter/specified_numeric_field_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,431 INFO:root:copying data_juicer/ops/filter/image_text_matching_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,433 INFO:root:copying data_juicer/ops/filter/image_shape_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,435 INFO:root:copying data_juicer/ops/filter/video_nsfw_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,437 INFO:root:copying data_juicer/ops/filter/image_face_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,440 INFO:root:copying data_juicer/ops/filter/image_face_count_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,442 INFO:root:copying data_juicer/ops/filter/specified_field_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,443 INFO:root:copying data_juicer/ops/filter/audio_size_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,445 INFO:root:copying data_juicer/ops/filter/phrase_grounding_recall_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,447 INFO:root:copying data_juicer/ops/filter/image_aesthetics_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,450 INFO:root:copying data_juicer/ops/filter/video_motion_score_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,452 INFO:root:copying data_juicer/ops/filter/words_num_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,454 INFO:root:copying data_juicer/ops/filter/video_watermark_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,456 INFO:root:copying data_juicer/ops/filter/image_aspect_ratio_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,458 INFO:root:copying data_juicer/ops/filter/llm_quality_score_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,460 INFO:root:copying data_juicer/ops/filter/video_resolution_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,462 INFO:root:copying data_juicer/ops/filter/video_duration_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,463 INFO:root:copying data_juicer/ops/filter/video_frames_text_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,466 INFO:root:copying data_juicer/ops/filter/perplexity_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,468 INFO:root:copying data_juicer/ops/filter/alphanumeric_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,469 INFO:root:copying data_juicer/ops/filter/image_watermark_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,471 INFO:root:copying data_juicer/ops/filter/image_size_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,473 INFO:root:copying data_juicer/ops/filter/text_entity_dependency_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,475 INFO:root:copying data_juicer/ops/filter/video_motion_score_raft_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,477 INFO:root:copying data_juicer/ops/filter/image_pair_similarity_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,479 INFO:root:copying data_juicer/ops/filter/average_line_length_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,481 INFO:root:copying data_juicer/ops/filter/flagged_words_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,483 INFO:root:copying data_juicer/ops/filter/text_length_filter.py -> build/lib/data_juicer/ops/filter 2025-06-07T04:14:28,485 INFO:root:creating build/lib/data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,486 INFO:root:copying data_juicer/ops/mapper/annotation/__init__.py -> build/lib/data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,488 INFO:root:copying data_juicer/ops/mapper/annotation/human_preference_annotation_mapper.py -> build/lib/data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,490 INFO:root:copying data_juicer/ops/mapper/annotation/annotation_mapper.py -> build/lib/data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,493 INFO:root:creating build/lib/data_juicer/core/executor 2025-06-07T04:14:28,494 INFO:root:copying data_juicer/core/executor/base.py -> build/lib/data_juicer/core/executor 2025-06-07T04:14:28,496 INFO:root:copying data_juicer/core/executor/factory.py -> build/lib/data_juicer/core/executor 2025-06-07T04:14:28,498 INFO:root:copying data_juicer/core/executor/__init__.py -> build/lib/data_juicer/core/executor 2025-06-07T04:14:28,500 INFO:root:copying data_juicer/core/executor/ray_executor.py -> build/lib/data_juicer/core/executor 2025-06-07T04:14:28,502 INFO:root:copying data_juicer/core/executor/default_executor.py -> build/lib/data_juicer/core/executor 2025-06-07T04:14:28,504 INFO:root:creating build/lib/data_juicer/core/data 2025-06-07T04:14:28,505 INFO:root:copying data_juicer/core/data/load_strategy.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,507 INFO:root:copying data_juicer/core/data/__init__.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,509 INFO:root:copying data_juicer/core/data/dj_dataset.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,512 INFO:root:copying data_juicer/core/data/schema.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,513 INFO:root:copying data_juicer/core/data/data_validator.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,516 INFO:root:copying data_juicer/core/data/ray_dataset.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,518 INFO:root:copying data_juicer/core/data/config_validator.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,520 INFO:root:copying data_juicer/core/data/dataset_builder.py -> build/lib/data_juicer/core/data 2025-06-07T04:14:28,523 INFO:root:creating build/lib/data_juicer/tools 2025-06-07T04:14:28,524 INFO:root:copying tools/__init__.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,525 INFO:root:copying tools/sandbox_starter.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,527 INFO:root:copying tools/data_resplit.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,529 INFO:root:copying tools/process_data.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,531 INFO:root:copying tools/analyze_data.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,533 INFO:root:copying tools/generate_smtp_cert.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,535 INFO:root:copying tools/dj_install.py -> build/lib/data_juicer/tools 2025-06-07T04:14:28,585 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-06-07T04:14:28,586 !! 2025-06-07T04:14:28,588 ******************************************************************************** 2025-06-07T04:14:28,589 Please avoid running ``setup.py`` directly. 2025-06-07T04:14:28,590 Instead, use pypa/build, pypa/installer or other 2025-06-07T04:14:28,591 standards-based tools. 2025-06-07T04:14:28,593 By 2025-Oct-31, you need to update your project and remove deprecated calls 2025-06-07T04:14:28,594 or your builds will no longer be supported. 2025-06-07T04:14:28,595 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-06-07T04:14:28,595 ******************************************************************************** 2025-06-07T04:14:28,596 !! 2025-06-07T04:14:28,597 self.initialize_options() 2025-06-07T04:14:28,617 INFO:root:installing to build/bdist.linux-armv7l/wheel 2025-06-07T04:14:28,617 INFO:root:running install 2025-06-07T04:14:28,642 INFO:root:running install_lib 2025-06-07T04:14:28,669 INFO:root:creating build/bdist.linux-armv7l/wheel 2025-06-07T04:14:28,672 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer 2025-06-07T04:14:28,674 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops 2025-06-07T04:14:28,675 INFO:root:copying build/lib/data_juicer/ops/mixins.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-06-07T04:14:28,679 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/common 2025-06-07T04:14:28,680 INFO:root:copying build/lib/data_juicer/ops/common/special_characters.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-06-07T04:14:28,682 INFO:root:copying build/lib/data_juicer/ops/common/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-06-07T04:14:28,684 INFO:root:copying build/lib/data_juicer/ops/common/helper_func.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-06-07T04:14:28,687 INFO:root:copying build/lib/data_juicer/ops/common/prompt2prompt_pipeline.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/common 2025-06-07T04:14:28,691 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/grouper 2025-06-07T04:14:28,692 INFO:root:copying build/lib/data_juicer/ops/grouper/naive_reverse_grouper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-06-07T04:14:28,694 INFO:root:copying build/lib/data_juicer/ops/grouper/key_value_grouper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-06-07T04:14:28,696 INFO:root:copying build/lib/data_juicer/ops/grouper/naive_grouper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-06-07T04:14:28,698 INFO:root:copying build/lib/data_juicer/ops/grouper/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/grouper 2025-06-07T04:14:28,700 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/deduplicator 2025-06-07T04:14:28,702 INFO:root:copying build/lib/data_juicer/ops/deduplicator/image_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,704 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_minhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,707 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_video_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,709 INFO:root:copying build/lib/data_juicer/ops/deduplicator/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,711 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,713 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_bts_minhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,716 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_basic_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,718 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_image_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,720 INFO:root:copying build/lib/data_juicer/ops/deduplicator/ray_document_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,722 INFO:root:copying build/lib/data_juicer/ops/deduplicator/document_simhash_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,725 INFO:root:copying build/lib/data_juicer/ops/deduplicator/video_deduplicator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/deduplicator 2025-06-07T04:14:28,729 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/mapper 2025-06-07T04:14:28,730 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_topic_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,733 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_bibliography_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,735 INFO:root:copying build/lib/data_juicer/ops/mapper/text_chunk_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,737 INFO:root:copying build/lib/data_juicer/ops/mapper/expand_macro_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,740 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_table_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,742 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_html_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,744 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_response_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,746 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_intent_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,749 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_video_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,752 INFO:root:copying build/lib/data_juicer/ops/mapper/replace_content_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,754 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_header_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,756 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_sentiment_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,758 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_entity_attribute_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,761 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_qa_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,764 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_scene_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,766 INFO:root:copying build/lib/data_juicer/ops/mapper/chinese_convert_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,768 INFO:root:copying build/lib/data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,770 INFO:root:copying build/lib/data_juicer/ops/mapper/dialog_sentiment_intensity_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,772 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_comments_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,774 INFO:root:copying build/lib/data_juicer/ops/mapper/nlpcda_zh_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,777 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_ip_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,779 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,781 INFO:root:copying build/lib/data_juicer/ops/mapper/image_remove_background_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,784 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_email_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,786 INFO:root:copying build/lib/data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,788 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_qa_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,791 INFO:root:copying build/lib/data_juicer/ops/mapper/generate_qa_from_examples_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,793 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_audio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,796 INFO:root:copying build/lib/data_juicer/ops/mapper/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,798 INFO:root:copying build/lib/data_juicer/ops/mapper/sentence_split_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,800 INFO:root:copying build/lib/data_juicer/ops/mapper/query_topic_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,802 INFO:root:copying build/lib/data_juicer/ops/mapper/imgdiff_difference_caption_generator_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,805 INFO:root:copying build/lib/data_juicer/ops/mapper/pair_preference_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,807 INFO:root:copying build/lib/data_juicer/ops/mapper/query_intent_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,810 INFO:root:copying build/lib/data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,812 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_duration_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,814 INFO:root:copying build/lib/data_juicer/ops/mapper/whitespace_normalization_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,816 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,819 INFO:root:copying build/lib/data_juicer/ops/mapper/video_remove_watermark_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,822 INFO:root:copying build/lib/data_juicer/ops/mapper/punctuation_normalization_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,824 INFO:root:copying build/lib/data_juicer/ops/mapper/nlpaug_en_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,826 INFO:root:copying build/lib/data_juicer/ops/mapper/video_tagging_from_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,829 INFO:root:copying build/lib/data_juicer/ops/mapper/python_file_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,831 INFO:root:copying build/lib/data_juicer/ops/mapper/mllm_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,833 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_copyright_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,835 INFO:root:copying build/lib/data_juicer/ops/mapper/imgdiff_difference_area_generator_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,838 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_non_chinese_character_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,840 INFO:root:copying build/lib/data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,842 INFO:root:copying build/lib/data_juicer/ops/mapper/audio_add_gaussian_noise_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,844 INFO:root:copying build/lib/data_juicer/ops/mapper/video_split_by_key_frame_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,846 INFO:root:copying build/lib/data_juicer/ops/mapper/fix_unicode_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,848 INFO:root:copying build/lib/data_juicer/ops/mapper/video_tagging_from_audio_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,850 INFO:root:copying build/lib/data_juicer/ops/mapper/video_resize_resolution_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,852 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_nickname_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,854 INFO:root:copying build/lib/data_juicer/ops/mapper/sdxl_prompt2prompt_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,856 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_long_words_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,858 INFO:root:copying build/lib/data_juicer/ops/mapper/image_segment_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,860 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_repeat_sentences_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,862 INFO:root:copying build/lib/data_juicer/ops/mapper/image_captioning_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,865 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,865 INFO:root:copying build/lib/data_juicer/ops/mapper/annotation/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,867 INFO:root:copying build/lib/data_juicer/ops/mapper/annotation/human_preference_annotation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,869 INFO:root:copying build/lib/data_juicer/ops/mapper/annotation/annotation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper/annotation 2025-06-07T04:14:28,872 INFO:root:copying build/lib/data_juicer/ops/mapper/video_extract_frames_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,874 INFO:root:copying build/lib/data_juicer/ops/mapper/image_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,876 INFO:root:copying build/lib/data_juicer/ops/mapper/sentence_augmentation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,878 INFO:root:copying build/lib/data_juicer/ops/mapper/relation_identity_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,880 INFO:root:copying build/lib/data_juicer/ops/mapper/image_tagging_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,882 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_tables_from_html_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,884 INFO:root:copying build/lib/data_juicer/ops/mapper/image_diffusion_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,886 INFO:root:copying build/lib/data_juicer/ops/mapper/video_face_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,888 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_event_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,891 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_query_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,892 INFO:root:copying build/lib/data_juicer/ops/mapper/clean_links_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,894 INFO:root:copying build/lib/data_juicer/ops/mapper/python_lambda_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,896 INFO:root:copying build/lib/data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,898 INFO:root:copying build/lib/data_juicer/ops/mapper/remove_specific_chars_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,900 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_keyword_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,902 INFO:root:copying build/lib/data_juicer/ops/mapper/generate_qa_from_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,904 INFO:root:copying build/lib/data_juicer/ops/mapper/calibrate_query_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,906 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_support_text_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,908 INFO:root:copying build/lib/data_juicer/ops/mapper/optimize_response_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,910 INFO:root:copying build/lib/data_juicer/ops/mapper/query_sentiment_detection_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,912 INFO:root:copying build/lib/data_juicer/ops/mapper/extract_entity_relation_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,914 INFO:root:copying build/lib/data_juicer/ops/mapper/image_face_blur_mapper.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/mapper 2025-06-07T04:14:28,916 INFO:root:copying build/lib/data_juicer/ops/load.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-06-07T04:14:28,918 INFO:root:copying build/lib/data_juicer/ops/op_fusion.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-06-07T04:14:28,920 INFO:root:copying build/lib/data_juicer/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-06-07T04:14:28,923 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/selector 2025-06-07T04:14:28,924 INFO:root:copying build/lib/data_juicer/ops/selector/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-06-07T04:14:28,925 INFO:root:copying build/lib/data_juicer/ops/selector/range_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-06-07T04:14:28,928 INFO:root:copying build/lib/data_juicer/ops/selector/random_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-06-07T04:14:28,930 INFO:root:copying build/lib/data_juicer/ops/selector/topk_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-06-07T04:14:28,931 INFO:root:copying build/lib/data_juicer/ops/selector/tags_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-06-07T04:14:28,933 INFO:root:copying build/lib/data_juicer/ops/selector/frequency_specified_field_selector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/selector 2025-06-07T04:14:28,935 INFO:root:copying build/lib/data_juicer/ops/base_op.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops 2025-06-07T04:14:28,938 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/aggregator 2025-06-07T04:14:28,939 INFO:root:copying build/lib/data_juicer/ops/aggregator/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-06-07T04:14:28,941 INFO:root:copying build/lib/data_juicer/ops/aggregator/entity_attribute_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-06-07T04:14:28,943 INFO:root:copying build/lib/data_juicer/ops/aggregator/most_relevant_entities_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-06-07T04:14:28,945 INFO:root:copying build/lib/data_juicer/ops/aggregator/meta_tags_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-06-07T04:14:28,948 INFO:root:copying build/lib/data_juicer/ops/aggregator/nested_aggregator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/aggregator 2025-06-07T04:14:28,951 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/ops/filter 2025-06-07T04:14:28,952 INFO:root:copying build/lib/data_juicer/ops/filter/audio_duration_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,954 INFO:root:copying build/lib/data_juicer/ops/filter/language_id_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,956 INFO:root:copying build/lib/data_juicer/ops/filter/video_aspect_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,958 INFO:root:copying build/lib/data_juicer/ops/filter/maximum_line_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,960 INFO:root:copying build/lib/data_juicer/ops/filter/video_ocr_area_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,962 INFO:root:copying build/lib/data_juicer/ops/filter/word_repetition_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,964 INFO:root:copying build/lib/data_juicer/ops/filter/stopwords_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,966 INFO:root:copying build/lib/data_juicer/ops/filter/text_action_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,968 INFO:root:copying build/lib/data_juicer/ops/filter/llm_difficulty_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,970 INFO:root:copying build/lib/data_juicer/ops/filter/special_characters_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,972 INFO:root:copying build/lib/data_juicer/ops/filter/suffix_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,974 INFO:root:copying build/lib/data_juicer/ops/filter/token_num_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,975 INFO:root:copying build/lib/data_juicer/ops/filter/image_nsfw_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,977 INFO:root:copying build/lib/data_juicer/ops/filter/text_pair_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,979 INFO:root:copying build/lib/data_juicer/ops/filter/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,981 INFO:root:copying build/lib/data_juicer/ops/filter/video_tagging_from_frames_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,983 INFO:root:copying build/lib/data_juicer/ops/filter/character_repetition_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,985 INFO:root:copying build/lib/data_juicer/ops/filter/audio_nmf_snr_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,987 INFO:root:copying build/lib/data_juicer/ops/filter/video_aesthetics_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,989 INFO:root:copying build/lib/data_juicer/ops/filter/image_text_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,992 INFO:root:copying build/lib/data_juicer/ops/filter/specified_numeric_field_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,994 INFO:root:copying build/lib/data_juicer/ops/filter/image_text_matching_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,996 INFO:root:copying build/lib/data_juicer/ops/filter/image_shape_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:28,998 INFO:root:copying build/lib/data_juicer/ops/filter/video_nsfw_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,000 INFO:root:copying build/lib/data_juicer/ops/filter/image_face_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,002 INFO:root:copying build/lib/data_juicer/ops/filter/image_face_count_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,004 INFO:root:copying build/lib/data_juicer/ops/filter/specified_field_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,006 INFO:root:copying build/lib/data_juicer/ops/filter/audio_size_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,008 INFO:root:copying build/lib/data_juicer/ops/filter/phrase_grounding_recall_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,011 INFO:root:copying build/lib/data_juicer/ops/filter/image_aesthetics_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,013 INFO:root:copying build/lib/data_juicer/ops/filter/video_motion_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,015 INFO:root:copying build/lib/data_juicer/ops/filter/words_num_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,017 INFO:root:copying build/lib/data_juicer/ops/filter/video_watermark_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,019 INFO:root:copying build/lib/data_juicer/ops/filter/image_aspect_ratio_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,021 INFO:root:copying build/lib/data_juicer/ops/filter/llm_quality_score_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,023 INFO:root:copying build/lib/data_juicer/ops/filter/video_resolution_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,025 INFO:root:copying build/lib/data_juicer/ops/filter/video_duration_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,027 INFO:root:copying build/lib/data_juicer/ops/filter/video_frames_text_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,029 INFO:root:copying build/lib/data_juicer/ops/filter/perplexity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,031 INFO:root:copying build/lib/data_juicer/ops/filter/alphanumeric_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,033 INFO:root:copying build/lib/data_juicer/ops/filter/image_watermark_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,035 INFO:root:copying build/lib/data_juicer/ops/filter/image_size_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,036 INFO:root:copying build/lib/data_juicer/ops/filter/text_entity_dependency_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,038 INFO:root:copying build/lib/data_juicer/ops/filter/video_motion_score_raft_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,040 INFO:root:copying build/lib/data_juicer/ops/filter/image_pair_similarity_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,042 INFO:root:copying build/lib/data_juicer/ops/filter/average_line_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,044 INFO:root:copying build/lib/data_juicer/ops/filter/flagged_words_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,046 INFO:root:copying build/lib/data_juicer/ops/filter/text_length_filter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/ops/filter 2025-06-07T04:14:29,049 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/core 2025-06-07T04:14:29,050 INFO:root:copying build/lib/data_juicer/core/analyzer.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-06-07T04:14:29,052 INFO:root:copying build/lib/data_juicer/core/exporter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-06-07T04:14:29,055 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/core/executor 2025-06-07T04:14:29,056 INFO:root:copying build/lib/data_juicer/core/executor/base.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/executor 2025-06-07T04:14:29,058 INFO:root:copying build/lib/data_juicer/core/executor/factory.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/executor 2025-06-07T04:14:29,060 INFO:root:copying build/lib/data_juicer/core/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/executor 2025-06-07T04:14:29,061 INFO:root:copying build/lib/data_juicer/core/executor/ray_executor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/executor 2025-06-07T04:14:29,063 INFO:root:copying build/lib/data_juicer/core/executor/default_executor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/executor 2025-06-07T04:14:29,065 INFO:root:copying build/lib/data_juicer/core/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-06-07T04:14:29,067 INFO:root:copying build/lib/data_juicer/core/tracer.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-06-07T04:14:29,069 INFO:root:copying build/lib/data_juicer/core/monitor.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-06-07T04:14:29,072 INFO:root:copying build/lib/data_juicer/core/adapter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core 2025-06-07T04:14:29,074 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/core/data 2025-06-07T04:14:29,075 INFO:root:copying build/lib/data_juicer/core/data/load_strategy.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,078 INFO:root:copying build/lib/data_juicer/core/data/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,080 INFO:root:copying build/lib/data_juicer/core/data/dj_dataset.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,082 INFO:root:copying build/lib/data_juicer/core/data/schema.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,084 INFO:root:copying build/lib/data_juicer/core/data/data_validator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,086 INFO:root:copying build/lib/data_juicer/core/data/ray_dataset.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,088 INFO:root:copying build/lib/data_juicer/core/data/config_validator.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,090 INFO:root:copying build/lib/data_juicer/core/data/dataset_builder.py -> build/bdist.linux-armv7l/wheel/./data_juicer/core/data 2025-06-07T04:14:29,093 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/config 2025-06-07T04:14:29,094 INFO:root:copying build/lib/data_juicer/config/config.py -> build/bdist.linux-armv7l/wheel/./data_juicer/config 2025-06-07T04:14:29,097 INFO:root:copying build/lib/data_juicer/config/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/config 2025-06-07T04:14:29,099 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/analysis 2025-06-07T04:14:29,100 INFO:root:copying build/lib/data_juicer/analysis/measure.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,103 INFO:root:copying build/lib/data_juicer/analysis/collector.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,104 INFO:root:copying build/lib/data_juicer/analysis/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,106 INFO:root:copying build/lib/data_juicer/analysis/overall_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,108 INFO:root:copying build/lib/data_juicer/analysis/draw.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,110 INFO:root:copying build/lib/data_juicer/analysis/column_wise_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,112 INFO:root:copying build/lib/data_juicer/analysis/diversity_analysis.py -> build/bdist.linux-armv7l/wheel/./data_juicer/analysis 2025-06-07T04:14:29,114 INFO:root:copying build/lib/data_juicer/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer 2025-06-07T04:14:29,116 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/tools 2025-06-07T04:14:29,117 INFO:root:copying build/lib/data_juicer/tools/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,119 INFO:root:copying build/lib/data_juicer/tools/sandbox_starter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,121 INFO:root:copying build/lib/data_juicer/tools/data_resplit.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,123 INFO:root:copying build/lib/data_juicer/tools/process_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,125 INFO:root:copying build/lib/data_juicer/tools/analyze_data.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,126 INFO:root:copying build/lib/data_juicer/tools/generate_smtp_cert.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,128 INFO:root:copying build/lib/data_juicer/tools/dj_install.py -> build/bdist.linux-armv7l/wheel/./data_juicer/tools 2025-06-07T04:14:29,131 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/utils 2025-06-07T04:14:29,132 INFO:root:copying build/lib/data_juicer/utils/resource_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,134 INFO:root:copying build/lib/data_juicer/utils/auto_install_mapping.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,136 INFO:root:copying build/lib/data_juicer/utils/ckpt_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,138 INFO:root:copying build/lib/data_juicer/utils/lazy_loader.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,140 INFO:root:copying build/lib/data_juicer/utils/compress.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,142 INFO:root:copying build/lib/data_juicer/utils/constant.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,144 INFO:root:copying build/lib/data_juicer/utils/process_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,147 INFO:root:copying build/lib/data_juicer/utils/file_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,149 INFO:root:copying build/lib/data_juicer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,151 INFO:root:copying build/lib/data_juicer/utils/mm_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,154 INFO:root:copying build/lib/data_juicer/utils/unittest_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,156 INFO:root:copying build/lib/data_juicer/utils/model_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,159 INFO:root:copying build/lib/data_juicer/utils/availability_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,161 INFO:root:copying build/lib/data_juicer/utils/nltk_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,163 INFO:root:copying build/lib/data_juicer/utils/auto_install_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,165 INFO:root:copying build/lib/data_juicer/utils/asset_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,167 INFO:root:copying build/lib/data_juicer/utils/logger_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,169 INFO:root:copying build/lib/data_juicer/utils/cache_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,171 INFO:root:copying build/lib/data_juicer/utils/sample.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,172 INFO:root:copying build/lib/data_juicer/utils/registry.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,175 INFO:root:copying build/lib/data_juicer/utils/common_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,176 INFO:root:copying build/lib/data_juicer/utils/fingerprint_utils.py -> build/bdist.linux-armv7l/wheel/./data_juicer/utils 2025-06-07T04:14:29,179 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/format 2025-06-07T04:14:29,180 INFO:root:copying build/lib/data_juicer/format/load.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,182 INFO:root:copying build/lib/data_juicer/format/text_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,185 INFO:root:copying build/lib/data_juicer/format/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,186 INFO:root:copying build/lib/data_juicer/format/empty_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,188 INFO:root:copying build/lib/data_juicer/format/formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,190 INFO:root:copying build/lib/data_juicer/format/json_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,192 INFO:root:copying build/lib/data_juicer/format/csv_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,193 INFO:root:copying build/lib/data_juicer/format/tsv_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,195 INFO:root:copying build/lib/data_juicer/format/parquet_formatter.py -> build/bdist.linux-armv7l/wheel/./data_juicer/format 2025-06-07T04:14:29,197 INFO:root:creating build/bdist.linux-armv7l/wheel/data_juicer/download 2025-06-07T04:14:29,198 INFO:root:copying build/lib/data_juicer/download/arxiv.py -> build/bdist.linux-armv7l/wheel/./data_juicer/download 2025-06-07T04:14:29,201 INFO:root:copying build/lib/data_juicer/download/downloader.py -> build/bdist.linux-armv7l/wheel/./data_juicer/download 2025-06-07T04:14:29,203 INFO:root:copying build/lib/data_juicer/download/wikipedia.py -> build/bdist.linux-armv7l/wheel/./data_juicer/download 2025-06-07T04:14:29,206 INFO:root:copying build/lib/data_juicer/download/commoncrawl.py -> build/bdist.linux-armv7l/wheel/./data_juicer/download 2025-06-07T04:14:29,207 INFO:root:copying build/lib/data_juicer/download/__init__.py -> build/bdist.linux-armv7l/wheel/./data_juicer/download 2025-06-07T04:14:29,209 INFO:root:running install_egg_info 2025-06-07T04:14:29,242 INFO:root:running egg_info 2025-06-07T04:14:29,270 INFO:root:writing py_data_juicer.egg-info/PKG-INFO 2025-06-07T04:14:29,274 INFO:root:writing dependency_links to py_data_juicer.egg-info/dependency_links.txt 2025-06-07T04:14:29,276 INFO:root:writing entry points to py_data_juicer.egg-info/entry_points.txt 2025-06-07T04:14:29,277 INFO:root:writing requirements to py_data_juicer.egg-info/requires.txt 2025-06-07T04:14:29,279 INFO:root:writing top-level names to py_data_juicer.egg-info/top_level.txt 2025-06-07T04:14:29,330 INFO:root:reading manifest file 'py_data_juicer.egg-info/SOURCES.txt' 2025-06-07T04:14:29,344 INFO:root:adding license file 'LICENSE' 2025-06-07T04:14:29,356 INFO:root:writing manifest file 'py_data_juicer.egg-info/SOURCES.txt' 2025-06-07T04:14:29,358 INFO:root:Copying py_data_juicer.egg-info to build/bdist.linux-armv7l/wheel/./py_data_juicer-1.3.3-py3.11.egg-info 2025-06-07T04:14:29,370 INFO:root:running install_scripts 2025-06-07T04:14:29,383 INFO:root:creating build/bdist.linux-armv7l/wheel/py_data_juicer-1.3.3.dist-info/WHEEL 2025-06-07T04:14:29,386 INFO:wheel:creating '/tmp/pip-wheel-7yy9_fn1/py_data_juicer-1.3.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-06-07T04:14:29,388 INFO:wheel:adding 'data_juicer/__init__.py' 2025-06-07T04:14:29,390 INFO:wheel:adding 'data_juicer/analysis/__init__.py' 2025-06-07T04:14:29,391 INFO:wheel:adding 'data_juicer/analysis/collector.py' 2025-06-07T04:14:29,393 INFO:wheel:adding 'data_juicer/analysis/column_wise_analysis.py' 2025-06-07T04:14:29,395 INFO:wheel:adding 'data_juicer/analysis/diversity_analysis.py' 2025-06-07T04:14:29,396 INFO:wheel:adding 'data_juicer/analysis/draw.py' 2025-06-07T04:14:29,398 INFO:wheel:adding 'data_juicer/analysis/measure.py' 2025-06-07T04:14:29,399 INFO:wheel:adding 'data_juicer/analysis/overall_analysis.py' 2025-06-07T04:14:29,401 INFO:wheel:adding 'data_juicer/config/__init__.py' 2025-06-07T04:14:29,406 INFO:wheel:adding 'data_juicer/config/config.py' 2025-06-07T04:14:29,408 INFO:wheel:adding 'data_juicer/core/__init__.py' 2025-06-07T04:14:29,410 INFO:wheel:adding 'data_juicer/core/adapter.py' 2025-06-07T04:14:29,411 INFO:wheel:adding 'data_juicer/core/analyzer.py' 2025-06-07T04:14:29,413 INFO:wheel:adding 'data_juicer/core/exporter.py' 2025-06-07T04:14:29,414 INFO:wheel:adding 'data_juicer/core/monitor.py' 2025-06-07T04:14:29,416 INFO:wheel:adding 'data_juicer/core/tracer.py' 2025-06-07T04:14:29,418 INFO:wheel:adding 'data_juicer/core/data/__init__.py' 2025-06-07T04:14:29,419 INFO:wheel:adding 'data_juicer/core/data/config_validator.py' 2025-06-07T04:14:29,421 INFO:wheel:adding 'data_juicer/core/data/data_validator.py' 2025-06-07T04:14:29,423 INFO:wheel:adding 'data_juicer/core/data/dataset_builder.py' 2025-06-07T04:14:29,425 INFO:wheel:adding 'data_juicer/core/data/dj_dataset.py' 2025-06-07T04:14:29,427 INFO:wheel:adding 'data_juicer/core/data/load_strategy.py' 2025-06-07T04:14:29,429 INFO:wheel:adding 'data_juicer/core/data/ray_dataset.py' 2025-06-07T04:14:29,430 INFO:wheel:adding 'data_juicer/core/data/schema.py' 2025-06-07T04:14:29,432 INFO:wheel:adding 'data_juicer/core/executor/__init__.py' 2025-06-07T04:14:29,433 INFO:wheel:adding 'data_juicer/core/executor/base.py' 2025-06-07T04:14:29,435 INFO:wheel:adding 'data_juicer/core/executor/default_executor.py' 2025-06-07T04:14:29,436 INFO:wheel:adding 'data_juicer/core/executor/factory.py' 2025-06-07T04:14:29,437 INFO:wheel:adding 'data_juicer/core/executor/ray_executor.py' 2025-06-07T04:14:29,439 INFO:wheel:adding 'data_juicer/download/__init__.py' 2025-06-07T04:14:29,441 INFO:wheel:adding 'data_juicer/download/arxiv.py' 2025-06-07T04:14:29,442 INFO:wheel:adding 'data_juicer/download/commoncrawl.py' 2025-06-07T04:14:29,444 INFO:wheel:adding 'data_juicer/download/downloader.py' 2025-06-07T04:14:29,448 INFO:wheel:adding 'data_juicer/download/wikipedia.py' 2025-06-07T04:14:29,450 INFO:wheel:adding 'data_juicer/format/__init__.py' 2025-06-07T04:14:29,451 INFO:wheel:adding 'data_juicer/format/csv_formatter.py' 2025-06-07T04:14:29,452 INFO:wheel:adding 'data_juicer/format/empty_formatter.py' 2025-06-07T04:14:29,454 INFO:wheel:adding 'data_juicer/format/formatter.py' 2025-06-07T04:14:29,455 INFO:wheel:adding 'data_juicer/format/json_formatter.py' 2025-06-07T04:14:29,457 INFO:wheel:adding 'data_juicer/format/load.py' 2025-06-07T04:14:29,458 INFO:wheel:adding 'data_juicer/format/parquet_formatter.py' 2025-06-07T04:14:29,459 INFO:wheel:adding 'data_juicer/format/text_formatter.py' 2025-06-07T04:14:29,461 INFO:wheel:adding 'data_juicer/format/tsv_formatter.py' 2025-06-07T04:14:29,462 INFO:wheel:adding 'data_juicer/ops/__init__.py' 2025-06-07T04:14:29,465 INFO:wheel:adding 'data_juicer/ops/base_op.py' 2025-06-07T04:14:29,466 INFO:wheel:adding 'data_juicer/ops/load.py' 2025-06-07T04:14:29,469 INFO:wheel:adding 'data_juicer/ops/mixins.py' 2025-06-07T04:14:29,471 INFO:wheel:adding 'data_juicer/ops/op_fusion.py' 2025-06-07T04:14:29,473 INFO:wheel:adding 'data_juicer/ops/aggregator/__init__.py' 2025-06-07T04:14:29,475 INFO:wheel:adding 'data_juicer/ops/aggregator/entity_attribute_aggregator.py' 2025-06-07T04:14:29,477 INFO:wheel:adding 'data_juicer/ops/aggregator/meta_tags_aggregator.py' 2025-06-07T04:14:29,478 INFO:wheel:adding 'data_juicer/ops/aggregator/most_relevant_entities_aggregator.py' 2025-06-07T04:14:29,480 INFO:wheel:adding 'data_juicer/ops/aggregator/nested_aggregator.py' 2025-06-07T04:14:29,482 INFO:wheel:adding 'data_juicer/ops/common/__init__.py' 2025-06-07T04:14:29,483 INFO:wheel:adding 'data_juicer/ops/common/helper_func.py' 2025-06-07T04:14:29,489 INFO:wheel:adding 'data_juicer/ops/common/prompt2prompt_pipeline.py' 2025-06-07T04:14:29,490 INFO:wheel:adding 'data_juicer/ops/common/special_characters.py' 2025-06-07T04:14:29,492 INFO:wheel:adding 'data_juicer/ops/deduplicator/__init__.py' 2025-06-07T04:14:29,494 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_deduplicator.py' 2025-06-07T04:14:29,496 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_minhash_deduplicator.py' 2025-06-07T04:14:29,497 INFO:wheel:adding 'data_juicer/ops/deduplicator/document_simhash_deduplicator.py' 2025-06-07T04:14:29,499 INFO:wheel:adding 'data_juicer/ops/deduplicator/image_deduplicator.py' 2025-06-07T04:14:29,500 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_basic_deduplicator.py' 2025-06-07T04:14:29,503 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_bts_minhash_deduplicator.py' 2025-06-07T04:14:29,504 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_document_deduplicator.py' 2025-06-07T04:14:29,505 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_image_deduplicator.py' 2025-06-07T04:14:29,506 INFO:wheel:adding 'data_juicer/ops/deduplicator/ray_video_deduplicator.py' 2025-06-07T04:14:29,508 INFO:wheel:adding 'data_juicer/ops/deduplicator/video_deduplicator.py' 2025-06-07T04:14:29,511 INFO:wheel:adding 'data_juicer/ops/filter/__init__.py' 2025-06-07T04:14:29,512 INFO:wheel:adding 'data_juicer/ops/filter/alphanumeric_filter.py' 2025-06-07T04:14:29,513 INFO:wheel:adding 'data_juicer/ops/filter/audio_duration_filter.py' 2025-06-07T04:14:29,515 INFO:wheel:adding 'data_juicer/ops/filter/audio_nmf_snr_filter.py' 2025-06-07T04:14:29,516 INFO:wheel:adding 'data_juicer/ops/filter/audio_size_filter.py' 2025-06-07T04:14:29,517 INFO:wheel:adding 'data_juicer/ops/filter/average_line_length_filter.py' 2025-06-07T04:14:29,519 INFO:wheel:adding 'data_juicer/ops/filter/character_repetition_filter.py' 2025-06-07T04:14:29,520 INFO:wheel:adding 'data_juicer/ops/filter/flagged_words_filter.py' 2025-06-07T04:14:29,521 INFO:wheel:adding 'data_juicer/ops/filter/image_aesthetics_filter.py' 2025-06-07T04:14:29,523 INFO:wheel:adding 'data_juicer/ops/filter/image_aspect_ratio_filter.py' 2025-06-07T04:14:29,524 INFO:wheel:adding 'data_juicer/ops/filter/image_face_count_filter.py' 2025-06-07T04:14:29,525 INFO:wheel:adding 'data_juicer/ops/filter/image_face_ratio_filter.py' 2025-06-07T04:14:29,527 INFO:wheel:adding 'data_juicer/ops/filter/image_nsfw_filter.py' 2025-06-07T04:14:29,528 INFO:wheel:adding 'data_juicer/ops/filter/image_pair_similarity_filter.py' 2025-06-07T04:14:29,529 INFO:wheel:adding 'data_juicer/ops/filter/image_shape_filter.py' 2025-06-07T04:14:29,531 INFO:wheel:adding 'data_juicer/ops/filter/image_size_filter.py' 2025-06-07T04:14:29,532 INFO:wheel:adding 'data_juicer/ops/filter/image_text_matching_filter.py' 2025-06-07T04:14:29,534 INFO:wheel:adding 'data_juicer/ops/filter/image_text_similarity_filter.py' 2025-06-07T04:14:29,535 INFO:wheel:adding 'data_juicer/ops/filter/image_watermark_filter.py' 2025-06-07T04:14:29,537 INFO:wheel:adding 'data_juicer/ops/filter/language_id_score_filter.py' 2025-06-07T04:14:29,538 INFO:wheel:adding 'data_juicer/ops/filter/llm_difficulty_score_filter.py' 2025-06-07T04:14:29,540 INFO:wheel:adding 'data_juicer/ops/filter/llm_quality_score_filter.py' 2025-06-07T04:14:29,542 INFO:wheel:adding 'data_juicer/ops/filter/maximum_line_length_filter.py' 2025-06-07T04:14:29,543 INFO:wheel:adding 'data_juicer/ops/filter/perplexity_filter.py' 2025-06-07T04:14:29,545 INFO:wheel:adding 'data_juicer/ops/filter/phrase_grounding_recall_filter.py' 2025-06-07T04:14:29,546 INFO:wheel:adding 'data_juicer/ops/filter/special_characters_filter.py' 2025-06-07T04:14:29,547 INFO:wheel:adding 'data_juicer/ops/filter/specified_field_filter.py' 2025-06-07T04:14:29,549 INFO:wheel:adding 'data_juicer/ops/filter/specified_numeric_field_filter.py' 2025-06-07T04:14:29,550 INFO:wheel:adding 'data_juicer/ops/filter/stopwords_filter.py' 2025-06-07T04:14:29,551 INFO:wheel:adding 'data_juicer/ops/filter/suffix_filter.py' 2025-06-07T04:14:29,553 INFO:wheel:adding 'data_juicer/ops/filter/text_action_filter.py' 2025-06-07T04:14:29,554 INFO:wheel:adding 'data_juicer/ops/filter/text_entity_dependency_filter.py' 2025-06-07T04:14:29,555 INFO:wheel:adding 'data_juicer/ops/filter/text_length_filter.py' 2025-06-07T04:14:29,557 INFO:wheel:adding 'data_juicer/ops/filter/text_pair_similarity_filter.py' 2025-06-07T04:14:29,558 INFO:wheel:adding 'data_juicer/ops/filter/token_num_filter.py' 2025-06-07T04:14:29,560 INFO:wheel:adding 'data_juicer/ops/filter/video_aesthetics_filter.py' 2025-06-07T04:14:29,561 INFO:wheel:adding 'data_juicer/ops/filter/video_aspect_ratio_filter.py' 2025-06-07T04:14:29,562 INFO:wheel:adding 'data_juicer/ops/filter/video_duration_filter.py' 2025-06-07T04:14:29,564 INFO:wheel:adding 'data_juicer/ops/filter/video_frames_text_similarity_filter.py' 2025-06-07T04:14:29,566 INFO:wheel:adding 'data_juicer/ops/filter/video_motion_score_filter.py' 2025-06-07T04:14:29,567 INFO:wheel:adding 'data_juicer/ops/filter/video_motion_score_raft_filter.py' 2025-06-07T04:14:29,568 INFO:wheel:adding 'data_juicer/ops/filter/video_nsfw_filter.py' 2025-06-07T04:14:29,570 INFO:wheel:adding 'data_juicer/ops/filter/video_ocr_area_ratio_filter.py' 2025-06-07T04:14:29,571 INFO:wheel:adding 'data_juicer/ops/filter/video_resolution_filter.py' 2025-06-07T04:14:29,573 INFO:wheel:adding 'data_juicer/ops/filter/video_tagging_from_frames_filter.py' 2025-06-07T04:14:29,574 INFO:wheel:adding 'data_juicer/ops/filter/video_watermark_filter.py' 2025-06-07T04:14:29,576 INFO:wheel:adding 'data_juicer/ops/filter/word_repetition_filter.py' 2025-06-07T04:14:29,577 INFO:wheel:adding 'data_juicer/ops/filter/words_num_filter.py' 2025-06-07T04:14:29,579 INFO:wheel:adding 'data_juicer/ops/grouper/__init__.py' 2025-06-07T04:14:29,580 INFO:wheel:adding 'data_juicer/ops/grouper/key_value_grouper.py' 2025-06-07T04:14:29,581 INFO:wheel:adding 'data_juicer/ops/grouper/naive_grouper.py' 2025-06-07T04:14:29,582 INFO:wheel:adding 'data_juicer/ops/grouper/naive_reverse_grouper.py' 2025-06-07T04:14:29,586 INFO:wheel:adding 'data_juicer/ops/mapper/__init__.py' 2025-06-07T04:14:29,587 INFO:wheel:adding 'data_juicer/ops/mapper/audio_add_gaussian_noise_mapper.py' 2025-06-07T04:14:29,588 INFO:wheel:adding 'data_juicer/ops/mapper/audio_ffmpeg_wrapped_mapper.py' 2025-06-07T04:14:29,590 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_qa_mapper.py' 2025-06-07T04:14:29,591 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_query_mapper.py' 2025-06-07T04:14:29,592 INFO:wheel:adding 'data_juicer/ops/mapper/calibrate_response_mapper.py' 2025-06-07T04:14:29,594 INFO:wheel:adding 'data_juicer/ops/mapper/chinese_convert_mapper.py' 2025-06-07T04:14:29,595 INFO:wheel:adding 'data_juicer/ops/mapper/clean_copyright_mapper.py' 2025-06-07T04:14:29,596 INFO:wheel:adding 'data_juicer/ops/mapper/clean_email_mapper.py' 2025-06-07T04:14:29,597 INFO:wheel:adding 'data_juicer/ops/mapper/clean_html_mapper.py' 2025-06-07T04:14:29,598 INFO:wheel:adding 'data_juicer/ops/mapper/clean_ip_mapper.py' 2025-06-07T04:14:29,599 INFO:wheel:adding 'data_juicer/ops/mapper/clean_links_mapper.py' 2025-06-07T04:14:29,601 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_intent_detection_mapper.py' 2025-06-07T04:14:29,603 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_sentiment_detection_mapper.py' 2025-06-07T04:14:29,605 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_sentiment_intensity_mapper.py' 2025-06-07T04:14:29,607 INFO:wheel:adding 'data_juicer/ops/mapper/dialog_topic_detection_mapper.py' 2025-06-07T04:14:29,608 INFO:wheel:adding 'data_juicer/ops/mapper/expand_macro_mapper.py' 2025-06-07T04:14:29,610 INFO:wheel:adding 'data_juicer/ops/mapper/extract_entity_attribute_mapper.py' 2025-06-07T04:14:29,612 INFO:wheel:adding 'data_juicer/ops/mapper/extract_entity_relation_mapper.py' 2025-06-07T04:14:29,614 INFO:wheel:adding 'data_juicer/ops/mapper/extract_event_mapper.py' 2025-06-07T04:14:29,616 INFO:wheel:adding 'data_juicer/ops/mapper/extract_keyword_mapper.py' 2025-06-07T04:14:29,618 INFO:wheel:adding 'data_juicer/ops/mapper/extract_nickname_mapper.py' 2025-06-07T04:14:29,619 INFO:wheel:adding 'data_juicer/ops/mapper/extract_support_text_mapper.py' 2025-06-07T04:14:29,620 INFO:wheel:adding 'data_juicer/ops/mapper/extract_tables_from_html_mapper.py' 2025-06-07T04:14:29,622 INFO:wheel:adding 'data_juicer/ops/mapper/fix_unicode_mapper.py' 2025-06-07T04:14:29,624 INFO:wheel:adding 'data_juicer/ops/mapper/generate_qa_from_examples_mapper.py' 2025-06-07T04:14:29,625 INFO:wheel:adding 'data_juicer/ops/mapper/generate_qa_from_text_mapper.py' 2025-06-07T04:14:29,626 INFO:wheel:adding 'data_juicer/ops/mapper/image_blur_mapper.py' 2025-06-07T04:14:29,628 INFO:wheel:adding 'data_juicer/ops/mapper/image_captioning_from_gpt4v_mapper.py' 2025-06-07T04:14:29,630 INFO:wheel:adding 'data_juicer/ops/mapper/image_captioning_mapper.py' 2025-06-07T04:14:29,632 INFO:wheel:adding 'data_juicer/ops/mapper/image_diffusion_mapper.py' 2025-06-07T04:14:29,634 INFO:wheel:adding 'data_juicer/ops/mapper/image_face_blur_mapper.py' 2025-06-07T04:14:29,635 INFO:wheel:adding 'data_juicer/ops/mapper/image_remove_background_mapper.py' 2025-06-07T04:14:29,636 INFO:wheel:adding 'data_juicer/ops/mapper/image_segment_mapper.py' 2025-06-07T04:14:29,637 INFO:wheel:adding 'data_juicer/ops/mapper/image_tagging_mapper.py' 2025-06-07T04:14:29,640 INFO:wheel:adding 'data_juicer/ops/mapper/imgdiff_difference_area_generator_mapper.py' 2025-06-07T04:14:29,642 INFO:wheel:adding 'data_juicer/ops/mapper/imgdiff_difference_caption_generator_mapper.py' 2025-06-07T04:14:29,643 INFO:wheel:adding 'data_juicer/ops/mapper/mllm_mapper.py' 2025-06-07T04:14:29,645 INFO:wheel:adding 'data_juicer/ops/mapper/nlpaug_en_mapper.py' 2025-06-07T04:14:29,646 INFO:wheel:adding 'data_juicer/ops/mapper/nlpcda_zh_mapper.py' 2025-06-07T04:14:29,648 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_qa_mapper.py' 2025-06-07T04:14:29,649 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_query_mapper.py' 2025-06-07T04:14:29,650 INFO:wheel:adding 'data_juicer/ops/mapper/optimize_response_mapper.py' 2025-06-07T04:14:29,651 INFO:wheel:adding 'data_juicer/ops/mapper/pair_preference_mapper.py' 2025-06-07T04:14:29,653 INFO:wheel:adding 'data_juicer/ops/mapper/punctuation_normalization_mapper.py' 2025-06-07T04:14:29,654 INFO:wheel:adding 'data_juicer/ops/mapper/python_file_mapper.py' 2025-06-07T04:14:29,655 INFO:wheel:adding 'data_juicer/ops/mapper/python_lambda_mapper.py' 2025-06-07T04:14:29,657 INFO:wheel:adding 'data_juicer/ops/mapper/query_intent_detection_mapper.py' 2025-06-07T04:14:29,658 INFO:wheel:adding 'data_juicer/ops/mapper/query_sentiment_detection_mapper.py' 2025-06-07T04:14:29,659 INFO:wheel:adding 'data_juicer/ops/mapper/query_topic_detection_mapper.py' 2025-06-07T04:14:29,661 INFO:wheel:adding 'data_juicer/ops/mapper/relation_identity_mapper.py' 2025-06-07T04:14:29,662 INFO:wheel:adding 'data_juicer/ops/mapper/remove_bibliography_mapper.py' 2025-06-07T04:14:29,664 INFO:wheel:adding 'data_juicer/ops/mapper/remove_comments_mapper.py' 2025-06-07T04:14:29,665 INFO:wheel:adding 'data_juicer/ops/mapper/remove_header_mapper.py' 2025-06-07T04:14:29,666 INFO:wheel:adding 'data_juicer/ops/mapper/remove_long_words_mapper.py' 2025-06-07T04:14:29,667 INFO:wheel:adding 'data_juicer/ops/mapper/remove_non_chinese_character_mapper.py' 2025-06-07T04:14:29,669 INFO:wheel:adding 'data_juicer/ops/mapper/remove_repeat_sentences_mapper.py' 2025-06-07T04:14:29,670 INFO:wheel:adding 'data_juicer/ops/mapper/remove_specific_chars_mapper.py' 2025-06-07T04:14:29,671 INFO:wheel:adding 'data_juicer/ops/mapper/remove_table_text_mapper.py' 2025-06-07T04:14:29,673 INFO:wheel:adding 'data_juicer/ops/mapper/remove_words_with_incorrect_substrings_mapper.py' 2025-06-07T04:14:29,674 INFO:wheel:adding 'data_juicer/ops/mapper/replace_content_mapper.py' 2025-06-07T04:14:29,675 INFO:wheel:adding 'data_juicer/ops/mapper/sdxl_prompt2prompt_mapper.py' 2025-06-07T04:14:29,677 INFO:wheel:adding 'data_juicer/ops/mapper/sentence_augmentation_mapper.py' 2025-06-07T04:14:29,678 INFO:wheel:adding 'data_juicer/ops/mapper/sentence_split_mapper.py' 2025-06-07T04:14:29,680 INFO:wheel:adding 'data_juicer/ops/mapper/text_chunk_mapper.py' 2025-06-07T04:14:29,681 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_audio_mapper.py' 2025-06-07T04:14:29,683 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_frames_mapper.py' 2025-06-07T04:14:29,685 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_summarizer_mapper.py' 2025-06-07T04:14:29,687 INFO:wheel:adding 'data_juicer/ops/mapper/video_captioning_from_video_mapper.py' 2025-06-07T04:14:29,689 INFO:wheel:adding 'data_juicer/ops/mapper/video_extract_frames_mapper.py' 2025-06-07T04:14:29,691 INFO:wheel:adding 'data_juicer/ops/mapper/video_face_blur_mapper.py' 2025-06-07T04:14:29,692 INFO:wheel:adding 'data_juicer/ops/mapper/video_ffmpeg_wrapped_mapper.py' 2025-06-07T04:14:29,693 INFO:wheel:adding 'data_juicer/ops/mapper/video_remove_watermark_mapper.py' 2025-06-07T04:14:29,695 INFO:wheel:adding 'data_juicer/ops/mapper/video_resize_aspect_ratio_mapper.py' 2025-06-07T04:14:29,696 INFO:wheel:adding 'data_juicer/ops/mapper/video_resize_resolution_mapper.py' 2025-06-07T04:14:29,698 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_duration_mapper.py' 2025-06-07T04:14:29,699 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_key_frame_mapper.py' 2025-06-07T04:14:29,701 INFO:wheel:adding 'data_juicer/ops/mapper/video_split_by_scene_mapper.py' 2025-06-07T04:14:29,702 INFO:wheel:adding 'data_juicer/ops/mapper/video_tagging_from_audio_mapper.py' 2025-06-07T04:14:29,704 INFO:wheel:adding 'data_juicer/ops/mapper/video_tagging_from_frames_mapper.py' 2025-06-07T04:14:29,705 INFO:wheel:adding 'data_juicer/ops/mapper/whitespace_normalization_mapper.py' 2025-06-07T04:14:29,707 INFO:wheel:adding 'data_juicer/ops/mapper/annotation/__init__.py' 2025-06-07T04:14:29,710 INFO:wheel:adding 'data_juicer/ops/mapper/annotation/annotation_mapper.py' 2025-06-07T04:14:29,712 INFO:wheel:adding 'data_juicer/ops/mapper/annotation/human_preference_annotation_mapper.py' 2025-06-07T04:14:29,714 INFO:wheel:adding 'data_juicer/ops/selector/__init__.py' 2025-06-07T04:14:29,715 INFO:wheel:adding 'data_juicer/ops/selector/frequency_specified_field_selector.py' 2025-06-07T04:14:29,716 INFO:wheel:adding 'data_juicer/ops/selector/random_selector.py' 2025-06-07T04:14:29,718 INFO:wheel:adding 'data_juicer/ops/selector/range_specified_field_selector.py' 2025-06-07T04:14:29,719 INFO:wheel:adding 'data_juicer/ops/selector/tags_specified_field_selector.py' 2025-06-07T04:14:29,720 INFO:wheel:adding 'data_juicer/ops/selector/topk_specified_field_selector.py' 2025-06-07T04:14:29,722 INFO:wheel:adding 'data_juicer/tools/__init__.py' 2025-06-07T04:14:29,723 INFO:wheel:adding 'data_juicer/tools/analyze_data.py' 2025-06-07T04:14:29,724 INFO:wheel:adding 'data_juicer/tools/data_resplit.py' 2025-06-07T04:14:29,726 INFO:wheel:adding 'data_juicer/tools/dj_install.py' 2025-06-07T04:14:29,727 INFO:wheel:adding 'data_juicer/tools/generate_smtp_cert.py' 2025-06-07T04:14:29,729 INFO:wheel:adding 'data_juicer/tools/process_data.py' 2025-06-07T04:14:29,730 INFO:wheel:adding 'data_juicer/tools/sandbox_starter.py' 2025-06-07T04:14:29,732 INFO:wheel:adding 'data_juicer/utils/__init__.py' 2025-06-07T04:14:29,734 INFO:wheel:adding 'data_juicer/utils/asset_utils.py' 2025-06-07T04:14:29,735 INFO:wheel:adding 'data_juicer/utils/auto_install_mapping.py' 2025-06-07T04:14:29,737 INFO:wheel:adding 'data_juicer/utils/auto_install_utils.py' 2025-06-07T04:14:29,738 INFO:wheel:adding 'data_juicer/utils/availability_utils.py' 2025-06-07T04:14:29,739 INFO:wheel:adding 'data_juicer/utils/cache_utils.py' 2025-06-07T04:14:29,741 INFO:wheel:adding 'data_juicer/utils/ckpt_utils.py' 2025-06-07T04:14:29,742 INFO:wheel:adding 'data_juicer/utils/common_utils.py' 2025-06-07T04:14:29,744 INFO:wheel:adding 'data_juicer/utils/compress.py' 2025-06-07T04:14:29,746 INFO:wheel:adding 'data_juicer/utils/constant.py' 2025-06-07T04:14:29,748 INFO:wheel:adding 'data_juicer/utils/file_utils.py' 2025-06-07T04:14:29,750 INFO:wheel:adding 'data_juicer/utils/fingerprint_utils.py' 2025-06-07T04:14:29,751 INFO:wheel:adding 'data_juicer/utils/lazy_loader.py' 2025-06-07T04:14:29,753 INFO:wheel:adding 'data_juicer/utils/logger_utils.py' 2025-06-07T04:14:29,757 INFO:wheel:adding 'data_juicer/utils/mm_utils.py' 2025-06-07T04:14:29,761 INFO:wheel:adding 'data_juicer/utils/model_utils.py' 2025-06-07T04:14:29,763 INFO:wheel:adding 'data_juicer/utils/nltk_utils.py' 2025-06-07T04:14:29,764 INFO:wheel:adding 'data_juicer/utils/process_utils.py' 2025-06-07T04:14:29,766 INFO:wheel:adding 'data_juicer/utils/registry.py' 2025-06-07T04:14:29,767 INFO:wheel:adding 'data_juicer/utils/resource_utils.py' 2025-06-07T04:14:29,768 INFO:wheel:adding 'data_juicer/utils/sample.py' 2025-06-07T04:14:29,769 INFO:wheel:adding 'data_juicer/utils/unittest_utils.py' 2025-06-07T04:14:29,773 INFO:wheel:adding 'py_data_juicer-1.3.3.dist-info/licenses/LICENSE' 2025-06-07T04:14:29,778 INFO:wheel:adding 'py_data_juicer-1.3.3.dist-info/METADATA' 2025-06-07T04:14:29,779 INFO:wheel:adding 'py_data_juicer-1.3.3.dist-info/WHEEL' 2025-06-07T04:14:29,780 INFO:wheel:adding 'py_data_juicer-1.3.3.dist-info/entry_points.txt' 2025-06-07T04:14:29,781 INFO:wheel:adding 'py_data_juicer-1.3.3.dist-info/top_level.txt' 2025-06-07T04:14:29,785 INFO:wheel:adding 'py_data_juicer-1.3.3.dist-info/RECORD' 2025-06-07T04:14:29,796 INFO:root:removing build/bdist.linux-armv7l/wheel 2025-06-07T04:14:29,941 Building wheel for py-data-juicer (setup.py): finished with status 'done' 2025-06-07T04:14:29,950 Created wheel for py-data-juicer: filename=py_data_juicer-1.3.3-py3-none-any.whl size=492642 sha256=056edf9f5004901c1c001fe20641ce1b98becb948d756ae0c5c3c2883e51e183 2025-06-07T04:14:29,951 Stored in directory: /tmp/pip-ephem-wheel-cache-4s85ttgp/wheels/34/d7/d9/cc6f7d3e6e8f69417854163f040bc539910124c3f1cb79cc47 2025-06-07T04:14:29,975 Successfully built py-data-juicer 2025-06-07T04:14:29,994 Removed build tracker: '/tmp/pip-build-tracker-r7jbsrt5'