2023-05-23T11:58:07,435 Created temporary directory: /tmp/pip-build-tracker-w9i4t0h9 2023-05-23T11:58:07,437 Initialized build tracking at /tmp/pip-build-tracker-w9i4t0h9 2023-05-23T11:58:07,437 Created build tracker: /tmp/pip-build-tracker-w9i4t0h9 2023-05-23T11:58:07,437 Entered build tracker: /tmp/pip-build-tracker-w9i4t0h9 2023-05-23T11:58:07,438 Created temporary directory: /tmp/pip-wheel-o86vdxu2 2023-05-23T11:58:07,441 Created temporary directory: /tmp/pip-ephem-wheel-cache-up3vwij3 2023-05-23T11:58:07,469 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:58:07,472 2 location(s) to search for versions of curated-tokenizers: 2023-05-23T11:58:07,472 * https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,472 * https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,472 Fetching project page and analyzing links: https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,473 Getting page https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,475 Found index url https://pypi.org/simple/ 2023-05-23T11:58:07,526 Fetched page https://pypi.org/simple/curated-tokenizers/ as application/vnd.pypi.simple.v1+json 2023-05-23T11:58:07,532 Found link https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.6 2023-05-23T11:58:07,534 Found link https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.7 2023-05-23T11:58:07,534 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ab/03/154ea07588145b1faf5ab9f74ec9e80dea57e32920bb8cbd4d11a1029784/curated_tokenizers-0.0.7-cp310-cp310-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,534 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/8b/44/48a6b56ee6d96dab6af01319b4bb0b999ae5dd79e314f124919ee5530a14/curated_tokenizers-0.0.7-cp310-cp310-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,534 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2e/f3/a74baca025795e9fafcceb277a26fe000d5706a51a21a0784e742622720b/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,535 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/a6/99/c717badc07bea0c347867fb3d8631a9f8099bd8c1294344adf94c6f745db/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,535 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/58/34/a87bff5c21ac46b0621a86aea39696a3f489b4fd35552c571a1620655832/curated_tokenizers-0.0.7-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,535 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/91/81/9709ed42e751148c7853feb54cacba7295072eebde2dc5c003331504976f/curated_tokenizers-0.0.7-cp311-cp311-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,535 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/93/b1/38f7f527a22a9a2e9393f52dc875b7875784b644bfcd5c7703882b2d1c36/curated_tokenizers-0.0.7-cp311-cp311-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,535 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/5d/d6/d4cb39a2bca58a332b1074508f8f3961b1be85c6c048a41b4b02dd95aef3/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,536 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/63/ae/5a892033ddcbd0f2c072f24662daba8fee8f772047339160f0cf3389a93c/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,536 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c5/25/88ac587b0718ebf5b8e94432ea02d8304ddd72f014df3406b54ffd2305d1/curated_tokenizers-0.0.7-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,536 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c3/bf/eecad1bf5195cb686deac249b82408519a205b59467193ceb46652d9cf21/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,536 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/53/7e/97e73e70c1beda5e743fed345aa8556234d701ce292a0b5e6453aedf8da2/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,536 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2b/9a/6cce938f8ecd03dbf42f8dfda93ac9d792fdac5de501ca28034706c77d30/curated_tokenizers-0.0.7-cp36-cp36m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,537 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/a5/8fec572adfb1bb1bd1b1da5637da8704c6c6424227078ca13cb20040474d/curated_tokenizers-0.0.7-cp37-cp37m-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,537 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ea/a9/fd09bacc1d268b7ce65e0d76e2db7bb4cffe8f8738b9a6208cbcde7f27ab/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,537 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c0/ad/6cb1d029551589851126e8f875879be2a229ceec87360e26bcc70ce0277c/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,537 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/4f/37/271d4c2da6726e052b3c8f796f8f62a35d737683e2eb380ab08876af72df/curated_tokenizers-0.0.7-cp37-cp37m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,537 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/7e/43c36efdb3d4c6933d04ff739bad7624647e1b5ef0150d2502affe3570d9/curated_tokenizers-0.0.7-cp38-cp38-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,538 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c9/4d/bce24fbafaf469779ebdf97c44cfc2bc8273a9b5149b0dd3862ecaea3004/curated_tokenizers-0.0.7-cp38-cp38-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,538 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/0f/98/fd0eacc8238aa4450a7afec74dd41026c269dc112242f7be4ece119d6dcb/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,538 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2d/2e/ea5716f79bcb4aff8e436e11119398af9c3a1d7a4612190dfc40e0cdb9a7/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,538 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/cf/fa/2c84864cf891d5c43bca09ba20b4df6b8f56cd06e8e8a36c9e661f09d7f1/curated_tokenizers-0.0.7-cp38-cp38-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,538 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/61/04/ced9b45557896758e66b93199277eb122f855a69e569b0b2abfc0cf0980e/curated_tokenizers-0.0.7-cp39-cp39-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,539 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/e2/2c/ac0b4984c513dc37ff8fd25bbdcc0de11351be0c421ce65f6a677003e45c/curated_tokenizers-0.0.7-cp39-cp39-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,539 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/1f/79/cbddbb037335a5b1dea9eaf4a34d0380d7a12f59ef905219a2a9edee72ff/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,539 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/49/7b/86edf0a051de18bdcc07bedb425b9e3c999a927b4a7c47eff5caaf0e2231/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,539 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/31/d7/d036791616d0bc89eb81de5d46ffa9b34e1333e6c420d8d28050fbdf1b82/curated_tokenizers-0.0.7-cp39-cp39-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,540 Fetching project page and analyzing links: https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,540 Getting page https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,541 Found index url https://www.piwheels.org/simple/ 2023-05-23T11:58:07,720 Fetched page https://www.piwheels.org/simple/curated-tokenizers/ as text/html 2023-05-23T11:58:07,723 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp39-cp39-linux_armv7l.whl#sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,723 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp39-cp39-linux_armv6l.whl#sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,723 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv7l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,723 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv6l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,723 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.6-cp37-cp37m-linux_armv7l.whl#sha256=f879b0c6698bd68d7861e7575b381982a214a3f3bfd74d3211e6ee3b0a873f24 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,724 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.6-cp37-cp37m-linux_armv6l.whl#sha256=f879b0c6698bd68d7861e7575b381982a214a3f3bfd74d3211e6ee3b0a873f24 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:58:07,724 Skipping link: not a file: https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,724 Skipping link: not a file: https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:58:07,742 Given no hashes to check 1 links for project 'curated-tokenizers': discarding no candidates 2023-05-23T11:58:07,759 Collecting curated-tokenizers==0.0.6 2023-05-23T11:58:07,761 Created temporary directory: /tmp/pip-unpack-ganysfo3 2023-05-23T11:58:07,825 Downloading curated-tokenizers-0.0.6.tar.gz (2.2 MB) 2023-05-23T11:58:08,841 Added curated-tokenizers==0.0.6 from https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz to build tracker '/tmp/pip-build-tracker-w9i4t0h9' 2023-05-23T11:58:08,845 Created temporary directory: /tmp/pip-build-env-y3uj88fd 2023-05-23T11:58:08,855 Installing build dependencies: started 2023-05-23T11:58:08,856 Running command pip subprocess to install build dependencies 2023-05-23T11:58:10,030 Using pip 23.1.2 from /home/piwheels/.local/lib/python3.9/site-packages/pip (python 3.9) 2023-05-23T11:58:10,393 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:58:12,069 Collecting setuptools 2023-05-23T11:58:12,182 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2023-05-23T11:58:13,602 Collecting cython>=0.25 2023-05-23T11:58:14,006 Using cached https://www.piwheels.org/simple/cython/Cython-0.29.34-cp39-cp39-linux_armv7l.whl (5.0 MB) 2023-05-23T11:58:15,951 Installing collected packages: setuptools, cython 2023-05-23T11:58:20,817 Creating /tmp/pip-build-env-y3uj88fd/overlay/bin 2023-05-23T11:58:20,819 changing mode of /tmp/pip-build-env-y3uj88fd/overlay/bin/cygdb to 755 2023-05-23T11:58:20,822 changing mode of /tmp/pip-build-env-y3uj88fd/overlay/bin/cython to 755 2023-05-23T11:58:20,824 changing mode of /tmp/pip-build-env-y3uj88fd/overlay/bin/cythonize to 755 2023-05-23T11:58:20,845 Successfully installed cython-0.29.34 setuptools-67.8.0 2023-05-23T11:58:21,157 Installing build dependencies: finished with status 'done' 2023-05-23T11:58:21,162 Getting requirements to build wheel: started 2023-05-23T11:58:21,163 Running command Getting requirements to build wheel 2023-05-23T11:58:24,653 Cythonizing sources 2023-05-23T11:58:24,654 Compiling curated_tokenizers/_spp.pyx because it changed. 2023-05-23T11:58:24,654 Compiling curated_tokenizers/_wordpiece.pyx because it changed. 2023-05-23T11:58:24,654 Compiling curated_tokenizers/_bbpe.pyx because it changed. 2023-05-23T11:58:24,654 [1/3] Cythonizing curated_tokenizers/_bbpe.pyx 2023-05-23T11:58:24,654 [2/3] Cythonizing curated_tokenizers/_spp.pyx 2023-05-23T11:58:24,654 [3/3] Cythonizing curated_tokenizers/_wordpiece.pyx 2023-05-23T11:58:24,813 running egg_info 2023-05-23T11:58:24,818 writing curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:58:24,820 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:58:24,823 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-05-23T11:58:24,824 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:58:24,857 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:24,883 adding license file 'LICENSE' 2023-05-23T11:58:24,893 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:25,105 Getting requirements to build wheel: finished with status 'done' 2023-05-23T11:58:25,116 Installing backend dependencies: started 2023-05-23T11:58:25,117 Running command pip subprocess to install backend dependencies 2023-05-23T11:58:26,294 Using pip 23.1.2 from /home/piwheels/.local/lib/python3.9/site-packages/pip (python 3.9) 2023-05-23T11:58:26,662 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:58:27,148 Collecting wheel 2023-05-23T11:58:27,170 Using cached https://www.piwheels.org/simple/wheel/wheel-0.40.0-py3-none-any.whl (64 kB) 2023-05-23T11:58:28,624 Installing collected packages: wheel 2023-05-23T11:58:28,856 Creating /tmp/pip-build-env-y3uj88fd/normal/bin 2023-05-23T11:58:28,858 changing mode of /tmp/pip-build-env-y3uj88fd/normal/bin/wheel to 755 2023-05-23T11:58:28,870 Successfully installed wheel-0.40.0 2023-05-23T11:58:29,084 Installing backend dependencies: finished with status 'done' 2023-05-23T11:58:29,086 Created temporary directory: /tmp/pip-modern-metadata-ong9hseg 2023-05-23T11:58:29,089 Preparing metadata (pyproject.toml): started 2023-05-23T11:58:29,090 Running command Preparing metadata (pyproject.toml) 2023-05-23T11:58:30,283 Cythonizing sources 2023-05-23T11:58:30,375 running dist_info 2023-05-23T11:58:30,398 creating /tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info 2023-05-23T11:58:30,403 writing /tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:58:30,406 writing dependency_links to /tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:58:30,408 writing requirements to /tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/requires.txt 2023-05-23T11:58:30,409 writing top-level names to /tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:58:30,410 writing manifest file '/tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:30,435 reading manifest file '/tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:30,437 adding license file 'LICENSE' 2023-05-23T11:58:30,441 writing manifest file '/tmp/pip-modern-metadata-ong9hseg/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:30,442 creating '/tmp/pip-modern-metadata-ong9hseg/curated_tokenizers-0.0.6.dist-info' 2023-05-23T11:58:30,651 Preparing metadata (pyproject.toml): finished with status 'done' 2023-05-23T11:58:30,657 Source in /tmp/pip-wheel-o86vdxu2/curated-tokenizers_37473ee6de3f40a584e4b6222c1a9b9c has version 0.0.6, which satisfies requirement curated-tokenizers==0.0.6 from https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz 2023-05-23T11:58:30,658 Removed curated-tokenizers==0.0.6 from https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz from build tracker '/tmp/pip-build-tracker-w9i4t0h9' 2023-05-23T11:58:30,664 Created temporary directory: /tmp/pip-unpack-dc8sf3d8 2023-05-23T11:58:30,665 Building wheels for collected packages: curated-tokenizers 2023-05-23T11:58:30,669 Created temporary directory: /tmp/pip-wheel-x6fu1tw5 2023-05-23T11:58:30,670 Destination directory: /tmp/pip-wheel-x6fu1tw5 2023-05-23T11:58:30,672 Building wheel for curated-tokenizers (pyproject.toml): started 2023-05-23T11:58:30,673 Running command Building wheel for curated-tokenizers (pyproject.toml) 2023-05-23T11:58:31,810 Cythonizing sources 2023-05-23T11:58:31,950 running bdist_wheel 2023-05-23T11:58:31,967 running build 2023-05-23T11:58:31,967 running build_py 2023-05-23T11:58:31,975 creating build 2023-05-23T11:58:31,976 creating build/lib.linux-armv7l-cpython-39 2023-05-23T11:58:31,976 creating build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:31,978 copying curated_tokenizers/__init__.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:31,980 creating build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:31,981 copying curated_tokenizers/tests/test_bbpe_processor.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:31,983 copying curated_tokenizers/tests/test_word_piece_processor.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:31,985 copying curated_tokenizers/tests/test_sp.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:31,987 copying curated_tokenizers/tests/__init__.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:31,988 running egg_info 2023-05-23T11:58:32,006 writing curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:58:32,008 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:58:32,010 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-05-23T11:58:32,011 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:58:32,031 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:32,057 adding license file 'LICENSE' 2023-05-23T11:58:32,067 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:58:32,083 copying curated_tokenizers/_bbpe.cpp -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,092 copying curated_tokenizers/_bbpe.pxd -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,094 copying curated_tokenizers/_bbpe.pyx -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,097 copying curated_tokenizers/_spp.cpp -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,103 copying curated_tokenizers/_spp.pxd -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,105 copying curated_tokenizers/_spp.pyx -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,108 copying curated_tokenizers/_wordpiece.cpp -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,115 copying curated_tokenizers/_wordpiece.pxd -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,117 copying curated_tokenizers/_wordpiece.pyx -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,119 copying curated_tokenizers/config.h -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,121 copying curated_tokenizers/merges.cc -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,124 copying curated_tokenizers/merges.hh -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,126 copying curated_tokenizers/util.hh -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,128 copying curated_tokenizers/wordpiece.cc -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,131 copying curated_tokenizers/wordpiece.hh -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,133 copying curated_tokenizers/tests/incorrect-merges.txt -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:32,135 copying curated_tokenizers/tests/robbert-merges-1000.txt -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:32,138 copying curated_tokenizers/tests/robbert-vocab-1000.json -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:32,141 copying curated_tokenizers/tests/toy-word-pieces.txt -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:32,143 copying curated_tokenizers/tests/toy.model -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:58:32,151 running build_ext 2023-05-23T11:58:32,155 building 'curated_tokenizers._spp' extension 2023-05-23T11:58:32,157 creating build/temp.linux-armv7l-cpython-39 2023-05-23T11:58:32,157 creating build/temp.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:58:32,159 creating build/temp.linux-armv7l-cpython-39/sentencepiece 2023-05-23T11:58:32,159 creating build/temp.linux-armv7l-cpython-39/sentencepiece/src 2023-05-23T11:58:32,161 creating build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb 2023-05-23T11:58:32,162 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party 2023-05-23T11:58:32,162 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl 2023-05-23T11:58:32,163 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/flags 2023-05-23T11:58:32,164 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/strings 2023-05-23T11:58:32,165 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite 2023-05-23T11:58:32,167 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c curated_tokenizers/_spp.cpp -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/_spp.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:58:40,565 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/bpe_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/bpe_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:58:47,526 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/builtin_pb/sentencepiece.pb.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece.pb.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:58:52,713 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/builtin_pb/sentencepiece_model.pb.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:02,194 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/char_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/char_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:07,594 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/error.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/error.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:09,718 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/filesystem.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/filesystem.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:13,449 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/model_factory.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_factory.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:18,214 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/model_interface.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_interface.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:25,642 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/normalizer.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/normalizer.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:33,762 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/sentencepiece_processor.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/sentencepiece_processor.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:37,625 sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(absl::string_view, absl::string_view, const std::vector&, const EncodeResult&, sentencepiece::SentencePieceText*) const’: 2023-05-23T11:59:37,625 sentencepiece/src/sentencepiece_processor.cc:372:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘absl::string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:37,625 372 | for (int i = 0; i < w.size(); ++i) { 2023-05-23T11:59:37,625 | ~~^~~~~~~~~~ 2023-05-23T11:59:37,625 sentencepiece/src/sentencepiece_processor.cc:383:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘absl::string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:37,626 383 | if (i == w.size() - 1) { 2023-05-23T11:59:37,626 | ~~^~~~~~~~~~~~~~~ 2023-05-23T11:59:37,686 sentencepiece/src/sentencepiece_processor.cc: In lambda function: 2023-05-23T11:59:37,686 sentencepiece/src/sentencepiece_processor.cc:628:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:37,686 628 | for (int j = 0; j < consumed; j++) { 2023-05-23T11:59:37,686 | ~~^~~~~~~~~~ 2023-05-23T11:59:37,686 sentencepiece/src/sentencepiece_processor.cc:632:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:37,687 632 | if (j == consumed - 1) { 2023-05-23T11:59:37,687 | ~~^~~~~~~~~~~~~~~ 2023-05-23T11:59:45,818 In file included from /usr/include/c++/10/vector:72, 2023-05-23T11:59:45,818 from sentencepiece/src/common.h:26, 2023-05-23T11:59:45,818 from sentencepiece/src/sentencepiece_processor.cc:19: 2023-05-23T11:59:45,819 /usr/include/c++/10/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const double&}; _Tp = double; _Alloc = std::allocator]’: 2023-05-23T11:59:45,819 /usr/include/c++/10/bits/vector.tcc:426:7: note: parameter passing for argument of type ‘std::vector::iterator’ changed in GCC 7.1 2023-05-23T11:59:45,819 426 | vector<_Tp, _Alloc>:: 2023-05-23T11:59:45,819 | ^~~~~~~~~~~~~~~~~~~ 2023-05-23T11:59:45,872 In file included from /usr/include/c++/10/vector:67, 2023-05-23T11:59:45,873 from sentencepiece/src/common.h:26, 2023-05-23T11:59:45,873 from sentencepiece/src/sentencepiece_processor.cc:19: 2023-05-23T11:59:45,873 /usr/include/c++/10/bits/stl_vector.h: In member function ‘void std::discrete_distribution<_IntType>::param_type::_M_initialize() [with _IntType = int]’: 2023-05-23T11:59:45,873 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T11:59:45,873 1198 | _M_realloc_insert(end(), __x); 2023-05-23T11:59:45,873 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T11:59:45,873 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T11:59:45,874 1198 | _M_realloc_insert(end(), __x); 2023-05-23T11:59:45,874 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T11:59:48,859 At global scope: 2023-05-23T11:59:48,859 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:59:50,174 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/unigram_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/unigram_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:59:54,024 sentencepiece/src/unigram_model.cc: In member function ‘std::vector, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’: 2023-05-23T11:59:54,024 sentencepiece/src/unigram_model.cc:382:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:54,024 382 | for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-05-23T11:59:54,024 | ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:59:54,025 sentencepiece/src/unigram_model.cc:392:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:54,025 392 | for (int i = 0; i < adjusted_probs.size(); i++) { 2023-05-23T11:59:54,025 | ~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:59:54,025 sentencepiece/src/unigram_model.cc:403:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:54,026 403 | for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-05-23T11:59:54,026 | ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:59:54,099 sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(absl::string_view, float, int, bool, bool) const’: 2023-05-23T11:59:54,099 sentencepiece/src/unigram_model.cc:704:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:54,099 704 | for (int i = 0; i < nbest_samples.size(); i++) { 2023-05-23T11:59:54,100 | ~~^~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:59:54,102 sentencepiece/src/unigram_model.cc:714:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:59:54,102 714 | if (index_of_best != nbest_samples.size()) { 2023-05-23T11:59:54,103 | ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:59:54,113 sentencepiece/src/unigram_model.cc:756:27: warning: comparison of integer expressions of different signedness: ‘std::vector >, float> >::size_type’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:59:54,113 756 | while (results.size() < samples) { 2023-05-23T11:59:54,113 | ~~~~~~~~~~~~~~~^~~~~~~~~ 2023-05-23T11:59:54,140 sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(absl::string_view) const’: 2023-05-23T11:59:54,140 sentencepiece/src/unigram_model.cc:895:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘unsigned int’} and ‘const int’ [-Wsign-compare] 2023-05-23T11:59:54,140 895 | while (key_pos < size) { 2023-05-23T11:59:54,140 | ~~~~~~~~^~~~~~ 2023-05-23T11:59:54,141 sentencepiece/src/unigram_model.cc:916:40: warning: comparison of integer expressions of different signedness: ‘const unsigned int’ and ‘const int’ [-Wsign-compare] 2023-05-23T11:59:54,141 916 | if (!has_single_node && length == mblen) { 2023-05-23T11:59:54,141 | ~~~~~~~^~~~~~~~ 2023-05-23T12:00:03,410 In file included from /usr/include/c++/10/vector:72, 2023-05-23T12:00:03,411 from /usr/include/c++/10/queue:61, 2023-05-23T12:00:03,411 from sentencepiece/src/unigram_model.cc:20: 2023-05-23T12:00:03,411 /usr/include/c++/10/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const double&}; _Tp = double; _Alloc = std::allocator]’: 2023-05-23T12:00:03,411 /usr/include/c++/10/bits/vector.tcc:426:7: note: parameter passing for argument of type ‘std::vector::iterator’ changed in GCC 7.1 2023-05-23T12:00:03,411 426 | vector<_Tp, _Alloc>:: 2023-05-23T12:00:03,411 | ^~~~~~~~~~~~~~~~~~~ 2023-05-23T12:00:03,465 In file included from /usr/include/c++/10/vector:67, 2023-05-23T12:00:03,465 from /usr/include/c++/10/queue:61, 2023-05-23T12:00:03,465 from sentencepiece/src/unigram_model.cc:20: 2023-05-23T12:00:03,465 /usr/include/c++/10/bits/stl_vector.h: In member function ‘void std::discrete_distribution<_IntType>::param_type::_M_initialize() [with _IntType = int]’: 2023-05-23T12:00:03,465 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T12:00:03,466 1198 | _M_realloc_insert(end(), __x); 2023-05-23T12:00:03,466 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T12:00:03,466 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T12:00:03,466 1198 | _M_realloc_insert(end(), __x); 2023-05-23T12:00:03,466 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T12:00:05,044 At global scope: 2023-05-23T12:00:05,045 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:00:06,139 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/util.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:09,589 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/word_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/word_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:14,888 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/absl/flags/flag.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/flags/flag.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:21,357 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/absl/strings/string_view.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/strings/string_view.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:22,934 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/arena.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arena.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:24,687 sentencepiece/third_party/protobuf-lite/arena.cc: In member function ‘std::pair google::protobuf::internal::ArenaImpl::NewBuffer(size_t, size_t)’: 2023-05-23T12:00:24,687 sentencepiece/third_party/protobuf-lite/arena.cc:237:17: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T12:00:24,687 237 | if (last_size != -1) { 2023-05-23T12:00:24,687 | ~~~~~~~~~~^~~~~ 2023-05-23T12:00:25,403 At global scope: 2023-05-23T12:00:25,403 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:00:25,501 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/arenastring.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arenastring.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:28,629 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/bytestream.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/bytestream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:30,127 In file included from sentencepiece/third_party/protobuf-lite/bytestream.cc:36: 2023-05-23T12:00:30,127 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual void google::protobuf::strings::ArrayByteSource::Skip(size_t)’: 2023-05-23T12:00:30,128 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:50: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-05-23T12:00:30,128 186 | #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-05-23T12:00:30,128 | ~~~~^~~~~~ 2023-05-23T12:00:30,128 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T12:00:30,128 151 | !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T12:00:30,128 | ^~~~~~~~~ 2023-05-23T12:00:30,129 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:181:48: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T12:00:30,129 181 | #define GOOGLE_DCHECK(EXPRESSION) while(false) GOOGLE_CHECK(EXPRESSION) 2023-05-23T12:00:30,129 | ^~~~~~~~~~~~ 2023-05-23T12:00:30,129 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:32: note: in expansion of macro ‘GOOGLE_DCHECK’ 2023-05-23T12:00:30,129 186 | #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-05-23T12:00:30,129 | ^~~~~~~~~~~~~ 2023-05-23T12:00:30,130 sentencepiece/third_party/protobuf-lite/bytestream.cc:157:3: note: in expansion of macro ‘GOOGLE_DCHECK_LE’ 2023-05-23T12:00:30,130 157 | GOOGLE_DCHECK_LE(n, input_.size()); 2023-05-23T12:00:30,130 | ^~~~~~~~~~~~~~~~ 2023-05-23T12:00:30,130 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual google::protobuf::StringPiece google::protobuf::strings::LimitByteSource::Peek()’: 2023-05-23T12:00:30,130 sentencepiece/third_party/protobuf-lite/bytestream.cc:177:20: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:00:30,130 177 | if (piece.size() > limit_) { 2023-05-23T12:00:30,131 | ~~~~~~~~~~~~~^~~~~~~~ 2023-05-23T12:00:30,507 At global scope: 2023-05-23T12:00:30,507 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:00:30,568 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/coded_stream.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/coded_stream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:32,361 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian32Fallback(google::protobuf::uint32*)’: 2023-05-23T12:00:32,361 sentencepiece/third_party/protobuf-lite/coded_stream.cc:315:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,361 315 | if (BufferSize() >= sizeof(*value)) { 2023-05-23T12:00:32,361 | ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-05-23T12:00:32,362 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian64Fallback(google::protobuf::uint64*)’: 2023-05-23T12:00:32,362 sentencepiece/third_party/protobuf-lite/coded_stream.cc:332:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,362 332 | if (BufferSize() >= sizeof(*value)) { 2023-05-23T12:00:32,362 | ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-05-23T12:00:32,505 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 2; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,506 sentencepiece/third_party/protobuf-lite/coded_stream.cc:421:52: required from here 2023-05-23T12:00:32,506 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,506 354 | for (int i = 0, offset = 0; i < N - 1; i++, offset += 7) { 2023-05-23T12:00:32,506 | ~~^~~~~~~ 2023-05-23T12:00:32,506 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 3; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,506 sentencepiece/third_party/protobuf-lite/coded_stream.cc:423:52: required from here 2023-05-23T12:00:32,507 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,507 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 4; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,507 sentencepiece/third_party/protobuf-lite/coded_stream.cc:425:52: required from here 2023-05-23T12:00:32,507 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,507 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 5; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,508 sentencepiece/third_party/protobuf-lite/coded_stream.cc:427:52: required from here 2023-05-23T12:00:32,508 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,508 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 6; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,508 sentencepiece/third_party/protobuf-lite/coded_stream.cc:429:52: required from here 2023-05-23T12:00:32,509 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,509 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 7; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,509 sentencepiece/third_party/protobuf-lite/coded_stream.cc:431:52: required from here 2023-05-23T12:00:32,509 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,510 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 8; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,510 sentencepiece/third_party/protobuf-lite/coded_stream.cc:433:52: required from here 2023-05-23T12:00:32,510 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,510 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 9; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,511 sentencepiece/third_party/protobuf-lite/coded_stream.cc:435:52: required from here 2023-05-23T12:00:32,511 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:32,511 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 10; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T12:00:32,511 sentencepiece/third_party/protobuf-lite/coded_stream.cc:437:53: required from here 2023-05-23T12:00:32,512 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:00:33,734 At global scope: 2023-05-23T12:00:33,734 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:00:33,868 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/common.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/common.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:36,652 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/extension_set.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/extension_set.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:49,137 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/generated_enum_util.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_enum_util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:51,238 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc: In function ‘bool google::protobuf::internal::InitializeEnumStrings(const google::protobuf::internal::EnumEntry*, const int*, size_t, google::protobuf::internal::ExplicitlyConstructed >*)’: 2023-05-23T12:00:51,239 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc:86:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:00:51,239 86 | for (int i = 0; i < size; ++i) { 2023-05-23T12:00:51,239 | ~~^~~~~~ 2023-05-23T12:00:51,726 At global scope: 2023-05-23T12:00:51,727 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:00:51,794 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:00:54,510 In file included from sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:31: 2023-05-23T12:00:54,511 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = google::protobuf::internal::ProcessingType_STRING; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-05-23T12:00:54,511 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:457:49: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-05-23T12:00:54,511 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-05-23T12:00:54,511 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-05-23T12:00:54,511 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T12:00:54,511 175 | if (*oneof_case == field_number) { 2023-05-23T12:00:54,512 | ~~~~~~~~~~~~^~~~~~~~~~~~~~~ 2023-05-23T12:00:54,519 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = google::protobuf::internal::ProcessingType_MESSAGE; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-05-23T12:00:54,519 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:647:50: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-05-23T12:00:54,519 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-05-23T12:00:54,519 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-05-23T12:00:54,519 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T12:01:03,302 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:04,084 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/generated_message_util.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:13,364 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/implicit_weak_message.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:16,169 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/int128.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/int128.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:17,873 sentencepiece/third_party/protobuf-lite/int128.cc: In function ‘std::ostream& google::protobuf::operator<<(std::ostream&, const google::protobuf::uint128&)’: 2023-05-23T12:01:17,873 sentencepiece/third_party/protobuf-lite/int128.cc:178:13: warning: comparison of integer expressions of different signedness: ‘std::streamsize’ {aka ‘int’} and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:01:17,873 178 | if (width > rep.size()) { 2023-05-23T12:01:17,874 | ~~~~~~^~~~~~~~~~~~ 2023-05-23T12:01:18,528 At global scope: 2023-05-23T12:01:18,528 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:18,621 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/io_win32.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/io_win32.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:18,688 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/message_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/message_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:21,113 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToCodedStream(google::protobuf::io::CodedOutputStream*) const’: 2023-05-23T12:01:21,114 sentencepiece/third_party/protobuf-lite/message_lite.cc:392:46: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T12:01:21,114 392 | if (final_byte_count - original_byte_count != size) { 2023-05-23T12:01:21,114 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~ 2023-05-23T12:01:21,122 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToArray(void*, int) const’: 2023-05-23T12:01:21,122 sentencepiece/third_party/protobuf-lite/message_lite.cc:491:12: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T12:01:21,122 491 | if (size < byte_size) return false; 2023-05-23T12:01:21,122 | ~~~~~^~~~~~~~~~~ 2023-05-23T12:01:23,079 At global scope: 2023-05-23T12:01:23,079 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:23,310 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/parse_context.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/parse_context.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:27,973 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/repeated_field.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/repeated_field.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:29,950 In file included from sentencepiece/third_party/protobuf-lite/google/protobuf/repeated_field.h:60, 2023-05-23T12:01:29,950 from sentencepiece/third_party/protobuf-lite/repeated_field.cc:35: 2023-05-23T12:01:29,951 sentencepiece/third_party/protobuf-lite/repeated_field.cc: In member function ‘void** google::protobuf::internal::RepeatedPtrFieldBase::InternalExtend(int)’: 2023-05-23T12:01:29,951 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:01:29,951 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T12:01:29,951 | ~~~~^~~~~~ 2023-05-23T12:01:29,951 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T12:01:29,951 151 | !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T12:01:29,951 | ^~~~~~~~~ 2023-05-23T12:01:29,952 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T12:01:29,952 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T12:01:29,952 | ^~~~~~~~~~~~ 2023-05-23T12:01:29,952 sentencepiece/third_party/protobuf-lite/repeated_field.cc:61:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-05-23T12:01:29,952 61 | GOOGLE_CHECK_LE(new_size, (std::numeric_limits::max() - kRepHeaderSize) / 2023-05-23T12:01:29,952 | ^~~~~~~~~~~~~~~ 2023-05-23T12:01:35,585 At global scope: 2023-05-23T12:01:35,585 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:36,221 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/status.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/status.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:38,474 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/statusor.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/statusor.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:40,220 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/stringpiece.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:41,343 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘bool google::protobuf::StringPiece::contains(google::protobuf::StringPiece) const’: 2023-05-23T12:01:41,343 sentencepiece/third_party/protobuf-lite/stringpiece.cc:101:21: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘const size_type’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T12:01:41,343 101 | return find(s, 0) != npos; 2023-05-23T12:01:41,344 | ~~~~~~~~~~~^~~~~~~ 2023-05-23T12:01:41,351 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘google::protobuf::StringPiece google::protobuf::StringPiece::substr(google::protobuf::StringPiece::size_type, google::protobuf::StringPiece::size_type) const’: 2023-05-23T12:01:41,352 sentencepiece/third_party/protobuf-lite/stringpiece.cc:262:11: warning: comparison of integer expressions of different signedness: ‘google::protobuf::StringPiece::size_type’ {aka ‘unsigned int’} and ‘const stringpiece_ssize_type’ {aka ‘const int’} [-Wsign-compare] 2023-05-23T12:01:41,352 262 | if (pos > length_) pos = length_; 2023-05-23T12:01:41,352 | ~~~~^~~~~~~~~ 2023-05-23T12:01:42,005 At global scope: 2023-05-23T12:01:42,005 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:42,082 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/stringprintf.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringprintf.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:43,585 sentencepiece/third_party/protobuf-lite/stringprintf.cc: In function ‘std::string google::protobuf::StringPrintfVector(const char*, const std::vector >&)’: 2023-05-23T12:01:43,585 sentencepiece/third_party/protobuf-lite/stringprintf.cc:153:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:01:43,585 153 | for (int i = 0; i < v.size(); ++i) { 2023-05-23T12:01:43,585 | ~~^~~~~~~~~~ 2023-05-23T12:01:43,586 sentencepiece/third_party/protobuf-lite/stringprintf.cc:156:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T12:01:43,586 156 | for (int i = v.size(); i < GOOGLE_ARRAYSIZE(cstr); ++i) { 2023-05-23T12:01:43,895 At global scope: 2023-05-23T12:01:43,895 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:43,954 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/structurally_valid.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/structurally_valid.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:45,883 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/strutil.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/strutil.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:47,569 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘void google::protobuf::CEscapeAndAppend(google::protobuf::StringPiece, std::string*)’: 2023-05-23T12:01:47,569 sentencepiece/third_party/protobuf-lite/strutil.cc:563:19: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-05-23T12:01:47,570 563 | if (escaped_len == src.size()) { 2023-05-23T12:01:47,570 | ~~~~~~~~~~~~^~~~~~~~~~~~~ 2023-05-23T12:01:47,595 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::memcasecmp(const char*, const char*, size_t)’: 2023-05-23T12:01:47,596 sentencepiece/third_party/protobuf-lite/strutil.cc:1290:22: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:01:47,596 1290 | for ( int i = 0; i < len; i++ ) { 2023-05-23T12:01:47,596 | ~~^~~~~ 2023-05-23T12:01:47,621 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::GlobalReplaceSubstring(const string&, const string&, std::string*)’: 2023-05-23T12:01:47,621 sentencepiece/third_party/protobuf-lite/strutil.cc:1623:18: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_type’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T12:01:47,622 1623 | match_pos != std::string::npos; pos = match_pos + substring.length(), 2023-05-23T12:01:47,622 | ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~ 2023-05-23T12:01:50,815 At global scope: 2023-05-23T12:01:50,816 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:01:51,192 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/time.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/time.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:53,554 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/wire_format_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/wire_format_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:58,081 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/zero_copy_stream.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:01:59,798 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:02:02,129 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:02:03,700 In file included from sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:41: 2023-05-23T12:02:03,700 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc: In member function ‘virtual void google::protobuf::io::StringOutputStream::BackUp(int)’: 2023-05-23T12:02:03,700 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:02:03,700 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T12:02:03,701 | ~~~~^~~~~~ 2023-05-23T12:02:03,701 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T12:02:03,701 151 | !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T12:02:03,701 | ^~~~~~~~~ 2023-05-23T12:02:03,701 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T12:02:03,701 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T12:02:03,701 | ^~~~~~~~~~~~ 2023-05-23T12:02:03,702 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:171:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-05-23T12:02:03,702 171 | GOOGLE_CHECK_LE(count, target_->size()); 2023-05-23T12:02:03,702 | ^~~~~~~~~~~~~~~ 2023-05-23T12:02:04,545 At global scope: 2023-05-23T12:02:04,545 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:02:04,636 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-armv7l-cpython-39/curated_tokenizers/_spp.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/bpe_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece.pb.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/char_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/error.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/filesystem.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_factory.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_interface.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/normalizer.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/sentencepiece_processor.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/unigram_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/util.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/word_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/flags/flag.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/strings/string_view.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arena.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arenastring.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/bytestream.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/coded_stream.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/common.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/extension_set.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_enum_util.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_util.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/int128.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/io_win32.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/message_lite.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/parse_context.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/repeated_field.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/status.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/statusor.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringpiece.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringprintf.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/structurally_valid.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/strutil.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/time.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/wire_format_lite.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o -L/usr/lib -o build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.cpython-39-arm-linux-gnueabihf.so 2023-05-23T12:02:06,109 building 'curated_tokenizers._wordpiece' extension 2023-05-23T12:02:06,110 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/_wordpiece.cpp -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:02:07,564 curated_tokenizers/_wordpiece.cpp: In function ‘PyObject* __pyx_pf_18curated_tokenizers_10_wordpiece_18WordPieceProcessor_14to_list(__pyx_obj_18curated_tokenizers_10_wordpiece_WordPieceProcessor*)’: 2023-05-23T12:02:07,564 curated_tokenizers/_wordpiece.cpp:3149:35: warning: comparison of integer expressions of different signedness: ‘Py_ssize_t’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:02:07,564 3149 | for (__pyx_temp=0; __pyx_temp < __pyx_v_self->_pieces.size(); __pyx_temp++) { 2023-05-23T12:02:07,564 | ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T12:02:12,340 At global scope: 2023-05-23T12:02:12,340 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:02:12,802 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/wordpiece.cc -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:02:13,700 curated_tokenizers/wordpiece.cc: In member function ‘const Piece& PieceStorage::id_to_piece(int) const’: 2023-05-23T12:02:13,700 curated_tokenizers/wordpiece.cc:15:22: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T12:02:13,701 15 | if (id < 0 || id >= size()) { 2023-05-23T12:02:13,701 | ~~~^~~~~~~~~ 2023-05-23T12:02:14,723 At global scope: 2023-05-23T12:02:14,723 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T12:02:14,872 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.o build/temp.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.o -L/usr/lib -o build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.cpython-39-arm-linux-gnueabihf.so 2023-05-23T12:02:15,165 building 'curated_tokenizers._bbpe' extension 2023-05-23T12:02:15,167 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/_bbpe.cpp -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:02:29,154 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/merges.cc -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/merges.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T12:02:32,003 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.o build/temp.linux-armv7l-cpython-39/curated_tokenizers/merges.o -L/usr/lib -o build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.cpython-39-arm-linux-gnueabihf.so 2023-05-23T12:02:32,340 installing to build/bdist.linux-armv7l/wheel 2023-05-23T12:02:32,341 running install 2023-05-23T12:02:32,366 running install_lib 2023-05-23T12:02:32,374 creating build/bdist.linux-armv7l 2023-05-23T12:02:32,375 creating build/bdist.linux-armv7l/wheel 2023-05-23T12:02:32,377 creating build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,378 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,380 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,391 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,400 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,402 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,404 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,406 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.cpython-39-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,602 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,604 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,614 creating build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,615 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/robbert-merges-1000.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,617 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/test_bbpe_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,619 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/toy-word-pieces.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,621 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/incorrect-merges.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,623 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/toy.model -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,629 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/test_word_piece_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,631 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/test_sp.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,633 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,634 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/robbert-vocab-1000.json -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T12:02:32,637 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/util.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,639 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,641 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,642 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,644 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/config.h -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,646 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.cpython-39-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,675 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,677 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/merges.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,678 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/merges.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,680 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.cpython-39-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T12:02:32,692 running install_egg_info 2023-05-23T12:02:32,706 Copying curated_tokenizers.egg-info to build/bdist.linux-armv7l/wheel/curated_tokenizers-0.0.6-py3.9.egg-info 2023-05-23T12:02:32,719 running install_scripts 2023-05-23T12:02:32,768 creating build/bdist.linux-armv7l/wheel/curated_tokenizers-0.0.6.dist-info/WHEEL 2023-05-23T12:02:32,772 creating '/tmp/pip-wheel-x6fu1tw5/.tmp-iupw5o8h/curated_tokenizers-0.0.6-cp39-cp39-linux_armv7l.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-05-23T12:02:32,775 adding 'curated_tokenizers/__init__.py' 2023-05-23T12:02:32,815 adding 'curated_tokenizers/_bbpe.cpp' 2023-05-23T12:02:33,076 adding 'curated_tokenizers/_bbpe.cpython-39-arm-linux-gnueabihf.so' 2023-05-23T12:02:33,086 adding 'curated_tokenizers/_bbpe.pxd' 2023-05-23T12:02:33,088 adding 'curated_tokenizers/_bbpe.pyx' 2023-05-23T12:02:33,115 adding 'curated_tokenizers/_spp.cpp' 2023-05-23T12:02:35,431 adding 'curated_tokenizers/_spp.cpython-39-arm-linux-gnueabihf.so' 2023-05-23T12:02:35,516 adding 'curated_tokenizers/_spp.pxd' 2023-05-23T12:02:35,518 adding 'curated_tokenizers/_spp.pyx' 2023-05-23T12:02:35,544 adding 'curated_tokenizers/_wordpiece.cpp' 2023-05-23T12:02:35,693 adding 'curated_tokenizers/_wordpiece.cpython-39-arm-linux-gnueabihf.so' 2023-05-23T12:02:35,699 adding 'curated_tokenizers/_wordpiece.pxd' 2023-05-23T12:02:35,701 adding 'curated_tokenizers/_wordpiece.pyx' 2023-05-23T12:02:35,702 adding 'curated_tokenizers/config.h' 2023-05-23T12:02:35,704 adding 'curated_tokenizers/merges.cc' 2023-05-23T12:02:35,706 adding 'curated_tokenizers/merges.hh' 2023-05-23T12:02:35,707 adding 'curated_tokenizers/util.hh' 2023-05-23T12:02:35,709 adding 'curated_tokenizers/wordpiece.cc' 2023-05-23T12:02:35,710 adding 'curated_tokenizers/wordpiece.hh' 2023-05-23T12:02:35,712 adding 'curated_tokenizers/tests/__init__.py' 2023-05-23T12:02:35,713 adding 'curated_tokenizers/tests/incorrect-merges.txt' 2023-05-23T12:02:35,716 adding 'curated_tokenizers/tests/robbert-merges-1000.txt' 2023-05-23T12:02:35,720 adding 'curated_tokenizers/tests/robbert-vocab-1000.json' 2023-05-23T12:02:35,722 adding 'curated_tokenizers/tests/test_bbpe_processor.py' 2023-05-23T12:02:35,724 adding 'curated_tokenizers/tests/test_sp.py' 2023-05-23T12:02:35,726 adding 'curated_tokenizers/tests/test_word_piece_processor.py' 2023-05-23T12:02:35,727 adding 'curated_tokenizers/tests/toy-word-pieces.txt' 2023-05-23T12:02:35,795 adding 'curated_tokenizers/tests/toy.model' 2023-05-23T12:02:35,799 adding 'curated_tokenizers-0.0.6.dist-info/LICENSE' 2023-05-23T12:02:35,800 adding 'curated_tokenizers-0.0.6.dist-info/METADATA' 2023-05-23T12:02:35,801 adding 'curated_tokenizers-0.0.6.dist-info/WHEEL' 2023-05-23T12:02:35,802 adding 'curated_tokenizers-0.0.6.dist-info/top_level.txt' 2023-05-23T12:02:35,803 adding 'curated_tokenizers-0.0.6.dist-info/zip-safe' 2023-05-23T12:02:35,804 adding 'curated_tokenizers-0.0.6.dist-info/RECORD' 2023-05-23T12:02:35,859 removing build/bdist.linux-armv7l/wheel 2023-05-23T12:02:36,005 Building wheel for curated-tokenizers (pyproject.toml): finished with status 'done' 2023-05-23T12:02:36,128 Created wheel for curated-tokenizers: filename=curated_tokenizers-0.0.6-cp39-cp39-linux_armv7l.whl size=5656636 sha256=3d098bb28fb0b27c2d9672d3e04e592b9a3cd854ac0a6aa7768efa00efb59382 2023-05-23T12:02:36,129 Stored in directory: /tmp/pip-ephem-wheel-cache-up3vwij3/wheels/23/41/47/37a0526a09530512c469edce9163cc8d99d6f5c173c8cc7153 2023-05-23T12:02:36,145 Successfully built curated-tokenizers 2023-05-23T12:02:36,283 Removed build tracker: '/tmp/pip-build-tracker-w9i4t0h9'