2023-05-23T11:33:22,038 Created temporary directory: /tmp/pip-build-tracker-iz9d616_ 2023-05-23T11:33:22,041 Initialized build tracking at /tmp/pip-build-tracker-iz9d616_ 2023-05-23T11:33:22,042 Created build tracker: /tmp/pip-build-tracker-iz9d616_ 2023-05-23T11:33:22,042 Entered build tracker: /tmp/pip-build-tracker-iz9d616_ 2023-05-23T11:33:22,043 Created temporary directory: /tmp/pip-wheel-3vy4_pct 2023-05-23T11:33:22,052 Created temporary directory: /tmp/pip-ephem-wheel-cache-q7poijnb 2023-05-23T11:33:22,109 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:33:22,118 2 location(s) to search for versions of curated-tokenizers: 2023-05-23T11:33:22,118 * https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,118 * https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,119 Fetching project page and analyzing links: https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,120 Getting page https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,124 Found index url https://pypi.org/simple/ 2023-05-23T11:33:22,235 Fetched page https://pypi.org/simple/curated-tokenizers/ as application/vnd.pypi.simple.v1+json 2023-05-23T11:33:22,252 Found link https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.6 2023-05-23T11:33:22,253 Found link https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.7 2023-05-23T11:33:22,254 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ab/03/154ea07588145b1faf5ab9f74ec9e80dea57e32920bb8cbd4d11a1029784/curated_tokenizers-0.0.7-cp310-cp310-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,255 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/8b/44/48a6b56ee6d96dab6af01319b4bb0b999ae5dd79e314f124919ee5530a14/curated_tokenizers-0.0.7-cp310-cp310-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,255 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2e/f3/a74baca025795e9fafcceb277a26fe000d5706a51a21a0784e742622720b/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,256 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/a6/99/c717badc07bea0c347867fb3d8631a9f8099bd8c1294344adf94c6f745db/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,256 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/58/34/a87bff5c21ac46b0621a86aea39696a3f489b4fd35552c571a1620655832/curated_tokenizers-0.0.7-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,257 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/91/81/9709ed42e751148c7853feb54cacba7295072eebde2dc5c003331504976f/curated_tokenizers-0.0.7-cp311-cp311-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,257 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/93/b1/38f7f527a22a9a2e9393f52dc875b7875784b644bfcd5c7703882b2d1c36/curated_tokenizers-0.0.7-cp311-cp311-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,258 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/5d/d6/d4cb39a2bca58a332b1074508f8f3961b1be85c6c048a41b4b02dd95aef3/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,258 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/63/ae/5a892033ddcbd0f2c072f24662daba8fee8f772047339160f0cf3389a93c/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,259 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c5/25/88ac587b0718ebf5b8e94432ea02d8304ddd72f014df3406b54ffd2305d1/curated_tokenizers-0.0.7-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,260 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c3/bf/eecad1bf5195cb686deac249b82408519a205b59467193ceb46652d9cf21/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,260 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/53/7e/97e73e70c1beda5e743fed345aa8556234d701ce292a0b5e6453aedf8da2/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,261 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2b/9a/6cce938f8ecd03dbf42f8dfda93ac9d792fdac5de501ca28034706c77d30/curated_tokenizers-0.0.7-cp36-cp36m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,261 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/a5/8fec572adfb1bb1bd1b1da5637da8704c6c6424227078ca13cb20040474d/curated_tokenizers-0.0.7-cp37-cp37m-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,262 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ea/a9/fd09bacc1d268b7ce65e0d76e2db7bb4cffe8f8738b9a6208cbcde7f27ab/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,262 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c0/ad/6cb1d029551589851126e8f875879be2a229ceec87360e26bcc70ce0277c/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,263 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/4f/37/271d4c2da6726e052b3c8f796f8f62a35d737683e2eb380ab08876af72df/curated_tokenizers-0.0.7-cp37-cp37m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,263 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/7e/43c36efdb3d4c6933d04ff739bad7624647e1b5ef0150d2502affe3570d9/curated_tokenizers-0.0.7-cp38-cp38-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,264 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c9/4d/bce24fbafaf469779ebdf97c44cfc2bc8273a9b5149b0dd3862ecaea3004/curated_tokenizers-0.0.7-cp38-cp38-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,264 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/0f/98/fd0eacc8238aa4450a7afec74dd41026c269dc112242f7be4ece119d6dcb/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,265 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2d/2e/ea5716f79bcb4aff8e436e11119398af9c3a1d7a4612190dfc40e0cdb9a7/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,265 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/cf/fa/2c84864cf891d5c43bca09ba20b4df6b8f56cd06e8e8a36c9e661f09d7f1/curated_tokenizers-0.0.7-cp38-cp38-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,266 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/61/04/ced9b45557896758e66b93199277eb122f855a69e569b0b2abfc0cf0980e/curated_tokenizers-0.0.7-cp39-cp39-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,266 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/e2/2c/ac0b4984c513dc37ff8fd25bbdcc0de11351be0c421ce65f6a677003e45c/curated_tokenizers-0.0.7-cp39-cp39-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,267 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/1f/79/cbddbb037335a5b1dea9eaf4a34d0380d7a12f59ef905219a2a9edee72ff/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,268 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/49/7b/86edf0a051de18bdcc07bedb425b9e3c999a927b4a7c47eff5caaf0e2231/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,268 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/31/d7/d036791616d0bc89eb81de5d46ffa9b34e1333e6c420d8d28050fbdf1b82/curated_tokenizers-0.0.7-cp39-cp39-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,269 Fetching project page and analyzing links: https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,270 Getting page https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,272 Found index url https://www.piwheels.org/simple/ 2023-05-23T11:33:22,494 Fetched page https://www.piwheels.org/simple/curated-tokenizers/ as text/html 2023-05-23T11:33:22,499 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp39-cp39-linux_armv7l.whl#sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,499 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp39-cp39-linux_armv6l.whl#sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,500 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv7l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,500 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv6l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:33:22,501 Skipping link: not a file: https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,502 Skipping link: not a file: https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:33:22,535 Given no hashes to check 1 links for project 'curated-tokenizers': discarding no candidates 2023-05-23T11:33:22,567 Collecting curated-tokenizers==0.0.6 2023-05-23T11:33:22,571 Created temporary directory: /tmp/pip-unpack-hcme26tx 2023-05-23T11:33:22,678 Downloading curated-tokenizers-0.0.6.tar.gz (2.2 MB) 2023-05-23T11:33:25,036 Added curated-tokenizers==0.0.6 from https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz to build tracker '/tmp/pip-build-tracker-iz9d616_' 2023-05-23T11:33:25,045 Created temporary directory: /tmp/pip-build-env-mh017958 2023-05-23T11:33:25,064 Installing build dependencies: started 2023-05-23T11:33:25,067 Running command pip subprocess to install build dependencies 2023-05-23T11:33:27,757 Using pip 23.1.2 from /usr/local/lib/python3.7/dist-packages/pip (python 3.7) 2023-05-23T11:33:28,508 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:33:32,482 Collecting setuptools 2023-05-23T11:33:32,738 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2023-05-23T11:33:36,136 Collecting cython>=0.25 2023-05-23T11:33:36,871 Using cached https://www.piwheels.org/simple/cython/Cython-0.29.34-cp37-cp37m-linux_armv7l.whl (2.3 MB) 2023-05-23T11:33:41,384 Installing collected packages: setuptools, cython 2023-05-23T11:33:50,866 Creating /tmp/pip-build-env-mh017958/overlay/bin 2023-05-23T11:33:50,871 changing mode of /tmp/pip-build-env-mh017958/overlay/bin/cygdb to 755 2023-05-23T11:33:50,875 changing mode of /tmp/pip-build-env-mh017958/overlay/bin/cython to 755 2023-05-23T11:33:50,880 changing mode of /tmp/pip-build-env-mh017958/overlay/bin/cythonize to 755 2023-05-23T11:33:50,926 Successfully installed cython-0.29.34 setuptools-67.8.0 2023-05-23T11:33:51,446 Installing build dependencies: finished with status 'done' 2023-05-23T11:33:51,457 Getting requirements to build wheel: started 2023-05-23T11:33:51,459 Running command Getting requirements to build wheel 2023-05-23T11:33:59,764 Cythonizing sources 2023-05-23T11:33:59,765 Compiling curated_tokenizers/_spp.pyx because it changed. 2023-05-23T11:33:59,766 Compiling curated_tokenizers/_wordpiece.pyx because it changed. 2023-05-23T11:33:59,766 Compiling curated_tokenizers/_bbpe.pyx because it changed. 2023-05-23T11:33:59,767 [1/3] Cythonizing curated_tokenizers/_bbpe.pyx 2023-05-23T11:33:59,767 [2/3] Cythonizing curated_tokenizers/_spp.pyx 2023-05-23T11:33:59,767 [3/3] Cythonizing curated_tokenizers/_wordpiece.pyx 2023-05-23T11:34:00,142 running egg_info 2023-05-23T11:34:00,154 writing curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:34:00,159 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:34:00,164 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-05-23T11:34:00,167 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:34:00,242 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:00,298 adding license file 'LICENSE' 2023-05-23T11:34:00,325 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:00,698 Getting requirements to build wheel: finished with status 'done' 2023-05-23T11:34:00,726 Installing backend dependencies: started 2023-05-23T11:34:00,728 Running command pip subprocess to install backend dependencies 2023-05-23T11:34:03,493 Using pip 23.1.2 from /usr/local/lib/python3.7/dist-packages/pip (python 3.7) 2023-05-23T11:34:04,238 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:34:05,119 Collecting wheel 2023-05-23T11:34:05,158 Using cached https://www.piwheels.org/simple/wheel/wheel-0.40.0-py3-none-any.whl (64 kB) 2023-05-23T11:34:08,719 Installing collected packages: wheel 2023-05-23T11:34:09,173 Creating /tmp/pip-build-env-mh017958/normal/bin 2023-05-23T11:34:09,177 changing mode of /tmp/pip-build-env-mh017958/normal/bin/wheel to 755 2023-05-23T11:34:09,206 Successfully installed wheel-0.40.0 2023-05-23T11:34:09,583 Installing backend dependencies: finished with status 'done' 2023-05-23T11:34:09,589 Created temporary directory: /tmp/pip-modern-metadata-9f__tmgn 2023-05-23T11:34:09,596 Preparing metadata (pyproject.toml): started 2023-05-23T11:34:09,598 Running command Preparing metadata (pyproject.toml) 2023-05-23T11:34:12,510 Cythonizing sources 2023-05-23T11:34:12,721 running dist_info 2023-05-23T11:34:12,767 creating /tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info 2023-05-23T11:34:12,777 writing /tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:34:12,783 writing dependency_links to /tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:34:12,787 writing requirements to /tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/requires.txt 2023-05-23T11:34:12,789 writing top-level names to /tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:34:12,792 writing manifest file '/tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:12,862 reading manifest file '/tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:12,867 adding license file 'LICENSE' 2023-05-23T11:34:12,878 writing manifest file '/tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:12,882 creating '/tmp/pip-modern-metadata-9f__tmgn/curated_tokenizers-0.0.6.dist-info' 2023-05-23T11:34:13,288 Preparing metadata (pyproject.toml): finished with status 'done' 2023-05-23T11:34:13,304 Source in /tmp/pip-wheel-3vy4_pct/curated-tokenizers_b16045636896400db3eb0c942a608cc7 has version 0.0.6, which satisfies requirement curated-tokenizers==0.0.6 from https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz 2023-05-23T11:34:13,306 Removed curated-tokenizers==0.0.6 from https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz from build tracker '/tmp/pip-build-tracker-iz9d616_' 2023-05-23T11:34:13,321 Created temporary directory: /tmp/pip-unpack-l0pvl8rz 2023-05-23T11:34:13,322 Building wheels for collected packages: curated-tokenizers 2023-05-23T11:34:13,333 Created temporary directory: /tmp/pip-wheel-3pub9hnn 2023-05-23T11:34:13,333 Destination directory: /tmp/pip-wheel-3pub9hnn 2023-05-23T11:34:13,338 Building wheel for curated-tokenizers (pyproject.toml): started 2023-05-23T11:34:13,341 Running command Building wheel for curated-tokenizers (pyproject.toml) 2023-05-23T11:34:16,207 Cythonizing sources 2023-05-23T11:34:16,528 running bdist_wheel 2023-05-23T11:34:16,571 running build 2023-05-23T11:34:16,572 running build_py 2023-05-23T11:34:16,589 creating build 2023-05-23T11:34:16,590 creating build/lib.linux-armv7l-cpython-37 2023-05-23T11:34:16,591 creating build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,593 copying curated_tokenizers/__init__.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,598 creating build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,600 copying curated_tokenizers/tests/test_word_piece_processor.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,604 copying curated_tokenizers/tests/test_sp.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,608 copying curated_tokenizers/tests/__init__.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,611 copying curated_tokenizers/tests/test_bbpe_processor.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,614 running egg_info 2023-05-23T11:34:16,654 writing curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:34:16,657 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:34:16,661 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-05-23T11:34:16,663 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:34:16,696 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:16,752 adding license file 'LICENSE' 2023-05-23T11:34:16,779 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:34:16,820 copying curated_tokenizers/_bbpe.cpp -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,849 copying curated_tokenizers/_bbpe.pxd -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,853 copying curated_tokenizers/_bbpe.pyx -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,858 copying curated_tokenizers/_spp.cpp -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,878 copying curated_tokenizers/_spp.pxd -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,882 copying curated_tokenizers/_spp.pyx -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,887 copying curated_tokenizers/_wordpiece.cpp -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,908 copying curated_tokenizers/_wordpiece.pxd -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,912 copying curated_tokenizers/_wordpiece.pyx -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,916 copying curated_tokenizers/config.h -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,920 copying curated_tokenizers/merges.cc -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,924 copying curated_tokenizers/merges.hh -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,928 copying curated_tokenizers/util.hh -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,932 copying curated_tokenizers/wordpiece.cc -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,936 copying curated_tokenizers/wordpiece.hh -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,940 copying curated_tokenizers/tests/incorrect-merges.txt -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,944 copying curated_tokenizers/tests/robbert-merges-1000.txt -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,949 copying curated_tokenizers/tests/robbert-vocab-1000.json -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,955 copying curated_tokenizers/tests/toy-word-pieces.txt -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,959 copying curated_tokenizers/tests/toy.model -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-05-23T11:34:16,978 running build_ext 2023-05-23T11:34:16,990 building 'curated_tokenizers._spp' extension 2023-05-23T11:34:16,994 creating build/temp.linux-armv7l-cpython-37 2023-05-23T11:34:16,995 creating build/temp.linux-armv7l-cpython-37/curated_tokenizers 2023-05-23T11:34:16,997 creating build/temp.linux-armv7l-cpython-37/sentencepiece 2023-05-23T11:34:16,998 creating build/temp.linux-armv7l-cpython-37/sentencepiece/src 2023-05-23T11:34:17,000 creating build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb 2023-05-23T11:34:17,003 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party 2023-05-23T11:34:17,004 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl 2023-05-23T11:34:17,006 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/flags 2023-05-23T11:34:17,007 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/strings 2023-05-23T11:34:17,009 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite 2023-05-23T11:34:17,013 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c curated_tokenizers/_spp.cpp -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/_spp.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:34:37,995 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/bpe_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/bpe_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:34:54,685 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/builtin_pb/sentencepiece.pb.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece.pb.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:35:07,013 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/builtin_pb/sentencepiece_model.pb.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:35:29,582 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/char_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/char_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:35:41,272 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/error.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/error.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:35:46,184 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/filesystem.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/filesystem.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:35:54,840 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/model_factory.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_factory.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:36:05,350 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/model_interface.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_interface.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:36:22,471 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/normalizer.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/normalizer.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:36:44,373 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/sentencepiece_processor.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/sentencepiece_processor.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:36:52,269 sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(absl::string_view, absl::string_view, const std::vector&, const EncodeResult&, sentencepiece::SentencePieceText*) const’: 2023-05-23T11:36:52,269 sentencepiece/src/sentencepiece_processor.cc:372:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘absl::string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:36:52,270 for (int i = 0; i < w.size(); ++i) { 2023-05-23T11:36:52,270 ~~^~~~~~~~~~ 2023-05-23T11:36:52,271 sentencepiece/src/sentencepiece_processor.cc:383:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘absl::string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:36:52,271 if (i == w.size() - 1) { 2023-05-23T11:36:52,272 ~~^~~~~~~~~~~~~~~ 2023-05-23T11:36:52,393 sentencepiece/src/sentencepiece_processor.cc: In lambda function: 2023-05-23T11:36:52,393 sentencepiece/src/sentencepiece_processor.cc:628:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:36:52,394 for (int j = 0; j < consumed; j++) { 2023-05-23T11:36:52,394 ~~^~~~~~~~~~ 2023-05-23T11:36:52,394 sentencepiece/src/sentencepiece_processor.cc:632:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:36:52,395 if (j == consumed - 1) { 2023-05-23T11:36:52,395 ~~^~~~~~~~~~~~~~~ 2023-05-23T11:37:18,759 sentencepiece/src/sentencepiece_processor.cc: At top level: 2023-05-23T11:37:18,760 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:37:22,682 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/unigram_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/unigram_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:37:30,409 sentencepiece/src/unigram_model.cc: In member function ‘std::vector, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’: 2023-05-23T11:37:30,409 sentencepiece/src/unigram_model.cc:382:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:37:30,410 for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-05-23T11:37:30,410 ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:37:30,411 sentencepiece/src/unigram_model.cc:392:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:37:30,411 for (int i = 0; i < adjusted_probs.size(); i++) { 2023-05-23T11:37:30,412 ~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:37:30,412 sentencepiece/src/unigram_model.cc:403:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:37:30,413 for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-05-23T11:37:30,413 ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:37:30,559 sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(absl::string_view, float, int, bool, bool) const’: 2023-05-23T11:37:30,559 sentencepiece/src/unigram_model.cc:704:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:37:30,560 for (int i = 0; i < nbest_samples.size(); i++) { 2023-05-23T11:37:30,560 ~~^~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:37:30,565 sentencepiece/src/unigram_model.cc:714:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:37:30,566 if (index_of_best != nbest_samples.size()) { 2023-05-23T11:37:30,566 ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:37:30,588 sentencepiece/src/unigram_model.cc:756:27: warning: comparison of integer expressions of different signedness: ‘std::vector >, float> >::size_type’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:37:30,588 while (results.size() < samples) { 2023-05-23T11:37:30,589 ~~~~~~~~~~~~~~~^~~~~~~~~ 2023-05-23T11:37:30,640 sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(absl::string_view) const’: 2023-05-23T11:37:30,640 sentencepiece/src/unigram_model.cc:895:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘unsigned int’} and ‘const int’ [-Wsign-compare] 2023-05-23T11:37:30,641 while (key_pos < size) { 2023-05-23T11:37:30,641 ~~~~~~~~^~~~~~ 2023-05-23T11:37:30,642 sentencepiece/src/unigram_model.cc:916:40: warning: comparison of integer expressions of different signedness: ‘const unsigned int’ and ‘const int’ [-Wsign-compare] 2023-05-23T11:37:30,643 if (!has_single_node && length == mblen) { 2023-05-23T11:37:30,643 ~~~~~~~^~~~~~~~ 2023-05-23T11:37:57,297 sentencepiece/src/unigram_model.cc: At top level: 2023-05-23T11:37:57,297 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:38:01,103 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/util.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:09,107 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/word_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/word_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:20,878 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/absl/flags/flag.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/flags/flag.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:36,327 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/absl/strings/string_view.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/strings/string_view.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:40,107 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/arena.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arena.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:43,779 sentencepiece/third_party/protobuf-lite/arena.cc: In member function ‘std::pair google::protobuf::internal::ArenaImpl::NewBuffer(size_t, size_t)’: 2023-05-23T11:38:43,780 sentencepiece/third_party/protobuf-lite/arena.cc:237:17: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:38:43,780 if (last_size != -1) { 2023-05-23T11:38:43,780 ~~~~~~~~~~^~~~~ 2023-05-23T11:38:45,583 sentencepiece/third_party/protobuf-lite/arena.cc: At top level: 2023-05-23T11:38:45,583 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:38:45,976 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/arenastring.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arenastring.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:53,387 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/bytestream.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/bytestream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:38:56,557 In file included from sentencepiece/third_party/protobuf-lite/bytestream.cc:36: 2023-05-23T11:38:56,558 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual void google::protobuf::strings::ArrayByteSource::Skip(size_t)’: 2023-05-23T11:38:56,558 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:50: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-05-23T11:38:56,558 #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-05-23T11:38:56,559 ~~~~^~~~~~ 2023-05-23T11:38:56,559 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T11:38:56,560 !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T11:38:56,560 ^~~~~~~~~ 2023-05-23T11:38:56,561 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:181:48: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T11:38:56,561 #define GOOGLE_DCHECK(EXPRESSION) while(false) GOOGLE_CHECK(EXPRESSION) 2023-05-23T11:38:56,561 ^~~~~~~~~~~~ 2023-05-23T11:38:56,562 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:32: note: in expansion of macro ‘GOOGLE_DCHECK’ 2023-05-23T11:38:56,562 #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-05-23T11:38:56,563 ^~~~~~~~~~~~~ 2023-05-23T11:38:56,563 sentencepiece/third_party/protobuf-lite/bytestream.cc:157:3: note: in expansion of macro ‘GOOGLE_DCHECK_LE’ 2023-05-23T11:38:56,563 GOOGLE_DCHECK_LE(n, input_.size()); 2023-05-23T11:38:56,564 ^~~~~~~~~~~~~~~~ 2023-05-23T11:38:56,564 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual google::protobuf::StringPiece google::protobuf::strings::LimitByteSource::Peek()’: 2023-05-23T11:38:56,565 sentencepiece/third_party/protobuf-lite/bytestream.cc:177:20: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:38:56,565 if (piece.size() > limit_) { 2023-05-23T11:38:56,565 ~~~~~~~~~~~~~^~~~~~~~ 2023-05-23T11:38:57,560 sentencepiece/third_party/protobuf-lite/bytestream.cc: At top level: 2023-05-23T11:38:57,561 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:38:57,821 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/coded_stream.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/coded_stream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:39:01,625 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian32Fallback(google::protobuf::uint32*)’: 2023-05-23T11:39:01,625 sentencepiece/third_party/protobuf-lite/coded_stream.cc:315:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,626 if (BufferSize() >= sizeof(*value)) { 2023-05-23T11:39:01,626 ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-05-23T11:39:01,627 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian64Fallback(google::protobuf::uint64*)’: 2023-05-23T11:39:01,627 sentencepiece/third_party/protobuf-lite/coded_stream.cc:332:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,628 if (BufferSize() >= sizeof(*value)) { 2023-05-23T11:39:01,628 ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-05-23T11:39:01,942 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 2; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,942 sentencepiece/third_party/protobuf-lite/coded_stream.cc:421:52: required from here 2023-05-23T11:39:01,943 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,943 for (int i = 0, offset = 0; i < N - 1; i++, offset += 7) { 2023-05-23T11:39:01,944 ~~^~~~~~~ 2023-05-23T11:39:01,944 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 3; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,944 sentencepiece/third_party/protobuf-lite/coded_stream.cc:423:52: required from here 2023-05-23T11:39:01,945 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,945 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 4; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,946 sentencepiece/third_party/protobuf-lite/coded_stream.cc:425:52: required from here 2023-05-23T11:39:01,946 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,946 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 5; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,947 sentencepiece/third_party/protobuf-lite/coded_stream.cc:427:52: required from here 2023-05-23T11:39:01,947 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,948 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 6; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,948 sentencepiece/third_party/protobuf-lite/coded_stream.cc:429:52: required from here 2023-05-23T11:39:01,948 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,949 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 7; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,949 sentencepiece/third_party/protobuf-lite/coded_stream.cc:431:52: required from here 2023-05-23T11:39:01,950 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,950 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 8; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,950 sentencepiece/third_party/protobuf-lite/coded_stream.cc:433:52: required from here 2023-05-23T11:39:01,951 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,951 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 9; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,952 sentencepiece/third_party/protobuf-lite/coded_stream.cc:435:52: required from here 2023-05-23T11:39:01,952 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:01,953 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 10; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:39:01,953 sentencepiece/third_party/protobuf-lite/coded_stream.cc:437:53: required from here 2023-05-23T11:39:01,953 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:39:05,052 sentencepiece/third_party/protobuf-lite/coded_stream.cc: At top level: 2023-05-23T11:39:05,052 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:39:05,550 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/common.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/common.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:39:12,160 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/extension_set.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/extension_set.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:39:41,406 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/generated_enum_util.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_enum_util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:39:45,816 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc: In function ‘bool google::protobuf::internal::InitializeEnumStrings(const google::protobuf::internal::EnumEntry*, const int*, size_t, google::protobuf::internal::ExplicitlyConstructed >*)’: 2023-05-23T11:39:45,817 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc:86:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:39:45,817 for (int i = 0; i < size; ++i) { 2023-05-23T11:39:45,818 ~~^~~~~~ 2023-05-23T11:39:47,068 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc: At top level: 2023-05-23T11:39:47,069 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:39:47,352 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:39:53,115 In file included from sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:31: 2023-05-23T11:39:53,115 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = (google::protobuf::internal::ProcessingType)0; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-05-23T11:39:53,116 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:457:49: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-05-23T11:39:53,116 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-05-23T11:39:53,117 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-05-23T11:39:53,117 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:39:53,117 if (*oneof_case == field_number) { 2023-05-23T11:39:53,118 ~~~~~~~~~~~~^~~~~~~~~~~~~~~ 2023-05-23T11:39:53,131 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = (google::protobuf::internal::ProcessingType)3; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-05-23T11:39:53,132 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:647:50: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-05-23T11:39:53,132 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-05-23T11:39:53,132 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-05-23T11:39:53,133 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:40:12,284 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:40:14,441 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/generated_message_util.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:40:36,449 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/implicit_weak_message.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:40:42,822 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/int128.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/int128.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:40:46,396 sentencepiece/third_party/protobuf-lite/int128.cc: In function ‘std::ostream& google::protobuf::operator<<(std::ostream&, const google::protobuf::uint128&)’: 2023-05-23T11:40:46,397 sentencepiece/third_party/protobuf-lite/int128.cc:178:13: warning: comparison of integer expressions of different signedness: ‘std::streamsize’ {aka ‘int’} and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:40:46,397 if (width > rep.size()) { 2023-05-23T11:40:46,398 ~~~~~~^~~~~~~~~~~~ 2023-05-23T11:40:48,131 sentencepiece/third_party/protobuf-lite/int128.cc: At top level: 2023-05-23T11:40:48,132 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:40:48,477 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/io_win32.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/io_win32.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:40:48,650 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/message_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/message_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:40:53,703 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToCodedStream(google::protobuf::io::CodedOutputStream*) const’: 2023-05-23T11:40:53,704 sentencepiece/third_party/protobuf-lite/message_lite.cc:392:46: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:40:53,704 if (final_byte_count - original_byte_count != size) { 2023-05-23T11:40:53,704 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~ 2023-05-23T11:40:53,722 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToArray(void*, int) const’: 2023-05-23T11:40:53,722 sentencepiece/third_party/protobuf-lite/message_lite.cc:491:12: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:40:53,723 if (size < byte_size) return false; 2023-05-23T11:40:53,723 ~~~~~^~~~~~~~~~~ 2023-05-23T11:40:58,719 sentencepiece/third_party/protobuf-lite/message_lite.cc: At top level: 2023-05-23T11:40:58,720 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:40:59,640 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/parse_context.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/parse_context.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:10,309 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/repeated_field.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/repeated_field.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:14,431 In file included from sentencepiece/third_party/protobuf-lite/google/protobuf/repeated_field.h:60, 2023-05-23T11:41:14,432 from sentencepiece/third_party/protobuf-lite/repeated_field.cc:35: 2023-05-23T11:41:14,432 sentencepiece/third_party/protobuf-lite/repeated_field.cc: In member function ‘void** google::protobuf::internal::RepeatedPtrFieldBase::InternalExtend(int)’: 2023-05-23T11:41:14,433 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:41:14,433 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:41:14,433 ~~~~^~~~~~ 2023-05-23T11:41:14,434 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T11:41:14,434 !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T11:41:14,434 ^~~~~~~~~ 2023-05-23T11:41:14,434 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T11:41:14,435 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:41:14,435 ^~~~~~~~~~~~ 2023-05-23T11:41:14,435 sentencepiece/third_party/protobuf-lite/repeated_field.cc:61:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-05-23T11:41:14,436 GOOGLE_CHECK_LE(new_size, (std::numeric_limits::max() - kRepHeaderSize) / 2023-05-23T11:41:14,436 ^~~~~~~~~~~~~~~ 2023-05-23T11:41:27,906 sentencepiece/third_party/protobuf-lite/repeated_field.cc: At top level: 2023-05-23T11:41:27,907 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:41:29,996 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/status.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/status.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:35,809 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/statusor.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/statusor.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:39,850 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/stringpiece.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:42,239 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘bool google::protobuf::StringPiece::contains(google::protobuf::StringPiece) const’: 2023-05-23T11:41:42,240 sentencepiece/third_party/protobuf-lite/stringpiece.cc:101:21: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘const size_type’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:41:42,240 return find(s, 0) != npos; 2023-05-23T11:41:42,241 ~~~~~~~~~~~^~~~~~~ 2023-05-23T11:41:42,257 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘google::protobuf::StringPiece google::protobuf::StringPiece::substr(google::protobuf::StringPiece::size_type, google::protobuf::StringPiece::size_type) const’: 2023-05-23T11:41:42,257 sentencepiece/third_party/protobuf-lite/stringpiece.cc:262:11: warning: comparison of integer expressions of different signedness: ‘google::protobuf::StringPiece::size_type’ {aka ‘unsigned int’} and ‘const stringpiece_ssize_type’ {aka ‘const int’} [-Wsign-compare] 2023-05-23T11:41:42,258 if (pos > length_) pos = length_; 2023-05-23T11:41:42,258 ~~~~^~~~~~~~~ 2023-05-23T11:41:43,929 sentencepiece/third_party/protobuf-lite/stringpiece.cc: At top level: 2023-05-23T11:41:43,929 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:41:44,217 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/stringprintf.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringprintf.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:47,404 sentencepiece/third_party/protobuf-lite/stringprintf.cc: In function ‘std::__cxx11::string google::protobuf::StringPrintfVector(const char*, const std::vector >&)’: 2023-05-23T11:41:47,405 sentencepiece/third_party/protobuf-lite/stringprintf.cc:153:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:41:47,405 for (int i = 0; i < v.size(); ++i) { 2023-05-23T11:41:47,406 ~~^~~~~~~~~~ 2023-05-23T11:41:47,407 sentencepiece/third_party/protobuf-lite/stringprintf.cc:156:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:41:47,408 for (int i = v.size(); i < GOOGLE_ARRAYSIZE(cstr); ++i) { 2023-05-23T11:41:48,242 sentencepiece/third_party/protobuf-lite/stringprintf.cc: At top level: 2023-05-23T11:41:48,242 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:41:48,478 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/structurally_valid.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/structurally_valid.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:52,862 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/strutil.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/strutil.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:41:56,463 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘void google::protobuf::CEscapeAndAppend(google::protobuf::StringPiece, std::__cxx11::string*)’: 2023-05-23T11:41:56,463 sentencepiece/third_party/protobuf-lite/strutil.cc:563:19: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-05-23T11:41:56,464 if (escaped_len == src.size()) { 2023-05-23T11:41:56,464 ~~~~~~~~~~~~^~~~~~~~~~~~~ 2023-05-23T11:41:56,520 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::memcasecmp(const char*, const char*, size_t)’: 2023-05-23T11:41:56,520 sentencepiece/third_party/protobuf-lite/strutil.cc:1290:22: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:41:56,520 for ( int i = 0; i < len; i++ ) { 2023-05-23T11:41:56,521 ~~^~~~~ 2023-05-23T11:41:56,572 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::GlobalReplaceSubstring(const string&, const string&, std::__cxx11::string*)’: 2023-05-23T11:41:56,572 sentencepiece/third_party/protobuf-lite/strutil.cc:1623:18: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:41:56,573 match_pos != std::string::npos; pos = match_pos + substring.length(), 2023-05-23T11:41:56,573 ~~~~~~~~~~^~~~~~ 2023-05-23T11:42:05,178 sentencepiece/third_party/protobuf-lite/strutil.cc: At top level: 2023-05-23T11:42:05,178 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:42:06,360 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/time.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/time.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:42:11,762 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/wire_format_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/wire_format_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:42:22,118 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/zero_copy_stream.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:42:25,912 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:42:31,266 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:42:34,563 In file included from sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:41: 2023-05-23T11:42:34,564 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc: In member function ‘virtual void google::protobuf::io::StringOutputStream::BackUp(int)’: 2023-05-23T11:42:34,564 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:42:34,564 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:42:34,565 ~~~~^~~~~~ 2023-05-23T11:42:34,565 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T11:42:34,566 !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T11:42:34,566 ^~~~~~~~~ 2023-05-23T11:42:34,566 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T11:42:34,567 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:42:34,567 ^~~~~~~~~~~~ 2023-05-23T11:42:34,568 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:171:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-05-23T11:42:34,568 GOOGLE_CHECK_LE(count, target_->size()); 2023-05-23T11:42:34,568 ^~~~~~~~~~~~~~~ 2023-05-23T11:42:36,694 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc: At top level: 2023-05-23T11:42:36,695 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:42:37,060 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro build/temp.linux-armv7l-cpython-37/curated_tokenizers/_spp.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/bpe_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece.pb.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/char_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/error.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/filesystem.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_factory.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_interface.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/normalizer.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/sentencepiece_processor.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/unigram_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/util.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/word_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/flags/flag.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/strings/string_view.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arena.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arenastring.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/bytestream.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/coded_stream.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/common.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/extension_set.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_enum_util.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_util.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/int128.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/io_win32.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/message_lite.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/parse_context.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/repeated_field.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/status.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/statusor.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringpiece.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringprintf.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/structurally_valid.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/strutil.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/time.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/wire_format_lite.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o -L/usr/lib -o build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.cpython-37m-arm-linux-gnueabihf.so 2023-05-23T11:44:51,851 building 'curated_tokenizers._wordpiece' extension 2023-05-23T11:44:51,854 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/_wordpiece.cpp -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:44:54,860 curated_tokenizers/_wordpiece.cpp: In function ‘PyObject* __pyx_pf_18curated_tokenizers_10_wordpiece_18WordPieceProcessor_14to_list(__pyx_obj_18curated_tokenizers_10_wordpiece_WordPieceProcessor*)’: 2023-05-23T11:44:54,861 curated_tokenizers/_wordpiece.cpp:3149:35: warning: comparison of integer expressions of different signedness: ‘Py_ssize_t’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:44:54,861 for (__pyx_temp=0; __pyx_temp < __pyx_v_self->_pieces.size(); __pyx_temp++) { 2023-05-23T11:44:54,862 ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:45:08,539 curated_tokenizers/_wordpiece.cpp: At top level: 2023-05-23T11:45:08,539 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:45:10,112 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/wordpiece.cc -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:45:11,954 curated_tokenizers/wordpiece.cc: In member function ‘const Piece& PieceStorage::id_to_piece(int) const’: 2023-05-23T11:45:11,955 curated_tokenizers/wordpiece.cc:15:22: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:45:11,955 if (id < 0 || id >= size()) { 2023-05-23T11:45:11,956 ~~~^~~~~~~~~ 2023-05-23T11:45:14,483 curated_tokenizers/wordpiece.cc: At top level: 2023-05-23T11:45:14,483 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-05-23T11:45:15,015 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro build/temp.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.o build/temp.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.o -L/usr/lib -o build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.cpython-37m-arm-linux-gnueabihf.so 2023-05-23T11:45:27,042 building 'curated_tokenizers._bbpe' extension 2023-05-23T11:45:27,044 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/_bbpe.cpp -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:45:59,989 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/merges.cc -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/merges.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:46:06,587 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro build/temp.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.o build/temp.linux-armv7l-cpython-37/curated_tokenizers/merges.o -L/usr/lib -o build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.cpython-37m-arm-linux-gnueabihf.so 2023-05-23T11:46:28,742 installing to build/bdist.linux-armv7l/wheel 2023-05-23T11:46:28,743 running install 2023-05-23T11:46:28,805 running install_lib 2023-05-23T11:46:28,838 creating build/bdist.linux-armv7l 2023-05-23T11:46:28,839 creating build/bdist.linux-armv7l/wheel 2023-05-23T11:46:28,843 creating build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,845 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,849 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,853 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,857 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,877 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/merges.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,881 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,905 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.cpython-37m-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,945 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,949 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/merges.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:28,952 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.cpython-37m-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,249 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,254 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,259 creating build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,260 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/robbert-vocab-1000.json -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,267 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/toy.model -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,286 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/robbert-merges-1000.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,290 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/toy-word-pieces.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,294 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/test_word_piece_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,297 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/test_sp.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,301 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/incorrect-merges.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,305 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,307 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/test_bbpe_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:46:29,311 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,315 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,318 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,339 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.cpython-37m-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,363 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/util.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,366 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,370 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/config.h -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:46:29,373 running install_egg_info 2023-05-23T11:46:29,399 Copying curated_tokenizers.egg-info to build/bdist.linux-armv7l/wheel/curated_tokenizers-0.0.6-py3.7.egg-info 2023-05-23T11:46:29,426 running install_scripts 2023-05-23T11:46:29,523 creating build/bdist.linux-armv7l/wheel/curated_tokenizers-0.0.6.dist-info/WHEEL 2023-05-23T11:46:29,529 creating '/tmp/pip-wheel-3pub9hnn/.tmp-khqm2161/curated_tokenizers-0.0.6-cp37-cp37m-linux_armv7l.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-05-23T11:46:29,535 adding 'curated_tokenizers/__init__.py' 2023-05-23T11:46:29,634 adding 'curated_tokenizers/_bbpe.cpp' 2023-05-23T11:46:29,894 adding 'curated_tokenizers/_bbpe.cpython-37m-arm-linux-gnueabihf.so' 2023-05-23T11:46:29,909 adding 'curated_tokenizers/_bbpe.pxd' 2023-05-23T11:46:29,913 adding 'curated_tokenizers/_bbpe.pyx' 2023-05-23T11:46:29,976 adding 'curated_tokenizers/_spp.cpp' 2023-05-23T11:46:32,970 adding 'curated_tokenizers/_spp.cpython-37m-arm-linux-gnueabihf.so' 2023-05-23T11:46:33,118 adding 'curated_tokenizers/_spp.pxd' 2023-05-23T11:46:33,131 adding 'curated_tokenizers/_spp.pyx' 2023-05-23T11:46:33,194 adding 'curated_tokenizers/_wordpiece.cpp' 2023-05-23T11:46:33,372 adding 'curated_tokenizers/_wordpiece.cpython-37m-arm-linux-gnueabihf.so' 2023-05-23T11:46:33,383 adding 'curated_tokenizers/_wordpiece.pxd' 2023-05-23T11:46:33,386 adding 'curated_tokenizers/_wordpiece.pyx' 2023-05-23T11:46:33,389 adding 'curated_tokenizers/config.h' 2023-05-23T11:46:33,392 adding 'curated_tokenizers/merges.cc' 2023-05-23T11:46:33,395 adding 'curated_tokenizers/merges.hh' 2023-05-23T11:46:33,398 adding 'curated_tokenizers/util.hh' 2023-05-23T11:46:33,402 adding 'curated_tokenizers/wordpiece.cc' 2023-05-23T11:46:33,405 adding 'curated_tokenizers/wordpiece.hh' 2023-05-23T11:46:33,408 adding 'curated_tokenizers/tests/__init__.py' 2023-05-23T11:46:33,411 adding 'curated_tokenizers/tests/incorrect-merges.txt' 2023-05-23T11:46:33,415 adding 'curated_tokenizers/tests/robbert-merges-1000.txt' 2023-05-23T11:46:33,424 adding 'curated_tokenizers/tests/robbert-vocab-1000.json' 2023-05-23T11:46:33,427 adding 'curated_tokenizers/tests/test_bbpe_processor.py' 2023-05-23T11:46:33,430 adding 'curated_tokenizers/tests/test_sp.py' 2023-05-23T11:46:33,433 adding 'curated_tokenizers/tests/test_word_piece_processor.py' 2023-05-23T11:46:33,435 adding 'curated_tokenizers/tests/toy-word-pieces.txt' 2023-05-23T11:46:33,609 adding 'curated_tokenizers/tests/toy.model' 2023-05-23T11:46:33,619 adding 'curated_tokenizers-0.0.6.dist-info/LICENSE' 2023-05-23T11:46:33,621 adding 'curated_tokenizers-0.0.6.dist-info/METADATA' 2023-05-23T11:46:33,623 adding 'curated_tokenizers-0.0.6.dist-info/WHEEL' 2023-05-23T11:46:33,625 adding 'curated_tokenizers-0.0.6.dist-info/top_level.txt' 2023-05-23T11:46:33,627 adding 'curated_tokenizers-0.0.6.dist-info/zip-safe' 2023-05-23T11:46:33,630 adding 'curated_tokenizers-0.0.6.dist-info/RECORD' 2023-05-23T11:46:33,744 removing build/bdist.linux-armv7l/wheel 2023-05-23T11:46:34,009 Building wheel for curated-tokenizers (pyproject.toml): finished with status 'done' 2023-05-23T11:46:34,203 Created wheel for curated-tokenizers: filename=curated_tokenizers-0.0.6-cp37-cp37m-linux_armv7l.whl size=3121572 sha256=f879b0c6698bd68d7861e7575b381982a214a3f3bfd74d3211e6ee3b0a873f24 2023-05-23T11:46:34,205 Stored in directory: /tmp/pip-ephem-wheel-cache-q7poijnb/wheels/09/c3/28/aed41acc4f64a443533e3b9764e997255d8c6d8b7f56eaaa3d 2023-05-23T11:46:34,237 Successfully built curated-tokenizers 2023-05-23T11:46:34,451 Removed build tracker: '/tmp/pip-build-tracker-iz9d616_'