2023-05-23T11:13:41,628 Created temporary directory: /tmp/pip-build-tracker-w29s38l3 2023-05-23T11:13:41,629 Initialized build tracking at /tmp/pip-build-tracker-w29s38l3 2023-05-23T11:13:41,629 Created build tracker: /tmp/pip-build-tracker-w29s38l3 2023-05-23T11:13:41,629 Entered build tracker: /tmp/pip-build-tracker-w29s38l3 2023-05-23T11:13:41,630 Created temporary directory: /tmp/pip-wheel-r0jnop47 2023-05-23T11:13:41,633 Created temporary directory: /tmp/pip-ephem-wheel-cache-ker75x2b 2023-05-23T11:13:41,659 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:13:41,663 2 location(s) to search for versions of curated-tokenizers: 2023-05-23T11:13:41,663 * https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,663 * https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,663 Fetching project page and analyzing links: https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,664 Getting page https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,665 Found index url https://pypi.org/simple/ 2023-05-23T11:13:41,716 Fetched page https://pypi.org/simple/curated-tokenizers/ as application/vnd.pypi.simple.v1+json 2023-05-23T11:13:41,723 Found link https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.6 2023-05-23T11:13:41,723 Found link https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.7 2023-05-23T11:13:41,724 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ab/03/154ea07588145b1faf5ab9f74ec9e80dea57e32920bb8cbd4d11a1029784/curated_tokenizers-0.0.7-cp310-cp310-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,724 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/8b/44/48a6b56ee6d96dab6af01319b4bb0b999ae5dd79e314f124919ee5530a14/curated_tokenizers-0.0.7-cp310-cp310-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,724 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2e/f3/a74baca025795e9fafcceb277a26fe000d5706a51a21a0784e742622720b/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,724 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/a6/99/c717badc07bea0c347867fb3d8631a9f8099bd8c1294344adf94c6f745db/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,724 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/58/34/a87bff5c21ac46b0621a86aea39696a3f489b4fd35552c571a1620655832/curated_tokenizers-0.0.7-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,725 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/91/81/9709ed42e751148c7853feb54cacba7295072eebde2dc5c003331504976f/curated_tokenizers-0.0.7-cp311-cp311-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,725 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/93/b1/38f7f527a22a9a2e9393f52dc875b7875784b644bfcd5c7703882b2d1c36/curated_tokenizers-0.0.7-cp311-cp311-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,725 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/5d/d6/d4cb39a2bca58a332b1074508f8f3961b1be85c6c048a41b4b02dd95aef3/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,725 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/63/ae/5a892033ddcbd0f2c072f24662daba8fee8f772047339160f0cf3389a93c/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,726 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c5/25/88ac587b0718ebf5b8e94432ea02d8304ddd72f014df3406b54ffd2305d1/curated_tokenizers-0.0.7-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,726 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c3/bf/eecad1bf5195cb686deac249b82408519a205b59467193ceb46652d9cf21/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,726 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/53/7e/97e73e70c1beda5e743fed345aa8556234d701ce292a0b5e6453aedf8da2/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,726 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2b/9a/6cce938f8ecd03dbf42f8dfda93ac9d792fdac5de501ca28034706c77d30/curated_tokenizers-0.0.7-cp36-cp36m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,726 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/a5/8fec572adfb1bb1bd1b1da5637da8704c6c6424227078ca13cb20040474d/curated_tokenizers-0.0.7-cp37-cp37m-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,726 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ea/a9/fd09bacc1d268b7ce65e0d76e2db7bb4cffe8f8738b9a6208cbcde7f27ab/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,727 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c0/ad/6cb1d029551589851126e8f875879be2a229ceec87360e26bcc70ce0277c/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,727 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/4f/37/271d4c2da6726e052b3c8f796f8f62a35d737683e2eb380ab08876af72df/curated_tokenizers-0.0.7-cp37-cp37m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,727 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/7e/43c36efdb3d4c6933d04ff739bad7624647e1b5ef0150d2502affe3570d9/curated_tokenizers-0.0.7-cp38-cp38-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,727 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c9/4d/bce24fbafaf469779ebdf97c44cfc2bc8273a9b5149b0dd3862ecaea3004/curated_tokenizers-0.0.7-cp38-cp38-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,727 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/0f/98/fd0eacc8238aa4450a7afec74dd41026c269dc112242f7be4ece119d6dcb/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,728 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2d/2e/ea5716f79bcb4aff8e436e11119398af9c3a1d7a4612190dfc40e0cdb9a7/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,728 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/cf/fa/2c84864cf891d5c43bca09ba20b4df6b8f56cd06e8e8a36c9e661f09d7f1/curated_tokenizers-0.0.7-cp38-cp38-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,728 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/61/04/ced9b45557896758e66b93199277eb122f855a69e569b0b2abfc0cf0980e/curated_tokenizers-0.0.7-cp39-cp39-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,728 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/e2/2c/ac0b4984c513dc37ff8fd25bbdcc0de11351be0c421ce65f6a677003e45c/curated_tokenizers-0.0.7-cp39-cp39-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,729 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/1f/79/cbddbb037335a5b1dea9eaf4a34d0380d7a12f59ef905219a2a9edee72ff/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,729 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/49/7b/86edf0a051de18bdcc07bedb425b9e3c999a927b4a7c47eff5caaf0e2231/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,729 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/31/d7/d036791616d0bc89eb81de5d46ffa9b34e1333e6c420d8d28050fbdf1b82/curated_tokenizers-0.0.7-cp39-cp39-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,729 Fetching project page and analyzing links: https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,730 Getting page https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,731 Found index url https://www.piwheels.org/simple/ 2023-05-23T11:13:41,900 Fetched page https://www.piwheels.org/simple/curated-tokenizers/ as text/html 2023-05-23T11:13:41,901 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv7l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,902 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv6l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-05-23T11:13:41,902 Skipping link: not a file: https://www.piwheels.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,902 Skipping link: not a file: https://pypi.org/simple/curated-tokenizers/ 2023-05-23T11:13:41,919 Given no hashes to check 1 links for project 'curated-tokenizers': discarding no candidates 2023-05-23T11:13:41,936 Collecting curated-tokenizers==0.0.7 2023-05-23T11:13:41,938 Created temporary directory: /tmp/pip-unpack-7ooywu_g 2023-05-23T11:13:41,982 Downloading curated-tokenizers-0.0.7.tar.gz (2.2 MB) 2023-05-23T11:13:42,926 Added curated-tokenizers==0.0.7 from https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz to build tracker '/tmp/pip-build-tracker-w29s38l3' 2023-05-23T11:13:42,931 Created temporary directory: /tmp/pip-build-env-w_0qz97u 2023-05-23T11:13:42,946 Installing build dependencies: started 2023-05-23T11:13:42,947 Running command pip subprocess to install build dependencies 2023-05-23T11:13:44,138 Using pip 23.1.2 from /usr/local/lib/python3.9/dist-packages/pip (python 3.9) 2023-05-23T11:13:44,493 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:13:46,161 Collecting setuptools 2023-05-23T11:13:46,250 Using cached https://www.piwheels.org/simple/setuptools/setuptools-67.8.0-py3-none-any.whl (1.1 MB) 2023-05-23T11:13:47,680 Collecting cython>=0.25 2023-05-23T11:13:48,089 Using cached https://www.piwheels.org/simple/cython/Cython-0.29.34-cp39-cp39-linux_armv7l.whl (5.0 MB) 2023-05-23T11:13:49,864 Installing collected packages: setuptools, cython 2023-05-23T11:13:54,592 Creating /tmp/pip-build-env-w_0qz97u/overlay/bin 2023-05-23T11:13:54,594 changing mode of /tmp/pip-build-env-w_0qz97u/overlay/bin/cygdb to 755 2023-05-23T11:13:54,596 changing mode of /tmp/pip-build-env-w_0qz97u/overlay/bin/cython to 755 2023-05-23T11:13:54,598 changing mode of /tmp/pip-build-env-w_0qz97u/overlay/bin/cythonize to 755 2023-05-23T11:13:54,619 Successfully installed cython-0.29.34 setuptools-67.8.0 2023-05-23T11:13:54,931 Installing build dependencies: finished with status 'done' 2023-05-23T11:13:54,936 Getting requirements to build wheel: started 2023-05-23T11:13:54,937 Running command Getting requirements to build wheel 2023-05-23T11:13:58,370 Cythonizing sources 2023-05-23T11:13:58,371 Compiling curated_tokenizers/_spp.pyx because it changed. 2023-05-23T11:13:58,371 Compiling curated_tokenizers/_wordpiece.pyx because it changed. 2023-05-23T11:13:58,371 Compiling curated_tokenizers/_bbpe.pyx because it changed. 2023-05-23T11:13:58,371 [1/3] Cythonizing curated_tokenizers/_bbpe.pyx 2023-05-23T11:13:58,371 [2/3] Cythonizing curated_tokenizers/_spp.pyx 2023-05-23T11:13:58,372 [3/3] Cythonizing curated_tokenizers/_wordpiece.pyx 2023-05-23T11:13:58,529 running egg_info 2023-05-23T11:13:58,534 writing curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:13:58,537 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:13:58,539 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-05-23T11:13:58,541 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:13:58,574 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:13:58,600 adding license file 'LICENSE' 2023-05-23T11:13:58,610 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:13:58,820 Getting requirements to build wheel: finished with status 'done' 2023-05-23T11:13:58,831 Installing backend dependencies: started 2023-05-23T11:13:58,832 Running command pip subprocess to install backend dependencies 2023-05-23T11:14:00,011 Using pip 23.1.2 from /usr/local/lib/python3.9/dist-packages/pip (python 3.9) 2023-05-23T11:14:00,369 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-23T11:14:00,801 Collecting wheel 2023-05-23T11:14:00,819 Using cached https://www.piwheels.org/simple/wheel/wheel-0.40.0-py3-none-any.whl (64 kB) 2023-05-23T11:14:02,105 Installing collected packages: wheel 2023-05-23T11:14:02,319 Creating /tmp/pip-build-env-w_0qz97u/normal/bin 2023-05-23T11:14:02,320 changing mode of /tmp/pip-build-env-w_0qz97u/normal/bin/wheel to 755 2023-05-23T11:14:02,333 Successfully installed wheel-0.40.0 2023-05-23T11:14:02,548 Installing backend dependencies: finished with status 'done' 2023-05-23T11:14:02,550 Created temporary directory: /tmp/pip-modern-metadata-adzk_0g0 2023-05-23T11:14:02,553 Preparing metadata (pyproject.toml): started 2023-05-23T11:14:02,554 Running command Preparing metadata (pyproject.toml) 2023-05-23T11:14:03,733 Cythonizing sources 2023-05-23T11:14:03,829 running dist_info 2023-05-23T11:14:03,853 creating /tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info 2023-05-23T11:14:03,857 writing /tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:14:03,860 writing dependency_links to /tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:14:03,862 writing requirements to /tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/requires.txt 2023-05-23T11:14:03,863 writing top-level names to /tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:14:03,865 writing manifest file '/tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:14:03,891 reading manifest file '/tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:14:03,894 adding license file 'LICENSE' 2023-05-23T11:14:03,898 writing manifest file '/tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:14:03,899 creating '/tmp/pip-modern-metadata-adzk_0g0/curated_tokenizers-0.0.7.dist-info' 2023-05-23T11:14:04,105 Preparing metadata (pyproject.toml): finished with status 'done' 2023-05-23T11:14:04,111 Source in /tmp/pip-wheel-r0jnop47/curated-tokenizers_2f8e633cdc7d4c6faf1f05c45d4126b1 has version 0.0.7, which satisfies requirement curated-tokenizers==0.0.7 from https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz 2023-05-23T11:14:04,112 Removed curated-tokenizers==0.0.7 from https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz from build tracker '/tmp/pip-build-tracker-w29s38l3' 2023-05-23T11:14:04,119 Created temporary directory: /tmp/pip-unpack-8azk7unn 2023-05-23T11:14:04,119 Building wheels for collected packages: curated-tokenizers 2023-05-23T11:14:04,124 Created temporary directory: /tmp/pip-wheel-1vw14pq6 2023-05-23T11:14:04,124 Destination directory: /tmp/pip-wheel-1vw14pq6 2023-05-23T11:14:04,126 Building wheel for curated-tokenizers (pyproject.toml): started 2023-05-23T11:14:04,127 Running command Building wheel for curated-tokenizers (pyproject.toml) 2023-05-23T11:14:05,263 Cythonizing sources 2023-05-23T11:14:05,403 running bdist_wheel 2023-05-23T11:14:05,420 running build 2023-05-23T11:14:05,420 running build_py 2023-05-23T11:14:05,428 creating build 2023-05-23T11:14:05,429 creating build/lib.linux-armv7l-cpython-39 2023-05-23T11:14:05,429 creating build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,431 copying curated_tokenizers/__init__.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,433 creating build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,434 copying curated_tokenizers/tests/test_word_piece_processor.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,436 copying curated_tokenizers/tests/__init__.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,437 copying curated_tokenizers/tests/test_sp.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,440 copying curated_tokenizers/tests/test_bbpe_processor.py -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,441 running egg_info 2023-05-23T11:14:05,459 writing curated_tokenizers.egg-info/PKG-INFO 2023-05-23T11:14:05,461 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-05-23T11:14:05,463 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-05-23T11:14:05,464 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-05-23T11:14:05,485 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:14:05,511 adding license file 'LICENSE' 2023-05-23T11:14:05,521 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-05-23T11:14:05,538 copying curated_tokenizers/_bbpe.cpp -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,551 copying curated_tokenizers/_bbpe.pxd -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,553 copying curated_tokenizers/_bbpe.pyx -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,556 copying curated_tokenizers/_spp.cpp -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,565 copying curated_tokenizers/_spp.pxd -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,568 copying curated_tokenizers/_spp.pyx -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,570 copying curated_tokenizers/_wordpiece.cpp -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,579 copying curated_tokenizers/_wordpiece.pxd -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,581 copying curated_tokenizers/_wordpiece.pyx -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,584 copying curated_tokenizers/config.h -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,586 copying curated_tokenizers/merges.cc -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,589 copying curated_tokenizers/merges.hh -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,591 copying curated_tokenizers/util.hh -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,594 copying curated_tokenizers/wordpiece.cc -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,597 copying curated_tokenizers/wordpiece.hh -> build/lib.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,618 copying curated_tokenizers/tests/incorrect-merges.txt -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,620 copying curated_tokenizers/tests/robbert-merges-1000.txt -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,623 copying curated_tokenizers/tests/robbert-vocab-1000.json -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,625 copying curated_tokenizers/tests/toy-word-pieces.txt -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,627 copying curated_tokenizers/tests/toy.model -> build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests 2023-05-23T11:14:05,636 running build_ext 2023-05-23T11:14:05,641 building 'curated_tokenizers._spp' extension 2023-05-23T11:14:05,643 creating build/temp.linux-armv7l-cpython-39 2023-05-23T11:14:05,643 creating build/temp.linux-armv7l-cpython-39/curated_tokenizers 2023-05-23T11:14:05,644 creating build/temp.linux-armv7l-cpython-39/sentencepiece 2023-05-23T11:14:05,645 creating build/temp.linux-armv7l-cpython-39/sentencepiece/src 2023-05-23T11:14:05,646 creating build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb 2023-05-23T11:14:05,648 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party 2023-05-23T11:14:05,648 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl 2023-05-23T11:14:05,649 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/flags 2023-05-23T11:14:05,650 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/strings 2023-05-23T11:14:05,650 creating build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite 2023-05-23T11:14:05,652 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c curated_tokenizers/_spp.cpp -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/_spp.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:14,316 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/bpe_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/bpe_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:21,241 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/builtin_pb/sentencepiece.pb.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece.pb.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:26,435 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/builtin_pb/sentencepiece_model.pb.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:35,914 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/char_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/char_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:41,111 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/error.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/error.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:43,244 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/filesystem.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/filesystem.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:46,944 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/model_factory.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_factory.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:51,726 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/model_interface.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_interface.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:14:59,077 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/normalizer.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/normalizer.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:06,898 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/sentencepiece_processor.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/sentencepiece_processor.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:10,728 sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(absl::string_view, absl::string_view, const std::vector&, const EncodeResult&, sentencepiece::SentencePieceText*) const’: 2023-05-23T11:15:10,729 sentencepiece/src/sentencepiece_processor.cc:372:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘absl::string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:10,729 372 | for (int i = 0; i < w.size(); ++i) { 2023-05-23T11:15:10,729 | ~~^~~~~~~~~~ 2023-05-23T11:15:10,730 sentencepiece/src/sentencepiece_processor.cc:383:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘absl::string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:10,730 383 | if (i == w.size() - 1) { 2023-05-23T11:15:10,730 | ~~^~~~~~~~~~~~~~~ 2023-05-23T11:15:10,789 sentencepiece/src/sentencepiece_processor.cc: In lambda function: 2023-05-23T11:15:10,790 sentencepiece/src/sentencepiece_processor.cc:628:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:10,790 628 | for (int j = 0; j < consumed; j++) { 2023-05-23T11:15:10,790 | ~~^~~~~~~~~~ 2023-05-23T11:15:10,790 sentencepiece/src/sentencepiece_processor.cc:632:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:10,791 632 | if (j == consumed - 1) { 2023-05-23T11:15:10,791 | ~~^~~~~~~~~~~~~~~ 2023-05-23T11:15:18,868 In file included from /usr/include/c++/10/vector:72, 2023-05-23T11:15:18,869 from sentencepiece/src/common.h:26, 2023-05-23T11:15:18,869 from sentencepiece/src/sentencepiece_processor.cc:19: 2023-05-23T11:15:18,869 /usr/include/c++/10/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const double&}; _Tp = double; _Alloc = std::allocator]’: 2023-05-23T11:15:18,869 /usr/include/c++/10/bits/vector.tcc:426:7: note: parameter passing for argument of type ‘std::vector::iterator’ changed in GCC 7.1 2023-05-23T11:15:18,869 426 | vector<_Tp, _Alloc>:: 2023-05-23T11:15:18,869 | ^~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:18,923 In file included from /usr/include/c++/10/vector:67, 2023-05-23T11:15:18,923 from sentencepiece/src/common.h:26, 2023-05-23T11:15:18,923 from sentencepiece/src/sentencepiece_processor.cc:19: 2023-05-23T11:15:18,923 /usr/include/c++/10/bits/stl_vector.h: In member function ‘void std::discrete_distribution<_IntType>::param_type::_M_initialize() [with _IntType = int]’: 2023-05-23T11:15:18,923 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T11:15:18,924 1198 | _M_realloc_insert(end(), __x); 2023-05-23T11:15:18,924 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T11:15:18,924 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T11:15:18,924 1198 | _M_realloc_insert(end(), __x); 2023-05-23T11:15:18,924 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T11:15:21,870 At global scope: 2023-05-23T11:15:21,870 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:15:23,146 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/unigram_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/unigram_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:26,961 sentencepiece/src/unigram_model.cc: In member function ‘std::vector, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’: 2023-05-23T11:15:26,961 sentencepiece/src/unigram_model.cc:382:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:26,962 382 | for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-05-23T11:15:26,962 | ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:26,962 sentencepiece/src/unigram_model.cc:392:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:26,962 392 | for (int i = 0; i < adjusted_probs.size(); i++) { 2023-05-23T11:15:26,962 | ~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:26,963 sentencepiece/src/unigram_model.cc:403:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:26,963 403 | for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-05-23T11:15:26,963 | ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:27,035 sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(absl::string_view, float, int, bool, bool) const’: 2023-05-23T11:15:27,035 sentencepiece/src/unigram_model.cc:704:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:27,035 704 | for (int i = 0; i < nbest_samples.size(); i++) { 2023-05-23T11:15:27,035 | ~~^~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:27,038 sentencepiece/src/unigram_model.cc:714:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:15:27,038 714 | if (index_of_best != nbest_samples.size()) { 2023-05-23T11:15:27,038 | ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:27,049 sentencepiece/src/unigram_model.cc:756:27: warning: comparison of integer expressions of different signedness: ‘std::vector >, float> >::size_type’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:15:27,049 756 | while (results.size() < samples) { 2023-05-23T11:15:27,049 | ~~~~~~~~~~~~~~~^~~~~~~~~ 2023-05-23T11:15:27,074 sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(absl::string_view) const’: 2023-05-23T11:15:27,075 sentencepiece/src/unigram_model.cc:895:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘unsigned int’} and ‘const int’ [-Wsign-compare] 2023-05-23T11:15:27,075 895 | while (key_pos < size) { 2023-05-23T11:15:27,075 | ~~~~~~~~^~~~~~ 2023-05-23T11:15:27,075 sentencepiece/src/unigram_model.cc:916:40: warning: comparison of integer expressions of different signedness: ‘const unsigned int’ and ‘const int’ [-Wsign-compare] 2023-05-23T11:15:27,076 916 | if (!has_single_node && length == mblen) { 2023-05-23T11:15:27,076 | ~~~~~~~^~~~~~~~ 2023-05-23T11:15:36,302 In file included from /usr/include/c++/10/vector:72, 2023-05-23T11:15:36,302 from /usr/include/c++/10/queue:61, 2023-05-23T11:15:36,303 from sentencepiece/src/unigram_model.cc:20: 2023-05-23T11:15:36,303 /usr/include/c++/10/bits/vector.tcc: In member function ‘void std::vector<_Tp, _Alloc>::_M_realloc_insert(std::vector<_Tp, _Alloc>::iterator, _Args&& ...) [with _Args = {const double&}; _Tp = double; _Alloc = std::allocator]’: 2023-05-23T11:15:36,303 /usr/include/c++/10/bits/vector.tcc:426:7: note: parameter passing for argument of type ‘std::vector::iterator’ changed in GCC 7.1 2023-05-23T11:15:36,303 426 | vector<_Tp, _Alloc>:: 2023-05-23T11:15:36,303 | ^~~~~~~~~~~~~~~~~~~ 2023-05-23T11:15:36,357 In file included from /usr/include/c++/10/vector:67, 2023-05-23T11:15:36,357 from /usr/include/c++/10/queue:61, 2023-05-23T11:15:36,357 from sentencepiece/src/unigram_model.cc:20: 2023-05-23T11:15:36,357 /usr/include/c++/10/bits/stl_vector.h: In member function ‘void std::discrete_distribution<_IntType>::param_type::_M_initialize() [with _IntType = int]’: 2023-05-23T11:15:36,357 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T11:15:36,358 1198 | _M_realloc_insert(end(), __x); 2023-05-23T11:15:36,358 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T11:15:36,358 /usr/include/c++/10/bits/stl_vector.h:1198:21: note: parameter passing for argument of type ‘__gnu_cxx::__normal_iterator >’ changed in GCC 7.1 2023-05-23T11:15:36,358 1198 | _M_realloc_insert(end(), __x); 2023-05-23T11:15:36,358 | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~ 2023-05-23T11:15:37,907 At global scope: 2023-05-23T11:15:37,907 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:15:39,017 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/util.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:42,440 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/src/word_model.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/src/word_model.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:47,701 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/absl/flags/flag.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/flags/flag.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:54,136 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/absl/strings/string_view.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/strings/string_view.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:55,749 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/arena.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arena.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:15:57,517 sentencepiece/third_party/protobuf-lite/arena.cc: In member function ‘std::pair google::protobuf::internal::ArenaImpl::NewBuffer(size_t, size_t)’: 2023-05-23T11:15:57,517 sentencepiece/third_party/protobuf-lite/arena.cc:237:17: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:15:57,517 237 | if (last_size != -1) { 2023-05-23T11:15:57,517 | ~~~~~~~~~~^~~~~ 2023-05-23T11:15:58,233 At global scope: 2023-05-23T11:15:58,233 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:15:58,331 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/arenastring.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arenastring.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:01,421 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/bytestream.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/bytestream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:02,944 In file included from sentencepiece/third_party/protobuf-lite/bytestream.cc:36: 2023-05-23T11:16:02,945 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual void google::protobuf::strings::ArrayByteSource::Skip(size_t)’: 2023-05-23T11:16:02,945 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:50: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-05-23T11:16:02,945 186 | #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-05-23T11:16:02,945 | ~~~~^~~~~~ 2023-05-23T11:16:02,945 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T11:16:02,946 151 | !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T11:16:02,946 | ^~~~~~~~~ 2023-05-23T11:16:02,946 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:181:48: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T11:16:02,946 181 | #define GOOGLE_DCHECK(EXPRESSION) while(false) GOOGLE_CHECK(EXPRESSION) 2023-05-23T11:16:02,946 | ^~~~~~~~~~~~ 2023-05-23T11:16:02,946 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:32: note: in expansion of macro ‘GOOGLE_DCHECK’ 2023-05-23T11:16:02,947 186 | #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-05-23T11:16:02,947 | ^~~~~~~~~~~~~ 2023-05-23T11:16:02,947 sentencepiece/third_party/protobuf-lite/bytestream.cc:157:3: note: in expansion of macro ‘GOOGLE_DCHECK_LE’ 2023-05-23T11:16:02,947 157 | GOOGLE_DCHECK_LE(n, input_.size()); 2023-05-23T11:16:02,947 | ^~~~~~~~~~~~~~~~ 2023-05-23T11:16:02,947 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual google::protobuf::StringPiece google::protobuf::strings::LimitByteSource::Peek()’: 2023-05-23T11:16:02,948 sentencepiece/third_party/protobuf-lite/bytestream.cc:177:20: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:16:02,948 177 | if (piece.size() > limit_) { 2023-05-23T11:16:02,948 | ~~~~~~~~~~~~~^~~~~~~~ 2023-05-23T11:16:03,327 At global scope: 2023-05-23T11:16:03,327 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:16:03,389 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/coded_stream.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/coded_stream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:05,188 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian32Fallback(google::protobuf::uint32*)’: 2023-05-23T11:16:05,189 sentencepiece/third_party/protobuf-lite/coded_stream.cc:315:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,189 315 | if (BufferSize() >= sizeof(*value)) { 2023-05-23T11:16:05,189 | ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-05-23T11:16:05,189 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian64Fallback(google::protobuf::uint64*)’: 2023-05-23T11:16:05,189 sentencepiece/third_party/protobuf-lite/coded_stream.cc:332:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,190 332 | if (BufferSize() >= sizeof(*value)) { 2023-05-23T11:16:05,190 | ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-05-23T11:16:05,335 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 2; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,335 sentencepiece/third_party/protobuf-lite/coded_stream.cc:421:52: required from here 2023-05-23T11:16:05,335 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,336 354 | for (int i = 0, offset = 0; i < N - 1; i++, offset += 7) { 2023-05-23T11:16:05,336 | ~~^~~~~~~ 2023-05-23T11:16:05,336 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 3; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,336 sentencepiece/third_party/protobuf-lite/coded_stream.cc:423:52: required from here 2023-05-23T11:16:05,336 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,337 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 4; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,337 sentencepiece/third_party/protobuf-lite/coded_stream.cc:425:52: required from here 2023-05-23T11:16:05,337 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,337 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 5; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,337 sentencepiece/third_party/protobuf-lite/coded_stream.cc:427:52: required from here 2023-05-23T11:16:05,337 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,338 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 6; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,338 sentencepiece/third_party/protobuf-lite/coded_stream.cc:429:52: required from here 2023-05-23T11:16:05,338 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,339 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 7; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,339 sentencepiece/third_party/protobuf-lite/coded_stream.cc:431:52: required from here 2023-05-23T11:16:05,339 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,339 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 8; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,340 sentencepiece/third_party/protobuf-lite/coded_stream.cc:433:52: required from here 2023-05-23T11:16:05,340 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,340 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 9; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,340 sentencepiece/third_party/protobuf-lite/coded_stream.cc:435:52: required from here 2023-05-23T11:16:05,340 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:05,341 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 10; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-05-23T11:16:05,341 sentencepiece/third_party/protobuf-lite/coded_stream.cc:437:53: required from here 2023-05-23T11:16:05,341 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:16:06,572 At global scope: 2023-05-23T11:16:06,572 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:16:06,697 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/common.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/common.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:09,474 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/extension_set.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/extension_set.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:21,935 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/generated_enum_util.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_enum_util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:24,013 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc: In function ‘bool google::protobuf::internal::InitializeEnumStrings(const google::protobuf::internal::EnumEntry*, const int*, size_t, google::protobuf::internal::ExplicitlyConstructed >*)’: 2023-05-23T11:16:24,013 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc:86:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:16:24,013 86 | for (int i = 0; i < size; ++i) { 2023-05-23T11:16:24,013 | ~~^~~~~~ 2023-05-23T11:16:24,496 At global scope: 2023-05-23T11:16:24,497 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:16:24,561 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:27,305 In file included from sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:31: 2023-05-23T11:16:27,306 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = google::protobuf::internal::ProcessingType_STRING; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-05-23T11:16:27,306 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:457:49: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-05-23T11:16:27,306 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-05-23T11:16:27,306 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-05-23T11:16:27,307 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:16:27,307 175 | if (*oneof_case == field_number) { 2023-05-23T11:16:27,307 | ~~~~~~~~~~~~^~~~~~~~~~~~~~~ 2023-05-23T11:16:27,314 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = google::protobuf::internal::ProcessingType_MESSAGE; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-05-23T11:16:27,314 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:647:50: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-05-23T11:16:27,314 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-05-23T11:16:27,314 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-05-23T11:16:27,315 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-05-23T11:16:36,127 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:16:36,857 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/generated_message_util.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_util.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:46,147 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/implicit_weak_message.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:48,979 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/int128.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/int128.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:50,678 sentencepiece/third_party/protobuf-lite/int128.cc: In function ‘std::ostream& google::protobuf::operator<<(std::ostream&, const google::protobuf::uint128&)’: 2023-05-23T11:16:50,678 sentencepiece/third_party/protobuf-lite/int128.cc:178:13: warning: comparison of integer expressions of different signedness: ‘std::streamsize’ {aka ‘int’} and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:16:50,678 178 | if (width > rep.size()) { 2023-05-23T11:16:50,679 | ~~~~~~^~~~~~~~~~~~ 2023-05-23T11:16:51,326 At global scope: 2023-05-23T11:16:51,326 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:16:51,416 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/io_win32.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/io_win32.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:51,484 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/message_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/message_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:16:53,923 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToCodedStream(google::protobuf::io::CodedOutputStream*) const’: 2023-05-23T11:16:53,924 sentencepiece/third_party/protobuf-lite/message_lite.cc:392:46: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:16:53,924 392 | if (final_byte_count - original_byte_count != size) { 2023-05-23T11:16:53,924 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~ 2023-05-23T11:16:53,932 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToArray(void*, int) const’: 2023-05-23T11:16:53,932 sentencepiece/third_party/protobuf-lite/message_lite.cc:491:12: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:16:53,932 491 | if (size < byte_size) return false; 2023-05-23T11:16:53,932 | ~~~~~^~~~~~~~~~~ 2023-05-23T11:16:55,895 At global scope: 2023-05-23T11:16:55,895 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:16:56,123 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/parse_context.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/parse_context.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:00,795 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/repeated_field.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/repeated_field.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:02,752 In file included from sentencepiece/third_party/protobuf-lite/google/protobuf/repeated_field.h:60, 2023-05-23T11:17:02,753 from sentencepiece/third_party/protobuf-lite/repeated_field.cc:35: 2023-05-23T11:17:02,753 sentencepiece/third_party/protobuf-lite/repeated_field.cc: In member function ‘void** google::protobuf::internal::RepeatedPtrFieldBase::InternalExtend(int)’: 2023-05-23T11:17:02,753 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:17:02,753 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:17:02,754 | ~~~~^~~~~~ 2023-05-23T11:17:02,754 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T11:17:02,754 151 | !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T11:17:02,754 | ^~~~~~~~~ 2023-05-23T11:17:02,754 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T11:17:02,754 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:17:02,754 | ^~~~~~~~~~~~ 2023-05-23T11:17:02,755 sentencepiece/third_party/protobuf-lite/repeated_field.cc:61:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-05-23T11:17:02,755 61 | GOOGLE_CHECK_LE(new_size, (std::numeric_limits::max() - kRepHeaderSize) / 2023-05-23T11:17:02,755 | ^~~~~~~~~~~~~~~ 2023-05-23T11:17:08,346 At global scope: 2023-05-23T11:17:08,346 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:08,975 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/status.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/status.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:11,226 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/statusor.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/statusor.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:12,989 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/stringpiece.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:14,103 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘bool google::protobuf::StringPiece::contains(google::protobuf::StringPiece) const’: 2023-05-23T11:17:14,103 sentencepiece/third_party/protobuf-lite/stringpiece.cc:101:21: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘const size_type’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:17:14,103 101 | return find(s, 0) != npos; 2023-05-23T11:17:14,103 | ~~~~~~~~~~~^~~~~~~ 2023-05-23T11:17:14,111 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘google::protobuf::StringPiece google::protobuf::StringPiece::substr(google::protobuf::StringPiece::size_type, google::protobuf::StringPiece::size_type) const’: 2023-05-23T11:17:14,111 sentencepiece/third_party/protobuf-lite/stringpiece.cc:262:11: warning: comparison of integer expressions of different signedness: ‘google::protobuf::StringPiece::size_type’ {aka ‘unsigned int’} and ‘const stringpiece_ssize_type’ {aka ‘const int’} [-Wsign-compare] 2023-05-23T11:17:14,111 262 | if (pos > length_) pos = length_; 2023-05-23T11:17:14,111 | ~~~~^~~~~~~~~ 2023-05-23T11:17:14,761 At global scope: 2023-05-23T11:17:14,761 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:14,836 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/stringprintf.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringprintf.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:16,336 sentencepiece/third_party/protobuf-lite/stringprintf.cc: In function ‘std::string google::protobuf::StringPrintfVector(const char*, const std::vector >&)’: 2023-05-23T11:17:16,336 sentencepiece/third_party/protobuf-lite/stringprintf.cc:153:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:17:16,336 153 | for (int i = 0; i < v.size(); ++i) { 2023-05-23T11:17:16,336 | ~~^~~~~~~~~~ 2023-05-23T11:17:16,337 sentencepiece/third_party/protobuf-lite/stringprintf.cc:156:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-05-23T11:17:16,337 156 | for (int i = v.size(); i < GOOGLE_ARRAYSIZE(cstr); ++i) { 2023-05-23T11:17:16,646 At global scope: 2023-05-23T11:17:16,646 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:16,704 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/structurally_valid.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/structurally_valid.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:19,021 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/strutil.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/strutil.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:20,711 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘void google::protobuf::CEscapeAndAppend(google::protobuf::StringPiece, std::string*)’: 2023-05-23T11:17:20,711 sentencepiece/third_party/protobuf-lite/strutil.cc:563:19: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-05-23T11:17:20,711 563 | if (escaped_len == src.size()) { 2023-05-23T11:17:20,711 | ~~~~~~~~~~~~^~~~~~~~~~~~~ 2023-05-23T11:17:20,737 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::memcasecmp(const char*, const char*, size_t)’: 2023-05-23T11:17:20,737 sentencepiece/third_party/protobuf-lite/strutil.cc:1290:22: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:17:20,737 1290 | for ( int i = 0; i < len; i++ ) { 2023-05-23T11:17:20,737 | ~~^~~~~ 2023-05-23T11:17:20,762 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::GlobalReplaceSubstring(const string&, const string&, std::string*)’: 2023-05-23T11:17:20,763 sentencepiece/third_party/protobuf-lite/strutil.cc:1623:18: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_type’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-05-23T11:17:20,763 1623 | match_pos != std::string::npos; pos = match_pos + substring.length(), 2023-05-23T11:17:20,763 | ~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:17:23,957 At global scope: 2023-05-23T11:17:23,958 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:24,291 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/time.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/time.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:26,660 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/wire_format_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/wire_format_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:31,146 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/zero_copy_stream.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:32,849 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:35,168 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.9 -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc -o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:36,737 In file included from sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:41: 2023-05-23T11:17:36,737 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc: In member function ‘virtual void google::protobuf::io::StringOutputStream::BackUp(int)’: 2023-05-23T11:17:36,737 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:17:36,738 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:17:36,738 | ~~~~^~~~~~ 2023-05-23T11:17:36,738 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-05-23T11:17:36,738 151 | !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-05-23T11:17:36,738 | ^~~~~~~~~ 2023-05-23T11:17:36,738 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-05-23T11:17:36,739 159 | #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-05-23T11:17:36,739 | ^~~~~~~~~~~~ 2023-05-23T11:17:36,739 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:171:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-05-23T11:17:36,739 171 | GOOGLE_CHECK_LE(count, target_->size()); 2023-05-23T11:17:36,739 | ^~~~~~~~~~~~~~~ 2023-05-23T11:17:37,576 At global scope: 2023-05-23T11:17:37,576 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:37,665 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-armv7l-cpython-39/curated_tokenizers/_spp.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/bpe_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece.pb.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/char_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/error.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/filesystem.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_factory.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/model_interface.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/normalizer.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/sentencepiece_processor.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/unigram_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/util.o build/temp.linux-armv7l-cpython-39/sentencepiece/src/word_model.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/flags/flag.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/absl/strings/string_view.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arena.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/arenastring.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/bytestream.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/coded_stream.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/common.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/extension_set.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_enum_util.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/generated_message_util.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/int128.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/io_win32.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/message_lite.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/parse_context.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/repeated_field.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/status.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/statusor.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringpiece.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/stringprintf.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/structurally_valid.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/strutil.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/time.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/wire_format_lite.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o build/temp.linux-armv7l-cpython-39/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o -L/usr/lib -o build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.cpython-39-arm-linux-gnueabihf.so 2023-05-23T11:17:39,189 building 'curated_tokenizers._wordpiece' extension 2023-05-23T11:17:39,190 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/_wordpiece.cpp -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:40,632 curated_tokenizers/_wordpiece.cpp: In function ‘PyObject* __pyx_pf_18curated_tokenizers_10_wordpiece_18WordPieceProcessor_14to_list(__pyx_obj_18curated_tokenizers_10_wordpiece_WordPieceProcessor*)’: 2023-05-23T11:17:40,633 curated_tokenizers/_wordpiece.cpp:3149:35: warning: comparison of integer expressions of different signedness: ‘Py_ssize_t’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:17:40,633 3149 | for (__pyx_temp=0; __pyx_temp < __pyx_v_self->_pieces.size(); __pyx_temp++) { 2023-05-23T11:17:40,633 | ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-23T11:17:45,383 At global scope: 2023-05-23T11:17:45,383 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:45,827 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/wordpiece.cc -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:17:46,724 curated_tokenizers/wordpiece.cc: In member function ‘const Piece& PieceStorage::id_to_piece(int) const’: 2023-05-23T11:17:46,724 curated_tokenizers/wordpiece.cc:15:22: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-05-23T11:17:46,725 15 | if (id < 0 || id >= size()) { 2023-05-23T11:17:46,725 | ~~~^~~~~~~~~ 2023-05-23T11:17:47,734 At global scope: 2023-05-23T11:17:47,735 cc1plus: note: unrecognized command-line option ‘-Wno-sign-compare-Wno-strict-prototypes’ may have been intended to silence earlier diagnostics 2023-05-23T11:17:47,879 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.o build/temp.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.o -L/usr/lib -o build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.cpython-39-arm-linux-gnueabihf.so 2023-05-23T11:17:48,156 building 'curated_tokenizers._bbpe' extension 2023-05-23T11:17:48,158 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/_bbpe.cpp -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:18:02,007 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -ffile-prefix-map=/python3.9-3.9.2=. -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -Icurated_tokenizers -I/usr/include/python3.9 -c curated_tokenizers/merges.cc -o build/temp.linux-armv7l-cpython-39/curated_tokenizers/merges.o --std=c++14 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -D_USE_INTERNAL_STRING_VIEW -pthread -DHAVE_PTHREAD=1 2023-05-23T11:18:04,848 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.o build/temp.linux-armv7l-cpython-39/curated_tokenizers/merges.o -L/usr/lib -o build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.cpython-39-arm-linux-gnueabihf.so 2023-05-23T11:18:05,178 installing to build/bdist.linux-armv7l/wheel 2023-05-23T11:18:05,179 running install 2023-05-23T11:18:05,204 running install_lib 2023-05-23T11:18:05,212 creating build/bdist.linux-armv7l 2023-05-23T11:18:05,213 creating build/bdist.linux-armv7l/wheel 2023-05-23T11:18:05,215 creating build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,216 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,218 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,220 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/wordpiece.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,222 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/merges.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,224 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,226 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,228 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.cpython-39-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,241 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,243 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,249 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.cpython-39-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,275 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,277 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/merges.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,279 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_bbpe.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,288 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,295 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/util.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,296 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_wordpiece.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,299 creating build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,300 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/toy.model -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,306 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/test_word_piece_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,308 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/robbert-merges-1000.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,310 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/toy-word-pieces.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,311 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/incorrect-merges.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,313 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,314 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/test_sp.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,316 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/robbert-vocab-1000.json -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,319 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/tests/test_bbpe_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-05-23T11:18:05,320 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.cpython-39-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,522 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/config.h -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,524 copying build/lib.linux-armv7l-cpython-39/curated_tokenizers/_spp.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-05-23T11:18:05,526 running install_egg_info 2023-05-23T11:18:05,540 Copying curated_tokenizers.egg-info to build/bdist.linux-armv7l/wheel/curated_tokenizers-0.0.7-py3.9.egg-info 2023-05-23T11:18:05,554 running install_scripts 2023-05-23T11:18:05,602 creating build/bdist.linux-armv7l/wheel/curated_tokenizers-0.0.7.dist-info/WHEEL 2023-05-23T11:18:05,605 creating '/tmp/pip-wheel-1vw14pq6/.tmp-h88qmg9v/curated_tokenizers-0.0.7-cp39-cp39-linux_armv7l.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-05-23T11:18:05,608 adding 'curated_tokenizers/__init__.py' 2023-05-23T11:18:05,647 adding 'curated_tokenizers/_bbpe.cpp' 2023-05-23T11:18:05,902 adding 'curated_tokenizers/_bbpe.cpython-39-arm-linux-gnueabihf.so' 2023-05-23T11:18:05,912 adding 'curated_tokenizers/_bbpe.pxd' 2023-05-23T11:18:05,914 adding 'curated_tokenizers/_bbpe.pyx' 2023-05-23T11:18:05,939 adding 'curated_tokenizers/_spp.cpp' 2023-05-23T11:18:08,208 adding 'curated_tokenizers/_spp.cpython-39-arm-linux-gnueabihf.so' 2023-05-23T11:18:08,291 adding 'curated_tokenizers/_spp.pxd' 2023-05-23T11:18:08,293 adding 'curated_tokenizers/_spp.pyx' 2023-05-23T11:18:08,319 adding 'curated_tokenizers/_wordpiece.cpp' 2023-05-23T11:18:08,464 adding 'curated_tokenizers/_wordpiece.cpython-39-arm-linux-gnueabihf.so' 2023-05-23T11:18:08,470 adding 'curated_tokenizers/_wordpiece.pxd' 2023-05-23T11:18:08,472 adding 'curated_tokenizers/_wordpiece.pyx' 2023-05-23T11:18:08,473 adding 'curated_tokenizers/config.h' 2023-05-23T11:18:08,474 adding 'curated_tokenizers/merges.cc' 2023-05-23T11:18:08,476 adding 'curated_tokenizers/merges.hh' 2023-05-23T11:18:08,477 adding 'curated_tokenizers/util.hh' 2023-05-23T11:18:08,478 adding 'curated_tokenizers/wordpiece.cc' 2023-05-23T11:18:08,479 adding 'curated_tokenizers/wordpiece.hh' 2023-05-23T11:18:08,481 adding 'curated_tokenizers/tests/__init__.py' 2023-05-23T11:18:08,482 adding 'curated_tokenizers/tests/incorrect-merges.txt' 2023-05-23T11:18:08,484 adding 'curated_tokenizers/tests/robbert-merges-1000.txt' 2023-05-23T11:18:08,488 adding 'curated_tokenizers/tests/robbert-vocab-1000.json' 2023-05-23T11:18:08,490 adding 'curated_tokenizers/tests/test_bbpe_processor.py' 2023-05-23T11:18:08,491 adding 'curated_tokenizers/tests/test_sp.py' 2023-05-23T11:18:08,493 adding 'curated_tokenizers/tests/test_word_piece_processor.py' 2023-05-23T11:18:08,494 adding 'curated_tokenizers/tests/toy-word-pieces.txt' 2023-05-23T11:18:08,562 adding 'curated_tokenizers/tests/toy.model' 2023-05-23T11:18:08,566 adding 'curated_tokenizers-0.0.7.dist-info/LICENSE' 2023-05-23T11:18:08,568 adding 'curated_tokenizers-0.0.7.dist-info/METADATA' 2023-05-23T11:18:08,569 adding 'curated_tokenizers-0.0.7.dist-info/WHEEL' 2023-05-23T11:18:08,570 adding 'curated_tokenizers-0.0.7.dist-info/top_level.txt' 2023-05-23T11:18:08,571 adding 'curated_tokenizers-0.0.7.dist-info/zip-safe' 2023-05-23T11:18:08,572 adding 'curated_tokenizers-0.0.7.dist-info/RECORD' 2023-05-23T11:18:08,646 removing build/bdist.linux-armv7l/wheel 2023-05-23T11:18:08,794 Building wheel for curated-tokenizers (pyproject.toml): finished with status 'done' 2023-05-23T11:18:08,908 Created wheel for curated-tokenizers: filename=curated_tokenizers-0.0.7-cp39-cp39-linux_armv7l.whl size=5656693 sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 2023-05-23T11:18:08,909 Stored in directory: /tmp/pip-ephem-wheel-cache-ker75x2b/wheels/44/3c/cb/753afa8402c119219a39f7bea6891670ba6d77c18f5e59954d 2023-05-23T11:18:08,926 Successfully built curated-tokenizers 2023-05-23T11:18:09,054 Removed build tracker: '/tmp/pip-build-tracker-w29s38l3'