2023-07-06T14:45:47,909 Created temporary directory: /tmp/pip-build-tracker-z3kild4j 2023-07-06T14:45:47,912 Initialized build tracking at /tmp/pip-build-tracker-z3kild4j 2023-07-06T14:45:47,912 Created build tracker: /tmp/pip-build-tracker-z3kild4j 2023-07-06T14:45:47,912 Entered build tracker: /tmp/pip-build-tracker-z3kild4j 2023-07-06T14:45:47,913 Created temporary directory: /tmp/pip-wheel-ke_cr7tb 2023-07-06T14:45:47,922 Created temporary directory: /tmp/pip-ephem-wheel-cache-cbr4__py 2023-07-06T14:45:47,974 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-07-06T14:45:47,982 2 location(s) to search for versions of curated-tokenizers: 2023-07-06T14:45:47,982 * https://pypi.org/simple/curated-tokenizers/ 2023-07-06T14:45:47,982 * https://www.piwheels.org/simple/curated-tokenizers/ 2023-07-06T14:45:47,983 Fetching project page and analyzing links: https://pypi.org/simple/curated-tokenizers/ 2023-07-06T14:45:47,984 Getting page https://pypi.org/simple/curated-tokenizers/ 2023-07-06T14:45:47,988 Found index url https://pypi.org/simple/ 2023-07-06T14:45:48,236 Fetched page https://pypi.org/simple/curated-tokenizers/ as application/vnd.pypi.simple.v1+json 2023-07-06T14:45:48,267 Found link https://files.pythonhosted.org/packages/a8/4f/7190248c036d05895b53b7c637bb5784daa4adff09961b7ed2ef40142b86/curated-tokenizers-0.0.6.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.6 2023-07-06T14:45:48,268 Found link https://files.pythonhosted.org/packages/61/26/e823bf07b6f7894f4abfe56058d26ce438bd98b8efeaf4f3a06277d55c97/curated-tokenizers-0.0.7.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.0.7 2023-07-06T14:45:48,269 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ab/03/154ea07588145b1faf5ab9f74ec9e80dea57e32920bb8cbd4d11a1029784/curated_tokenizers-0.0.7-cp310-cp310-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,270 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/8b/44/48a6b56ee6d96dab6af01319b4bb0b999ae5dd79e314f124919ee5530a14/curated_tokenizers-0.0.7-cp310-cp310-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,270 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2e/f3/a74baca025795e9fafcceb277a26fe000d5706a51a21a0784e742622720b/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,271 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/a6/99/c717badc07bea0c347867fb3d8631a9f8099bd8c1294344adf94c6f745db/curated_tokenizers-0.0.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,272 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/58/34/a87bff5c21ac46b0621a86aea39696a3f489b4fd35552c571a1620655832/curated_tokenizers-0.0.7-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,272 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/91/81/9709ed42e751148c7853feb54cacba7295072eebde2dc5c003331504976f/curated_tokenizers-0.0.7-cp311-cp311-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,273 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/93/b1/38f7f527a22a9a2e9393f52dc875b7875784b644bfcd5c7703882b2d1c36/curated_tokenizers-0.0.7-cp311-cp311-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,274 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/5d/d6/d4cb39a2bca58a332b1074508f8f3961b1be85c6c048a41b4b02dd95aef3/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,274 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/63/ae/5a892033ddcbd0f2c072f24662daba8fee8f772047339160f0cf3389a93c/curated_tokenizers-0.0.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,275 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c5/25/88ac587b0718ebf5b8e94432ea02d8304ddd72f014df3406b54ffd2305d1/curated_tokenizers-0.0.7-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,276 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c3/bf/eecad1bf5195cb686deac249b82408519a205b59467193ceb46652d9cf21/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,276 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/53/7e/97e73e70c1beda5e743fed345aa8556234d701ce292a0b5e6453aedf8da2/curated_tokenizers-0.0.7-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,277 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2b/9a/6cce938f8ecd03dbf42f8dfda93ac9d792fdac5de501ca28034706c77d30/curated_tokenizers-0.0.7-cp36-cp36m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,278 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/a5/8fec572adfb1bb1bd1b1da5637da8704c6c6424227078ca13cb20040474d/curated_tokenizers-0.0.7-cp37-cp37m-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,278 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ea/a9/fd09bacc1d268b7ce65e0d76e2db7bb4cffe8f8738b9a6208cbcde7f27ab/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,279 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c0/ad/6cb1d029551589851126e8f875879be2a229ceec87360e26bcc70ce0277c/curated_tokenizers-0.0.7-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,279 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/4f/37/271d4c2da6726e052b3c8f796f8f62a35d737683e2eb380ab08876af72df/curated_tokenizers-0.0.7-cp37-cp37m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,280 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/30/7e/43c36efdb3d4c6933d04ff739bad7624647e1b5ef0150d2502affe3570d9/curated_tokenizers-0.0.7-cp38-cp38-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,280 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c9/4d/bce24fbafaf469779ebdf97c44cfc2bc8273a9b5149b0dd3862ecaea3004/curated_tokenizers-0.0.7-cp38-cp38-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,281 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/0f/98/fd0eacc8238aa4450a7afec74dd41026c269dc112242f7be4ece119d6dcb/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,281 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/2d/2e/ea5716f79bcb4aff8e436e11119398af9c3a1d7a4612190dfc40e0cdb9a7/curated_tokenizers-0.0.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,282 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/cf/fa/2c84864cf891d5c43bca09ba20b4df6b8f56cd06e8e8a36c9e661f09d7f1/curated_tokenizers-0.0.7-cp38-cp38-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,282 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/61/04/ced9b45557896758e66b93199277eb122f855a69e569b0b2abfc0cf0980e/curated_tokenizers-0.0.7-cp39-cp39-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,283 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/e2/2c/ac0b4984c513dc37ff8fd25bbdcc0de11351be0c421ce65f6a677003e45c/curated_tokenizers-0.0.7-cp39-cp39-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,283 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/1f/79/cbddbb037335a5b1dea9eaf4a34d0380d7a12f59ef905219a2a9edee72ff/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,284 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/49/7b/86edf0a051de18bdcc07bedb425b9e3c999a927b4a7c47eff5caaf0e2231/curated_tokenizers-0.0.7-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,284 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/31/d7/d036791616d0bc89eb81de5d46ffa9b34e1333e6c420d8d28050fbdf1b82/curated_tokenizers-0.0.7-cp39-cp39-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,286 Found link https://files.pythonhosted.org/packages/c7/c0/cd86813bdbab69b45ff426152ba65dc60ef8fe68feee1280cb7199bcc730/curated-tokenizers-0.9.0.dev0.tar.gz (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6), version: 0.9.0.dev0 2023-07-06T14:45:48,287 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/99/a1/903ff557b6188f638da1c0bdf44859a7a16c238dc17042f204a446248052/curated_tokenizers-0.9.0.dev0-cp310-cp310-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,287 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/8e/f1/f0314c685b3e9ee1a869c7eab934668ca9a28e204b0bde591605aad8cec4/curated_tokenizers-0.9.0.dev0-cp310-cp310-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,288 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/74/ca/f2eb926cca9ed8a3db36d05b83559a2b78b8f15fbea649a85831da82901a/curated_tokenizers-0.9.0.dev0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,288 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/84/5e/0ec2c51711d9412106ef37b672e73284f0f649de79109f342f72d15d01bc/curated_tokenizers-0.9.0.dev0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,289 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/e9/e2/8b708ebab16c43a5e0ac87239fb61f540f0a05c7ac9ee2b801a31daabcf0/curated_tokenizers-0.9.0.dev0-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,289 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/00/13/fa11ecba08c8cbeda04e646147dd1b83bb86d9c3e9c2c72bb314f3a3bd8f/curated_tokenizers-0.9.0.dev0-cp311-cp311-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,290 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c1/8f/bda661f4474a397ddf30e376d030debb75d15b586b0234bbb3845866fd85/curated_tokenizers-0.9.0.dev0-cp311-cp311-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,290 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/21/d9/92f92206e358f307e385a828d28672588744146d5ffb11fed6e13131b08f/curated_tokenizers-0.9.0.dev0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,291 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/57/1a/06711466098c8cfd356719383078843a5e8f796be677ab3984ca55f519c9/curated_tokenizers-0.9.0.dev0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,291 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/82/73/10e7558bc87c0ec6fafc965409a39c160f9eede0aa9664956e641d7b415e/curated_tokenizers-0.9.0.dev0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,292 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/c1/d7/016f0e8864c0c4278414afdcdef1bd38a3a401ddd1b1abfa608fde28b4f1/curated_tokenizers-0.9.0.dev0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,292 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/42/cd/884b8f2ae4debdfa51401854f0907b6fda5a7b325b45ffbf5992a0a0156b/curated_tokenizers-0.9.0.dev0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,293 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/3b/20/43311bc0141898fae817c20d4df5342c37022123db008e45a13691b99953/curated_tokenizers-0.9.0.dev0-cp36-cp36m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,293 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ee/ee/dfa73eb79c63ca0f9767e19803a4ba24977a65ff77087032be0431c074da/curated_tokenizers-0.9.0.dev0-cp37-cp37m-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,294 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/02/a0/125b9d8d2f47dc1613e1679e008f10d363749dd36aadb772a30f98d57e66/curated_tokenizers-0.9.0.dev0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,294 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/41/56/bb26e6ff955c67f807af2fcd7f19c3aae72553a85dfbe8bee4b4e5fc272b/curated_tokenizers-0.9.0.dev0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,295 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/d3/94/876dc371ef17abfa41c0af8b959bc3f174a1c368ebf85bb5f0463a9fd456/curated_tokenizers-0.9.0.dev0-cp37-cp37m-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,295 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/ad/ac/95827581f2e60cd223f89802d12f0ecd6931cc3b405c4697b63909bb9830/curated_tokenizers-0.9.0.dev0-cp38-cp38-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,296 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/28/bf/ff41741211ca0e279aa84cde66eb56285b6e411a8380a521963653faf0a6/curated_tokenizers-0.9.0.dev0-cp38-cp38-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,296 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/80/5d/a5e9a21056283ce85194bd9fe2fb6e3dbe6f6b3dff2d2cc7d3e889b26060/curated_tokenizers-0.9.0.dev0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,297 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/5f/ca/c0f95ec5670e4c3d28deceb61310f478b6a2126d40ea1329fa2a11fef51c/curated_tokenizers-0.9.0.dev0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,297 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/cb/bd/c496c3d7e9236f2d53199540c73f92909e4481f94c4269bf4e39967bbf61/curated_tokenizers-0.9.0.dev0-cp38-cp38-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,298 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/77/62/26aff211d9ef75bc7fb6343f52348c4f864ccb905fcfedc883b972f8fc29/curated_tokenizers-0.9.0.dev0-cp39-cp39-macosx_10_9_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,298 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/78/a4/7ef598a71c57bc8109c7acff908124c713faf1c05b2d47354aa0cbd3cea9/curated_tokenizers-0.9.0.dev0-cp39-cp39-macosx_11_0_arm64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,299 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/bf/df/23cdcb8fc5d09bc51b1891919f3ce275bf5daa0d895470d80f4a49898d55/curated_tokenizers-0.9.0.dev0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,299 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/07/a4/a8cb4a9bc0e132b7f624b18dbde4db1dfb6780400148ec2ef8c94dbe016a/curated_tokenizers-0.9.0.dev0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,300 Skipping link: No binaries permitted for curated-tokenizers: https://files.pythonhosted.org/packages/d2/5b/1c3debc2741fdb63a36e44cf992e45083a4f0b3b34fbdc0b70ac9f76946f/curated_tokenizers-0.9.0.dev0-cp39-cp39-win_amd64.whl (from https://pypi.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,301 Fetching project page and analyzing links: https://www.piwheels.org/simple/curated-tokenizers/ 2023-07-06T14:45:48,301 Getting page https://www.piwheels.org/simple/curated-tokenizers/ 2023-07-06T14:45:48,304 Found index url https://www.piwheels.org/simple/ 2023-07-06T14:45:48,543 Fetched page https://www.piwheels.org/simple/curated-tokenizers/ as text/html 2023-07-06T14:45:48,552 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp39-cp39-linux_armv7l.whl#sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,552 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp39-cp39-linux_armv6l.whl#sha256=83732d276690ecf425ff9f991d6aa305f59e2b2a8a9a465a0ee73c125e875c31 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,553 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv7l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,553 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.7-cp37-cp37m-linux_armv6l.whl#sha256=57435846b1fd543344c6be54e8ed60fcc7581aaf7e2103124e60a912f9c34a6d (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,554 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.6-cp39-cp39-linux_armv7l.whl#sha256=3d098bb28fb0b27c2d9672d3e04e592b9a3cd854ac0a6aa7768efa00efb59382 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,554 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.6-cp39-cp39-linux_armv6l.whl#sha256=3d098bb28fb0b27c2d9672d3e04e592b9a3cd854ac0a6aa7768efa00efb59382 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,555 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.6-cp37-cp37m-linux_armv7l.whl#sha256=f879b0c6698bd68d7861e7575b381982a214a3f3bfd74d3211e6ee3b0a873f24 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,555 Skipping link: No binaries permitted for curated-tokenizers: https://www.piwheels.org/simple/curated-tokenizers/curated_tokenizers-0.0.6-cp37-cp37m-linux_armv6l.whl#sha256=f879b0c6698bd68d7861e7575b381982a214a3f3bfd74d3211e6ee3b0a873f24 (from https://www.piwheels.org/simple/curated-tokenizers/) (requires-python:>=3.6) 2023-07-06T14:45:48,556 Skipping link: not a file: https://www.piwheels.org/simple/curated-tokenizers/ 2023-07-06T14:45:48,556 Skipping link: not a file: https://pypi.org/simple/curated-tokenizers/ 2023-07-06T14:45:48,589 Given no hashes to check 1 links for project 'curated-tokenizers': discarding no candidates 2023-07-06T14:45:48,623 Collecting curated-tokenizers==0.9.0.dev0 2023-07-06T14:45:48,628 Created temporary directory: /tmp/pip-unpack-dzu13t_7 2023-07-06T14:45:48,821 Downloading curated-tokenizers-0.9.0.dev0.tar.gz (2.2 MB) 2023-07-06T14:45:51,238 Added curated-tokenizers==0.9.0.dev0 from https://files.pythonhosted.org/packages/c7/c0/cd86813bdbab69b45ff426152ba65dc60ef8fe68feee1280cb7199bcc730/curated-tokenizers-0.9.0.dev0.tar.gz to build tracker '/tmp/pip-build-tracker-z3kild4j' 2023-07-06T14:45:51,247 Created temporary directory: /tmp/pip-build-env-iga6fryw 2023-07-06T14:45:51,266 Installing build dependencies: started 2023-07-06T14:45:51,268 Running command pip subprocess to install build dependencies 2023-07-06T14:45:53,986 Using pip 23.1.2 from /home/piwheels/.local/lib/python3.7/site-packages/pip (python 3.7) 2023-07-06T14:45:54,809 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-07-06T14:45:58,823 Collecting setuptools 2023-07-06T14:45:59,022 Using cached https://www.piwheels.org/simple/setuptools/setuptools-68.0.0-py3-none-any.whl (804 kB) 2023-07-06T14:46:02,463 Collecting cython>=0.25 2023-07-06T14:46:02,959 Using cached https://www.piwheels.org/simple/cython/Cython-0.29.36-cp37-cp37m-linux_armv7l.whl (2.3 MB) 2023-07-06T14:46:08,119 Installing collected packages: setuptools, cython 2023-07-06T14:46:17,531 Creating /tmp/pip-build-env-iga6fryw/overlay/bin 2023-07-06T14:46:17,537 changing mode of /tmp/pip-build-env-iga6fryw/overlay/bin/cygdb to 755 2023-07-06T14:46:17,542 changing mode of /tmp/pip-build-env-iga6fryw/overlay/bin/cython to 755 2023-07-06T14:46:17,547 changing mode of /tmp/pip-build-env-iga6fryw/overlay/bin/cythonize to 755 2023-07-06T14:46:17,592 Successfully installed cython-0.29.36 setuptools-68.0.0 2023-07-06T14:46:18,118 Installing build dependencies: finished with status 'done' 2023-07-06T14:46:18,129 Getting requirements to build wheel: started 2023-07-06T14:46:18,131 Running command Getting requirements to build wheel 2023-07-06T14:46:26,342 Cythonizing sources 2023-07-06T14:46:26,344 Compiling curated_tokenizers/_spp.pyx because it changed. 2023-07-06T14:46:26,344 Compiling curated_tokenizers/_wordpiece.pyx because it changed. 2023-07-06T14:46:26,345 Compiling curated_tokenizers/_bbpe.pyx because it changed. 2023-07-06T14:46:26,345 [1/3] Cythonizing curated_tokenizers/_bbpe.pyx 2023-07-06T14:46:26,345 [2/3] Cythonizing curated_tokenizers/_spp.pyx 2023-07-06T14:46:26,346 [3/3] Cythonizing curated_tokenizers/_wordpiece.pyx 2023-07-06T14:46:26,728 running egg_info 2023-07-06T14:46:26,747 writing curated_tokenizers.egg-info/PKG-INFO 2023-07-06T14:46:26,752 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-07-06T14:46:26,757 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-07-06T14:46:26,761 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-07-06T14:46:26,836 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:26,892 adding license file 'LICENSE' 2023-07-06T14:46:26,919 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:27,284 Getting requirements to build wheel: finished with status 'done' 2023-07-06T14:46:27,312 Installing backend dependencies: started 2023-07-06T14:46:27,314 Running command pip subprocess to install backend dependencies 2023-07-06T14:46:30,025 Using pip 23.1.2 from /home/piwheels/.local/lib/python3.7/site-packages/pip (python 3.7) 2023-07-06T14:46:30,802 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-07-06T14:46:31,744 Collecting wheel 2023-07-06T14:46:31,786 Using cached https://www.piwheels.org/simple/wheel/wheel-0.40.0-py3-none-any.whl (64 kB) 2023-07-06T14:46:35,968 Installing collected packages: wheel 2023-07-06T14:46:36,414 Creating /tmp/pip-build-env-iga6fryw/normal/bin 2023-07-06T14:46:36,418 changing mode of /tmp/pip-build-env-iga6fryw/normal/bin/wheel to 755 2023-07-06T14:46:36,443 Successfully installed wheel-0.40.0 2023-07-06T14:46:36,820 Installing backend dependencies: finished with status 'done' 2023-07-06T14:46:36,826 Created temporary directory: /tmp/pip-modern-metadata-80crse7k 2023-07-06T14:46:36,832 Preparing metadata (pyproject.toml): started 2023-07-06T14:46:36,834 Running command Preparing metadata (pyproject.toml) 2023-07-06T14:46:39,760 Cythonizing sources 2023-07-06T14:46:39,976 running dist_info 2023-07-06T14:46:40,020 creating /tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info 2023-07-06T14:46:40,030 writing /tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/PKG-INFO 2023-07-06T14:46:40,035 writing dependency_links to /tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/dependency_links.txt 2023-07-06T14:46:40,039 writing requirements to /tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/requires.txt 2023-07-06T14:46:40,041 writing top-level names to /tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/top_level.txt 2023-07-06T14:46:40,044 writing manifest file '/tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:40,113 reading manifest file '/tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:40,118 adding license file 'LICENSE' 2023-07-06T14:46:40,128 writing manifest file '/tmp/pip-modern-metadata-80crse7k/curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:40,130 creating '/tmp/pip-modern-metadata-80crse7k/curated_tokenizers-0.9.0.dev0.dist-info' 2023-07-06T14:46:40,519 Preparing metadata (pyproject.toml): finished with status 'done' 2023-07-06T14:46:40,536 Source in /tmp/pip-wheel-ke_cr7tb/curated-tokenizers_1fef1224b4f74d9d964b027ed9924abb has version 0.9.0.dev0, which satisfies requirement curated-tokenizers==0.9.0.dev0 from https://files.pythonhosted.org/packages/c7/c0/cd86813bdbab69b45ff426152ba65dc60ef8fe68feee1280cb7199bcc730/curated-tokenizers-0.9.0.dev0.tar.gz 2023-07-06T14:46:40,538 Removed curated-tokenizers==0.9.0.dev0 from https://files.pythonhosted.org/packages/c7/c0/cd86813bdbab69b45ff426152ba65dc60ef8fe68feee1280cb7199bcc730/curated-tokenizers-0.9.0.dev0.tar.gz from build tracker '/tmp/pip-build-tracker-z3kild4j' 2023-07-06T14:46:40,552 Created temporary directory: /tmp/pip-unpack-ccb5bpzj 2023-07-06T14:46:40,553 Building wheels for collected packages: curated-tokenizers 2023-07-06T14:46:40,563 Created temporary directory: /tmp/pip-wheel-r5k1pcpm 2023-07-06T14:46:40,563 Destination directory: /tmp/pip-wheel-r5k1pcpm 2023-07-06T14:46:40,569 Building wheel for curated-tokenizers (pyproject.toml): started 2023-07-06T14:46:40,571 Running command Building wheel for curated-tokenizers (pyproject.toml) 2023-07-06T14:46:43,406 Cythonizing sources 2023-07-06T14:46:43,719 running bdist_wheel 2023-07-06T14:46:43,756 running build 2023-07-06T14:46:43,757 running build_py 2023-07-06T14:46:43,774 creating build 2023-07-06T14:46:43,775 creating build/lib.linux-armv7l-cpython-37 2023-07-06T14:46:43,777 creating build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:43,779 copying curated_tokenizers/__init__.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:43,784 creating build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:43,786 copying curated_tokenizers/tests/test_sp.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:43,790 copying curated_tokenizers/tests/__init__.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:43,793 copying curated_tokenizers/tests/test_word_piece_processor.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:43,796 copying curated_tokenizers/tests/test_bbpe_processor.py -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:43,799 running egg_info 2023-07-06T14:46:43,836 writing curated_tokenizers.egg-info/PKG-INFO 2023-07-06T14:46:43,840 writing dependency_links to curated_tokenizers.egg-info/dependency_links.txt 2023-07-06T14:46:43,843 writing requirements to curated_tokenizers.egg-info/requires.txt 2023-07-06T14:46:43,845 writing top-level names to curated_tokenizers.egg-info/top_level.txt 2023-07-06T14:46:43,879 reading manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:43,935 adding license file 'LICENSE' 2023-07-06T14:46:43,962 writing manifest file 'curated_tokenizers.egg-info/SOURCES.txt' 2023-07-06T14:46:44,001 copying curated_tokenizers/_bbpe.cpp -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,030 copying curated_tokenizers/_bbpe.pxd -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,033 copying curated_tokenizers/_bbpe.pyx -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,038 copying curated_tokenizers/_spp.cpp -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,058 copying curated_tokenizers/_spp.pxd -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,063 copying curated_tokenizers/_spp.pyx -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,068 copying curated_tokenizers/_wordpiece.cpp -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,086 copying curated_tokenizers/_wordpiece.pxd -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,090 copying curated_tokenizers/_wordpiece.pyx -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,094 copying curated_tokenizers/config.h -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,098 copying curated_tokenizers/merges.cc -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,102 copying curated_tokenizers/merges.hh -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,106 copying curated_tokenizers/util.hh -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,110 copying curated_tokenizers/wordpiece.cc -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,114 copying curated_tokenizers/wordpiece.hh -> build/lib.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,117 copying curated_tokenizers/tests/incorrect-merges.txt -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:44,121 copying curated_tokenizers/tests/robbert-merges-1000.txt -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:44,125 copying curated_tokenizers/tests/robbert-vocab-1000.json -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:44,132 copying curated_tokenizers/tests/toy-word-pieces.txt -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:44,136 copying curated_tokenizers/tests/toy.model -> build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests 2023-07-06T14:46:44,154 running build_ext 2023-07-06T14:46:44,171 building 'curated_tokenizers._spp' extension 2023-07-06T14:46:44,175 creating build/temp.linux-armv7l-cpython-37 2023-07-06T14:46:44,176 creating build/temp.linux-armv7l-cpython-37/curated_tokenizers 2023-07-06T14:46:44,178 creating build/temp.linux-armv7l-cpython-37/sentencepiece 2023-07-06T14:46:44,179 creating build/temp.linux-armv7l-cpython-37/sentencepiece/src 2023-07-06T14:46:44,181 creating build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb 2023-07-06T14:46:44,184 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party 2023-07-06T14:46:44,185 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl 2023-07-06T14:46:44,186 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/flags 2023-07-06T14:46:44,188 creating build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite 2023-07-06T14:46:44,192 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c curated_tokenizers/_spp.cpp -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/_spp.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:47:08,483 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/bpe_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/bpe_model.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:47:27,594 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/builtin_pb/sentencepiece.pb.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece.pb.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:47:41,583 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/builtin_pb/sentencepiece_model.pb.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:48:06,223 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/char_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/char_model.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:48:20,303 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/error.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/error.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:48:29,395 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/filesystem.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/filesystem.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:48:40,478 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/model_factory.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_factory.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:48:53,301 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/model_interface.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_interface.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:49:13,570 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/normalizer.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/normalizer.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:49:38,612 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/sentencepiece_processor.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/sentencepiece_processor.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:49:47,571 sentencepiece/src/sentencepiece_processor.cc: In function ‘std::vector > sentencepiece::{anonymous}::ToPieceArray(const std::vector >&)’: 2023-07-06T14:49:47,571 sentencepiece/src/sentencepiece_processor.cc:54:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:49:47,572 for (int i = 0; i < v.size(); ++i) out[i] = v[i]; 2023-07-06T14:49:47,572 ~~^~~~~~~~~~ 2023-07-06T14:49:47,575 sentencepiece/src/sentencepiece_processor.cc: In function ‘void sentencepiece::{anonymous}::ConvertToUnicodeSpansInternal(sentencepiece::SentencePieceText*)’: 2023-07-06T14:49:47,575 sentencepiece/src/sentencepiece_processor.cc:67:26: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:49:47,576 for (int i = prev; i < prev + mblen; ++i) { 2023-07-06T14:49:47,576 ~~^~~~~~~~~~~~~~ 2023-07-06T14:49:47,915 sentencepiece/src/sentencepiece_processor.cc: In member function ‘sentencepiece::util::Status sentencepiece::SentencePieceProcessor::PopulateSentencePieceText(std::string_view, std::string_view, const std::vector&, const EncodeResult&, sentencepiece::SentencePieceText*) const’: 2023-07-06T14:49:47,916 sentencepiece/src/sentencepiece_processor.cc:578:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:49:47,916 for (int i = 0; i < w.size(); ++i) { 2023-07-06T14:49:47,916 ~~^~~~~~~~~~ 2023-07-06T14:49:47,917 sentencepiece/src/sentencepiece_processor.cc:589:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::basic_string_view::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:49:47,917 if (i == w.size() - 1) { 2023-07-06T14:49:47,918 ~~^~~~~~~~~~~~~~~ 2023-07-06T14:49:48,093 sentencepiece/src/sentencepiece_processor.cc: In lambda function: 2023-07-06T14:49:48,094 sentencepiece/src/sentencepiece_processor.cc:853:27: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:49:48,094 for (int j = 0; j < consumed; j++) { 2023-07-06T14:49:48,095 ~~^~~~~~~~~~ 2023-07-06T14:49:48,095 sentencepiece/src/sentencepiece_processor.cc:857:17: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:49:48,096 if (j == consumed - 1) { 2023-07-06T14:49:48,096 ~~^~~~~~~~~~~~~~~ 2023-07-06T14:50:21,976 sentencepiece/src/sentencepiece_processor.cc: At top level: 2023-07-06T14:50:21,977 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:50:27,321 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/unigram_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/unigram_model.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:50:36,568 sentencepiece/src/unigram_model.cc: In member function ‘std::vector, float> > sentencepiece::unigram::Lattice::NBest(size_t, bool, float)’: 2023-07-06T14:50:36,568 sentencepiece/src/unigram_model.cc:432:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:50:36,569 for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-07-06T14:50:36,569 ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-06T14:50:36,570 sentencepiece/src/unigram_model.cc:443:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:50:36,570 for (int i = 0; i < adjusted_probs.size(); i++) { 2023-07-06T14:50:36,571 ~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-07-06T14:50:36,571 sentencepiece/src/unigram_model.cc:454:23: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:50:36,572 for (int i = 0; i < end_nodes(node->pos).size(); i++) { 2023-07-06T14:50:36,572 ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-06T14:50:36,751 sentencepiece/src/unigram_model.cc: In member function ‘virtual sentencepiece::NBestEncodeResult sentencepiece::unigram::Model::SampleEncodeAndScore(std::string_view, float, int, bool, bool) const’: 2023-07-06T14:50:36,752 sentencepiece/src/unigram_model.cc:779:25: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:50:36,752 for (int i = 0; i < nbest_samples.size(); i++) { 2023-07-06T14:50:36,753 ~~^~~~~~~~~~~~~~~~~~~~~~ 2023-07-06T14:50:36,756 sentencepiece/src/unigram_model.cc:789:25: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘std::vector, float> >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:50:36,756 if (index_of_best != nbest_samples.size()) { 2023-07-06T14:50:36,757 ~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~ 2023-07-06T14:50:36,771 sentencepiece/src/unigram_model.cc:830:27: warning: comparison of integer expressions of different signedness: ‘std::vector, int> >, float> >::size_type’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-07-06T14:50:36,771 while (results.size() < samples) { 2023-07-06T14:50:36,772 ~~~~~~~~~~~~~~~^~~~~~~~~ 2023-07-06T14:50:36,824 sentencepiece/src/unigram_model.cc: In member function ‘sentencepiece::EncodeResult sentencepiece::unigram::Model::EncodeOptimized(std::string_view) const’: 2023-07-06T14:50:36,824 sentencepiece/src/unigram_model.cc:970:20: warning: comparison of integer expressions of different signedness: ‘std::size_t’ {aka ‘unsigned int’} and ‘const int’ [-Wsign-compare] 2023-07-06T14:50:36,825 while (key_pos < size) { 2023-07-06T14:50:36,825 ~~~~~~~~^~~~~~ 2023-07-06T14:50:36,826 sentencepiece/src/unigram_model.cc:991:40: warning: comparison of integer expressions of different signedness: ‘const unsigned int’ and ‘const int’ [-Wsign-compare] 2023-07-06T14:50:36,827 if (!has_single_node && length == mblen) { 2023-07-06T14:50:36,827 ~~~~~~~^~~~~~~~ 2023-07-06T14:51:04,120 sentencepiece/src/unigram_model.cc: At top level: 2023-07-06T14:51:04,121 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:51:08,362 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/util.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/util.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:51:19,288 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/src/word_model.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/src/word_model.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:51:33,499 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/absl/flags/flag.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/flags/flag.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:51:54,300 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/arena.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arena.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:51:58,755 sentencepiece/third_party/protobuf-lite/arena.cc: In member function ‘std::pair google::protobuf::internal::ArenaImpl::NewBuffer(size_t, size_t)’: 2023-07-06T14:51:58,756 sentencepiece/third_party/protobuf-lite/arena.cc:237:17: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-07-06T14:51:58,756 if (last_size != -1) { 2023-07-06T14:51:58,757 ~~~~~~~~~~^~~~~ 2023-07-06T14:52:00,793 sentencepiece/third_party/protobuf-lite/arena.cc: At top level: 2023-07-06T14:52:00,794 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:52:01,411 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/arenastring.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arenastring.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:52:10,443 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/bytestream.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/bytestream.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:52:14,390 In file included from sentencepiece/third_party/protobuf-lite/bytestream.cc:36: 2023-07-06T14:52:14,391 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual void google::protobuf::strings::ArrayByteSource::Skip(size_t)’: 2023-07-06T14:52:14,391 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:50: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-07-06T14:52:14,392 #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-07-06T14:52:14,392 ~~~~^~~~~~ 2023-07-06T14:52:14,392 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-07-06T14:52:14,393 !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-07-06T14:52:14,393 ^~~~~~~~~ 2023-07-06T14:52:14,394 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:181:48: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-07-06T14:52:14,394 #define GOOGLE_DCHECK(EXPRESSION) while(false) GOOGLE_CHECK(EXPRESSION) 2023-07-06T14:52:14,394 ^~~~~~~~~~~~ 2023-07-06T14:52:14,395 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:186:32: note: in expansion of macro ‘GOOGLE_DCHECK’ 2023-07-06T14:52:14,395 #define GOOGLE_DCHECK_LE(A, B) GOOGLE_DCHECK((A) <= (B)) 2023-07-06T14:52:14,396 ^~~~~~~~~~~~~ 2023-07-06T14:52:14,396 sentencepiece/third_party/protobuf-lite/bytestream.cc:157:3: note: in expansion of macro ‘GOOGLE_DCHECK_LE’ 2023-07-06T14:52:14,396 GOOGLE_DCHECK_LE(n, input_.size()); 2023-07-06T14:52:14,397 ^~~~~~~~~~~~~~~~ 2023-07-06T14:52:14,397 sentencepiece/third_party/protobuf-lite/bytestream.cc: In member function ‘virtual google::protobuf::StringPiece google::protobuf::strings::LimitByteSource::Peek()’: 2023-07-06T14:52:14,398 sentencepiece/third_party/protobuf-lite/bytestream.cc:177:20: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:52:14,398 if (piece.size() > limit_) { 2023-07-06T14:52:14,399 ~~~~~~~~~~~~~^~~~~~~~ 2023-07-06T14:52:15,740 sentencepiece/third_party/protobuf-lite/bytestream.cc: At top level: 2023-07-06T14:52:15,741 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:52:16,178 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/coded_stream.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/coded_stream.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:52:20,730 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian32Fallback(google::protobuf::uint32*)’: 2023-07-06T14:52:20,731 sentencepiece/third_party/protobuf-lite/coded_stream.cc:315:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:20,731 if (BufferSize() >= sizeof(*value)) { 2023-07-06T14:52:20,732 ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-07-06T14:52:20,732 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In member function ‘bool google::protobuf::io::CodedInputStream::ReadLittleEndian64Fallback(google::protobuf::uint64*)’: 2023-07-06T14:52:20,733 sentencepiece/third_party/protobuf-lite/coded_stream.cc:332:20: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:20,733 if (BufferSize() >= sizeof(*value)) { 2023-07-06T14:52:20,733 ~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~ 2023-07-06T14:52:21,027 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 2; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,027 sentencepiece/third_party/protobuf-lite/coded_stream.cc:421:52: required from here 2023-07-06T14:52:21,028 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,028 for (int i = 0, offset = 0; i < N - 1; i++, offset += 7) { 2023-07-06T14:52:21,028 ~~^~~~~~~ 2023-07-06T14:52:21,029 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 3; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,029 sentencepiece/third_party/protobuf-lite/coded_stream.cc:423:52: required from here 2023-07-06T14:52:21,030 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,030 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 4; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,030 sentencepiece/third_party/protobuf-lite/coded_stream.cc:425:52: required from here 2023-07-06T14:52:21,031 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,031 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 5; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,032 sentencepiece/third_party/protobuf-lite/coded_stream.cc:427:52: required from here 2023-07-06T14:52:21,032 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,033 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 6; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,033 sentencepiece/third_party/protobuf-lite/coded_stream.cc:429:52: required from here 2023-07-06T14:52:21,033 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,034 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 7; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,034 sentencepiece/third_party/protobuf-lite/coded_stream.cc:431:52: required from here 2023-07-06T14:52:21,034 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,035 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 8; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,035 sentencepiece/third_party/protobuf-lite/coded_stream.cc:433:52: required from here 2023-07-06T14:52:21,036 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,036 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 9; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,037 sentencepiece/third_party/protobuf-lite/coded_stream.cc:435:52: required from here 2023-07-06T14:52:21,037 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:21,037 sentencepiece/third_party/protobuf-lite/coded_stream.cc: In instantiation of ‘const uint8* google::protobuf::io::{anonymous}::DecodeVarint64KnownSize(const uint8*, google::protobuf::uint64*) [with unsigned int N = 10; google::protobuf::uint8 = unsigned char; google::protobuf::uint64 = long long unsigned int]’: 2023-07-06T14:52:21,038 sentencepiece/third_party/protobuf-lite/coded_stream.cc:437:53: required from here 2023-07-06T14:52:21,038 sentencepiece/third_party/protobuf-lite/coded_stream.cc:354:33: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:52:24,820 sentencepiece/third_party/protobuf-lite/coded_stream.cc: At top level: 2023-07-06T14:52:24,820 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:52:25,621 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/common.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/common.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:52:34,011 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/extension_set.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/extension_set.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:53:05,371 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/generated_enum_util.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_enum_util.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:53:10,506 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc: In function ‘bool google::protobuf::internal::InitializeEnumStrings(const google::protobuf::internal::EnumEntry*, const int*, size_t, google::protobuf::internal::ExplicitlyConstructed >*)’: 2023-07-06T14:53:10,506 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc:86:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:53:10,507 for (int i = 0; i < size; ++i) { 2023-07-06T14:53:10,507 ~~^~~~~~ 2023-07-06T14:53:12,108 sentencepiece/third_party/protobuf-lite/generated_enum_util.cc: At top level: 2023-07-06T14:53:12,109 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:53:12,777 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:53:19,398 In file included from sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:31: 2023-07-06T14:53:19,399 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = (google::protobuf::internal::ProcessingType)0; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-07-06T14:53:19,399 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:457:49: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-07-06T14:53:19,400 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-07-06T14:53:19,400 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-07-06T14:53:19,400 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-07-06T14:53:19,401 if (*oneof_case == field_number) { 2023-07-06T14:53:19,401 ~~~~~~~~~~~~^~~~~~~~~~~~~~~ 2023-07-06T14:53:19,413 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h: In instantiation of ‘void google::protobuf::internal::ResetOneofField(const google::protobuf::internal::ParseTable&, int, google::protobuf::Arena*, google::protobuf::MessageLite*, google::protobuf::uint32*, google::protobuf::int64, const void*) [with google::protobuf::internal::ProcessingType field_type = (google::protobuf::internal::ProcessingType)3; google::protobuf::uint32 = unsigned int; google::protobuf::int64 = long long int]’: 2023-07-06T14:53:19,413 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:647:50: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamInlined(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite; unsigned int kMaxTag = 127]’ 2023-07-06T14:53:19,414 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:784:73: required from ‘bool google::protobuf::internal::MergePartialFromCodedStreamImpl(google::protobuf::MessageLite*, const google::protobuf::internal::ParseTable&, google::protobuf::io::CodedInputStream*) [with UnknownFieldHandler = google::protobuf::internal::{anonymous}::UnknownFieldHandlerLite]’ 2023-07-06T14:53:19,414 sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.cc:101:72: required from here 2023-07-06T14:53:19,415 sentencepiece/third_party/protobuf-lite/google/protobuf/generated_message_table_driven_lite.h:175:19: warning: comparison of integer expressions of different signedness: ‘google::protobuf::uint32’ {aka ‘unsigned int’} and ‘int’ [-Wsign-compare] 2023-07-06T14:53:38,563 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:53:40,971 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/generated_message_util.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_util.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:04,316 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/implicit_weak_message.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:12,403 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/int128.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/int128.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:16,767 sentencepiece/third_party/protobuf-lite/int128.cc: In function ‘std::ostream& google::protobuf::operator<<(std::ostream&, const google::protobuf::uint128&)’: 2023-07-06T14:54:16,768 sentencepiece/third_party/protobuf-lite/int128.cc:178:13: warning: comparison of integer expressions of different signedness: ‘std::streamsize’ {aka ‘int’} and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:54:16,768 if (width > rep.size()) { 2023-07-06T14:54:16,768 ~~~~~~^~~~~~~~~~~~ 2023-07-06T14:54:19,153 sentencepiece/third_party/protobuf-lite/int128.cc: At top level: 2023-07-06T14:54:19,153 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:54:19,674 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/io_win32.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/io_win32.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:19,847 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/message_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/message_lite.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:25,802 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToCodedStream(google::protobuf::io::CodedOutputStream*) const’: 2023-07-06T14:54:25,802 sentencepiece/third_party/protobuf-lite/message_lite.cc:392:46: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-07-06T14:54:25,803 if (final_byte_count - original_byte_count != size) { 2023-07-06T14:54:25,803 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~ 2023-07-06T14:54:25,821 sentencepiece/third_party/protobuf-lite/message_lite.cc: In member function ‘bool google::protobuf::MessageLite::SerializePartialToArray(void*, int) const’: 2023-07-06T14:54:25,821 sentencepiece/third_party/protobuf-lite/message_lite.cc:491:12: warning: comparison of integer expressions of different signedness: ‘int’ and ‘const size_t’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-07-06T14:54:25,822 if (size < byte_size) return false; 2023-07-06T14:54:25,822 ~~~~~^~~~~~~~~~~ 2023-07-06T14:54:31,590 sentencepiece/third_party/protobuf-lite/message_lite.cc: At top level: 2023-07-06T14:54:31,590 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:54:32,832 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/parse_context.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/parse_context.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:45,396 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/repeated_field.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/repeated_field.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:54:50,307 In file included from sentencepiece/third_party/protobuf-lite/google/protobuf/repeated_field.h:60, 2023-07-06T14:54:50,307 from sentencepiece/third_party/protobuf-lite/repeated_field.cc:35: 2023-07-06T14:54:50,308 sentencepiece/third_party/protobuf-lite/repeated_field.cc: In member function ‘void** google::protobuf::internal::RepeatedPtrFieldBase::InternalExtend(int)’: 2023-07-06T14:54:50,308 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:54:50,308 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-07-06T14:54:50,309 ~~~~^~~~~~ 2023-07-06T14:54:50,309 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-07-06T14:54:50,309 !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-07-06T14:54:50,309 ^~~~~~~~~ 2023-07-06T14:54:50,310 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-07-06T14:54:50,310 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-07-06T14:54:50,310 ^~~~~~~~~~~~ 2023-07-06T14:54:50,311 sentencepiece/third_party/protobuf-lite/repeated_field.cc:61:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-07-06T14:54:50,311 GOOGLE_CHECK_LE(new_size, (std::numeric_limits::max() - kRepHeaderSize) / 2023-07-06T14:54:50,311 ^~~~~~~~~~~~~~~ 2023-07-06T14:55:04,307 sentencepiece/third_party/protobuf-lite/repeated_field.cc: At top level: 2023-07-06T14:55:04,307 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:55:06,684 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/status.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/status.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:13,263 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/statusor.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/statusor.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:18,174 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/stringpiece.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringpiece.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:21,249 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘bool google::protobuf::StringPiece::contains(google::protobuf::StringPiece) const’: 2023-07-06T14:55:21,249 sentencepiece/third_party/protobuf-lite/stringpiece.cc:101:21: warning: comparison of integer expressions of different signedness: ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} and ‘const size_type’ {aka ‘const unsigned int’} [-Wsign-compare] 2023-07-06T14:55:21,250 return find(s, 0) != npos; 2023-07-06T14:55:21,250 ~~~~~~~~~~~^~~~~~~ 2023-07-06T14:55:21,267 sentencepiece/third_party/protobuf-lite/stringpiece.cc: In member function ‘google::protobuf::StringPiece google::protobuf::StringPiece::substr(google::protobuf::StringPiece::size_type, google::protobuf::StringPiece::size_type) const’: 2023-07-06T14:55:21,267 sentencepiece/third_party/protobuf-lite/stringpiece.cc:262:11: warning: comparison of integer expressions of different signedness: ‘google::protobuf::StringPiece::size_type’ {aka ‘unsigned int’} and ‘const stringpiece_ssize_type’ {aka ‘const int’} [-Wsign-compare] 2023-07-06T14:55:21,267 if (pos > length_) pos = length_; 2023-07-06T14:55:21,268 ~~~~^~~~~~~~~ 2023-07-06T14:55:23,509 sentencepiece/third_party/protobuf-lite/stringpiece.cc: At top level: 2023-07-06T14:55:23,509 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:55:23,956 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/stringprintf.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringprintf.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:27,928 sentencepiece/third_party/protobuf-lite/stringprintf.cc: In function ‘std::__cxx11::string google::protobuf::StringPrintfVector(const char*, const std::vector >&)’: 2023-07-06T14:55:27,928 sentencepiece/third_party/protobuf-lite/stringprintf.cc:153:21: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::vector >::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:55:27,929 for (int i = 0; i < v.size(); ++i) { 2023-07-06T14:55:27,929 ~~^~~~~~~~~~ 2023-07-06T14:55:27,930 sentencepiece/third_party/protobuf-lite/stringprintf.cc:156:28: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare] 2023-07-06T14:55:27,930 for (int i = v.size(); i < GOOGLE_ARRAYSIZE(cstr); ++i) { 2023-07-06T14:55:29,099 sentencepiece/third_party/protobuf-lite/stringprintf.cc: At top level: 2023-07-06T14:55:29,100 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:55:29,457 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/structurally_valid.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/structurally_valid.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:34,841 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/strutil.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/strutil.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:39,397 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘void google::protobuf::CEscapeAndAppend(google::protobuf::StringPiece, std::__cxx11::string*)’: 2023-07-06T14:55:39,398 sentencepiece/third_party/protobuf-lite/strutil.cc:563:19: warning: comparison of integer expressions of different signedness: ‘size_t’ {aka ‘unsigned int’} and ‘google::protobuf::stringpiece_ssize_type’ {aka ‘int’} [-Wsign-compare] 2023-07-06T14:55:39,398 if (escaped_len == src.size()) { 2023-07-06T14:55:39,399 ~~~~~~~~~~~~^~~~~~~~~~~~~ 2023-07-06T14:55:39,452 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::memcasecmp(const char*, const char*, size_t)’: 2023-07-06T14:55:39,452 sentencepiece/third_party/protobuf-lite/strutil.cc:1290:22: warning: comparison of integer expressions of different signedness: ‘int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:55:39,453 for ( int i = 0; i < len; i++ ) { 2023-07-06T14:55:39,453 ~~^~~~~ 2023-07-06T14:55:39,508 sentencepiece/third_party/protobuf-lite/strutil.cc: In function ‘int google::protobuf::GlobalReplaceSubstring(const string&, const string&, std::__cxx11::string*)’: 2023-07-06T14:55:39,509 sentencepiece/third_party/protobuf-lite/strutil.cc:1623:18: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:55:39,509 match_pos != std::string::npos; pos = match_pos + substring.length(), 2023-07-06T14:55:39,510 ~~~~~~~~~~^~~~~~ 2023-07-06T14:55:49,033 sentencepiece/third_party/protobuf-lite/strutil.cc: At top level: 2023-07-06T14:55:49,034 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:55:50,417 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/time.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/time.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:55:57,253 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/wire_format_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/wire_format_lite.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:56:09,026 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/zero_copy_stream.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:56:13,831 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:56:20,147 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -Isentencepiece -Isentencepiece/src -Isentencepiece/src/builtin_pb -Isentencepiece/third_party/protobuf-lite -I/usr/include/python3.7m -c sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc -o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:56:24,199 In file included from sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:41: 2023-07-06T14:56:24,200 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc: In member function ‘virtual void google::protobuf::io::StringOutputStream::BackUp(int)’: 2023-07-06T14:56:24,200 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:48: warning: comparison of integer expressions of different signedness: ‘int’ and ‘std::__cxx11::basic_string::size_type’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:56:24,201 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-07-06T14:56:24,201 ~~~~^~~~~~ 2023-07-06T14:56:24,202 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:151:5: note: in definition of macro ‘GOOGLE_LOG_IF’ 2023-07-06T14:56:24,202 !(CONDITION) ? (void)0 : GOOGLE_LOG(LEVEL) 2023-07-06T14:56:24,202 ^~~~~~~~~ 2023-07-06T14:56:24,203 sentencepiece/third_party/protobuf-lite/google/protobuf/stubs/logging.h:159:31: note: in expansion of macro ‘GOOGLE_CHECK’ 2023-07-06T14:56:24,203 #define GOOGLE_CHECK_LE(A, B) GOOGLE_CHECK((A) <= (B)) 2023-07-06T14:56:24,203 ^~~~~~~~~~~~ 2023-07-06T14:56:24,204 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc:171:3: note: in expansion of macro ‘GOOGLE_CHECK_LE’ 2023-07-06T14:56:24,204 GOOGLE_CHECK_LE(count, target_->size()); 2023-07-06T14:56:24,204 ^~~~~~~~~~~~~~~ 2023-07-06T14:56:26,776 sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.cc: At top level: 2023-07-06T14:56:26,776 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:56:27,284 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro build/temp.linux-armv7l-cpython-37/curated_tokenizers/_spp.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/bpe_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece.pb.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/builtin_pb/sentencepiece_model.pb.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/char_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/error.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/filesystem.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_factory.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/model_interface.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/normalizer.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/sentencepiece_processor.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/unigram_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/util.o build/temp.linux-armv7l-cpython-37/sentencepiece/src/word_model.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/absl/flags/flag.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arena.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/arenastring.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/bytestream.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/coded_stream.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/common.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/extension_set.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_enum_util.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_table_driven_lite.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/generated_message_util.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/implicit_weak_message.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/int128.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/io_win32.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/message_lite.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/parse_context.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/repeated_field.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/status.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/statusor.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringpiece.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/stringprintf.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/structurally_valid.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/strutil.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/time.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/wire_format_lite.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl.o build/temp.linux-armv7l-cpython-37/sentencepiece/third_party/protobuf-lite/zero_copy_stream_impl_lite.o -L/usr/lib -o build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.cpython-37m-arm-linux-gnueabihf.so 2023-07-06T14:58:47,994 building 'curated_tokenizers._wordpiece' extension 2023-07-06T14:58:47,996 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/_wordpiece.cpp -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:58:51,861 curated_tokenizers/_wordpiece.cpp: In function ‘PyObject* __pyx_pf_18curated_tokenizers_10_wordpiece_18WordPieceProcessor_14to_list(__pyx_obj_18curated_tokenizers_10_wordpiece_WordPieceProcessor*)’: 2023-07-06T14:58:51,861 curated_tokenizers/_wordpiece.cpp:3451:35: warning: comparison of integer expressions of different signedness: ‘Py_ssize_t’ {aka ‘int’} and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:58:51,862 for (__pyx_temp=0; __pyx_temp < __pyx_v_self->_pieces.size(); __pyx_temp++) { 2023-07-06T14:58:51,862 ~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-06T14:59:06,915 curated_tokenizers/_wordpiece.cpp: At top level: 2023-07-06T14:59:06,915 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:59:08,648 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/wordpiece.cc -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T14:59:11,004 curated_tokenizers/wordpiece.cc: In member function ‘const Piece& PieceStorage::id_to_piece(int) const’: 2023-07-06T14:59:11,004 curated_tokenizers/wordpiece.cc:15:22: warning: comparison of integer expressions of different signedness: ‘const int’ and ‘size_t’ {aka ‘unsigned int’} [-Wsign-compare] 2023-07-06T14:59:11,005 if (id < 0 || id >= size()) { 2023-07-06T14:59:11,005 ~~~^~~~~~~~~ 2023-07-06T14:59:14,263 curated_tokenizers/wordpiece.cc: At top level: 2023-07-06T14:59:14,264 cc1plus: warning: unrecognized command line option ‘-Wno-sign-compare-Wno-strict-prototypes’ 2023-07-06T14:59:14,991 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro build/temp.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.o build/temp.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.o -L/usr/lib -o build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.cpython-37m-arm-linux-gnueabihf.so 2023-07-06T14:59:28,477 building 'curated_tokenizers._bbpe' extension 2023-07-06T14:59:28,479 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/_bbpe.cpp -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T15:00:02,836 arm-linux-gnueabihf-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -flto -fuse-linker-plugin -ffat-lto-objects -fPIC -Icurated_tokenizers -I/usr/include/python3.7m -c curated_tokenizers/merges.cc -o build/temp.linux-armv7l-cpython-37/curated_tokenizers/merges.o --std=c++17 -Wno-sign-compare-Wno-strict-prototypes -Wno-unused-function -pthread -DHAVE_PTHREAD=1 2023-07-06T15:00:10,547 arm-linux-gnueabihf-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-z,relro build/temp.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.o build/temp.linux-armv7l-cpython-37/curated_tokenizers/merges.o -L/usr/lib -o build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.cpython-37m-arm-linux-gnueabihf.so 2023-07-06T15:00:33,008 installing to build/bdist.linux-armv7l/wheel 2023-07-06T15:00:33,008 running install 2023-07-06T15:00:33,070 running install_lib 2023-07-06T15:00:33,086 creating build/bdist.linux-armv7l 2023-07-06T15:00:33,087 creating build/bdist.linux-armv7l/wheel 2023-07-06T15:00:33,091 creating build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,093 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.cpython-37m-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,135 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,139 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/util.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,143 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.cpython-37m-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,654 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,681 creating build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,683 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/test_sp.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,687 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/robbert-vocab-1000.json -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,693 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,696 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/incorrect-merges.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,699 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/toy-word-pieces.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,702 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/robbert-merges-1000.txt -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,707 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/test_word_piece_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,710 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/test_bbpe_processor.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,714 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/tests/toy.model -> build/bdist.linux-armv7l/wheel/curated_tokenizers/tests 2023-07-06T15:00:33,729 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,733 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,739 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/merges.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,742 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.cpython-37m-arm-linux-gnueabihf.so -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,776 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/__init__.py -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,780 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_wordpiece.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,801 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.cc -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,805 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/merges.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,809 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,813 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/wordpiece.hh -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,816 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/config.h -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,820 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.cpp -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,841 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_bbpe.pxd -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,844 copying build/lib.linux-armv7l-cpython-37/curated_tokenizers/_spp.pyx -> build/bdist.linux-armv7l/wheel/curated_tokenizers 2023-07-06T15:00:33,848 running install_egg_info 2023-07-06T15:00:33,877 Copying curated_tokenizers.egg-info to build/bdist.linux-armv7l/wheel/curated_tokenizers-0.9.0.dev0-py3.7.egg-info 2023-07-06T15:00:33,904 running install_scripts 2023-07-06T15:00:34,004 creating build/bdist.linux-armv7l/wheel/curated_tokenizers-0.9.0.dev0.dist-info/WHEEL 2023-07-06T15:00:34,010 creating '/tmp/pip-wheel-r5k1pcpm/.tmp-56nybyeq/curated_tokenizers-0.9.0.dev0-cp37-cp37m-linux_armv7l.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-07-06T15:00:34,016 adding 'curated_tokenizers/__init__.py' 2023-07-06T15:00:34,113 adding 'curated_tokenizers/_bbpe.cpp' 2023-07-06T15:00:34,403 adding 'curated_tokenizers/_bbpe.cpython-37m-arm-linux-gnueabihf.so' 2023-07-06T15:00:34,420 adding 'curated_tokenizers/_bbpe.pxd' 2023-07-06T15:00:34,423 adding 'curated_tokenizers/_bbpe.pyx' 2023-07-06T15:00:34,486 adding 'curated_tokenizers/_spp.cpp' 2023-07-06T15:00:38,574 adding 'curated_tokenizers/_spp.cpython-37m-arm-linux-gnueabihf.so' 2023-07-06T15:00:38,781 adding 'curated_tokenizers/_spp.pxd' 2023-07-06T15:00:38,785 adding 'curated_tokenizers/_spp.pyx' 2023-07-06T15:00:38,851 adding 'curated_tokenizers/_wordpiece.cpp' 2023-07-06T15:00:39,064 adding 'curated_tokenizers/_wordpiece.cpython-37m-arm-linux-gnueabihf.so' 2023-07-06T15:00:39,077 adding 'curated_tokenizers/_wordpiece.pxd' 2023-07-06T15:00:39,081 adding 'curated_tokenizers/_wordpiece.pyx' 2023-07-06T15:00:39,084 adding 'curated_tokenizers/config.h' 2023-07-06T15:00:39,087 adding 'curated_tokenizers/merges.cc' 2023-07-06T15:00:39,090 adding 'curated_tokenizers/merges.hh' 2023-07-06T15:00:39,093 adding 'curated_tokenizers/util.hh' 2023-07-06T15:00:39,096 adding 'curated_tokenizers/wordpiece.cc' 2023-07-06T15:00:39,098 adding 'curated_tokenizers/wordpiece.hh' 2023-07-06T15:00:39,102 adding 'curated_tokenizers/tests/__init__.py' 2023-07-06T15:00:39,104 adding 'curated_tokenizers/tests/incorrect-merges.txt' 2023-07-06T15:00:39,109 adding 'curated_tokenizers/tests/robbert-merges-1000.txt' 2023-07-06T15:00:39,118 adding 'curated_tokenizers/tests/robbert-vocab-1000.json' 2023-07-06T15:00:39,121 adding 'curated_tokenizers/tests/test_bbpe_processor.py' 2023-07-06T15:00:39,124 adding 'curated_tokenizers/tests/test_sp.py' 2023-07-06T15:00:39,127 adding 'curated_tokenizers/tests/test_word_piece_processor.py' 2023-07-06T15:00:39,129 adding 'curated_tokenizers/tests/toy-word-pieces.txt' 2023-07-06T15:00:39,297 adding 'curated_tokenizers/tests/toy.model' 2023-07-06T15:00:39,307 adding 'curated_tokenizers-0.9.0.dev0.dist-info/LICENSE' 2023-07-06T15:00:39,310 adding 'curated_tokenizers-0.9.0.dev0.dist-info/METADATA' 2023-07-06T15:00:39,312 adding 'curated_tokenizers-0.9.0.dev0.dist-info/WHEEL' 2023-07-06T15:00:39,313 adding 'curated_tokenizers-0.9.0.dev0.dist-info/top_level.txt' 2023-07-06T15:00:39,315 adding 'curated_tokenizers-0.9.0.dev0.dist-info/zip-safe' 2023-07-06T15:00:39,318 adding 'curated_tokenizers-0.9.0.dev0.dist-info/RECORD' 2023-07-06T15:00:39,486 removing build/bdist.linux-armv7l/wheel 2023-07-06T15:00:39,745 Building wheel for curated-tokenizers (pyproject.toml): finished with status 'done' 2023-07-06T15:00:40,015 Created wheel for curated-tokenizers: filename=curated_tokenizers-0.9.0.dev0-cp37-cp37m-linux_armv7l.whl size=4423710 sha256=01f63e0af45facbf415afdbda7256dab80507ee3477faea59599b373638632d9 2023-07-06T15:00:40,018 Stored in directory: /tmp/pip-ephem-wheel-cache-cbr4__py/wheels/c0/2e/23/30531d7b709a11c14456b3a22f3f9dedc6a69987b5e477e04d 2023-07-06T15:00:40,051 Successfully built curated-tokenizers 2023-07-06T15:00:40,400 Removed build tracker: '/tmp/pip-build-tracker-z3kild4j'