2024-01-17T00:20:28,565 Created temporary directory: /tmp/pip-build-tracker-h8jcjrem 2024-01-17T00:20:28,566 Initialized build tracking at /tmp/pip-build-tracker-h8jcjrem 2024-01-17T00:20:28,567 Created build tracker: /tmp/pip-build-tracker-h8jcjrem 2024-01-17T00:20:28,567 Entered build tracker: /tmp/pip-build-tracker-h8jcjrem 2024-01-17T00:20:28,568 Created temporary directory: /tmp/pip-wheel-y8dx84kx 2024-01-17T00:20:28,571 Created temporary directory: /tmp/pip-ephem-wheel-cache-o8npq2hj 2024-01-17T00:20:28,593 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-17T00:20:28,597 2 location(s) to search for versions of sglang: 2024-01-17T00:20:28,597 * https://pypi.org/simple/sglang/ 2024-01-17T00:20:28,597 * https://www.piwheels.org/simple/sglang/ 2024-01-17T00:20:28,598 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-01-17T00:20:28,598 Getting page https://pypi.org/simple/sglang/ 2024-01-17T00:20:28,600 Found index url https://pypi.org/simple/ 2024-01-17T00:20:28,815 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-01-17T00:20:28,817 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-17T00:20:28,818 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-01-17T00:20:28,819 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-17T00:20:28,820 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-01-17T00:20:28,820 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-01-17T00:20:28,821 Getting page https://www.piwheels.org/simple/sglang/ 2024-01-17T00:20:28,822 Found index url https://www.piwheels.org/simple/ 2024-01-17T00:20:28,977 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-01-17T00:20:28,978 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-17T00:20:28,979 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-01-17T00:20:28,980 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-01-17T00:20:28,998 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-01-17T00:20:29,016 Collecting sglang==0.1.4 2024-01-17T00:20:29,019 Created temporary directory: /tmp/pip-unpack-oxjlp6yx 2024-01-17T00:20:29,259 Downloading sglang-0.1.4.tar.gz (88 kB) 2024-01-17T00:20:30,654 Added sglang==0.1.4 from https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz to build tracker '/tmp/pip-build-tracker-h8jcjrem' 2024-01-17T00:20:30,663 Created temporary directory: /tmp/pip-build-env-0g1ttdcx 2024-01-17T00:20:30,671 Installing build dependencies: started 2024-01-17T00:20:30,673 Running command pip subprocess to install build dependencies 2024-01-17T00:20:32,672 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-01-17T00:20:33,188 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-17T00:20:34,592 Collecting setuptools>=61.0 2024-01-17T00:20:34,606 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-01-17T00:20:34,837 Collecting wheel 2024-01-17T00:20:34,851 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-01-17T00:20:37,408 Installing collected packages: wheel, setuptools 2024-01-17T00:20:37,635 Creating /tmp/pip-build-env-0g1ttdcx/overlay/local/bin 2024-01-17T00:20:37,638 changing mode of /tmp/pip-build-env-0g1ttdcx/overlay/local/bin/wheel to 755 2024-01-17T00:20:39,936 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-01-17T00:20:40,220 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-01-17T00:20:40,221 [notice] To update, run: python3 -m pip install --upgrade pip 2024-01-17T00:20:40,487 Installing build dependencies: finished with status 'done' 2024-01-17T00:20:40,490 Getting requirements to build wheel: started 2024-01-17T00:20:40,492 Running command Getting requirements to build wheel 2024-01-17T00:20:41,335 running egg_info 2024-01-17T00:20:41,339 writing sglang.egg-info/PKG-INFO 2024-01-17T00:20:41,348 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-17T00:20:41,353 writing requirements to sglang.egg-info/requires.txt 2024-01-17T00:20:41,354 writing top-level names to sglang.egg-info/top_level.txt 2024-01-17T00:20:41,380 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:41,383 adding license file 'LICENSE' 2024-01-17T00:20:41,387 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:41,503 Getting requirements to build wheel: finished with status 'done' 2024-01-17T00:20:41,512 Created temporary directory: /tmp/pip-modern-metadata-26mj2xxk 2024-01-17T00:20:41,514 Preparing metadata (pyproject.toml): started 2024-01-17T00:20:41,515 Running command Preparing metadata (pyproject.toml) 2024-01-17T00:20:42,278 running dist_info 2024-01-17T00:20:42,282 creating /tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info 2024-01-17T00:20:42,287 writing /tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/PKG-INFO 2024-01-17T00:20:42,295 writing dependency_links to /tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/dependency_links.txt 2024-01-17T00:20:42,300 writing requirements to /tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/requires.txt 2024-01-17T00:20:42,301 writing top-level names to /tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/top_level.txt 2024-01-17T00:20:42,302 writing manifest file '/tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:42,323 reading manifest file '/tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:42,325 adding license file 'LICENSE' 2024-01-17T00:20:42,328 writing manifest file '/tmp/pip-modern-metadata-26mj2xxk/sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:42,329 creating '/tmp/pip-modern-metadata-26mj2xxk/sglang-0.1.4.dist-info' 2024-01-17T00:20:42,482 Preparing metadata (pyproject.toml): finished with status 'done' 2024-01-17T00:20:42,489 Source in /tmp/pip-wheel-y8dx84kx/sglang_407bdeb1512c4c29b8e289952bea7421 has version 0.1.4, which satisfies requirement sglang==0.1.4 from https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz 2024-01-17T00:20:42,490 Removed sglang==0.1.4 from https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz from build tracker '/tmp/pip-build-tracker-h8jcjrem' 2024-01-17T00:20:42,500 Created temporary directory: /tmp/pip-unpack-vpzj4oql 2024-01-17T00:20:42,501 Created temporary directory: /tmp/pip-unpack-n1q1ftvr 2024-01-17T00:20:42,555 Building wheels for collected packages: sglang 2024-01-17T00:20:42,559 Created temporary directory: /tmp/pip-wheel-6505kg2h 2024-01-17T00:20:42,560 Destination directory: /tmp/pip-wheel-6505kg2h 2024-01-17T00:20:42,562 Building wheel for sglang (pyproject.toml): started 2024-01-17T00:20:42,563 Running command Building wheel for sglang (pyproject.toml) 2024-01-17T00:20:43,302 running bdist_wheel 2024-01-17T00:20:43,318 running build 2024-01-17T00:20:43,319 running build_py 2024-01-17T00:20:43,323 creating build 2024-01-17T00:20:43,324 creating build/lib 2024-01-17T00:20:43,325 creating build/lib/sglang 2024-01-17T00:20:43,326 copying sglang/launch_server.py -> build/lib/sglang 2024-01-17T00:20:43,328 copying sglang/global_config.py -> build/lib/sglang 2024-01-17T00:20:43,329 copying sglang/__init__.py -> build/lib/sglang 2024-01-17T00:20:43,332 copying sglang/api.py -> build/lib/sglang 2024-01-17T00:20:43,334 copying sglang/flush_cache.py -> build/lib/sglang 2024-01-17T00:20:43,336 copying sglang/utils.py -> build/lib/sglang 2024-01-17T00:20:43,339 creating build/lib/sglang/lang 2024-01-17T00:20:43,339 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-01-17T00:20:43,342 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-01-17T00:20:43,344 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-01-17T00:20:43,346 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-01-17T00:20:43,349 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-01-17T00:20:43,350 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-01-17T00:20:43,353 creating build/lib/sglang/test 2024-01-17T00:20:43,354 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-01-17T00:20:43,356 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-01-17T00:20:43,359 creating build/lib/sglang/backend 2024-01-17T00:20:43,360 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-01-17T00:20:43,362 copying sglang/backend/huggingface.py -> build/lib/sglang/backend 2024-01-17T00:20:43,364 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-01-17T00:20:43,365 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-01-17T00:20:43,367 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-01-17T00:20:43,369 copying sglang/backend/tgi.py -> build/lib/sglang/backend 2024-01-17T00:20:43,371 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-01-17T00:20:43,374 creating build/lib/sglang/srt 2024-01-17T00:20:43,375 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-01-17T00:20:43,377 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-01-17T00:20:43,379 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-01-17T00:20:43,381 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-01-17T00:20:43,383 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-01-17T00:20:43,385 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-01-17T00:20:43,388 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-01-17T00:20:43,389 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-01-17T00:20:43,392 creating build/lib/sglang/srt/managers 2024-01-17T00:20:43,393 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-01-17T00:20:43,395 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-17T00:20:43,397 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-01-17T00:20:43,399 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-17T00:20:43,401 creating build/lib/sglang/srt/constrained 2024-01-17T00:20:43,402 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-01-17T00:20:43,404 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-01-17T00:20:43,407 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-01-17T00:20:43,409 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-01-17T00:20:43,412 creating build/lib/sglang/srt/models 2024-01-17T00:20:43,413 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-01-17T00:20:43,415 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-01-17T00:20:43,417 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-01-17T00:20:43,420 creating build/lib/sglang/srt/layers 2024-01-17T00:20:43,421 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-01-17T00:20:43,423 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-01-17T00:20:43,425 copying sglang/srt/layers/get_selected_logprob.py -> build/lib/sglang/srt/layers 2024-01-17T00:20:43,427 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-01-17T00:20:43,429 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-01-17T00:20:43,431 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-01-17T00:20:43,433 creating build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,434 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,436 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,438 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,440 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,442 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,444 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-01-17T00:20:43,446 running egg_info 2024-01-17T00:20:43,450 writing sglang.egg-info/PKG-INFO 2024-01-17T00:20:43,458 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-17T00:20:43,462 writing requirements to sglang.egg-info/requires.txt 2024-01-17T00:20:43,463 writing top-level names to sglang.egg-info/top_level.txt 2024-01-17T00:20:43,477 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:43,480 adding license file 'LICENSE' 2024-01-17T00:20:43,484 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-17T00:20:43,500 installing to build/bdist.linux-armv7l/wheel 2024-01-17T00:20:43,501 running install 2024-01-17T00:20:43,524 running install_lib 2024-01-17T00:20:43,528 creating build/bdist.linux-armv7l 2024-01-17T00:20:43,529 creating build/bdist.linux-armv7l/wheel 2024-01-17T00:20:43,530 creating build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,532 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,533 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,535 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,538 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,540 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,542 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,543 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-17T00:20:43,546 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-01-17T00:20:43,547 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-17T00:20:43,549 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-17T00:20:43,552 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,552 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,555 copying build/lib/sglang/backend/huggingface.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,557 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,559 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,560 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,562 copying build/lib/sglang/backend/tgi.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,565 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-17T00:20:43,567 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,568 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,570 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-17T00:20:43,571 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-17T00:20:43,573 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,574 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,576 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,578 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,581 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,583 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,585 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-17T00:20:43,587 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-17T00:20:43,589 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-17T00:20:43,591 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-17T00:20:43,593 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,596 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-17T00:20:43,597 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-17T00:20:43,599 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-17T00:20:43,601 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-17T00:20:43,603 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-17T00:20:43,606 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,608 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,610 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-17T00:20:43,611 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-17T00:20:43,614 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-17T00:20:43,616 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-17T00:20:43,618 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,620 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,623 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,624 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,627 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,629 copying build/lib/sglang/srt/layers/get_selected_logprob.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,631 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,632 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,635 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-17T00:20:43,637 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,638 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-17T00:20:43,640 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,642 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,644 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,646 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,647 copying build/lib/sglang/flush_cache.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,649 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-17T00:20:43,651 running install_egg_info 2024-01-17T00:20:43,655 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.4-py3.11.egg-info 2024-01-17T00:20:43,665 running install_scripts 2024-01-17T00:20:43,684 creating build/bdist.linux-armv7l/wheel/sglang-0.1.4.dist-info/WHEEL 2024-01-17T00:20:43,686 creating '/tmp/pip-wheel-6505kg2h/.tmp-vnj2s55o/sglang-0.1.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-01-17T00:20:43,688 adding 'sglang/__init__.py' 2024-01-17T00:20:43,690 adding 'sglang/api.py' 2024-01-17T00:20:43,691 adding 'sglang/flush_cache.py' 2024-01-17T00:20:43,692 adding 'sglang/global_config.py' 2024-01-17T00:20:43,693 adding 'sglang/launch_server.py' 2024-01-17T00:20:43,695 adding 'sglang/utils.py' 2024-01-17T00:20:43,697 adding 'sglang/backend/__init__.py' 2024-01-17T00:20:43,698 adding 'sglang/backend/anthropic.py' 2024-01-17T00:20:43,700 adding 'sglang/backend/base_backend.py' 2024-01-17T00:20:43,702 adding 'sglang/backend/huggingface.py' 2024-01-17T00:20:43,703 adding 'sglang/backend/openai.py' 2024-01-17T00:20:43,705 adding 'sglang/backend/runtime_endpoint.py' 2024-01-17T00:20:43,706 adding 'sglang/backend/tgi.py' 2024-01-17T00:20:43,708 adding 'sglang/lang/__init__.py' 2024-01-17T00:20:43,709 adding 'sglang/lang/chat_template.py' 2024-01-17T00:20:43,711 adding 'sglang/lang/compiler.py' 2024-01-17T00:20:43,714 adding 'sglang/lang/interpreter.py' 2024-01-17T00:20:43,716 adding 'sglang/lang/ir.py' 2024-01-17T00:20:43,717 adding 'sglang/lang/tracer.py' 2024-01-17T00:20:43,719 adding 'sglang/srt/backend_config.py' 2024-01-17T00:20:43,721 adding 'sglang/srt/hf_transformers_utils.py' 2024-01-17T00:20:43,722 adding 'sglang/srt/memory_pool.py' 2024-01-17T00:20:43,723 adding 'sglang/srt/model_config.py' 2024-01-17T00:20:43,725 adding 'sglang/srt/sampling_params.py' 2024-01-17T00:20:43,726 adding 'sglang/srt/server.py' 2024-01-17T00:20:43,728 adding 'sglang/srt/server_args.py' 2024-01-17T00:20:43,729 adding 'sglang/srt/utils.py' 2024-01-17T00:20:43,732 adding 'sglang/srt/constrained/fsm.py' 2024-01-17T00:20:43,733 adding 'sglang/srt/constrained/fsm_cache.py' 2024-01-17T00:20:43,736 adding 'sglang/srt/constrained/regex.py' 2024-01-17T00:20:43,738 adding 'sglang/srt/constrained/tokenizer.py' 2024-01-17T00:20:43,740 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-01-17T00:20:43,742 adding 'sglang/srt/layers/extend_attention.py' 2024-01-17T00:20:43,744 adding 'sglang/srt/layers/get_selected_logprob.py' 2024-01-17T00:20:43,745 adding 'sglang/srt/layers/logits_processor.py' 2024-01-17T00:20:43,746 adding 'sglang/srt/layers/radix_attention.py' 2024-01-17T00:20:43,748 adding 'sglang/srt/layers/token_attention.py' 2024-01-17T00:20:43,750 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-01-17T00:20:43,751 adding 'sglang/srt/managers/io_struct.py' 2024-01-17T00:20:43,752 adding 'sglang/srt/managers/openai_protocol.py' 2024-01-17T00:20:43,753 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-01-17T00:20:43,756 adding 'sglang/srt/managers/router/infer_batch.py' 2024-01-17T00:20:43,757 adding 'sglang/srt/managers/router/manager.py' 2024-01-17T00:20:43,759 adding 'sglang/srt/managers/router/model_rpc.py' 2024-01-17T00:20:43,761 adding 'sglang/srt/managers/router/model_runner.py' 2024-01-17T00:20:43,763 adding 'sglang/srt/managers/router/radix_cache.py' 2024-01-17T00:20:43,764 adding 'sglang/srt/managers/router/scheduler.py' 2024-01-17T00:20:43,766 adding 'sglang/srt/models/llama2.py' 2024-01-17T00:20:43,768 adding 'sglang/srt/models/llava.py' 2024-01-17T00:20:43,770 adding 'sglang/srt/models/mixtral.py' 2024-01-17T00:20:43,772 adding 'sglang/test/test_programs.py' 2024-01-17T00:20:43,774 adding 'sglang/test/test_utils.py' 2024-01-17T00:20:43,777 adding 'sglang-0.1.4.dist-info/LICENSE' 2024-01-17T00:20:43,780 adding 'sglang-0.1.4.dist-info/METADATA' 2024-01-17T00:20:43,781 adding 'sglang-0.1.4.dist-info/WHEEL' 2024-01-17T00:20:43,782 adding 'sglang-0.1.4.dist-info/top_level.txt' 2024-01-17T00:20:43,783 adding 'sglang-0.1.4.dist-info/RECORD' 2024-01-17T00:20:43,786 removing build/bdist.linux-armv7l/wheel 2024-01-17T00:20:43,920 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-01-17T00:20:43,926 Created wheel for sglang: filename=sglang-0.1.4-py3-none-any.whl size=105282 sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe 2024-01-17T00:20:43,927 Stored in directory: /tmp/pip-ephem-wheel-cache-o8npq2hj/wheels/c0/6a/4f/7aa0ea8f788ecfa4b2089bbdd0f02065bb49b8be22e7d70b6f 2024-01-17T00:20:43,947 Successfully built sglang 2024-01-17T00:20:43,954 Removed build tracker: '/tmp/pip-build-tracker-h8jcjrem'