2024-01-21T11:37:43,789 Created temporary directory: /tmp/pip-build-tracker-n52ayrx1 2024-01-21T11:37:43,791 Initialized build tracking at /tmp/pip-build-tracker-n52ayrx1 2024-01-21T11:37:43,792 Created build tracker: /tmp/pip-build-tracker-n52ayrx1 2024-01-21T11:37:43,792 Entered build tracker: /tmp/pip-build-tracker-n52ayrx1 2024-01-21T11:37:43,793 Created temporary directory: /tmp/pip-wheel-p0_8_jha 2024-01-21T11:37:43,798 Created temporary directory: /tmp/pip-ephem-wheel-cache-hxfmk6uq 2024-01-21T11:37:43,828 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-21T11:37:43,831 2 location(s) to search for versions of sglang: 2024-01-21T11:37:43,831 * https://pypi.org/simple/sglang/ 2024-01-21T11:37:43,831 * https://www.piwheels.org/simple/sglang/ 2024-01-21T11:37:43,832 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-01-21T11:37:43,833 Getting page https://pypi.org/simple/sglang/ 2024-01-21T11:37:43,834 Found index url https://pypi.org/simple/ 2024-01-21T11:37:43,974 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-01-21T11:37:43,977 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:43,978 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-01-21T11:37:43,979 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:43,980 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-01-21T11:37:43,980 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:43,981 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-01-21T11:37:43,982 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:43,983 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-01-21T11:37:43,983 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:43,984 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-01-21T11:37:43,988 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-01-21T11:37:43,989 Getting page https://www.piwheels.org/simple/sglang/ 2024-01-21T11:37:43,990 Found index url https://www.piwheels.org/simple/ 2024-01-21T11:37:44,154 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-01-21T11:37:44,156 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:44,157 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:44,158 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:44,158 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T11:37:44,159 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-01-21T11:37:44,159 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-01-21T11:37:44,178 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-01-21T11:37:44,196 Collecting sglang==0.1.7 2024-01-21T11:37:44,199 Created temporary directory: /tmp/pip-unpack-of9zbgyg 2024-01-21T11:37:44,422 Downloading sglang-0.1.7.tar.gz (92 kB) 2024-01-21T11:37:44,615 Added sglang==0.1.7 from https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz to build tracker '/tmp/pip-build-tracker-n52ayrx1' 2024-01-21T11:37:44,621 Created temporary directory: /tmp/pip-build-env-lll0_8lp 2024-01-21T11:37:44,626 Installing build dependencies: started 2024-01-21T11:37:44,627 Running command pip subprocess to install build dependencies 2024-01-21T11:37:45,766 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-01-21T11:37:46,264 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-21T11:37:47,661 Collecting setuptools>=61.0 2024-01-21T11:37:47,675 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-01-21T11:37:47,894 Collecting wheel 2024-01-21T11:37:47,908 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-01-21T11:37:50,476 Installing collected packages: wheel, setuptools 2024-01-21T11:37:50,693 Creating /tmp/pip-build-env-lll0_8lp/overlay/local/bin 2024-01-21T11:37:50,696 changing mode of /tmp/pip-build-env-lll0_8lp/overlay/local/bin/wheel to 755 2024-01-21T11:37:52,927 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-01-21T11:37:53,182 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-01-21T11:37:53,183 [notice] To update, run: python3 -m pip install --upgrade pip 2024-01-21T11:37:53,451 Installing build dependencies: finished with status 'done' 2024-01-21T11:37:53,454 Getting requirements to build wheel: started 2024-01-21T11:37:53,455 Running command Getting requirements to build wheel 2024-01-21T11:37:54,296 running egg_info 2024-01-21T11:37:54,300 writing sglang.egg-info/PKG-INFO 2024-01-21T11:37:54,310 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-21T11:37:54,315 writing requirements to sglang.egg-info/requires.txt 2024-01-21T11:37:54,316 writing top-level names to sglang.egg-info/top_level.txt 2024-01-21T11:37:54,342 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:54,345 adding license file 'LICENSE' 2024-01-21T11:37:54,350 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:54,467 Getting requirements to build wheel: finished with status 'done' 2024-01-21T11:37:54,478 Created temporary directory: /tmp/pip-modern-metadata-wpot3ben 2024-01-21T11:37:54,480 Preparing metadata (pyproject.toml): started 2024-01-21T11:37:54,482 Running command Preparing metadata (pyproject.toml) 2024-01-21T11:37:55,252 running dist_info 2024-01-21T11:37:55,257 creating /tmp/pip-modern-metadata-wpot3ben/sglang.egg-info 2024-01-21T11:37:55,261 writing /tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/PKG-INFO 2024-01-21T11:37:55,271 writing dependency_links to /tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/dependency_links.txt 2024-01-21T11:37:55,276 writing requirements to /tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/requires.txt 2024-01-21T11:37:55,277 writing top-level names to /tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/top_level.txt 2024-01-21T11:37:55,278 writing manifest file '/tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:55,300 reading manifest file '/tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:55,302 adding license file 'LICENSE' 2024-01-21T11:37:55,305 writing manifest file '/tmp/pip-modern-metadata-wpot3ben/sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:55,306 creating '/tmp/pip-modern-metadata-wpot3ben/sglang-0.1.7.dist-info' 2024-01-21T11:37:55,460 Preparing metadata (pyproject.toml): finished with status 'done' 2024-01-21T11:37:55,468 Source in /tmp/pip-wheel-p0_8_jha/sglang_91ebba79a59a41e8a550fa2ec9bc8fc1 has version 0.1.7, which satisfies requirement sglang==0.1.7 from https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz 2024-01-21T11:37:55,469 Removed sglang==0.1.7 from https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz from build tracker '/tmp/pip-build-tracker-n52ayrx1' 2024-01-21T11:37:55,480 Created temporary directory: /tmp/pip-unpack-74tonkda 2024-01-21T11:37:55,482 Created temporary directory: /tmp/pip-unpack-fagtwro4 2024-01-21T11:37:55,549 Building wheels for collected packages: sglang 2024-01-21T11:37:55,554 Created temporary directory: /tmp/pip-wheel-v26uymjl 2024-01-21T11:37:55,554 Destination directory: /tmp/pip-wheel-v26uymjl 2024-01-21T11:37:55,556 Building wheel for sglang (pyproject.toml): started 2024-01-21T11:37:55,558 Running command Building wheel for sglang (pyproject.toml) 2024-01-21T11:37:56,306 running bdist_wheel 2024-01-21T11:37:56,323 running build 2024-01-21T11:37:56,323 running build_py 2024-01-21T11:37:56,328 creating build 2024-01-21T11:37:56,329 creating build/lib 2024-01-21T11:37:56,330 creating build/lib/sglang 2024-01-21T11:37:56,332 copying sglang/flush_cache.py -> build/lib/sglang 2024-01-21T11:37:56,335 copying sglang/launch_server.py -> build/lib/sglang 2024-01-21T11:37:56,337 copying sglang/__init__.py -> build/lib/sglang 2024-01-21T11:37:56,339 copying sglang/api.py -> build/lib/sglang 2024-01-21T11:37:56,341 copying sglang/global_config.py -> build/lib/sglang 2024-01-21T11:37:56,342 copying sglang/utils.py -> build/lib/sglang 2024-01-21T11:37:56,346 creating build/lib/sglang/backend 2024-01-21T11:37:56,347 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-01-21T11:37:56,349 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-01-21T11:37:56,351 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-01-21T11:37:56,353 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-01-21T11:37:56,355 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-01-21T11:37:56,357 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-01-21T11:37:56,360 creating build/lib/sglang/test 2024-01-21T11:37:56,362 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-01-21T11:37:56,364 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-01-21T11:37:56,368 creating build/lib/sglang/lang 2024-01-21T11:37:56,369 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-01-21T11:37:56,372 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-01-21T11:37:56,374 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-01-21T11:37:56,377 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-01-21T11:37:56,380 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-01-21T11:37:56,382 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-01-21T11:37:56,385 creating build/lib/sglang/srt 2024-01-21T11:37:56,386 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-01-21T11:37:56,388 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-01-21T11:37:56,390 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-01-21T11:37:56,393 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-01-21T11:37:56,396 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-01-21T11:37:56,398 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-01-21T11:37:56,400 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-01-21T11:37:56,403 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-01-21T11:37:56,405 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-01-21T11:37:56,407 creating build/lib/sglang/srt/constrained 2024-01-21T11:37:56,408 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-01-21T11:37:56,411 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-01-21T11:37:56,413 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-01-21T11:37:56,416 copying sglang/srt/constrained/disk_cache.py -> build/lib/sglang/srt/constrained 2024-01-21T11:37:56,418 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-01-21T11:37:56,421 creating build/lib/sglang/srt/managers 2024-01-21T11:37:56,422 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-01-21T11:37:56,424 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-21T11:37:56,426 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-21T11:37:56,429 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-01-21T11:37:56,431 creating build/lib/sglang/srt/layers 2024-01-21T11:37:56,432 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-01-21T11:37:56,435 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-01-21T11:37:56,437 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-01-21T11:37:56,440 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-01-21T11:37:56,442 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-01-21T11:37:56,445 creating build/lib/sglang/srt/models 2024-01-21T11:37:56,446 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-01-21T11:37:56,449 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-01-21T11:37:56,452 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-01-21T11:37:56,455 creating build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,456 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,458 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,461 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,463 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,466 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,469 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-01-21T11:37:56,471 running egg_info 2024-01-21T11:37:56,475 writing sglang.egg-info/PKG-INFO 2024-01-21T11:37:56,485 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-21T11:37:56,489 writing requirements to sglang.egg-info/requires.txt 2024-01-21T11:37:56,491 writing top-level names to sglang.egg-info/top_level.txt 2024-01-21T11:37:56,506 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:56,509 adding license file 'LICENSE' 2024-01-21T11:37:56,513 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T11:37:56,530 installing to build/bdist.linux-armv7l/wheel 2024-01-21T11:37:56,530 running install 2024-01-21T11:37:56,554 running install_lib 2024-01-21T11:37:56,558 creating build/bdist.linux-armv7l 2024-01-21T11:37:56,559 creating build/bdist.linux-armv7l/wheel 2024-01-21T11:37:56,561 creating build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,562 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,564 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,566 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,568 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,570 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,572 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,574 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T11:37:56,576 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-01-21T11:37:56,577 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-21T11:37:56,579 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-21T11:37:56,582 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,583 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,593 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,595 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,597 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,600 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,601 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T11:37:56,603 copying build/lib/sglang/flush_cache.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,605 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,607 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,608 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,610 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,612 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T11:37:56,613 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T11:37:56,616 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T11:37:56,618 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T11:37:56,620 copying build/lib/sglang/srt/constrained/disk_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T11:37:56,621 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T11:37:56,624 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,626 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T11:37:56,627 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T11:37:56,629 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T11:37:56,631 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T11:37:56,634 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,634 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,637 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,638 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,641 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,643 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,646 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T11:37:56,647 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T11:37:56,650 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T11:37:56,651 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T11:37:56,653 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T11:37:56,655 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T11:37:56,657 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T11:37:56,660 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T11:37:56,662 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,664 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,667 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,669 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,671 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,673 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T11:37:56,675 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T11:37:56,676 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T11:37:56,679 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T11:37:56,681 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T11:37:56,684 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,686 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,687 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,689 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T11:37:56,691 running install_egg_info 2024-01-21T11:37:56,695 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.7-py3.11.egg-info 2024-01-21T11:37:56,706 running install_scripts 2024-01-21T11:37:56,725 creating build/bdist.linux-armv7l/wheel/sglang-0.1.7.dist-info/WHEEL 2024-01-21T11:37:56,728 creating '/tmp/pip-wheel-v26uymjl/.tmp-f3w8jhxz/sglang-0.1.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-01-21T11:37:56,730 adding 'sglang/__init__.py' 2024-01-21T11:37:56,732 adding 'sglang/api.py' 2024-01-21T11:37:56,733 adding 'sglang/flush_cache.py' 2024-01-21T11:37:56,735 adding 'sglang/global_config.py' 2024-01-21T11:37:56,736 adding 'sglang/launch_server.py' 2024-01-21T11:37:56,738 adding 'sglang/utils.py' 2024-01-21T11:37:56,739 adding 'sglang/backend/__init__.py' 2024-01-21T11:37:56,741 adding 'sglang/backend/anthropic.py' 2024-01-21T11:37:56,742 adding 'sglang/backend/base_backend.py' 2024-01-21T11:37:56,744 adding 'sglang/backend/openai.py' 2024-01-21T11:37:56,745 adding 'sglang/backend/runtime_endpoint.py' 2024-01-21T11:37:56,747 adding 'sglang/backend/vertexai.py' 2024-01-21T11:37:56,748 adding 'sglang/lang/__init__.py' 2024-01-21T11:37:56,750 adding 'sglang/lang/chat_template.py' 2024-01-21T11:37:56,751 adding 'sglang/lang/compiler.py' 2024-01-21T11:37:56,754 adding 'sglang/lang/interpreter.py' 2024-01-21T11:37:56,756 adding 'sglang/lang/ir.py' 2024-01-21T11:37:56,758 adding 'sglang/lang/tracer.py' 2024-01-21T11:37:56,759 adding 'sglang/srt/backend_config.py' 2024-01-21T11:37:56,761 adding 'sglang/srt/conversation.py' 2024-01-21T11:37:56,763 adding 'sglang/srt/hf_transformers_utils.py' 2024-01-21T11:37:56,764 adding 'sglang/srt/memory_pool.py' 2024-01-21T11:37:56,765 adding 'sglang/srt/model_config.py' 2024-01-21T11:37:56,767 adding 'sglang/srt/sampling_params.py' 2024-01-21T11:37:56,769 adding 'sglang/srt/server.py' 2024-01-21T11:37:56,770 adding 'sglang/srt/server_args.py' 2024-01-21T11:37:56,772 adding 'sglang/srt/utils.py' 2024-01-21T11:37:56,774 adding 'sglang/srt/constrained/disk_cache.py' 2024-01-21T11:37:56,776 adding 'sglang/srt/constrained/fsm.py' 2024-01-21T11:37:56,777 adding 'sglang/srt/constrained/fsm_cache.py' 2024-01-21T11:37:56,780 adding 'sglang/srt/constrained/regex.py' 2024-01-21T11:37:56,781 adding 'sglang/srt/constrained/tokenizer.py' 2024-01-21T11:37:56,784 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-01-21T11:37:56,785 adding 'sglang/srt/layers/extend_attention.py' 2024-01-21T11:37:56,787 adding 'sglang/srt/layers/logits_processor.py' 2024-01-21T11:37:56,788 adding 'sglang/srt/layers/radix_attention.py' 2024-01-21T11:37:56,790 adding 'sglang/srt/layers/token_attention.py' 2024-01-21T11:37:56,792 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-01-21T11:37:56,793 adding 'sglang/srt/managers/io_struct.py' 2024-01-21T11:37:56,795 adding 'sglang/srt/managers/openai_protocol.py' 2024-01-21T11:37:56,796 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-01-21T11:37:56,799 adding 'sglang/srt/managers/router/infer_batch.py' 2024-01-21T11:37:56,800 adding 'sglang/srt/managers/router/manager.py' 2024-01-21T11:37:56,803 adding 'sglang/srt/managers/router/model_rpc.py' 2024-01-21T11:37:56,805 adding 'sglang/srt/managers/router/model_runner.py' 2024-01-21T11:37:56,807 adding 'sglang/srt/managers/router/radix_cache.py' 2024-01-21T11:37:56,808 adding 'sglang/srt/managers/router/scheduler.py' 2024-01-21T11:37:56,811 adding 'sglang/srt/models/llama2.py' 2024-01-21T11:37:56,813 adding 'sglang/srt/models/llava.py' 2024-01-21T11:37:56,814 adding 'sglang/srt/models/mixtral.py' 2024-01-21T11:37:56,817 adding 'sglang/test/test_programs.py' 2024-01-21T11:37:56,818 adding 'sglang/test/test_utils.py' 2024-01-21T11:37:56,821 adding 'sglang-0.1.7.dist-info/LICENSE' 2024-01-21T11:37:56,825 adding 'sglang-0.1.7.dist-info/METADATA' 2024-01-21T11:37:56,826 adding 'sglang-0.1.7.dist-info/WHEEL' 2024-01-21T11:37:56,827 adding 'sglang-0.1.7.dist-info/top_level.txt' 2024-01-21T11:37:56,829 adding 'sglang-0.1.7.dist-info/RECORD' 2024-01-21T11:37:56,831 removing build/bdist.linux-armv7l/wheel 2024-01-21T11:37:56,966 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-01-21T11:37:56,973 Created wheel for sglang: filename=sglang-0.1.7-py3-none-any.whl size=108350 sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 2024-01-21T11:37:56,974 Stored in directory: /tmp/pip-ephem-wheel-cache-hxfmk6uq/wheels/b3/76/91/ee0169148ec14a395555ddb7780bb3bea900460005f6c94dd8 2024-01-21T11:37:56,996 Successfully built sglang 2024-01-21T11:37:57,002 Removed build tracker: '/tmp/pip-build-tracker-n52ayrx1'