2024-01-24T11:56:09,387 Created temporary directory: /tmp/pip-build-tracker-ns9alowl 2024-01-24T11:56:09,389 Initialized build tracking at /tmp/pip-build-tracker-ns9alowl 2024-01-24T11:56:09,389 Created build tracker: /tmp/pip-build-tracker-ns9alowl 2024-01-24T11:56:09,390 Entered build tracker: /tmp/pip-build-tracker-ns9alowl 2024-01-24T11:56:09,390 Created temporary directory: /tmp/pip-wheel-n_tppy69 2024-01-24T11:56:09,394 Created temporary directory: /tmp/pip-ephem-wheel-cache-_vaw2al1 2024-01-24T11:56:09,416 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-24T11:56:09,419 2 location(s) to search for versions of sglang: 2024-01-24T11:56:09,419 * https://pypi.org/simple/sglang/ 2024-01-24T11:56:09,419 * https://www.piwheels.org/simple/sglang/ 2024-01-24T11:56:09,426 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-01-24T11:56:09,427 Getting page https://pypi.org/simple/sglang/ 2024-01-24T11:56:09,428 Found index url https://pypi.org/simple/ 2024-01-24T11:56:09,638 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-01-24T11:56:09,641 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,642 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-01-24T11:56:09,642 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,643 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-01-24T11:56:09,644 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,645 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-01-24T11:56:09,646 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,647 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-01-24T11:56:09,648 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,649 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-01-24T11:56:09,649 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,650 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-01-24T11:56:09,651 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-01-24T11:56:09,652 Getting page https://www.piwheels.org/simple/sglang/ 2024-01-24T11:56:09,653 Found index url https://www.piwheels.org/simple/ 2024-01-24T11:56:09,809 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-01-24T11:56:09,811 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,812 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,812 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,813 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,813 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-24T11:56:09,814 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-01-24T11:56:09,815 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-01-24T11:56:09,833 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-01-24T11:56:09,851 Collecting sglang==0.1.9 2024-01-24T11:56:09,854 Created temporary directory: /tmp/pip-unpack-1e2l3_zk 2024-01-24T11:56:10,061 Downloading sglang-0.1.9.tar.gz (98 kB) 2024-01-24T11:56:10,255 Added sglang==0.1.9 from https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz to build tracker '/tmp/pip-build-tracker-ns9alowl' 2024-01-24T11:56:10,260 Created temporary directory: /tmp/pip-build-env-8og1od88 2024-01-24T11:56:10,265 Installing build dependencies: started 2024-01-24T11:56:10,266 Running command pip subprocess to install build dependencies 2024-01-24T11:56:11,423 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-01-24T11:56:11,920 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-24T11:56:13,345 Collecting setuptools>=61.0 2024-01-24T11:56:13,358 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-01-24T11:56:13,576 Collecting wheel 2024-01-24T11:56:13,589 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-01-24T11:56:16,147 Installing collected packages: wheel, setuptools 2024-01-24T11:56:16,373 Creating /tmp/pip-build-env-8og1od88/overlay/local/bin 2024-01-24T11:56:16,375 changing mode of /tmp/pip-build-env-8og1od88/overlay/local/bin/wheel to 755 2024-01-24T11:56:18,654 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-01-24T11:56:18,906 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-01-24T11:56:18,907 [notice] To update, run: python3 -m pip install --upgrade pip 2024-01-24T11:56:19,177 Installing build dependencies: finished with status 'done' 2024-01-24T11:56:19,181 Getting requirements to build wheel: started 2024-01-24T11:56:19,182 Running command Getting requirements to build wheel 2024-01-24T11:56:19,991 running egg_info 2024-01-24T11:56:19,995 writing sglang.egg-info/PKG-INFO 2024-01-24T11:56:20,006 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-24T11:56:20,012 writing requirements to sglang.egg-info/requires.txt 2024-01-24T11:56:20,013 writing top-level names to sglang.egg-info/top_level.txt 2024-01-24T11:56:20,039 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:20,042 adding license file 'LICENSE' 2024-01-24T11:56:20,046 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:20,165 Getting requirements to build wheel: finished with status 'done' 2024-01-24T11:56:20,175 Created temporary directory: /tmp/pip-modern-metadata-gnup84qc 2024-01-24T11:56:20,177 Preparing metadata (pyproject.toml): started 2024-01-24T11:56:20,178 Running command Preparing metadata (pyproject.toml) 2024-01-24T11:56:20,960 running dist_info 2024-01-24T11:56:20,966 creating /tmp/pip-modern-metadata-gnup84qc/sglang.egg-info 2024-01-24T11:56:20,969 writing /tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/PKG-INFO 2024-01-24T11:56:20,980 writing dependency_links to /tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/dependency_links.txt 2024-01-24T11:56:20,985 writing requirements to /tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/requires.txt 2024-01-24T11:56:20,986 writing top-level names to /tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/top_level.txt 2024-01-24T11:56:20,987 writing manifest file '/tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:21,009 reading manifest file '/tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:21,011 adding license file 'LICENSE' 2024-01-24T11:56:21,014 writing manifest file '/tmp/pip-modern-metadata-gnup84qc/sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:21,015 creating '/tmp/pip-modern-metadata-gnup84qc/sglang-0.1.9.dist-info' 2024-01-24T11:56:21,168 Preparing metadata (pyproject.toml): finished with status 'done' 2024-01-24T11:56:21,176 Source in /tmp/pip-wheel-n_tppy69/sglang_2a002b8249e94098a85b8ed46635bece has version 0.1.9, which satisfies requirement sglang==0.1.9 from https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz 2024-01-24T11:56:21,177 Removed sglang==0.1.9 from https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz from build tracker '/tmp/pip-build-tracker-ns9alowl' 2024-01-24T11:56:21,188 Created temporary directory: /tmp/pip-unpack-0x28fckb 2024-01-24T11:56:21,189 Created temporary directory: /tmp/pip-unpack-09cx6a2u 2024-01-24T11:56:21,257 Building wheels for collected packages: sglang 2024-01-24T11:56:21,261 Created temporary directory: /tmp/pip-wheel-eoz69exd 2024-01-24T11:56:21,261 Destination directory: /tmp/pip-wheel-eoz69exd 2024-01-24T11:56:21,264 Building wheel for sglang (pyproject.toml): started 2024-01-24T11:56:21,265 Running command Building wheel for sglang (pyproject.toml) 2024-01-24T11:56:22,009 running bdist_wheel 2024-01-24T11:56:22,025 running build 2024-01-24T11:56:22,026 running build_py 2024-01-24T11:56:22,030 creating build 2024-01-24T11:56:22,031 creating build/lib 2024-01-24T11:56:22,031 creating build/lib/sglang 2024-01-24T11:56:22,033 copying sglang/flush_cache.py -> build/lib/sglang 2024-01-24T11:56:22,035 copying sglang/launch_server.py -> build/lib/sglang 2024-01-24T11:56:22,036 copying sglang/__init__.py -> build/lib/sglang 2024-01-24T11:56:22,038 copying sglang/api.py -> build/lib/sglang 2024-01-24T11:56:22,040 copying sglang/global_config.py -> build/lib/sglang 2024-01-24T11:56:22,041 copying sglang/utils.py -> build/lib/sglang 2024-01-24T11:56:22,044 creating build/lib/sglang/backend 2024-01-24T11:56:22,045 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-01-24T11:56:22,047 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-01-24T11:56:22,049 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-01-24T11:56:22,051 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-01-24T11:56:22,052 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-01-24T11:56:22,054 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-01-24T11:56:22,057 creating build/lib/sglang/test 2024-01-24T11:56:22,058 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-01-24T11:56:22,060 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-01-24T11:56:22,062 creating build/lib/sglang/lang 2024-01-24T11:56:22,063 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-01-24T11:56:22,066 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-01-24T11:56:22,068 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-01-24T11:56:22,070 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-01-24T11:56:22,072 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-01-24T11:56:22,073 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-01-24T11:56:22,076 creating build/lib/sglang/srt 2024-01-24T11:56:22,077 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-01-24T11:56:22,080 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-01-24T11:56:22,081 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-01-24T11:56:22,083 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-01-24T11:56:22,085 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-01-24T11:56:22,088 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-01-24T11:56:22,090 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-01-24T11:56:22,092 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-01-24T11:56:22,094 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-01-24T11:56:22,096 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-01-24T11:56:22,098 creating build/lib/sglang/srt/constrained 2024-01-24T11:56:22,099 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-01-24T11:56:22,101 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-01-24T11:56:22,103 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-01-24T11:56:22,105 copying sglang/srt/constrained/disk_cache.py -> build/lib/sglang/srt/constrained 2024-01-24T11:56:22,107 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-01-24T11:56:22,109 creating build/lib/sglang/srt/managers 2024-01-24T11:56:22,110 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-01-24T11:56:22,112 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-24T11:56:22,114 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-24T11:56:22,116 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-01-24T11:56:22,119 creating build/lib/sglang/srt/layers 2024-01-24T11:56:22,120 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-01-24T11:56:22,122 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-01-24T11:56:22,124 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-01-24T11:56:22,126 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-01-24T11:56:22,128 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-01-24T11:56:22,131 creating build/lib/sglang/srt/models 2024-01-24T11:56:22,132 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-01-24T11:56:22,134 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-01-24T11:56:22,136 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-01-24T11:56:22,139 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-01-24T11:56:22,142 creating build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,142 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,145 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,146 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,149 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,151 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,153 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-01-24T11:56:22,155 running egg_info 2024-01-24T11:56:22,158 writing sglang.egg-info/PKG-INFO 2024-01-24T11:56:22,169 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-24T11:56:22,173 writing requirements to sglang.egg-info/requires.txt 2024-01-24T11:56:22,174 writing top-level names to sglang.egg-info/top_level.txt 2024-01-24T11:56:22,189 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:22,192 adding license file 'LICENSE' 2024-01-24T11:56:22,196 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-24T11:56:22,213 installing to build/bdist.linux-armv7l/wheel 2024-01-24T11:56:22,213 running install 2024-01-24T11:56:22,237 running install_lib 2024-01-24T11:56:22,241 creating build/bdist.linux-armv7l 2024-01-24T11:56:22,242 creating build/bdist.linux-armv7l/wheel 2024-01-24T11:56:22,243 creating build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,245 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,246 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,248 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,250 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,252 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,254 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,256 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-24T11:56:22,259 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-01-24T11:56:22,260 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-24T11:56:22,262 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-24T11:56:22,265 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,266 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,269 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,271 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,273 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,275 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,277 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-24T11:56:22,279 copying build/lib/sglang/flush_cache.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,281 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,283 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,284 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,286 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,288 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,291 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-24T11:56:22,292 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-24T11:56:22,294 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-24T11:56:22,296 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-24T11:56:22,298 copying build/lib/sglang/srt/constrained/disk_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-24T11:56:22,300 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-24T11:56:22,303 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,305 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-24T11:56:22,306 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-24T11:56:22,308 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-24T11:56:22,310 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-24T11:56:22,313 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,314 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,316 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,318 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,321 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,324 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,326 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-24T11:56:22,328 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-24T11:56:22,331 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-24T11:56:22,332 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-24T11:56:22,334 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-24T11:56:22,336 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-24T11:56:22,338 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-24T11:56:22,341 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-24T11:56:22,343 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,346 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,348 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,350 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,352 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,354 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-24T11:56:22,356 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-24T11:56:22,357 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-24T11:56:22,359 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-24T11:56:22,362 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-24T11:56:22,363 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-24T11:56:22,366 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,367 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,369 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,370 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-24T11:56:22,372 running install_egg_info 2024-01-24T11:56:22,376 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.9-py3.11.egg-info 2024-01-24T11:56:22,386 running install_scripts 2024-01-24T11:56:22,407 creating build/bdist.linux-armv7l/wheel/sglang-0.1.9.dist-info/WHEEL 2024-01-24T11:56:22,409 creating '/tmp/pip-wheel-eoz69exd/.tmp-fzlayx7v/sglang-0.1.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-01-24T11:56:22,412 adding 'sglang/__init__.py' 2024-01-24T11:56:22,413 adding 'sglang/api.py' 2024-01-24T11:56:22,414 adding 'sglang/flush_cache.py' 2024-01-24T11:56:22,416 adding 'sglang/global_config.py' 2024-01-24T11:56:22,417 adding 'sglang/launch_server.py' 2024-01-24T11:56:22,419 adding 'sglang/utils.py' 2024-01-24T11:56:22,420 adding 'sglang/backend/__init__.py' 2024-01-24T11:56:22,422 adding 'sglang/backend/anthropic.py' 2024-01-24T11:56:22,423 adding 'sglang/backend/base_backend.py' 2024-01-24T11:56:22,425 adding 'sglang/backend/openai.py' 2024-01-24T11:56:22,426 adding 'sglang/backend/runtime_endpoint.py' 2024-01-24T11:56:22,427 adding 'sglang/backend/vertexai.py' 2024-01-24T11:56:22,429 adding 'sglang/lang/__init__.py' 2024-01-24T11:56:22,431 adding 'sglang/lang/chat_template.py' 2024-01-24T11:56:22,432 adding 'sglang/lang/compiler.py' 2024-01-24T11:56:22,435 adding 'sglang/lang/interpreter.py' 2024-01-24T11:56:22,437 adding 'sglang/lang/ir.py' 2024-01-24T11:56:22,439 adding 'sglang/lang/tracer.py' 2024-01-24T11:56:22,441 adding 'sglang/srt/backend_config.py' 2024-01-24T11:56:22,443 adding 'sglang/srt/conversation.py' 2024-01-24T11:56:22,444 adding 'sglang/srt/hf_transformers_utils.py' 2024-01-24T11:56:22,446 adding 'sglang/srt/memory_pool.py' 2024-01-24T11:56:22,447 adding 'sglang/srt/mm_utils.py' 2024-01-24T11:56:22,449 adding 'sglang/srt/model_config.py' 2024-01-24T11:56:22,450 adding 'sglang/srt/sampling_params.py' 2024-01-24T11:56:22,453 adding 'sglang/srt/server.py' 2024-01-24T11:56:22,454 adding 'sglang/srt/server_args.py' 2024-01-24T11:56:22,456 adding 'sglang/srt/utils.py' 2024-01-24T11:56:22,458 adding 'sglang/srt/constrained/disk_cache.py' 2024-01-24T11:56:22,460 adding 'sglang/srt/constrained/fsm.py' 2024-01-24T11:56:22,461 adding 'sglang/srt/constrained/fsm_cache.py' 2024-01-24T11:56:22,464 adding 'sglang/srt/constrained/regex.py' 2024-01-24T11:56:22,465 adding 'sglang/srt/constrained/tokenizer.py' 2024-01-24T11:56:22,467 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-01-24T11:56:22,469 adding 'sglang/srt/layers/extend_attention.py' 2024-01-24T11:56:22,471 adding 'sglang/srt/layers/logits_processor.py' 2024-01-24T11:56:22,473 adding 'sglang/srt/layers/radix_attention.py' 2024-01-24T11:56:22,474 adding 'sglang/srt/layers/token_attention.py' 2024-01-24T11:56:22,476 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-01-24T11:56:22,478 adding 'sglang/srt/managers/io_struct.py' 2024-01-24T11:56:22,479 adding 'sglang/srt/managers/openai_protocol.py' 2024-01-24T11:56:22,481 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-01-24T11:56:22,484 adding 'sglang/srt/managers/router/infer_batch.py' 2024-01-24T11:56:22,485 adding 'sglang/srt/managers/router/manager.py' 2024-01-24T11:56:22,488 adding 'sglang/srt/managers/router/model_rpc.py' 2024-01-24T11:56:22,490 adding 'sglang/srt/managers/router/model_runner.py' 2024-01-24T11:56:22,491 adding 'sglang/srt/managers/router/radix_cache.py' 2024-01-24T11:56:22,493 adding 'sglang/srt/managers/router/scheduler.py' 2024-01-24T11:56:22,495 adding 'sglang/srt/models/llama2.py' 2024-01-24T11:56:22,497 adding 'sglang/srt/models/llava.py' 2024-01-24T11:56:22,499 adding 'sglang/srt/models/mixtral.py' 2024-01-24T11:56:22,501 adding 'sglang/srt/models/qwen.py' 2024-01-24T11:56:22,504 adding 'sglang/test/test_programs.py' 2024-01-24T11:56:22,505 adding 'sglang/test/test_utils.py' 2024-01-24T11:56:22,509 adding 'sglang-0.1.9.dist-info/LICENSE' 2024-01-24T11:56:22,512 adding 'sglang-0.1.9.dist-info/METADATA' 2024-01-24T11:56:22,513 adding 'sglang-0.1.9.dist-info/WHEEL' 2024-01-24T11:56:22,514 adding 'sglang-0.1.9.dist-info/top_level.txt' 2024-01-24T11:56:22,516 adding 'sglang-0.1.9.dist-info/RECORD' 2024-01-24T11:56:22,519 removing build/bdist.linux-armv7l/wheel 2024-01-24T11:56:22,657 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-01-24T11:56:22,664 Created wheel for sglang: filename=sglang-0.1.9-py3-none-any.whl size=115383 sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 2024-01-24T11:56:22,665 Stored in directory: /tmp/pip-ephem-wheel-cache-_vaw2al1/wheels/dd/52/b6/f30e83a67cba0c8acfb412aea11509c15861ceb1e1c7ace8f7 2024-01-24T11:56:22,686 Successfully built sglang 2024-01-24T11:56:22,692 Removed build tracker: '/tmp/pip-build-tracker-ns9alowl'