2024-01-16T07:08:19,162 Created temporary directory: /tmp/pip-build-tracker-0e5ttw0q 2024-01-16T07:08:19,163 Initialized build tracking at /tmp/pip-build-tracker-0e5ttw0q 2024-01-16T07:08:19,164 Created build tracker: /tmp/pip-build-tracker-0e5ttw0q 2024-01-16T07:08:19,164 Entered build tracker: /tmp/pip-build-tracker-0e5ttw0q 2024-01-16T07:08:19,165 Created temporary directory: /tmp/pip-wheel-24xa6gvc 2024-01-16T07:08:19,168 Created temporary directory: /tmp/pip-ephem-wheel-cache-qcaskpxl 2024-01-16T07:08:19,194 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-16T07:08:19,197 2 location(s) to search for versions of sglang: 2024-01-16T07:08:19,197 * https://pypi.org/simple/sglang/ 2024-01-16T07:08:19,197 * https://www.piwheels.org/simple/sglang/ 2024-01-16T07:08:19,198 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-01-16T07:08:19,199 Getting page https://pypi.org/simple/sglang/ 2024-01-16T07:08:19,200 Found index url https://pypi.org/simple/ 2024-01-16T07:08:19,412 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-01-16T07:08:19,414 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-16T07:08:19,415 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-01-16T07:08:19,416 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-01-16T07:08:19,416 Getting page https://www.piwheels.org/simple/sglang/ 2024-01-16T07:08:19,418 Found index url https://www.piwheels.org/simple/ 2024-01-16T07:08:19,578 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-01-16T07:08:19,579 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-01-16T07:08:19,580 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-01-16T07:08:19,598 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-01-16T07:08:19,616 Collecting sglang==0.1.3 2024-01-16T07:08:19,618 Created temporary directory: /tmp/pip-unpack-01_hr79d 2024-01-16T07:08:19,855 Downloading sglang-0.1.3.tar.gz (87 kB) 2024-01-16T07:08:20,038 Added sglang==0.1.3 from https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz to build tracker '/tmp/pip-build-tracker-0e5ttw0q' 2024-01-16T07:08:20,043 Created temporary directory: /tmp/pip-build-env-kpuzpk92 2024-01-16T07:08:20,048 Installing build dependencies: started 2024-01-16T07:08:20,049 Running command pip subprocess to install build dependencies 2024-01-16T07:08:21,219 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-01-16T07:08:21,737 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-16T07:08:23,152 Collecting setuptools>=61.0 2024-01-16T07:08:23,167 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-01-16T07:08:23,389 Collecting wheel 2024-01-16T07:08:23,403 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-01-16T07:08:25,978 Installing collected packages: wheel, setuptools 2024-01-16T07:08:26,202 Creating /tmp/pip-build-env-kpuzpk92/overlay/local/bin 2024-01-16T07:08:26,205 changing mode of /tmp/pip-build-env-kpuzpk92/overlay/local/bin/wheel to 755 2024-01-16T07:08:30,628 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-01-16T07:08:31,401 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-01-16T07:08:31,402 [notice] To update, run: python3 -m pip install --upgrade pip 2024-01-16T07:08:31,675 Installing build dependencies: finished with status 'done' 2024-01-16T07:08:31,683 Getting requirements to build wheel: started 2024-01-16T07:08:31,684 Running command Getting requirements to build wheel 2024-01-16T07:08:32,819 running egg_info 2024-01-16T07:08:32,823 writing sglang.egg-info/PKG-INFO 2024-01-16T07:08:32,834 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-16T07:08:32,839 writing requirements to sglang.egg-info/requires.txt 2024-01-16T07:08:32,841 writing top-level names to sglang.egg-info/top_level.txt 2024-01-16T07:08:32,876 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:32,882 adding license file 'LICENSE' 2024-01-16T07:08:32,885 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:33,003 Getting requirements to build wheel: finished with status 'done' 2024-01-16T07:08:33,013 Created temporary directory: /tmp/pip-modern-metadata-vwlz99o_ 2024-01-16T07:08:33,016 Preparing metadata (pyproject.toml): started 2024-01-16T07:08:33,026 Running command Preparing metadata (pyproject.toml) 2024-01-16T07:08:33,925 running dist_info 2024-01-16T07:08:33,930 creating /tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info 2024-01-16T07:08:33,935 writing /tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/PKG-INFO 2024-01-16T07:08:33,946 writing dependency_links to /tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/dependency_links.txt 2024-01-16T07:08:33,951 writing requirements to /tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/requires.txt 2024-01-16T07:08:33,952 writing top-level names to /tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/top_level.txt 2024-01-16T07:08:33,954 writing manifest file '/tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:33,978 reading manifest file '/tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:33,981 adding license file 'LICENSE' 2024-01-16T07:08:33,984 writing manifest file '/tmp/pip-modern-metadata-vwlz99o_/sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:33,985 creating '/tmp/pip-modern-metadata-vwlz99o_/sglang-0.1.3.dist-info' 2024-01-16T07:08:34,155 Preparing metadata (pyproject.toml): finished with status 'done' 2024-01-16T07:08:34,162 Source in /tmp/pip-wheel-24xa6gvc/sglang_436c44e137b54db68079f9d970f9ca5a has version 0.1.3, which satisfies requirement sglang==0.1.3 from https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz 2024-01-16T07:08:34,163 Removed sglang==0.1.3 from https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz from build tracker '/tmp/pip-build-tracker-0e5ttw0q' 2024-01-16T07:08:34,174 Created temporary directory: /tmp/pip-unpack-zx73zy_k 2024-01-16T07:08:34,176 Created temporary directory: /tmp/pip-unpack-8qos4kdh 2024-01-16T07:08:34,228 Building wheels for collected packages: sglang 2024-01-16T07:08:34,234 Created temporary directory: /tmp/pip-wheel-t1gq7c37 2024-01-16T07:08:34,235 Destination directory: /tmp/pip-wheel-t1gq7c37 2024-01-16T07:08:34,237 Building wheel for sglang (pyproject.toml): started 2024-01-16T07:08:34,241 Running command Building wheel for sglang (pyproject.toml) 2024-01-16T07:08:34,994 running bdist_wheel 2024-01-16T07:08:35,012 running build 2024-01-16T07:08:35,013 running build_py 2024-01-16T07:08:35,017 creating build 2024-01-16T07:08:35,018 creating build/lib 2024-01-16T07:08:35,019 creating build/lib/sglang 2024-01-16T07:08:35,020 copying sglang/__init__.py -> build/lib/sglang 2024-01-16T07:08:35,022 copying sglang/utils.py -> build/lib/sglang 2024-01-16T07:08:35,024 copying sglang/global_config.py -> build/lib/sglang 2024-01-16T07:08:35,026 copying sglang/api.py -> build/lib/sglang 2024-01-16T07:08:35,028 copying sglang/launch_server.py -> build/lib/sglang 2024-01-16T07:08:35,030 copying sglang/flush_cache.py -> build/lib/sglang 2024-01-16T07:08:35,032 creating build/lib/sglang/srt 2024-01-16T07:08:35,033 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-01-16T07:08:35,035 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-01-16T07:08:35,038 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-01-16T07:08:35,040 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-01-16T07:08:35,042 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-01-16T07:08:35,044 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-01-16T07:08:35,046 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-01-16T07:08:35,047 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-01-16T07:08:35,050 creating build/lib/sglang/backend 2024-01-16T07:08:35,051 copying sglang/backend/huggingface.py -> build/lib/sglang/backend 2024-01-16T07:08:35,054 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-01-16T07:08:35,056 copying sglang/backend/tgi.py -> build/lib/sglang/backend 2024-01-16T07:08:35,058 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-01-16T07:08:35,060 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-01-16T07:08:35,061 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-01-16T07:08:35,064 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-01-16T07:08:35,066 creating build/lib/sglang/test 2024-01-16T07:08:35,067 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-01-16T07:08:35,069 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-01-16T07:08:35,072 creating build/lib/sglang/lang 2024-01-16T07:08:35,073 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-01-16T07:08:35,075 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-01-16T07:08:35,076 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-01-16T07:08:35,079 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-01-16T07:08:35,081 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-01-16T07:08:35,083 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-01-16T07:08:35,086 creating build/lib/sglang/srt/models 2024-01-16T07:08:35,087 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-01-16T07:08:35,089 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-01-16T07:08:35,091 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-01-16T07:08:35,094 creating build/lib/sglang/srt/managers 2024-01-16T07:08:35,095 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-01-16T07:08:35,097 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-01-16T07:08:35,098 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-16T07:08:35,100 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-16T07:08:35,103 creating build/lib/sglang/srt/layers 2024-01-16T07:08:35,104 copying sglang/srt/layers/get_selected_logprob.py -> build/lib/sglang/srt/layers 2024-01-16T07:08:35,106 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-01-16T07:08:35,108 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-01-16T07:08:35,110 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-01-16T07:08:35,112 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-01-16T07:08:35,114 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-01-16T07:08:35,117 creating build/lib/sglang/srt/constrained 2024-01-16T07:08:35,117 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-01-16T07:08:35,120 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-01-16T07:08:35,122 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-01-16T07:08:35,124 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-01-16T07:08:35,127 creating build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,128 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,131 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,134 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,136 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,138 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,140 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-01-16T07:08:35,142 running egg_info 2024-01-16T07:08:35,145 writing sglang.egg-info/PKG-INFO 2024-01-16T07:08:35,154 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-16T07:08:35,158 writing requirements to sglang.egg-info/requires.txt 2024-01-16T07:08:35,159 writing top-level names to sglang.egg-info/top_level.txt 2024-01-16T07:08:35,173 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:35,176 adding license file 'LICENSE' 2024-01-16T07:08:35,180 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-16T07:08:35,195 installing to build/bdist.linux-armv7l/wheel 2024-01-16T07:08:35,196 running install 2024-01-16T07:08:35,220 running install_lib 2024-01-16T07:08:35,224 creating build/bdist.linux-armv7l 2024-01-16T07:08:35,224 creating build/bdist.linux-armv7l/wheel 2024-01-16T07:08:35,226 creating build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,228 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,229 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-16T07:08:35,230 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-16T07:08:35,233 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-16T07:08:35,236 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-16T07:08:35,238 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,240 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,242 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,244 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,247 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-16T07:08:35,247 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-16T07:08:35,249 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-16T07:08:35,251 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-16T07:08:35,253 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-16T07:08:35,256 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,257 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,259 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,262 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,264 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,266 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,269 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-16T07:08:35,270 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,272 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,275 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,275 copying build/lib/sglang/srt/layers/get_selected_logprob.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,278 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,280 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,282 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,284 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,286 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-16T07:08:35,288 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-16T07:08:35,289 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-16T07:08:35,291 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-16T07:08:35,294 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-16T07:08:35,296 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-16T07:08:35,298 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,300 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-16T07:08:35,303 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,304 copying build/lib/sglang/backend/huggingface.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,307 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,309 copying build/lib/sglang/backend/tgi.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,311 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,313 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,314 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,317 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-16T07:08:35,318 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,320 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,323 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-01-16T07:08:35,324 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-16T07:08:35,326 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-16T07:08:35,329 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,330 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,332 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,334 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,336 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,339 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,341 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-16T07:08:35,343 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,345 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,347 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,349 copying build/lib/sglang/flush_cache.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-16T07:08:35,350 running install_egg_info 2024-01-16T07:08:35,354 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.3-py3.11.egg-info 2024-01-16T07:08:35,364 running install_scripts 2024-01-16T07:08:35,387 creating build/bdist.linux-armv7l/wheel/sglang-0.1.3.dist-info/WHEEL 2024-01-16T07:08:35,389 creating '/tmp/pip-wheel-t1gq7c37/.tmp-vhzore8z/sglang-0.1.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-01-16T07:08:35,391 adding 'sglang/__init__.py' 2024-01-16T07:08:35,393 adding 'sglang/api.py' 2024-01-16T07:08:35,394 adding 'sglang/flush_cache.py' 2024-01-16T07:08:35,396 adding 'sglang/global_config.py' 2024-01-16T07:08:35,397 adding 'sglang/launch_server.py' 2024-01-16T07:08:35,399 adding 'sglang/utils.py' 2024-01-16T07:08:35,400 adding 'sglang/backend/__init__.py' 2024-01-16T07:08:35,402 adding 'sglang/backend/anthropic.py' 2024-01-16T07:08:35,403 adding 'sglang/backend/base_backend.py' 2024-01-16T07:08:35,405 adding 'sglang/backend/huggingface.py' 2024-01-16T07:08:35,406 adding 'sglang/backend/openai.py' 2024-01-16T07:08:35,408 adding 'sglang/backend/runtime_endpoint.py' 2024-01-16T07:08:35,409 adding 'sglang/backend/tgi.py' 2024-01-16T07:08:35,411 adding 'sglang/lang/__init__.py' 2024-01-16T07:08:35,412 adding 'sglang/lang/chat_template.py' 2024-01-16T07:08:35,414 adding 'sglang/lang/compiler.py' 2024-01-16T07:08:35,417 adding 'sglang/lang/interpreter.py' 2024-01-16T07:08:35,419 adding 'sglang/lang/ir.py' 2024-01-16T07:08:35,420 adding 'sglang/lang/tracer.py' 2024-01-16T07:08:35,422 adding 'sglang/srt/backend_config.py' 2024-01-16T07:08:35,424 adding 'sglang/srt/hf_transformers_utils.py' 2024-01-16T07:08:35,425 adding 'sglang/srt/memory_pool.py' 2024-01-16T07:08:35,426 adding 'sglang/srt/model_config.py' 2024-01-16T07:08:35,428 adding 'sglang/srt/sampling_params.py' 2024-01-16T07:08:35,429 adding 'sglang/srt/server.py' 2024-01-16T07:08:35,431 adding 'sglang/srt/server_args.py' 2024-01-16T07:08:35,432 adding 'sglang/srt/utils.py' 2024-01-16T07:08:35,435 adding 'sglang/srt/constrained/fsm.py' 2024-01-16T07:08:35,436 adding 'sglang/srt/constrained/fsm_cache.py' 2024-01-16T07:08:35,439 adding 'sglang/srt/constrained/regex.py' 2024-01-16T07:08:35,441 adding 'sglang/srt/constrained/tokenizer.py' 2024-01-16T07:08:35,443 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-01-16T07:08:35,445 adding 'sglang/srt/layers/extend_attention.py' 2024-01-16T07:08:35,447 adding 'sglang/srt/layers/get_selected_logprob.py' 2024-01-16T07:08:35,448 adding 'sglang/srt/layers/logits_processor.py' 2024-01-16T07:08:35,450 adding 'sglang/srt/layers/radix_attention.py' 2024-01-16T07:08:35,451 adding 'sglang/srt/layers/token_attention.py' 2024-01-16T07:08:35,454 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-01-16T07:08:35,455 adding 'sglang/srt/managers/io_struct.py' 2024-01-16T07:08:35,456 adding 'sglang/srt/managers/openai_protocol.py' 2024-01-16T07:08:35,458 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-01-16T07:08:35,460 adding 'sglang/srt/managers/router/infer_batch.py' 2024-01-16T07:08:35,462 adding 'sglang/srt/managers/router/manager.py' 2024-01-16T07:08:35,464 adding 'sglang/srt/managers/router/model_rpc.py' 2024-01-16T07:08:35,466 adding 'sglang/srt/managers/router/model_runner.py' 2024-01-16T07:08:35,468 adding 'sglang/srt/managers/router/radix_cache.py' 2024-01-16T07:08:35,469 adding 'sglang/srt/managers/router/scheduler.py' 2024-01-16T07:08:35,472 adding 'sglang/srt/models/llama2.py' 2024-01-16T07:08:35,473 adding 'sglang/srt/models/llava.py' 2024-01-16T07:08:35,475 adding 'sglang/srt/models/mixtral.py' 2024-01-16T07:08:35,477 adding 'sglang/test/test_programs.py' 2024-01-16T07:08:35,479 adding 'sglang/test/test_utils.py' 2024-01-16T07:08:35,482 adding 'sglang-0.1.3.dist-info/LICENSE' 2024-01-16T07:08:35,484 adding 'sglang-0.1.3.dist-info/METADATA' 2024-01-16T07:08:35,486 adding 'sglang-0.1.3.dist-info/WHEEL' 2024-01-16T07:08:35,487 adding 'sglang-0.1.3.dist-info/top_level.txt' 2024-01-16T07:08:35,488 adding 'sglang-0.1.3.dist-info/RECORD' 2024-01-16T07:08:35,491 removing build/bdist.linux-armv7l/wheel 2024-01-16T07:08:35,623 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-01-16T07:08:35,630 Created wheel for sglang: filename=sglang-0.1.3-py3-none-any.whl size=104679 sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 2024-01-16T07:08:35,632 Stored in directory: /tmp/pip-ephem-wheel-cache-qcaskpxl/wheels/50/ea/cc/b989d0018a504e05ff8b9bf80198687a2eaace5e077a1d0271 2024-01-16T07:08:35,651 Successfully built sglang 2024-01-16T07:08:35,658 Removed build tracker: '/tmp/pip-build-tracker-0e5ttw0q'