2024-02-11T15:08:23,532 Created temporary directory: /tmp/pip-build-tracker-1nphj7b8 2024-02-11T15:08:23,533 Initialized build tracking at /tmp/pip-build-tracker-1nphj7b8 2024-02-11T15:08:23,534 Created build tracker: /tmp/pip-build-tracker-1nphj7b8 2024-02-11T15:08:23,534 Entered build tracker: /tmp/pip-build-tracker-1nphj7b8 2024-02-11T15:08:23,535 Created temporary directory: /tmp/pip-wheel-jcyby5c4 2024-02-11T15:08:23,538 Created temporary directory: /tmp/pip-ephem-wheel-cache-gdn3jo2m 2024-02-11T15:08:23,561 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-11T15:08:23,565 2 location(s) to search for versions of sglang: 2024-02-11T15:08:23,565 * https://pypi.org/simple/sglang/ 2024-02-11T15:08:23,565 * https://www.piwheels.org/simple/sglang/ 2024-02-11T15:08:23,565 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-02-11T15:08:23,566 Getting page https://pypi.org/simple/sglang/ 2024-02-11T15:08:23,568 Found index url https://pypi.org/simple/ 2024-02-11T15:08:23,781 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-02-11T15:08:23,785 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,786 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-02-11T15:08:23,787 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,788 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-02-11T15:08:23,789 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,790 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-02-11T15:08:23,790 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,791 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-02-11T15:08:23,792 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,793 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-02-11T15:08:23,794 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,795 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-02-11T15:08:23,796 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,797 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-02-11T15:08:23,797 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e2/c9/cc220d8db8e4a894e51bb6286a3e1b89b2de4b387ff4a2ea5b3809787165/sglang-0.1.11-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,798 Found link https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.11 2024-02-11T15:08:23,799 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/67/c6/c9a5bfd22ee72413dc979f5c5983503a92e60341042b9268e6b10845488d/sglang-0.1.12-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,800 Found link https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.12 2024-02-11T15:08:23,801 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-02-11T15:08:23,801 Getting page https://www.piwheels.org/simple/sglang/ 2024-02-11T15:08:23,803 Found index url https://www.piwheels.org/simple/ 2024-02-11T15:08:23,963 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-02-11T15:08:23,966 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.11-py3-none-any.whl#sha256=464124ce4f7e5d1ab437a9cef13a7188e0f71f1a6b07ed81c3d3d1e0c818a1b6 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,967 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.10-py3-none-any.whl#sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,967 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,968 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,969 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,969 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,970 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,971 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-11T15:08:23,971 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-02-11T15:08:23,972 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-02-11T15:08:23,992 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-02-11T15:08:24,009 Collecting sglang==0.1.12 2024-02-11T15:08:24,012 Created temporary directory: /tmp/pip-unpack-ke8zkwx5 2024-02-11T15:08:24,222 Downloading sglang-0.1.12.tar.gz (103 kB) 2024-02-11T15:08:24,432 Added sglang==0.1.12 from https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz to build tracker '/tmp/pip-build-tracker-1nphj7b8' 2024-02-11T15:08:24,437 Created temporary directory: /tmp/pip-build-env-7xfn4pxi 2024-02-11T15:08:24,442 Installing build dependencies: started 2024-02-11T15:08:24,443 Running command pip subprocess to install build dependencies 2024-02-11T15:08:25,566 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-02-11T15:08:26,071 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-11T15:08:27,478 Collecting setuptools>=61.0 2024-02-11T15:08:27,494 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-02-11T15:08:27,720 Collecting wheel 2024-02-11T15:08:27,735 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-02-11T15:08:30,318 Installing collected packages: wheel, setuptools 2024-02-11T15:08:30,541 Creating /tmp/pip-build-env-7xfn4pxi/overlay/local/bin 2024-02-11T15:08:30,544 changing mode of /tmp/pip-build-env-7xfn4pxi/overlay/local/bin/wheel to 755 2024-02-11T15:08:32,830 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-02-11T15:08:33,085 [notice] A new release of pip is available: 23.3.1 -> 24.0 2024-02-11T15:08:33,086 [notice] To update, run: python3 -m pip install --upgrade pip 2024-02-11T15:08:33,354 Installing build dependencies: finished with status 'done' 2024-02-11T15:08:33,358 Getting requirements to build wheel: started 2024-02-11T15:08:33,359 Running command Getting requirements to build wheel 2024-02-11T15:08:34,177 running egg_info 2024-02-11T15:08:34,182 writing sglang.egg-info/PKG-INFO 2024-02-11T15:08:34,197 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-02-11T15:08:34,203 writing requirements to sglang.egg-info/requires.txt 2024-02-11T15:08:34,204 writing top-level names to sglang.egg-info/top_level.txt 2024-02-11T15:08:34,231 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:34,234 adding license file 'LICENSE' 2024-02-11T15:08:34,238 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:34,356 Getting requirements to build wheel: finished with status 'done' 2024-02-11T15:08:34,367 Created temporary directory: /tmp/pip-modern-metadata-pyjj6oje 2024-02-11T15:08:34,370 Preparing metadata (pyproject.toml): started 2024-02-11T15:08:34,371 Running command Preparing metadata (pyproject.toml) 2024-02-11T15:08:35,150 running dist_info 2024-02-11T15:08:35,155 creating /tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info 2024-02-11T15:08:35,159 writing /tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/PKG-INFO 2024-02-11T15:08:35,171 writing dependency_links to /tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/dependency_links.txt 2024-02-11T15:08:35,177 writing requirements to /tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/requires.txt 2024-02-11T15:08:35,178 writing top-level names to /tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/top_level.txt 2024-02-11T15:08:35,179 writing manifest file '/tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:35,202 reading manifest file '/tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:35,204 adding license file 'LICENSE' 2024-02-11T15:08:35,208 writing manifest file '/tmp/pip-modern-metadata-pyjj6oje/sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:35,209 creating '/tmp/pip-modern-metadata-pyjj6oje/sglang-0.1.12.dist-info' 2024-02-11T15:08:35,375 Preparing metadata (pyproject.toml): finished with status 'done' 2024-02-11T15:08:35,383 Source in /tmp/pip-wheel-jcyby5c4/sglang_ed0e6e7f6c394b93989ad34a51bb1248 has version 0.1.12, which satisfies requirement sglang==0.1.12 from https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz 2024-02-11T15:08:35,384 Removed sglang==0.1.12 from https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz from build tracker '/tmp/pip-build-tracker-1nphj7b8' 2024-02-11T15:08:35,396 Created temporary directory: /tmp/pip-unpack-v5_5izi9 2024-02-11T15:08:35,397 Created temporary directory: /tmp/pip-unpack-jbs1i9mi 2024-02-11T15:08:35,475 Building wheels for collected packages: sglang 2024-02-11T15:08:35,479 Created temporary directory: /tmp/pip-wheel-dg1xw8lb 2024-02-11T15:08:35,480 Destination directory: /tmp/pip-wheel-dg1xw8lb 2024-02-11T15:08:35,483 Building wheel for sglang (pyproject.toml): started 2024-02-11T15:08:35,484 Running command Building wheel for sglang (pyproject.toml) 2024-02-11T15:08:36,230 running bdist_wheel 2024-02-11T15:08:36,246 running build 2024-02-11T15:08:36,247 running build_py 2024-02-11T15:08:36,252 creating build 2024-02-11T15:08:36,252 creating build/lib 2024-02-11T15:08:36,253 creating build/lib/sglang 2024-02-11T15:08:36,254 copying sglang/launch_server.py -> build/lib/sglang 2024-02-11T15:08:36,256 copying sglang/__init__.py -> build/lib/sglang 2024-02-11T15:08:36,258 copying sglang/api.py -> build/lib/sglang 2024-02-11T15:08:36,260 copying sglang/global_config.py -> build/lib/sglang 2024-02-11T15:08:36,262 copying sglang/utils.py -> build/lib/sglang 2024-02-11T15:08:36,265 creating build/lib/sglang/backend 2024-02-11T15:08:36,266 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-02-11T15:08:36,268 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-02-11T15:08:36,270 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-02-11T15:08:36,272 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-02-11T15:08:36,273 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-02-11T15:08:36,276 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-02-11T15:08:36,278 creating build/lib/sglang/test 2024-02-11T15:08:36,279 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-02-11T15:08:36,281 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-02-11T15:08:36,283 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-02-11T15:08:36,285 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-02-11T15:08:36,288 creating build/lib/sglang/lang 2024-02-11T15:08:36,289 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-02-11T15:08:36,292 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-02-11T15:08:36,295 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-02-11T15:08:36,297 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-02-11T15:08:36,299 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-02-11T15:08:36,301 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-02-11T15:08:36,304 creating build/lib/sglang/srt 2024-02-11T15:08:36,305 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-02-11T15:08:36,308 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-02-11T15:08:36,309 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-02-11T15:08:36,311 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-02-11T15:08:36,314 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-02-11T15:08:36,316 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-02-11T15:08:36,319 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-02-11T15:08:36,321 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-02-11T15:08:36,323 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-02-11T15:08:36,325 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-02-11T15:08:36,327 creating build/lib/sglang/srt/constrained 2024-02-11T15:08:36,328 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-02-11T15:08:36,330 copying sglang/srt/constrained/jump_forward.py -> build/lib/sglang/srt/constrained 2024-02-11T15:08:36,331 copying sglang/srt/constrained/base_cache.py -> build/lib/sglang/srt/constrained 2024-02-11T15:08:36,333 copying sglang/srt/constrained/__init__.py -> build/lib/sglang/srt/constrained 2024-02-11T15:08:36,335 creating build/lib/sglang/srt/managers 2024-02-11T15:08:36,336 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-02-11T15:08:36,338 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-02-11T15:08:36,340 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-02-11T15:08:36,343 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-02-11T15:08:36,345 creating build/lib/sglang/srt/layers 2024-02-11T15:08:36,346 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-02-11T15:08:36,348 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-02-11T15:08:36,350 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-02-11T15:08:36,353 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-02-11T15:08:36,355 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-02-11T15:08:36,358 creating build/lib/sglang/srt/models 2024-02-11T15:08:36,359 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,360 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,363 copying sglang/srt/models/yivl.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,365 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,367 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,369 copying sglang/srt/models/gpt_neox.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,372 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,374 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-02-11T15:08:36,377 creating build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,378 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,380 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,382 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,385 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,388 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,390 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-02-11T15:08:36,392 running egg_info 2024-02-11T15:08:36,395 writing sglang.egg-info/PKG-INFO 2024-02-11T15:08:36,407 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-02-11T15:08:36,412 writing requirements to sglang.egg-info/requires.txt 2024-02-11T15:08:36,413 writing top-level names to sglang.egg-info/top_level.txt 2024-02-11T15:08:36,428 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:36,431 adding license file 'LICENSE' 2024-02-11T15:08:36,435 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-11T15:08:36,452 installing to build/bdist.linux-armv7l/wheel 2024-02-11T15:08:36,452 running install 2024-02-11T15:08:36,476 running install_lib 2024-02-11T15:08:36,480 creating build/bdist.linux-armv7l 2024-02-11T15:08:36,480 creating build/bdist.linux-armv7l/wheel 2024-02-11T15:08:36,482 creating build/bdist.linux-armv7l/wheel/sglang 2024-02-11T15:08:36,483 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,484 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,486 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,488 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,490 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,492 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,494 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-11T15:08:36,497 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-02-11T15:08:36,498 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-11T15:08:36,500 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-11T15:08:36,502 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-11T15:08:36,504 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-11T15:08:36,507 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,508 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,511 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,513 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,516 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,518 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,520 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-11T15:08:36,522 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-11T15:08:36,525 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,526 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,528 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,530 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,532 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-11T15:08:36,533 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-11T15:08:36,535 copying build/lib/sglang/srt/constrained/jump_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-11T15:08:36,537 copying build/lib/sglang/srt/constrained/base_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-11T15:08:36,539 copying build/lib/sglang/srt/constrained/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-11T15:08:36,541 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,544 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-11T15:08:36,545 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-11T15:08:36,547 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-11T15:08:36,549 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-11T15:08:36,552 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,552 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,555 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,557 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,559 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,562 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,565 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-11T15:08:36,566 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-11T15:08:36,569 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-11T15:08:36,569 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-11T15:08:36,572 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-11T15:08:36,574 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-11T15:08:36,577 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-11T15:08:36,579 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-11T15:08:36,581 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,584 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,586 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,589 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,591 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,593 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-11T15:08:36,595 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,596 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,598 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,600 copying build/lib/sglang/srt/models/yivl.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,602 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,605 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,607 copying build/lib/sglang/srt/models/gpt_neox.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,609 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,612 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-11T15:08:36,614 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-11T15:08:36,616 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-11T15:08:36,618 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-11T15:08:36,620 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-11T15:08:36,622 running install_egg_info 2024-02-11T15:08:36,626 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.12-py3.11.egg-info 2024-02-11T15:08:36,636 running install_scripts 2024-02-11T15:08:36,659 creating build/bdist.linux-armv7l/wheel/sglang-0.1.12.dist-info/WHEEL 2024-02-11T15:08:36,661 creating '/tmp/pip-wheel-dg1xw8lb/.tmp-m4mt7qfi/sglang-0.1.12-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-02-11T15:08:36,663 adding 'sglang/__init__.py' 2024-02-11T15:08:36,665 adding 'sglang/api.py' 2024-02-11T15:08:36,666 adding 'sglang/global_config.py' 2024-02-11T15:08:36,667 adding 'sglang/launch_server.py' 2024-02-11T15:08:36,669 adding 'sglang/utils.py' 2024-02-11T15:08:36,671 adding 'sglang/backend/__init__.py' 2024-02-11T15:08:36,672 adding 'sglang/backend/anthropic.py' 2024-02-11T15:08:36,673 adding 'sglang/backend/base_backend.py' 2024-02-11T15:08:36,675 adding 'sglang/backend/openai.py' 2024-02-11T15:08:36,677 adding 'sglang/backend/runtime_endpoint.py' 2024-02-11T15:08:36,678 adding 'sglang/backend/vertexai.py' 2024-02-11T15:08:36,680 adding 'sglang/lang/__init__.py' 2024-02-11T15:08:36,681 adding 'sglang/lang/chat_template.py' 2024-02-11T15:08:36,683 adding 'sglang/lang/compiler.py' 2024-02-11T15:08:36,686 adding 'sglang/lang/interpreter.py' 2024-02-11T15:08:36,688 adding 'sglang/lang/ir.py' 2024-02-11T15:08:36,690 adding 'sglang/lang/tracer.py' 2024-02-11T15:08:36,692 adding 'sglang/srt/backend_config.py' 2024-02-11T15:08:36,694 adding 'sglang/srt/conversation.py' 2024-02-11T15:08:36,695 adding 'sglang/srt/hf_transformers_utils.py' 2024-02-11T15:08:36,696 adding 'sglang/srt/memory_pool.py' 2024-02-11T15:08:36,698 adding 'sglang/srt/mm_utils.py' 2024-02-11T15:08:36,699 adding 'sglang/srt/model_config.py' 2024-02-11T15:08:36,701 adding 'sglang/srt/sampling_params.py' 2024-02-11T15:08:36,703 adding 'sglang/srt/server.py' 2024-02-11T15:08:36,705 adding 'sglang/srt/server_args.py' 2024-02-11T15:08:36,707 adding 'sglang/srt/utils.py' 2024-02-11T15:08:36,708 adding 'sglang/srt/constrained/__init__.py' 2024-02-11T15:08:36,710 adding 'sglang/srt/constrained/base_cache.py' 2024-02-11T15:08:36,711 adding 'sglang/srt/constrained/fsm_cache.py' 2024-02-11T15:08:36,712 adding 'sglang/srt/constrained/jump_forward.py' 2024-02-11T15:08:36,714 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-02-11T15:08:36,716 adding 'sglang/srt/layers/extend_attention.py' 2024-02-11T15:08:36,717 adding 'sglang/srt/layers/logits_processor.py' 2024-02-11T15:08:36,719 adding 'sglang/srt/layers/radix_attention.py' 2024-02-11T15:08:36,720 adding 'sglang/srt/layers/token_attention.py' 2024-02-11T15:08:36,722 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-02-11T15:08:36,724 adding 'sglang/srt/managers/io_struct.py' 2024-02-11T15:08:36,725 adding 'sglang/srt/managers/openai_protocol.py' 2024-02-11T15:08:36,727 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-02-11T15:08:36,730 adding 'sglang/srt/managers/router/infer_batch.py' 2024-02-11T15:08:36,731 adding 'sglang/srt/managers/router/manager.py' 2024-02-11T15:08:36,734 adding 'sglang/srt/managers/router/model_rpc.py' 2024-02-11T15:08:36,737 adding 'sglang/srt/managers/router/model_runner.py' 2024-02-11T15:08:36,738 adding 'sglang/srt/managers/router/radix_cache.py' 2024-02-11T15:08:36,739 adding 'sglang/srt/managers/router/scheduler.py' 2024-02-11T15:08:36,742 adding 'sglang/srt/models/gpt_neox.py' 2024-02-11T15:08:36,744 adding 'sglang/srt/models/llama2.py' 2024-02-11T15:08:36,746 adding 'sglang/srt/models/llava.py' 2024-02-11T15:08:36,747 adding 'sglang/srt/models/mistral.py' 2024-02-11T15:08:36,749 adding 'sglang/srt/models/mixtral.py' 2024-02-11T15:08:36,751 adding 'sglang/srt/models/qwen.py' 2024-02-11T15:08:36,753 adding 'sglang/srt/models/qwen2.py' 2024-02-11T15:08:36,754 adding 'sglang/srt/models/yivl.py' 2024-02-11T15:08:36,756 adding 'sglang/test/test_conversation.py' 2024-02-11T15:08:36,757 adding 'sglang/test/test_openai_protocol.py' 2024-02-11T15:08:36,759 adding 'sglang/test/test_programs.py' 2024-02-11T15:08:36,761 adding 'sglang/test/test_utils.py' 2024-02-11T15:08:36,763 adding 'sglang-0.1.12.dist-info/LICENSE' 2024-02-11T15:08:36,767 adding 'sglang-0.1.12.dist-info/METADATA' 2024-02-11T15:08:36,768 adding 'sglang-0.1.12.dist-info/WHEEL' 2024-02-11T15:08:36,769 adding 'sglang-0.1.12.dist-info/top_level.txt' 2024-02-11T15:08:36,770 adding 'sglang-0.1.12.dist-info/RECORD' 2024-02-11T15:08:36,774 removing build/bdist.linux-armv7l/wheel 2024-02-11T15:08:36,910 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-02-11T15:08:36,917 Created wheel for sglang: filename=sglang-0.1.12-py3-none-any.whl size=121689 sha256=66805b774197e9ab95436d69ae02b29ff3853d59596ba4b50581ae9e90f8f969 2024-02-11T15:08:36,918 Stored in directory: /tmp/pip-ephem-wheel-cache-gdn3jo2m/wheels/e0/f9/1d/ef37a0d2127c8e2170f04e0ba52add4de19bde8732919ed535 2024-02-11T15:08:36,940 Successfully built sglang 2024-02-11T15:08:36,946 Removed build tracker: '/tmp/pip-build-tracker-1nphj7b8'