2024-03-22T21:37:03,078 Created temporary directory: /tmp/pip-build-tracker-h4rdnue5 2024-03-22T21:37:03,080 Initialized build tracking at /tmp/pip-build-tracker-h4rdnue5 2024-03-22T21:37:03,080 Created build tracker: /tmp/pip-build-tracker-h4rdnue5 2024-03-22T21:37:03,081 Entered build tracker: /tmp/pip-build-tracker-h4rdnue5 2024-03-22T21:37:03,082 Created temporary directory: /tmp/pip-wheel-siewjohn 2024-03-22T21:37:03,085 Created temporary directory: /tmp/pip-ephem-wheel-cache-dtpl4iof 2024-03-22T21:37:03,107 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-22T21:37:03,111 2 location(s) to search for versions of sglang: 2024-03-22T21:37:03,111 * https://pypi.org/simple/sglang/ 2024-03-22T21:37:03,111 * https://www.piwheels.org/simple/sglang/ 2024-03-22T21:37:03,111 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-03-22T21:37:03,112 Getting page https://pypi.org/simple/sglang/ 2024-03-22T21:37:03,113 Found index url https://pypi.org/simple/ 2024-03-22T21:37:03,341 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-03-22T21:37:03,346 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,347 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-03-22T21:37:03,347 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,348 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-03-22T21:37:03,349 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,350 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-03-22T21:37:03,351 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,352 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-03-22T21:37:03,352 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,353 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-03-22T21:37:03,354 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,355 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-03-22T21:37:03,356 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,357 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-03-22T21:37:03,358 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e2/c9/cc220d8db8e4a894e51bb6286a3e1b89b2de4b387ff4a2ea5b3809787165/sglang-0.1.11-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,358 Found link https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.11 2024-03-22T21:37:03,359 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/67/c6/c9a5bfd22ee72413dc979f5c5983503a92e60341042b9268e6b10845488d/sglang-0.1.12-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,360 Found link https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.12 2024-03-22T21:37:03,360 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/2c/9c/ef2ea3987904a937d0f8540f3aa144fcf3523d0cd7343b28e88e29a833d9/sglang-0.1.13-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,361 Found link https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.13 2024-03-22T21:37:03,362 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e3/f6/0bc8d86f5993dd728cb2b0d73782e060c6b85e639c53c00889a0de5a093c/sglang-0.1.14-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,363 Found link https://files.pythonhosted.org/packages/db/ba/87856203f741d3b965995d3aaf01cf5c1cf0efee5ef2784bd8063a75d9eb/sglang-0.1.14.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.14 2024-03-22T21:37:03,364 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-03-22T21:37:03,365 Getting page https://www.piwheels.org/simple/sglang/ 2024-03-22T21:37:03,366 Found index url https://www.piwheels.org/simple/ 2024-03-22T21:37:03,638 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-03-22T21:37:03,645 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.13-py3-none-any.whl#sha256=a52f32fcdfc81f57c0a67b780dd9560a923e45ee32854410deb59be7893c7ef8 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,646 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.12-py3-none-any.whl#sha256=66805b774197e9ab95436d69ae02b29ff3853d59596ba4b50581ae9e90f8f969 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,647 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.11-py3-none-any.whl#sha256=464124ce4f7e5d1ab437a9cef13a7188e0f71f1a6b07ed81c3d3d1e0c818a1b6 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,648 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.10-py3-none-any.whl#sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,649 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,650 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,651 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,652 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,653 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,654 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-22T21:37:03,655 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-03-22T21:37:03,656 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-03-22T21:37:03,695 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-03-22T21:37:03,722 Collecting sglang==0.1.14 2024-03-22T21:37:03,725 Created temporary directory: /tmp/pip-unpack-aq00klwt 2024-03-22T21:37:03,964 Downloading sglang-0.1.14.tar.gz (106 kB) 2024-03-22T21:37:04,187 Added sglang==0.1.14 from https://files.pythonhosted.org/packages/db/ba/87856203f741d3b965995d3aaf01cf5c1cf0efee5ef2784bd8063a75d9eb/sglang-0.1.14.tar.gz to build tracker '/tmp/pip-build-tracker-h4rdnue5' 2024-03-22T21:37:04,193 Created temporary directory: /tmp/pip-build-env-ogszr1wp 2024-03-22T21:37:04,197 Installing build dependencies: started 2024-03-22T21:37:04,198 Running command pip subprocess to install build dependencies 2024-03-22T21:37:05,391 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-22T21:37:05,984 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-22T21:37:07,778 Collecting setuptools>=61.0 2024-03-22T21:37:08,147 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.2.0-py3-none-any.whl (821 kB) 2024-03-22T21:37:08,413 Collecting wheel 2024-03-22T21:37:08,568 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-03-22T21:37:11,194 Installing collected packages: wheel, setuptools 2024-03-22T21:37:11,435 Creating /tmp/pip-build-env-ogszr1wp/overlay/local/bin 2024-03-22T21:37:11,437 changing mode of /tmp/pip-build-env-ogszr1wp/overlay/local/bin/wheel to 755 2024-03-22T21:37:15,453 Successfully installed setuptools-69.2.0 wheel-0.43.0 2024-03-22T21:37:16,027 Installing build dependencies: finished with status 'done' 2024-03-22T21:37:16,030 Getting requirements to build wheel: started 2024-03-22T21:37:16,032 Running command Getting requirements to build wheel 2024-03-22T21:37:17,104 running egg_info 2024-03-22T21:37:17,109 writing sglang.egg-info/PKG-INFO 2024-03-22T21:37:17,121 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-03-22T21:37:17,127 writing requirements to sglang.egg-info/requires.txt 2024-03-22T21:37:17,128 writing top-level names to sglang.egg-info/top_level.txt 2024-03-22T21:37:17,153 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:17,156 adding license file 'LICENSE' 2024-03-22T21:37:17,160 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:17,277 Getting requirements to build wheel: finished with status 'done' 2024-03-22T21:37:17,286 Created temporary directory: /tmp/pip-modern-metadata-76nfr5wl 2024-03-22T21:37:17,288 Preparing metadata (pyproject.toml): started 2024-03-22T21:37:17,290 Running command Preparing metadata (pyproject.toml) 2024-03-22T21:37:18,304 running dist_info 2024-03-22T21:37:18,309 creating /tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info 2024-03-22T21:37:18,313 writing /tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/PKG-INFO 2024-03-22T21:37:18,327 writing dependency_links to /tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/dependency_links.txt 2024-03-22T21:37:18,333 writing requirements to /tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/requires.txt 2024-03-22T21:37:18,334 writing top-level names to /tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/top_level.txt 2024-03-22T21:37:18,336 writing manifest file '/tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:18,358 reading manifest file '/tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:18,361 adding license file 'LICENSE' 2024-03-22T21:37:18,364 writing manifest file '/tmp/pip-modern-metadata-76nfr5wl/sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:18,365 creating '/tmp/pip-modern-metadata-76nfr5wl/sglang-0.1.14.dist-info' 2024-03-22T21:37:18,527 Preparing metadata (pyproject.toml): finished with status 'done' 2024-03-22T21:37:18,537 Source in /tmp/pip-wheel-siewjohn/sglang_9591f484aab74257a16e13df460148c8 has version 0.1.14, which satisfies requirement sglang==0.1.14 from https://files.pythonhosted.org/packages/db/ba/87856203f741d3b965995d3aaf01cf5c1cf0efee5ef2784bd8063a75d9eb/sglang-0.1.14.tar.gz 2024-03-22T21:37:18,538 Removed sglang==0.1.14 from https://files.pythonhosted.org/packages/db/ba/87856203f741d3b965995d3aaf01cf5c1cf0efee5ef2784bd8063a75d9eb/sglang-0.1.14.tar.gz from build tracker '/tmp/pip-build-tracker-h4rdnue5' 2024-03-22T21:37:18,550 Created temporary directory: /tmp/pip-unpack-n1bcuj0g 2024-03-22T21:37:18,551 Created temporary directory: /tmp/pip-unpack-_96pld_q 2024-03-22T21:37:18,627 Building wheels for collected packages: sglang 2024-03-22T21:37:18,632 Created temporary directory: /tmp/pip-wheel-kl9e6fwu 2024-03-22T21:37:18,632 Destination directory: /tmp/pip-wheel-kl9e6fwu 2024-03-22T21:37:18,635 Building wheel for sglang (pyproject.toml): started 2024-03-22T21:37:18,636 Running command Building wheel for sglang (pyproject.toml) 2024-03-22T21:37:19,410 running bdist_wheel 2024-03-22T21:37:19,427 running build 2024-03-22T21:37:19,427 running build_py 2024-03-22T21:37:19,432 creating build 2024-03-22T21:37:19,433 creating build/lib 2024-03-22T21:37:19,435 creating build/lib/sglang 2024-03-22T21:37:19,437 copying sglang/__init__.py -> build/lib/sglang 2024-03-22T21:37:19,439 copying sglang/launch_server.py -> build/lib/sglang 2024-03-22T21:37:19,441 copying sglang/global_config.py -> build/lib/sglang 2024-03-22T21:37:19,443 copying sglang/utils.py -> build/lib/sglang 2024-03-22T21:37:19,446 copying sglang/api.py -> build/lib/sglang 2024-03-22T21:37:19,449 creating build/lib/sglang/lang 2024-03-22T21:37:19,450 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-03-22T21:37:19,453 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-03-22T21:37:19,456 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-03-22T21:37:19,461 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-03-22T21:37:19,465 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-03-22T21:37:19,468 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-03-22T21:37:19,472 creating build/lib/sglang/backend 2024-03-22T21:37:19,473 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-03-22T21:37:19,476 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-03-22T21:37:19,584 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-03-22T21:37:19,803 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-03-22T21:37:19,807 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-03-22T21:37:19,810 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-03-22T21:37:19,814 creating build/lib/sglang/test 2024-03-22T21:37:19,815 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-03-22T21:37:19,818 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-03-22T21:37:19,822 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-03-22T21:37:19,825 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-03-22T21:37:19,830 creating build/lib/sglang/srt 2024-03-22T21:37:19,831 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-03-22T21:37:19,835 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-03-22T21:37:19,838 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-03-22T21:37:19,842 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-03-22T21:37:19,845 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-03-22T21:37:19,849 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-03-22T21:37:19,853 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-03-22T21:37:19,858 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-03-22T21:37:19,862 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-03-22T21:37:19,865 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-03-22T21:37:19,870 creating build/lib/sglang/srt/constrained 2024-03-22T21:37:19,872 copying sglang/srt/constrained/__init__.py -> build/lib/sglang/srt/constrained 2024-03-22T21:37:19,875 copying sglang/srt/constrained/jump_forward.py -> build/lib/sglang/srt/constrained 2024-03-22T21:37:19,879 copying sglang/srt/constrained/base_cache.py -> build/lib/sglang/srt/constrained 2024-03-22T21:37:19,883 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-03-22T21:37:19,887 creating build/lib/sglang/srt/managers 2024-03-22T21:37:19,889 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-03-22T21:37:19,893 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-03-22T21:37:19,896 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-03-22T21:37:19,899 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-03-22T21:37:19,904 creating build/lib/sglang/srt/models 2024-03-22T21:37:19,905 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,909 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,911 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,915 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,919 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,924 copying sglang/srt/models/yivl.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,927 copying sglang/srt/models/gemma.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,930 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,932 copying sglang/srt/models/stablelm.py -> build/lib/sglang/srt/models 2024-03-22T21:37:19,936 creating build/lib/sglang/srt/layers 2024-03-22T21:37:19,937 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-03-22T21:37:19,940 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-03-22T21:37:19,943 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-03-22T21:37:19,946 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-03-22T21:37:19,949 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-03-22T21:37:19,954 creating build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,955 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,959 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,962 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,966 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,969 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,972 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-03-22T21:37:19,975 running egg_info 2024-03-22T21:37:19,980 writing sglang.egg-info/PKG-INFO 2024-03-22T21:37:19,997 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-03-22T21:37:20,004 writing requirements to sglang.egg-info/requires.txt 2024-03-22T21:37:20,006 writing top-level names to sglang.egg-info/top_level.txt 2024-03-22T21:37:20,030 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:20,034 adding license file 'LICENSE' 2024-03-22T21:37:20,040 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-22T21:37:20,066 installing to build/bdist.linux-armv7l/wheel 2024-03-22T21:37:20,066 running install 2024-03-22T21:37:20,105 running install_lib 2024-03-22T21:37:20,110 creating build/bdist.linux-armv7l 2024-03-22T21:37:20,110 creating build/bdist.linux-armv7l/wheel 2024-03-22T21:37:20,112 creating build/bdist.linux-armv7l/wheel/sglang 2024-03-22T21:37:20,113 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,114 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,116 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,119 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,121 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,123 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,126 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-22T21:37:20,129 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-22T21:37:20,131 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,132 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,134 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,136 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,138 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,141 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,143 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-22T21:37:20,145 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-22T21:37:20,147 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-03-22T21:37:20,148 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-22T21:37:20,150 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-22T21:37:20,152 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-22T21:37:20,154 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-22T21:37:20,156 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,157 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,160 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,161 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,164 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,166 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-22T21:37:20,167 copying build/lib/sglang/srt/constrained/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-22T21:37:20,170 copying build/lib/sglang/srt/constrained/jump_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-22T21:37:20,173 copying build/lib/sglang/srt/constrained/base_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-22T21:37:20,175 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-22T21:37:20,177 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-22T21:37:20,177 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-22T21:37:20,179 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-22T21:37:20,182 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-22T21:37:20,184 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,185 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,188 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,190 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,192 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,195 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,198 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-22T21:37:20,201 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-22T21:37:20,204 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,207 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,209 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,210 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,213 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,215 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,217 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,220 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,222 copying build/lib/sglang/srt/models/yivl.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,225 copying build/lib/sglang/srt/models/gemma.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,227 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,231 copying build/lib/sglang/srt/models/stablelm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-22T21:37:20,234 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,235 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,238 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,240 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-22T21:37:20,242 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-22T21:37:20,243 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-22T21:37:20,246 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-22T21:37:20,248 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-22T21:37:20,250 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-22T21:37:20,253 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-22T21:37:20,255 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-22T21:37:20,257 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-22T21:37:20,260 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-22T21:37:20,262 running install_egg_info 2024-03-22T21:37:20,266 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.14-py3.11.egg-info 2024-03-22T21:37:20,277 running install_scripts 2024-03-22T21:37:20,299 creating build/bdist.linux-armv7l/wheel/sglang-0.1.14.dist-info/WHEEL 2024-03-22T21:37:20,302 creating '/tmp/pip-wheel-kl9e6fwu/.tmp-_rzks_9l/sglang-0.1.14-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-22T21:37:20,304 adding 'sglang/__init__.py' 2024-03-22T21:37:20,305 adding 'sglang/api.py' 2024-03-22T21:37:20,306 adding 'sglang/global_config.py' 2024-03-22T21:37:20,308 adding 'sglang/launch_server.py' 2024-03-22T21:37:20,310 adding 'sglang/utils.py' 2024-03-22T21:37:20,312 adding 'sglang/backend/__init__.py' 2024-03-22T21:37:20,313 adding 'sglang/backend/anthropic.py' 2024-03-22T21:37:20,315 adding 'sglang/backend/base_backend.py' 2024-03-22T21:37:20,317 adding 'sglang/backend/openai.py' 2024-03-22T21:37:20,318 adding 'sglang/backend/runtime_endpoint.py' 2024-03-22T21:37:20,320 adding 'sglang/backend/vertexai.py' 2024-03-22T21:37:20,322 adding 'sglang/lang/__init__.py' 2024-03-22T21:37:20,323 adding 'sglang/lang/chat_template.py' 2024-03-22T21:37:20,325 adding 'sglang/lang/compiler.py' 2024-03-22T21:37:20,328 adding 'sglang/lang/interpreter.py' 2024-03-22T21:37:20,330 adding 'sglang/lang/ir.py' 2024-03-22T21:37:20,332 adding 'sglang/lang/tracer.py' 2024-03-22T21:37:20,334 adding 'sglang/srt/backend_config.py' 2024-03-22T21:37:20,336 adding 'sglang/srt/conversation.py' 2024-03-22T21:37:20,338 adding 'sglang/srt/hf_transformers_utils.py' 2024-03-22T21:37:20,340 adding 'sglang/srt/memory_pool.py' 2024-03-22T21:37:20,342 adding 'sglang/srt/mm_utils.py' 2024-03-22T21:37:20,343 adding 'sglang/srt/model_config.py' 2024-03-22T21:37:20,344 adding 'sglang/srt/sampling_params.py' 2024-03-22T21:37:20,347 adding 'sglang/srt/server.py' 2024-03-22T21:37:20,349 adding 'sglang/srt/server_args.py' 2024-03-22T21:37:20,351 adding 'sglang/srt/utils.py' 2024-03-22T21:37:20,353 adding 'sglang/srt/constrained/__init__.py' 2024-03-22T21:37:20,354 adding 'sglang/srt/constrained/base_cache.py' 2024-03-22T21:37:20,356 adding 'sglang/srt/constrained/fsm_cache.py' 2024-03-22T21:37:20,357 adding 'sglang/srt/constrained/jump_forward.py' 2024-03-22T21:37:20,359 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-03-22T21:37:20,361 adding 'sglang/srt/layers/extend_attention.py' 2024-03-22T21:37:20,363 adding 'sglang/srt/layers/logits_processor.py' 2024-03-22T21:37:20,364 adding 'sglang/srt/layers/radix_attention.py' 2024-03-22T21:37:20,366 adding 'sglang/srt/layers/token_attention.py' 2024-03-22T21:37:20,367 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-03-22T21:37:20,369 adding 'sglang/srt/managers/io_struct.py' 2024-03-22T21:37:20,370 adding 'sglang/srt/managers/openai_protocol.py' 2024-03-22T21:37:20,372 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-03-22T21:37:20,375 adding 'sglang/srt/managers/router/infer_batch.py' 2024-03-22T21:37:20,377 adding 'sglang/srt/managers/router/manager.py' 2024-03-22T21:37:20,380 adding 'sglang/srt/managers/router/model_rpc.py' 2024-03-22T21:37:20,382 adding 'sglang/srt/managers/router/model_runner.py' 2024-03-22T21:37:20,384 adding 'sglang/srt/managers/router/radix_cache.py' 2024-03-22T21:37:20,385 adding 'sglang/srt/managers/router/scheduler.py' 2024-03-22T21:37:20,388 adding 'sglang/srt/models/gemma.py' 2024-03-22T21:37:20,390 adding 'sglang/srt/models/llama2.py' 2024-03-22T21:37:20,392 adding 'sglang/srt/models/llava.py' 2024-03-22T21:37:20,394 adding 'sglang/srt/models/mistral.py' 2024-03-22T21:37:20,396 adding 'sglang/srt/models/mixtral.py' 2024-03-22T21:37:20,397 adding 'sglang/srt/models/qwen.py' 2024-03-22T21:37:20,399 adding 'sglang/srt/models/qwen2.py' 2024-03-22T21:37:20,401 adding 'sglang/srt/models/stablelm.py' 2024-03-22T21:37:20,403 adding 'sglang/srt/models/yivl.py' 2024-03-22T21:37:20,405 adding 'sglang/test/test_conversation.py' 2024-03-22T21:37:20,406 adding 'sglang/test/test_openai_protocol.py' 2024-03-22T21:37:20,408 adding 'sglang/test/test_programs.py' 2024-03-22T21:37:20,409 adding 'sglang/test/test_utils.py' 2024-03-22T21:37:20,412 adding 'sglang-0.1.14.dist-info/LICENSE' 2024-03-22T21:37:20,416 adding 'sglang-0.1.14.dist-info/METADATA' 2024-03-22T21:37:20,417 adding 'sglang-0.1.14.dist-info/WHEEL' 2024-03-22T21:37:20,418 adding 'sglang-0.1.14.dist-info/top_level.txt' 2024-03-22T21:37:20,420 adding 'sglang-0.1.14.dist-info/RECORD' 2024-03-22T21:37:20,424 removing build/bdist.linux-armv7l/wheel 2024-03-22T21:37:20,563 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-03-22T21:37:20,570 Created wheel for sglang: filename=sglang-0.1.14-py3-none-any.whl size=127397 sha256=9a17abcd48bbc267101b00879531fe4554fed7237149e2a75626c437004bcbda 2024-03-22T21:37:20,572 Stored in directory: /tmp/pip-ephem-wheel-cache-dtpl4iof/wheels/1c/3d/ce/e0b021e53eab9860dae0793c329699365eada9d779b58ee22f 2024-03-22T21:37:20,594 Successfully built sglang 2024-03-22T21:37:20,603 Removed build tracker: '/tmp/pip-build-tracker-h4rdnue5'