2024-05-12T22:43:52,321 Created temporary directory: /tmp/pip-build-tracker-vljjjckr 2024-05-12T22:43:52,323 Initialized build tracking at /tmp/pip-build-tracker-vljjjckr 2024-05-12T22:43:52,323 Created build tracker: /tmp/pip-build-tracker-vljjjckr 2024-05-12T22:43:52,323 Entered build tracker: /tmp/pip-build-tracker-vljjjckr 2024-05-12T22:43:52,324 Created temporary directory: /tmp/pip-wheel-n8zazrxa 2024-05-12T22:43:52,327 Created temporary directory: /tmp/pip-ephem-wheel-cache-gt7rqbq4 2024-05-12T22:43:52,352 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-05-12T22:43:52,355 2 location(s) to search for versions of sglang: 2024-05-12T22:43:52,355 * https://pypi.org/simple/sglang/ 2024-05-12T22:43:52,355 * https://www.piwheels.org/simple/sglang/ 2024-05-12T22:43:52,356 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-05-12T22:43:52,357 Getting page https://pypi.org/simple/sglang/ 2024-05-12T22:43:52,358 Found index url https://pypi.org/simple/ 2024-05-12T22:43:52,573 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-05-12T22:43:52,578 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,579 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-05-12T22:43:52,579 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,580 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-05-12T22:43:52,581 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,582 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-05-12T22:43:52,583 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,584 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-05-12T22:43:52,584 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,585 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-05-12T22:43:52,586 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,587 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-05-12T22:43:52,587 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,589 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-05-12T22:43:52,589 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e2/c9/cc220d8db8e4a894e51bb6286a3e1b89b2de4b387ff4a2ea5b3809787165/sglang-0.1.11-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,590 Found link https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.11 2024-05-12T22:43:52,591 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/67/c6/c9a5bfd22ee72413dc979f5c5983503a92e60341042b9268e6b10845488d/sglang-0.1.12-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,592 Found link https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.12 2024-05-12T22:43:52,592 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/2c/9c/ef2ea3987904a937d0f8540f3aa144fcf3523d0cd7343b28e88e29a833d9/sglang-0.1.13-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,593 Found link https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.13 2024-05-12T22:43:52,594 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e3/f6/0bc8d86f5993dd728cb2b0d73782e060c6b85e639c53c00889a0de5a093c/sglang-0.1.14-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,595 Found link https://files.pythonhosted.org/packages/db/ba/87856203f741d3b965995d3aaf01cf5c1cf0efee5ef2784bd8063a75d9eb/sglang-0.1.14.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.14 2024-05-12T22:43:52,595 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/9e/d2/dd8e9ff0dafb1e8ebb0a566c2a0c0c8793aa88008ba8617507e27eb25dbb/sglang-0.1.15-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,596 Found link https://files.pythonhosted.org/packages/d5/ea/413337a61efdb095fccd7ec46a55575c78cc37de48eaaf89ab9de20b0346/sglang-0.1.15.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.15 2024-05-12T22:43:52,597 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-05-12T22:43:52,598 Getting page https://www.piwheels.org/simple/sglang/ 2024-05-12T22:43:52,599 Found index url https://www.piwheels.org/simple/ 2024-05-12T22:43:52,809 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-05-12T22:43:52,813 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.14-py3-none-any.whl#sha256=9a17abcd48bbc267101b00879531fe4554fed7237149e2a75626c437004bcbda (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,813 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.13-py3-none-any.whl#sha256=a52f32fcdfc81f57c0a67b780dd9560a923e45ee32854410deb59be7893c7ef8 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,814 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.12-py3-none-any.whl#sha256=66805b774197e9ab95436d69ae02b29ff3853d59596ba4b50581ae9e90f8f969 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,815 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.11-py3-none-any.whl#sha256=464124ce4f7e5d1ab437a9cef13a7188e0f71f1a6b07ed81c3d3d1e0c818a1b6 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,815 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.10-py3-none-any.whl#sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,816 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,816 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,817 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,817 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,818 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,818 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-05-12T22:43:52,819 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-05-12T22:43:52,820 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-05-12T22:43:52,839 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-05-12T22:43:52,858 Collecting sglang==0.1.15 2024-05-12T22:43:52,860 Created temporary directory: /tmp/pip-unpack-wg23fyac 2024-05-12T22:43:53,082 Downloading sglang-0.1.15.tar.gz (121 kB) 2024-05-12T22:43:53,316 Added sglang==0.1.15 from https://files.pythonhosted.org/packages/d5/ea/413337a61efdb095fccd7ec46a55575c78cc37de48eaaf89ab9de20b0346/sglang-0.1.15.tar.gz to build tracker '/tmp/pip-build-tracker-vljjjckr' 2024-05-12T22:43:53,322 Created temporary directory: /tmp/pip-build-env-2o3aqv4e 2024-05-12T22:43:53,326 Installing build dependencies: started 2024-05-12T22:43:53,328 Running command pip subprocess to install build dependencies 2024-05-12T22:43:54,495 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-05-12T22:43:54,975 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-05-12T22:43:56,712 Collecting setuptools>=61.0 2024-05-12T22:43:56,729 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.5.1-py3-none-any.whl (894 kB) 2024-05-12T22:43:56,967 Collecting wheel 2024-05-12T22:43:56,981 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-05-12T22:44:00,637 Installing collected packages: wheel, setuptools 2024-05-12T22:44:00,860 Creating /tmp/pip-build-env-2o3aqv4e/overlay/local/bin 2024-05-12T22:44:00,862 changing mode of /tmp/pip-build-env-2o3aqv4e/overlay/local/bin/wheel to 755 2024-05-12T22:44:10,659 Successfully installed setuptools-69.5.1 wheel-0.43.0 2024-05-12T22:44:11,239 Installing build dependencies: finished with status 'done' 2024-05-12T22:44:11,248 Getting requirements to build wheel: started 2024-05-12T22:44:11,249 Running command Getting requirements to build wheel 2024-05-12T22:44:13,684 running egg_info 2024-05-12T22:44:13,690 writing sglang.egg-info/PKG-INFO 2024-05-12T22:44:13,710 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-05-12T22:44:13,717 writing requirements to sglang.egg-info/requires.txt 2024-05-12T22:44:13,722 writing top-level names to sglang.egg-info/top_level.txt 2024-05-12T22:44:13,756 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:13,766 adding license file 'LICENSE' 2024-05-12T22:44:13,770 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:13,890 Getting requirements to build wheel: finished with status 'done' 2024-05-12T22:44:13,902 Created temporary directory: /tmp/pip-modern-metadata-vg_ft9jx 2024-05-12T22:44:13,906 Preparing metadata (pyproject.toml): started 2024-05-12T22:44:13,907 Running command Preparing metadata (pyproject.toml) 2024-05-12T22:44:14,775 running dist_info 2024-05-12T22:44:14,780 creating /tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info 2024-05-12T22:44:14,784 writing /tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/PKG-INFO 2024-05-12T22:44:14,796 writing dependency_links to /tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/dependency_links.txt 2024-05-12T22:44:14,802 writing requirements to /tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/requires.txt 2024-05-12T22:44:14,803 writing top-level names to /tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/top_level.txt 2024-05-12T22:44:14,805 writing manifest file '/tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:14,828 reading manifest file '/tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:14,830 adding license file 'LICENSE' 2024-05-12T22:44:14,834 writing manifest file '/tmp/pip-modern-metadata-vg_ft9jx/sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:14,835 creating '/tmp/pip-modern-metadata-vg_ft9jx/sglang-0.1.15.dist-info' 2024-05-12T22:44:15,001 Preparing metadata (pyproject.toml): finished with status 'done' 2024-05-12T22:44:15,011 Source in /tmp/pip-wheel-n8zazrxa/sglang_820230c4807e4f5dbbad7a9defad05bc has version 0.1.15, which satisfies requirement sglang==0.1.15 from https://files.pythonhosted.org/packages/d5/ea/413337a61efdb095fccd7ec46a55575c78cc37de48eaaf89ab9de20b0346/sglang-0.1.15.tar.gz 2024-05-12T22:44:15,013 Removed sglang==0.1.15 from https://files.pythonhosted.org/packages/d5/ea/413337a61efdb095fccd7ec46a55575c78cc37de48eaaf89ab9de20b0346/sglang-0.1.15.tar.gz from build tracker '/tmp/pip-build-tracker-vljjjckr' 2024-05-12T22:44:15,025 Created temporary directory: /tmp/pip-unpack-1yz_dq7a 2024-05-12T22:44:15,026 Created temporary directory: /tmp/pip-unpack-t72f461s 2024-05-12T22:44:15,230 Building wheels for collected packages: sglang 2024-05-12T22:44:15,235 Created temporary directory: /tmp/pip-wheel-4t9y_9fw 2024-05-12T22:44:15,236 Destination directory: /tmp/pip-wheel-4t9y_9fw 2024-05-12T22:44:15,239 Building wheel for sglang (pyproject.toml): started 2024-05-12T22:44:15,240 Running command Building wheel for sglang (pyproject.toml) 2024-05-12T22:44:16,033 running bdist_wheel 2024-05-12T22:44:16,049 running build 2024-05-12T22:44:16,050 running build_py 2024-05-12T22:44:16,054 creating build 2024-05-12T22:44:16,055 creating build/lib 2024-05-12T22:44:16,055 creating build/lib/sglang 2024-05-12T22:44:16,057 copying sglang/api.py -> build/lib/sglang 2024-05-12T22:44:16,059 copying sglang/__init__.py -> build/lib/sglang 2024-05-12T22:44:16,061 copying sglang/utils.py -> build/lib/sglang 2024-05-12T22:44:16,063 copying sglang/global_config.py -> build/lib/sglang 2024-05-12T22:44:16,065 copying sglang/launch_server.py -> build/lib/sglang 2024-05-12T22:44:16,067 creating build/lib/sglang/test 2024-05-12T22:44:16,068 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-05-12T22:44:16,070 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-05-12T22:44:16,073 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-05-12T22:44:16,074 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-05-12T22:44:16,076 creating build/lib/sglang/backend 2024-05-12T22:44:16,077 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-05-12T22:44:16,079 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-05-12T22:44:16,080 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-05-12T22:44:16,082 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-05-12T22:44:16,085 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-05-12T22:44:16,086 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-05-12T22:44:16,089 creating build/lib/sglang/lang 2024-05-12T22:44:16,090 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-05-12T22:44:16,092 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-05-12T22:44:16,094 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-05-12T22:44:16,097 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-05-12T22:44:16,099 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-05-12T22:44:16,101 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-05-12T22:44:16,104 creating build/lib/sglang/srt 2024-05-12T22:44:16,105 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-05-12T22:44:16,107 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-05-12T22:44:16,108 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-05-12T22:44:16,110 copying sglang/srt/weight_utils.py -> build/lib/sglang/srt 2024-05-12T22:44:16,112 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-05-12T22:44:16,114 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-05-12T22:44:16,117 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-05-12T22:44:16,119 copying sglang/srt/openai_api_adapter.py -> build/lib/sglang/srt 2024-05-12T22:44:16,121 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-05-12T22:44:16,124 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-05-12T22:44:16,126 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-05-12T22:44:16,128 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-05-12T22:44:16,130 copying sglang/srt/openai_protocol.py -> build/lib/sglang/srt 2024-05-12T22:44:16,133 creating build/lib/sglang/srt/layers 2024-05-12T22:44:16,134 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-05-12T22:44:16,137 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-05-12T22:44:16,139 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-05-12T22:44:16,141 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-05-12T22:44:16,143 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-05-12T22:44:16,146 creating build/lib/sglang/srt/managers 2024-05-12T22:44:16,147 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-05-12T22:44:16,149 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-05-12T22:44:16,152 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-05-12T22:44:16,154 creating build/lib/sglang/srt/models 2024-05-12T22:44:16,156 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,158 copying sglang/srt/models/dbrx_config.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,160 copying sglang/srt/models/yivl.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,162 copying sglang/srt/models/dbrx.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,165 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,167 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,169 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,171 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,173 copying sglang/srt/models/gemma.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,176 copying sglang/srt/models/stablelm.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,178 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,180 copying sglang/srt/models/commandr.py -> build/lib/sglang/srt/models 2024-05-12T22:44:16,183 creating build/lib/sglang/srt/constrained 2024-05-12T22:44:16,184 copying sglang/srt/constrained/base_cache.py -> build/lib/sglang/srt/constrained 2024-05-12T22:44:16,186 copying sglang/srt/constrained/__init__.py -> build/lib/sglang/srt/constrained 2024-05-12T22:44:16,188 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-05-12T22:44:16,190 copying sglang/srt/constrained/jump_forward.py -> build/lib/sglang/srt/constrained 2024-05-12T22:44:16,192 creating build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,193 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,196 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,198 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,200 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,202 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,205 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-05-12T22:44:16,207 running egg_info 2024-05-12T22:44:16,211 writing sglang.egg-info/PKG-INFO 2024-05-12T22:44:16,222 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-05-12T22:44:16,227 writing requirements to sglang.egg-info/requires.txt 2024-05-12T22:44:16,228 writing top-level names to sglang.egg-info/top_level.txt 2024-05-12T22:44:16,243 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:16,246 adding license file 'LICENSE' 2024-05-12T22:44:16,250 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-05-12T22:44:16,268 installing to build/bdist.linux-armv7l/wheel 2024-05-12T22:44:16,269 running install 2024-05-12T22:44:16,293 running install_lib 2024-05-12T22:44:16,298 creating build/bdist.linux-armv7l 2024-05-12T22:44:16,298 creating build/bdist.linux-armv7l/wheel 2024-05-12T22:44:16,300 creating build/bdist.linux-armv7l/wheel/sglang 2024-05-12T22:44:16,301 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-05-12T22:44:16,302 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-05-12T22:44:16,305 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-05-12T22:44:16,307 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-05-12T22:44:16,309 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-05-12T22:44:16,311 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-05-12T22:44:16,314 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,315 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,317 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,319 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,321 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,323 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,325 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-05-12T22:44:16,327 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-05-12T22:44:16,329 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-05-12T22:44:16,331 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,332 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,335 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,337 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,340 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,341 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,343 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-05-12T22:44:16,346 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,347 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,349 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-05-12T22:44:16,350 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-05-12T22:44:16,353 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-05-12T22:44:16,355 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-05-12T22:44:16,358 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-05-12T22:44:16,360 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-05-12T22:44:16,363 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,364 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,366 copying build/lib/sglang/srt/weight_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,369 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,371 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,374 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,377 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-05-12T22:44:16,378 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-05-12T22:44:16,380 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,381 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,384 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,386 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,389 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,391 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,393 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-05-12T22:44:16,396 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-05-12T22:44:16,399 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-05-12T22:44:16,401 copying build/lib/sglang/srt/openai_api_adapter.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,403 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,405 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,409 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,410 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,412 copying build/lib/sglang/srt/models/dbrx_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,414 copying build/lib/sglang/srt/models/yivl.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,416 copying build/lib/sglang/srt/models/dbrx.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,418 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,421 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,423 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,425 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,428 copying build/lib/sglang/srt/models/gemma.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,430 copying build/lib/sglang/srt/models/stablelm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,433 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,435 copying build/lib/sglang/srt/models/commandr.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-05-12T22:44:16,438 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,440 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-05-12T22:44:16,441 copying build/lib/sglang/srt/constrained/base_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-05-12T22:44:16,443 copying build/lib/sglang/srt/constrained/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-05-12T22:44:16,445 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-05-12T22:44:16,447 copying build/lib/sglang/srt/constrained/jump_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-05-12T22:44:16,449 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,451 copying build/lib/sglang/srt/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-05-12T22:44:16,453 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-05-12T22:44:16,455 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-05-12T22:44:16,457 running install_egg_info 2024-05-12T22:44:16,461 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.15-py3.11.egg-info 2024-05-12T22:44:16,472 running install_scripts 2024-05-12T22:44:16,494 creating build/bdist.linux-armv7l/wheel/sglang-0.1.15.dist-info/WHEEL 2024-05-12T22:44:16,497 creating '/tmp/pip-wheel-4t9y_9fw/.tmp-i1nc46xt/sglang-0.1.15-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-05-12T22:44:16,499 adding 'sglang/__init__.py' 2024-05-12T22:44:16,501 adding 'sglang/api.py' 2024-05-12T22:44:16,502 adding 'sglang/global_config.py' 2024-05-12T22:44:16,503 adding 'sglang/launch_server.py' 2024-05-12T22:44:16,505 adding 'sglang/utils.py' 2024-05-12T22:44:16,507 adding 'sglang/backend/__init__.py' 2024-05-12T22:44:16,508 adding 'sglang/backend/anthropic.py' 2024-05-12T22:44:16,509 adding 'sglang/backend/base_backend.py' 2024-05-12T22:44:16,511 adding 'sglang/backend/openai.py' 2024-05-12T22:44:16,513 adding 'sglang/backend/runtime_endpoint.py' 2024-05-12T22:44:16,514 adding 'sglang/backend/vertexai.py' 2024-05-12T22:44:16,516 adding 'sglang/lang/__init__.py' 2024-05-12T22:44:16,518 adding 'sglang/lang/chat_template.py' 2024-05-12T22:44:16,519 adding 'sglang/lang/compiler.py' 2024-05-12T22:44:16,523 adding 'sglang/lang/interpreter.py' 2024-05-12T22:44:16,525 adding 'sglang/lang/ir.py' 2024-05-12T22:44:16,527 adding 'sglang/lang/tracer.py' 2024-05-12T22:44:16,529 adding 'sglang/srt/backend_config.py' 2024-05-12T22:44:16,532 adding 'sglang/srt/conversation.py' 2024-05-12T22:44:16,533 adding 'sglang/srt/hf_transformers_utils.py' 2024-05-12T22:44:16,535 adding 'sglang/srt/memory_pool.py' 2024-05-12T22:44:16,536 adding 'sglang/srt/mm_utils.py' 2024-05-12T22:44:16,538 adding 'sglang/srt/model_config.py' 2024-05-12T22:44:16,540 adding 'sglang/srt/openai_api_adapter.py' 2024-05-12T22:44:16,541 adding 'sglang/srt/openai_protocol.py' 2024-05-12T22:44:16,543 adding 'sglang/srt/sampling_params.py' 2024-05-12T22:44:16,545 adding 'sglang/srt/server.py' 2024-05-12T22:44:16,546 adding 'sglang/srt/server_args.py' 2024-05-12T22:44:16,548 adding 'sglang/srt/utils.py' 2024-05-12T22:44:16,551 adding 'sglang/srt/weight_utils.py' 2024-05-12T22:44:16,552 adding 'sglang/srt/constrained/__init__.py' 2024-05-12T22:44:16,554 adding 'sglang/srt/constrained/base_cache.py' 2024-05-12T22:44:16,555 adding 'sglang/srt/constrained/fsm_cache.py' 2024-05-12T22:44:16,556 adding 'sglang/srt/constrained/jump_forward.py' 2024-05-12T22:44:16,558 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-05-12T22:44:16,560 adding 'sglang/srt/layers/extend_attention.py' 2024-05-12T22:44:16,562 adding 'sglang/srt/layers/logits_processor.py' 2024-05-12T22:44:16,563 adding 'sglang/srt/layers/radix_attention.py' 2024-05-12T22:44:16,565 adding 'sglang/srt/layers/token_attention.py' 2024-05-12T22:44:16,567 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-05-12T22:44:16,568 adding 'sglang/srt/managers/io_struct.py' 2024-05-12T22:44:16,570 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-05-12T22:44:16,573 adding 'sglang/srt/managers/router/infer_batch.py' 2024-05-12T22:44:16,575 adding 'sglang/srt/managers/router/manager.py' 2024-05-12T22:44:16,578 adding 'sglang/srt/managers/router/model_rpc.py' 2024-05-12T22:44:16,580 adding 'sglang/srt/managers/router/model_runner.py' 2024-05-12T22:44:16,582 adding 'sglang/srt/managers/router/radix_cache.py' 2024-05-12T22:44:16,584 adding 'sglang/srt/managers/router/scheduler.py' 2024-05-12T22:44:16,586 adding 'sglang/srt/models/commandr.py' 2024-05-12T22:44:16,588 adding 'sglang/srt/models/dbrx.py' 2024-05-12T22:44:16,590 adding 'sglang/srt/models/dbrx_config.py' 2024-05-12T22:44:16,592 adding 'sglang/srt/models/gemma.py' 2024-05-12T22:44:16,594 adding 'sglang/srt/models/llama2.py' 2024-05-12T22:44:16,597 adding 'sglang/srt/models/llava.py' 2024-05-12T22:44:16,599 adding 'sglang/srt/models/mistral.py' 2024-05-12T22:44:16,601 adding 'sglang/srt/models/mixtral.py' 2024-05-12T22:44:16,603 adding 'sglang/srt/models/qwen.py' 2024-05-12T22:44:16,604 adding 'sglang/srt/models/qwen2.py' 2024-05-12T22:44:16,606 adding 'sglang/srt/models/stablelm.py' 2024-05-12T22:44:16,608 adding 'sglang/srt/models/yivl.py' 2024-05-12T22:44:16,610 adding 'sglang/test/test_conversation.py' 2024-05-12T22:44:16,611 adding 'sglang/test/test_openai_protocol.py' 2024-05-12T22:44:16,613 adding 'sglang/test/test_programs.py' 2024-05-12T22:44:16,615 adding 'sglang/test/test_utils.py' 2024-05-12T22:44:16,618 adding 'sglang-0.1.15.dist-info/LICENSE' 2024-05-12T22:44:16,621 adding 'sglang-0.1.15.dist-info/METADATA' 2024-05-12T22:44:16,623 adding 'sglang-0.1.15.dist-info/WHEEL' 2024-05-12T22:44:16,623 adding 'sglang-0.1.15.dist-info/top_level.txt' 2024-05-12T22:44:16,625 adding 'sglang-0.1.15.dist-info/RECORD' 2024-05-12T22:44:16,629 removing build/bdist.linux-armv7l/wheel 2024-05-12T22:44:16,770 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-05-12T22:44:16,778 Created wheel for sglang: filename=sglang-0.1.15-py3-none-any.whl size=146941 sha256=ff0147fac746002650e43e10e4f58c3cc20c460e7b631199e2d97186af58e34b 2024-05-12T22:44:16,779 Stored in directory: /tmp/pip-ephem-wheel-cache-gt7rqbq4/wheels/30/73/2e/2a21219a95629dc4254ede799381388eb777e34024ae0d1a2e 2024-05-12T22:44:16,802 Successfully built sglang 2024-05-12T22:44:16,810 Removed build tracker: '/tmp/pip-build-tracker-vljjjckr'