2024-06-08T03:57:03,352 Created temporary directory: /tmp/pip-build-tracker-v7_rx1h6 2024-06-08T03:57:03,353 Initialized build tracking at /tmp/pip-build-tracker-v7_rx1h6 2024-06-08T03:57:03,354 Created build tracker: /tmp/pip-build-tracker-v7_rx1h6 2024-06-08T03:57:03,354 Entered build tracker: /tmp/pip-build-tracker-v7_rx1h6 2024-06-08T03:57:03,355 Created temporary directory: /tmp/pip-wheel-v0eqgr7g 2024-06-08T03:57:03,359 Created temporary directory: /tmp/pip-ephem-wheel-cache-5r1rl_bf 2024-06-08T03:57:03,381 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-08T03:57:03,384 2 location(s) to search for versions of sglang: 2024-06-08T03:57:03,384 * https://pypi.org/simple/sglang/ 2024-06-08T03:57:03,384 * https://www.piwheels.org/simple/sglang/ 2024-06-08T03:57:03,385 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-06-08T03:57:03,386 Getting page https://pypi.org/simple/sglang/ 2024-06-08T03:57:03,387 Found index url https://pypi.org/simple/ 2024-06-08T03:57:03,598 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-06-08T03:57:03,604 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,605 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-06-08T03:57:03,606 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,607 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-06-08T03:57:03,607 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,608 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-06-08T03:57:03,609 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,610 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-06-08T03:57:03,610 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,611 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-06-08T03:57:03,612 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,613 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-06-08T03:57:03,613 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,614 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-06-08T03:57:03,615 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e2/c9/cc220d8db8e4a894e51bb6286a3e1b89b2de4b387ff4a2ea5b3809787165/sglang-0.1.11-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,616 Found link https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.11 2024-06-08T03:57:03,616 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/67/c6/c9a5bfd22ee72413dc979f5c5983503a92e60341042b9268e6b10845488d/sglang-0.1.12-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,617 Found link https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.12 2024-06-08T03:57:03,618 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/2c/9c/ef2ea3987904a937d0f8540f3aa144fcf3523d0cd7343b28e88e29a833d9/sglang-0.1.13-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,619 Found link https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.13 2024-06-08T03:57:03,619 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e3/f6/0bc8d86f5993dd728cb2b0d73782e060c6b85e639c53c00889a0de5a093c/sglang-0.1.14-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,620 Found link https://files.pythonhosted.org/packages/db/ba/87856203f741d3b965995d3aaf01cf5c1cf0efee5ef2784bd8063a75d9eb/sglang-0.1.14.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.14 2024-06-08T03:57:03,621 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/9e/d2/dd8e9ff0dafb1e8ebb0a566c2a0c0c8793aa88008ba8617507e27eb25dbb/sglang-0.1.15-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,621 Found link https://files.pythonhosted.org/packages/d5/ea/413337a61efdb095fccd7ec46a55575c78cc37de48eaaf89ab9de20b0346/sglang-0.1.15.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.15 2024-06-08T03:57:03,622 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/a7/4b/267f9a9361c62073b07d972f9d39b65447abfa97f07b26e981e3111de40a/sglang-0.1.16-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,623 Found link https://files.pythonhosted.org/packages/55/b9/3b5cbcec872f521b5ffea5fa34a04daec4b7979589bd19cc959e8575625c/sglang-0.1.16.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.16 2024-06-08T03:57:03,624 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/3c/83/efe4e29fd3a5b2f2a214d70300a6f48da550bc3d4123d177dd3ccd593e92/sglang-0.1.17-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,625 Found link https://files.pythonhosted.org/packages/0f/a3/f9a58fe90a22a6b838128706b8ae0fd230c8931aa5a0ce37745732da809c/sglang-0.1.17.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.17 2024-06-08T03:57:03,626 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-06-08T03:57:03,627 Getting page https://www.piwheels.org/simple/sglang/ 2024-06-08T03:57:03,628 Found index url https://www.piwheels.org/simple/ 2024-06-08T03:57:03,864 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-06-08T03:57:03,869 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.16-py3-none-any.whl#sha256=7ed511d89fbea9e61553b6d8f7939e0921b85c8ab1a0eb160b822eec27e99c02 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,870 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.15-py3-none-any.whl#sha256=ff0147fac746002650e43e10e4f58c3cc20c460e7b631199e2d97186af58e34b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,870 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.14-py3-none-any.whl#sha256=9a17abcd48bbc267101b00879531fe4554fed7237149e2a75626c437004bcbda (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,871 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.13-py3-none-any.whl#sha256=a52f32fcdfc81f57c0a67b780dd9560a923e45ee32854410deb59be7893c7ef8 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,871 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.12-py3-none-any.whl#sha256=66805b774197e9ab95436d69ae02b29ff3853d59596ba4b50581ae9e90f8f969 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,872 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.11-py3-none-any.whl#sha256=464124ce4f7e5d1ab437a9cef13a7188e0f71f1a6b07ed81c3d3d1e0c818a1b6 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,872 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.10-py3-none-any.whl#sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,873 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,873 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,874 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,875 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,875 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,876 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-06-08T03:57:03,877 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-06-08T03:57:03,877 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-06-08T03:57:03,905 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-06-08T03:57:03,934 Collecting sglang==0.1.17 2024-06-08T03:57:03,937 Created temporary directory: /tmp/pip-unpack-pqovnxgg 2024-06-08T03:57:04,172 Downloading sglang-0.1.17.tar.gz (155 kB) 2024-06-08T03:57:04,441 Added sglang==0.1.17 from https://files.pythonhosted.org/packages/0f/a3/f9a58fe90a22a6b838128706b8ae0fd230c8931aa5a0ce37745732da809c/sglang-0.1.17.tar.gz to build tracker '/tmp/pip-build-tracker-v7_rx1h6' 2024-06-08T03:57:04,446 Created temporary directory: /tmp/pip-build-env-ept24bo9 2024-06-08T03:57:04,451 Installing build dependencies: started 2024-06-08T03:57:04,452 Running command pip subprocess to install build dependencies 2024-06-08T03:57:05,634 Using pip 24.0 from /home/piwheels/.local/lib/python3.11/site-packages/pip (python 3.11) 2024-06-08T03:57:06,169 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-06-08T03:57:07,782 Collecting setuptools>=61.0 2024-06-08T03:57:07,802 Using cached https://www.piwheels.org/simple/setuptools/setuptools-70.0.0-py3-none-any.whl (863 kB) 2024-06-08T03:57:08,034 Collecting wheel 2024-06-08T03:57:08,051 Using cached https://www.piwheels.org/simple/wheel/wheel-0.43.0-py3-none-any.whl (65 kB) 2024-06-08T03:57:10,772 Installing collected packages: wheel, setuptools 2024-06-08T03:57:11,013 Creating /tmp/pip-build-env-ept24bo9/overlay/local/bin 2024-06-08T03:57:11,015 changing mode of /tmp/pip-build-env-ept24bo9/overlay/local/bin/wheel to 755 2024-06-08T03:57:13,429 Successfully installed setuptools-70.0.0 wheel-0.43.0 2024-06-08T03:57:13,925 Installing build dependencies: finished with status 'done' 2024-06-08T03:57:13,929 Getting requirements to build wheel: started 2024-06-08T03:57:13,930 Running command Getting requirements to build wheel 2024-06-08T03:57:14,791 running egg_info 2024-06-08T03:57:14,795 writing sglang.egg-info/PKG-INFO 2024-06-08T03:57:14,809 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-06-08T03:57:14,815 writing requirements to sglang.egg-info/requires.txt 2024-06-08T03:57:14,817 writing top-level names to sglang.egg-info/top_level.txt 2024-06-08T03:57:14,845 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:14,849 adding license file 'LICENSE' 2024-06-08T03:57:14,854 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:14,976 Getting requirements to build wheel: finished with status 'done' 2024-06-08T03:57:14,986 Created temporary directory: /tmp/pip-modern-metadata-6y3mym3m 2024-06-08T03:57:14,988 Preparing metadata (pyproject.toml): started 2024-06-08T03:57:14,989 Running command Preparing metadata (pyproject.toml) 2024-06-08T03:57:15,771 running dist_info 2024-06-08T03:57:15,777 creating /tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info 2024-06-08T03:57:15,781 writing /tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/PKG-INFO 2024-06-08T03:57:15,795 writing dependency_links to /tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/dependency_links.txt 2024-06-08T03:57:15,801 writing requirements to /tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/requires.txt 2024-06-08T03:57:15,802 writing top-level names to /tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/top_level.txt 2024-06-08T03:57:15,804 writing manifest file '/tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:15,827 reading manifest file '/tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:15,829 adding license file 'LICENSE' 2024-06-08T03:57:15,833 writing manifest file '/tmp/pip-modern-metadata-6y3mym3m/sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:15,835 creating '/tmp/pip-modern-metadata-6y3mym3m/sglang-0.1.17.dist-info' 2024-06-08T03:57:15,995 Preparing metadata (pyproject.toml): finished with status 'done' 2024-06-08T03:57:16,003 Source in /tmp/pip-wheel-v0eqgr7g/sglang_f63686ffd741496f8d12252822b0f462 has version 0.1.17, which satisfies requirement sglang==0.1.17 from https://files.pythonhosted.org/packages/0f/a3/f9a58fe90a22a6b838128706b8ae0fd230c8931aa5a0ce37745732da809c/sglang-0.1.17.tar.gz 2024-06-08T03:57:16,004 Removed sglang==0.1.17 from https://files.pythonhosted.org/packages/0f/a3/f9a58fe90a22a6b838128706b8ae0fd230c8931aa5a0ce37745732da809c/sglang-0.1.17.tar.gz from build tracker '/tmp/pip-build-tracker-v7_rx1h6' 2024-06-08T03:57:16,016 Created temporary directory: /tmp/pip-unpack-jln2qgbd 2024-06-08T03:57:16,017 Created temporary directory: /tmp/pip-unpack-qe567lky 2024-06-08T03:57:16,098 Building wheels for collected packages: sglang 2024-06-08T03:57:16,102 Created temporary directory: /tmp/pip-wheel-2ye59m4h 2024-06-08T03:57:16,103 Destination directory: /tmp/pip-wheel-2ye59m4h 2024-06-08T03:57:16,105 Building wheel for sglang (pyproject.toml): started 2024-06-08T03:57:16,106 Running command Building wheel for sglang (pyproject.toml) 2024-06-08T03:57:16,900 running bdist_wheel 2024-06-08T03:57:16,916 running build 2024-06-08T03:57:16,917 running build_py 2024-06-08T03:57:16,921 creating build 2024-06-08T03:57:16,922 creating build/lib 2024-06-08T03:57:16,923 creating build/lib/sglang 2024-06-08T03:57:16,924 copying sglang/global_config.py -> build/lib/sglang 2024-06-08T03:57:16,926 copying sglang/utils.py -> build/lib/sglang 2024-06-08T03:57:16,928 copying sglang/api.py -> build/lib/sglang 2024-06-08T03:57:16,930 copying sglang/launch_server_llavavid.py -> build/lib/sglang 2024-06-08T03:57:16,932 copying sglang/launch_server.py -> build/lib/sglang 2024-06-08T03:57:16,934 copying sglang/__init__.py -> build/lib/sglang 2024-06-08T03:57:16,936 creating build/lib/sglang/srt 2024-06-08T03:57:16,937 copying sglang/srt/openai_api_adapter.py -> build/lib/sglang/srt 2024-06-08T03:57:16,940 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-06-08T03:57:16,942 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-06-08T03:57:16,944 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-06-08T03:57:16,947 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-06-08T03:57:16,949 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-06-08T03:57:16,951 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-06-08T03:57:16,954 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-06-08T03:57:16,957 copying sglang/srt/openai_protocol.py -> build/lib/sglang/srt 2024-06-08T03:57:16,959 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-06-08T03:57:16,961 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-06-08T03:57:16,963 copying sglang/srt/flush_cache.py -> build/lib/sglang/srt 2024-06-08T03:57:16,966 creating build/lib/sglang/backend 2024-06-08T03:57:16,967 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-06-08T03:57:16,969 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-06-08T03:57:16,971 copying sglang/backend/litellm.py -> build/lib/sglang/backend 2024-06-08T03:57:16,973 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-06-08T03:57:16,974 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-06-08T03:57:16,976 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-06-08T03:57:16,979 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-06-08T03:57:16,982 creating build/lib/sglang/lang 2024-06-08T03:57:16,982 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-06-08T03:57:16,986 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-06-08T03:57:16,990 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-06-08T03:57:16,991 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-06-08T03:57:16,994 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-06-08T03:57:16,996 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-06-08T03:57:16,999 creating build/lib/sglang/test 2024-06-08T03:57:17,001 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-06-08T03:57:17,003 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-06-08T03:57:17,005 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-06-08T03:57:17,007 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-06-08T03:57:17,010 creating build/lib/sglang/srt/constrained 2024-06-08T03:57:17,011 copying sglang/srt/constrained/jump_forward.py -> build/lib/sglang/srt/constrained 2024-06-08T03:57:17,013 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-06-08T03:57:17,014 copying sglang/srt/constrained/base_cache.py -> build/lib/sglang/srt/constrained 2024-06-08T03:57:17,016 copying sglang/srt/constrained/__init__.py -> build/lib/sglang/srt/constrained 2024-06-08T03:57:17,019 creating build/lib/sglang/srt/models 2024-06-08T03:57:17,020 copying sglang/srt/models/gemma.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,023 copying sglang/srt/models/llavavid.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,026 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,028 copying sglang/srt/models/yivl.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,030 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,034 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,035 copying sglang/srt/models/grok.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,038 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,041 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,044 copying sglang/srt/models/stablelm.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,046 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,049 copying sglang/srt/models/mixtral_quant.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,052 copying sglang/srt/models/dbrx.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,055 copying sglang/srt/models/commandr.py -> build/lib/sglang/srt/models 2024-06-08T03:57:17,058 creating build/lib/sglang/srt/managers 2024-06-08T03:57:17,059 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-06-08T03:57:17,062 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-06-08T03:57:17,065 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-06-08T03:57:17,068 creating build/lib/sglang/srt/layers 2024-06-08T03:57:17,069 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-06-08T03:57:17,072 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-06-08T03:57:17,075 copying sglang/srt/layers/fused_moe.py -> build/lib/sglang/srt/layers 2024-06-08T03:57:17,077 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-06-08T03:57:17,080 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-06-08T03:57:17,082 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-06-08T03:57:17,085 creating build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,087 copying sglang/srt/managers/controller/model_runner.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,090 copying sglang/srt/managers/controller/tp_worker.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,093 copying sglang/srt/managers/controller/radix_cache.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,096 copying sglang/srt/managers/controller/manager_multi.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,098 copying sglang/srt/managers/controller/dp_worker.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,101 copying sglang/srt/managers/controller/schedule_heuristic.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,103 copying sglang/srt/managers/controller/infer_batch.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,106 copying sglang/srt/managers/controller/manager_single.py -> build/lib/sglang/srt/managers/controller 2024-06-08T03:57:17,108 creating build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,109 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,111 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,113 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,115 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,118 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,120 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-06-08T03:57:17,123 running egg_info 2024-06-08T03:57:17,126 writing sglang.egg-info/PKG-INFO 2024-06-08T03:57:17,139 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-06-08T03:57:17,144 writing requirements to sglang.egg-info/requires.txt 2024-06-08T03:57:17,146 writing top-level names to sglang.egg-info/top_level.txt 2024-06-08T03:57:17,162 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:17,166 adding license file 'LICENSE' 2024-06-08T03:57:17,170 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-06-08T03:57:17,188 installing to build/bdist.linux-armv7l/wheel 2024-06-08T03:57:17,189 running install 2024-06-08T03:57:17,213 running install_lib 2024-06-08T03:57:17,218 creating build/bdist.linux-armv7l 2024-06-08T03:57:17,218 creating build/bdist.linux-armv7l/wheel 2024-06-08T03:57:17,220 creating build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,221 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,223 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,226 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,228 copying build/lib/sglang/launch_server_llavavid.py -> build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,230 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,232 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-06-08T03:57:17,234 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,236 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-06-08T03:57:17,237 copying build/lib/sglang/srt/constrained/jump_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-06-08T03:57:17,239 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-06-08T03:57:17,241 copying build/lib/sglang/srt/constrained/base_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-06-08T03:57:17,243 copying build/lib/sglang/srt/constrained/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-06-08T03:57:17,245 copying build/lib/sglang/srt/openai_api_adapter.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,248 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,249 copying build/lib/sglang/srt/models/gemma.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,252 copying build/lib/sglang/srt/models/llavavid.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,254 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,257 copying build/lib/sglang/srt/models/yivl.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,259 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,262 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,263 copying build/lib/sglang/srt/models/grok.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,266 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,268 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,270 copying build/lib/sglang/srt/models/stablelm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,273 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,275 copying build/lib/sglang/srt/models/mixtral_quant.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,278 copying build/lib/sglang/srt/models/dbrx.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,281 copying build/lib/sglang/srt/models/commandr.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-06-08T03:57:17,284 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-06-08T03:57:17,285 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-06-08T03:57:17,287 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,288 copying build/lib/sglang/srt/managers/controller/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,291 copying build/lib/sglang/srt/managers/controller/tp_worker.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,293 copying build/lib/sglang/srt/managers/controller/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,296 copying build/lib/sglang/srt/managers/controller/manager_multi.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,298 copying build/lib/sglang/srt/managers/controller/dp_worker.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,301 copying build/lib/sglang/srt/managers/controller/schedule_heuristic.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,303 copying build/lib/sglang/srt/managers/controller/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,305 copying build/lib/sglang/srt/managers/controller/manager_single.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/controller 2024-06-08T03:57:17,307 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-06-08T03:57:17,311 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,312 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,315 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,317 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,319 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,322 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,324 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-06-08T03:57:17,327 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-06-08T03:57:17,330 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,332 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,334 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,337 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,340 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,342 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,345 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,347 copying build/lib/sglang/srt/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,349 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,351 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,354 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,355 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,358 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,361 copying build/lib/sglang/srt/layers/fused_moe.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,364 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,367 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,370 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-06-08T03:57:17,373 copying build/lib/sglang/srt/flush_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-06-08T03:57:17,375 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,376 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,379 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,381 copying build/lib/sglang/backend/litellm.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,383 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,384 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,386 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,390 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-06-08T03:57:17,393 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,394 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,397 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,399 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,401 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,403 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,406 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-06-08T03:57:17,409 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-06-08T03:57:17,410 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-06-08T03:57:17,412 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-06-08T03:57:17,414 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-06-08T03:57:17,417 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-06-08T03:57:17,418 running install_egg_info 2024-06-08T03:57:17,422 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.17-py3.11.egg-info 2024-06-08T03:57:17,433 running install_scripts 2024-06-08T03:57:17,458 creating build/bdist.linux-armv7l/wheel/sglang-0.1.17.dist-info/WHEEL 2024-06-08T03:57:17,460 creating '/tmp/pip-wheel-2ye59m4h/.tmp-55w7ybkz/sglang-0.1.17-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-06-08T03:57:17,463 adding 'sglang/__init__.py' 2024-06-08T03:57:17,464 adding 'sglang/api.py' 2024-06-08T03:57:17,466 adding 'sglang/global_config.py' 2024-06-08T03:57:17,467 adding 'sglang/launch_server.py' 2024-06-08T03:57:17,468 adding 'sglang/launch_server_llavavid.py' 2024-06-08T03:57:17,470 adding 'sglang/utils.py' 2024-06-08T03:57:17,472 adding 'sglang/backend/__init__.py' 2024-06-08T03:57:17,473 adding 'sglang/backend/anthropic.py' 2024-06-08T03:57:17,474 adding 'sglang/backend/base_backend.py' 2024-06-08T03:57:17,476 adding 'sglang/backend/litellm.py' 2024-06-08T03:57:17,478 adding 'sglang/backend/openai.py' 2024-06-08T03:57:17,479 adding 'sglang/backend/runtime_endpoint.py' 2024-06-08T03:57:17,481 adding 'sglang/backend/vertexai.py' 2024-06-08T03:57:17,483 adding 'sglang/lang/__init__.py' 2024-06-08T03:57:17,485 adding 'sglang/lang/chat_template.py' 2024-06-08T03:57:17,486 adding 'sglang/lang/compiler.py' 2024-06-08T03:57:17,490 adding 'sglang/lang/interpreter.py' 2024-06-08T03:57:17,492 adding 'sglang/lang/ir.py' 2024-06-08T03:57:17,493 adding 'sglang/lang/tracer.py' 2024-06-08T03:57:17,496 adding 'sglang/srt/conversation.py' 2024-06-08T03:57:17,497 adding 'sglang/srt/flush_cache.py' 2024-06-08T03:57:17,499 adding 'sglang/srt/hf_transformers_utils.py' 2024-06-08T03:57:17,500 adding 'sglang/srt/memory_pool.py' 2024-06-08T03:57:17,503 adding 'sglang/srt/mm_utils.py' 2024-06-08T03:57:17,505 adding 'sglang/srt/model_config.py' 2024-06-08T03:57:17,507 adding 'sglang/srt/openai_api_adapter.py' 2024-06-08T03:57:17,508 adding 'sglang/srt/openai_protocol.py' 2024-06-08T03:57:17,510 adding 'sglang/srt/sampling_params.py' 2024-06-08T03:57:17,512 adding 'sglang/srt/server.py' 2024-06-08T03:57:17,513 adding 'sglang/srt/server_args.py' 2024-06-08T03:57:17,516 adding 'sglang/srt/utils.py' 2024-06-08T03:57:17,518 adding 'sglang/srt/constrained/__init__.py' 2024-06-08T03:57:17,519 adding 'sglang/srt/constrained/base_cache.py' 2024-06-08T03:57:17,520 adding 'sglang/srt/constrained/fsm_cache.py' 2024-06-08T03:57:17,521 adding 'sglang/srt/constrained/jump_forward.py' 2024-06-08T03:57:17,524 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-06-08T03:57:17,526 adding 'sglang/srt/layers/extend_attention.py' 2024-06-08T03:57:17,528 adding 'sglang/srt/layers/fused_moe.py' 2024-06-08T03:57:17,530 adding 'sglang/srt/layers/logits_processor.py' 2024-06-08T03:57:17,532 adding 'sglang/srt/layers/radix_attention.py' 2024-06-08T03:57:17,533 adding 'sglang/srt/layers/token_attention.py' 2024-06-08T03:57:17,535 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-06-08T03:57:17,537 adding 'sglang/srt/managers/io_struct.py' 2024-06-08T03:57:17,539 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-06-08T03:57:17,541 adding 'sglang/srt/managers/controller/dp_worker.py' 2024-06-08T03:57:17,544 adding 'sglang/srt/managers/controller/infer_batch.py' 2024-06-08T03:57:17,546 adding 'sglang/srt/managers/controller/manager_multi.py' 2024-06-08T03:57:17,547 adding 'sglang/srt/managers/controller/manager_single.py' 2024-06-08T03:57:17,549 adding 'sglang/srt/managers/controller/model_runner.py' 2024-06-08T03:57:17,551 adding 'sglang/srt/managers/controller/radix_cache.py' 2024-06-08T03:57:17,552 adding 'sglang/srt/managers/controller/schedule_heuristic.py' 2024-06-08T03:57:17,555 adding 'sglang/srt/managers/controller/tp_worker.py' 2024-06-08T03:57:17,559 adding 'sglang/srt/managers/router/infer_batch.py' 2024-06-08T03:57:17,560 adding 'sglang/srt/managers/router/manager.py' 2024-06-08T03:57:17,563 adding 'sglang/srt/managers/router/model_rpc.py' 2024-06-08T03:57:17,569 adding 'sglang/srt/managers/router/model_runner.py' 2024-06-08T03:57:17,571 adding 'sglang/srt/managers/router/radix_cache.py' 2024-06-08T03:57:17,572 adding 'sglang/srt/managers/router/scheduler.py' 2024-06-08T03:57:17,574 adding 'sglang/srt/models/commandr.py' 2024-06-08T03:57:17,576 adding 'sglang/srt/models/dbrx.py' 2024-06-08T03:57:17,578 adding 'sglang/srt/models/gemma.py' 2024-06-08T03:57:17,581 adding 'sglang/srt/models/grok.py' 2024-06-08T03:57:17,583 adding 'sglang/srt/models/llama2.py' 2024-06-08T03:57:17,585 adding 'sglang/srt/models/llava.py' 2024-06-08T03:57:17,588 adding 'sglang/srt/models/llavavid.py' 2024-06-08T03:57:17,589 adding 'sglang/srt/models/mistral.py' 2024-06-08T03:57:17,591 adding 'sglang/srt/models/mixtral.py' 2024-06-08T03:57:17,593 adding 'sglang/srt/models/mixtral_quant.py' 2024-06-08T03:57:17,595 adding 'sglang/srt/models/qwen.py' 2024-06-08T03:57:17,597 adding 'sglang/srt/models/qwen2.py' 2024-06-08T03:57:17,599 adding 'sglang/srt/models/stablelm.py' 2024-06-08T03:57:17,600 adding 'sglang/srt/models/yivl.py' 2024-06-08T03:57:17,602 adding 'sglang/test/test_conversation.py' 2024-06-08T03:57:17,603 adding 'sglang/test/test_openai_protocol.py' 2024-06-08T03:57:17,605 adding 'sglang/test/test_programs.py' 2024-06-08T03:57:17,607 adding 'sglang/test/test_utils.py' 2024-06-08T03:57:17,610 adding 'sglang-0.1.17.dist-info/LICENSE' 2024-06-08T03:57:17,614 adding 'sglang-0.1.17.dist-info/METADATA' 2024-06-08T03:57:17,615 adding 'sglang-0.1.17.dist-info/WHEEL' 2024-06-08T03:57:17,616 adding 'sglang-0.1.17.dist-info/top_level.txt' 2024-06-08T03:57:17,617 adding 'sglang-0.1.17.dist-info/RECORD' 2024-06-08T03:57:17,622 removing build/bdist.linux-armv7l/wheel 2024-06-08T03:57:17,771 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-06-08T03:57:17,782 Created wheel for sglang: filename=sglang-0.1.17-py3-none-any.whl size=192637 sha256=07bfd01ff24c0a702bb5c39aea418257921f3ec18db3ecc4532ab0429f56d579 2024-06-08T03:57:17,784 Stored in directory: /tmp/pip-ephem-wheel-cache-5r1rl_bf/wheels/dd/39/56/458d8d3f75eb226eb6e84ddd1743378cb4c5e12366d11c4e28 2024-06-08T03:57:17,817 Successfully built sglang 2024-06-08T03:57:17,831 Removed build tracker: '/tmp/pip-build-tracker-v7_rx1h6'