2024-03-11T13:57:44,386 Created temporary directory: /tmp/pip-build-tracker-872dfkv3 2024-03-11T13:57:44,387 Initialized build tracking at /tmp/pip-build-tracker-872dfkv3 2024-03-11T13:57:44,388 Created build tracker: /tmp/pip-build-tracker-872dfkv3 2024-03-11T13:57:44,388 Entered build tracker: /tmp/pip-build-tracker-872dfkv3 2024-03-11T13:57:44,389 Created temporary directory: /tmp/pip-wheel-is103ki5 2024-03-11T13:57:44,392 Created temporary directory: /tmp/pip-ephem-wheel-cache-m74gik2g 2024-03-11T13:57:44,414 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-11T13:57:44,418 2 location(s) to search for versions of sglang: 2024-03-11T13:57:44,418 * https://pypi.org/simple/sglang/ 2024-03-11T13:57:44,418 * https://www.piwheels.org/simple/sglang/ 2024-03-11T13:57:44,419 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-03-11T13:57:44,419 Getting page https://pypi.org/simple/sglang/ 2024-03-11T13:57:44,421 Found index url https://pypi.org/simple/ 2024-03-11T13:57:44,637 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-03-11T13:57:44,642 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,642 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-03-11T13:57:44,643 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,644 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-03-11T13:57:44,645 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,646 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-03-11T13:57:44,647 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,648 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-03-11T13:57:44,649 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,650 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-03-11T13:57:44,650 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,651 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-03-11T13:57:44,652 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,653 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-03-11T13:57:44,654 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e2/c9/cc220d8db8e4a894e51bb6286a3e1b89b2de4b387ff4a2ea5b3809787165/sglang-0.1.11-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,655 Found link https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.11 2024-03-11T13:57:44,655 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/67/c6/c9a5bfd22ee72413dc979f5c5983503a92e60341042b9268e6b10845488d/sglang-0.1.12-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,656 Found link https://files.pythonhosted.org/packages/2d/6b/d48d3822405b827b50bf1daa6135085b1ffe577369cdc74d6e6fb6d7a5e9/sglang-0.1.12.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.12 2024-03-11T13:57:44,657 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/2c/9c/ef2ea3987904a937d0f8540f3aa144fcf3523d0cd7343b28e88e29a833d9/sglang-0.1.13-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,658 Found link https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.13 2024-03-11T13:57:44,658 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-03-11T13:57:44,659 Getting page https://www.piwheels.org/simple/sglang/ 2024-03-11T13:57:44,661 Found index url https://www.piwheels.org/simple/ 2024-03-11T13:57:44,896 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-03-11T13:57:44,900 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.12-py3-none-any.whl#sha256=66805b774197e9ab95436d69ae02b29ff3853d59596ba4b50581ae9e90f8f969 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,901 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.11-py3-none-any.whl#sha256=464124ce4f7e5d1ab437a9cef13a7188e0f71f1a6b07ed81c3d3d1e0c818a1b6 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,902 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.10-py3-none-any.whl#sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,902 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,903 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,903 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,904 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,906 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,906 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-03-11T13:57:44,907 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-03-11T13:57:44,908 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-03-11T13:57:44,928 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-03-11T13:57:44,946 Collecting sglang==0.1.13 2024-03-11T13:57:44,949 Created temporary directory: /tmp/pip-unpack-0np3t6ic 2024-03-11T13:57:45,164 Downloading sglang-0.1.13.tar.gz (105 kB) 2024-03-11T13:57:45,445 Added sglang==0.1.13 from https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz to build tracker '/tmp/pip-build-tracker-872dfkv3' 2024-03-11T13:57:45,451 Created temporary directory: /tmp/pip-build-env-1a9u35ws 2024-03-11T13:57:45,456 Installing build dependencies: started 2024-03-11T13:57:45,457 Running command pip subprocess to install build dependencies 2024-03-11T13:57:46,661 Using pip 24.0 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-03-11T13:57:47,204 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-03-11T13:57:48,874 Collecting setuptools>=61.0 2024-03-11T13:57:48,889 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.1.1-py3-none-any.whl (819 kB) 2024-03-11T13:57:49,136 Collecting wheel 2024-03-11T13:57:49,164 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-03-11T13:57:51,767 Installing collected packages: wheel, setuptools 2024-03-11T13:57:52,013 Creating /tmp/pip-build-env-1a9u35ws/overlay/local/bin 2024-03-11T13:57:52,015 changing mode of /tmp/pip-build-env-1a9u35ws/overlay/local/bin/wheel to 755 2024-03-11T13:57:54,444 Successfully installed setuptools-69.1.1 wheel-0.42.0 2024-03-11T13:57:55,016 Installing build dependencies: finished with status 'done' 2024-03-11T13:57:55,020 Getting requirements to build wheel: started 2024-03-11T13:57:55,022 Running command Getting requirements to build wheel 2024-03-11T13:57:55,860 running egg_info 2024-03-11T13:57:55,864 writing sglang.egg-info/PKG-INFO 2024-03-11T13:57:55,876 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-03-11T13:57:55,882 writing requirements to sglang.egg-info/requires.txt 2024-03-11T13:57:55,883 writing top-level names to sglang.egg-info/top_level.txt 2024-03-11T13:57:55,909 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:55,912 adding license file 'LICENSE' 2024-03-11T13:57:55,916 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:56,034 Getting requirements to build wheel: finished with status 'done' 2024-03-11T13:57:56,043 Created temporary directory: /tmp/pip-modern-metadata-o8k4h0um 2024-03-11T13:57:56,045 Preparing metadata (pyproject.toml): started 2024-03-11T13:57:56,046 Running command Preparing metadata (pyproject.toml) 2024-03-11T13:57:56,817 running dist_info 2024-03-11T13:57:56,822 creating /tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info 2024-03-11T13:57:56,827 writing /tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/PKG-INFO 2024-03-11T13:57:56,839 writing dependency_links to /tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/dependency_links.txt 2024-03-11T13:57:56,844 writing requirements to /tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/requires.txt 2024-03-11T13:57:56,846 writing top-level names to /tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/top_level.txt 2024-03-11T13:57:56,847 writing manifest file '/tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:56,869 reading manifest file '/tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:56,871 adding license file 'LICENSE' 2024-03-11T13:57:56,874 writing manifest file '/tmp/pip-modern-metadata-o8k4h0um/sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:56,875 creating '/tmp/pip-modern-metadata-o8k4h0um/sglang-0.1.13.dist-info' 2024-03-11T13:57:57,030 Preparing metadata (pyproject.toml): finished with status 'done' 2024-03-11T13:57:57,039 Source in /tmp/pip-wheel-is103ki5/sglang_8ebde3d4e5264ba9a092934657a0e4fb has version 0.1.13, which satisfies requirement sglang==0.1.13 from https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz 2024-03-11T13:57:57,041 Removed sglang==0.1.13 from https://files.pythonhosted.org/packages/57/f4/387e5330c1af208873cb160b0936e2b51d718a3c2e9a107edb0f6ff6fe54/sglang-0.1.13.tar.gz from build tracker '/tmp/pip-build-tracker-872dfkv3' 2024-03-11T13:57:57,053 Created temporary directory: /tmp/pip-unpack-cz2qgjv4 2024-03-11T13:57:57,054 Created temporary directory: /tmp/pip-unpack-7du36t7x 2024-03-11T13:57:57,131 Building wheels for collected packages: sglang 2024-03-11T13:57:57,136 Created temporary directory: /tmp/pip-wheel-eyt3h5u2 2024-03-11T13:57:57,137 Destination directory: /tmp/pip-wheel-eyt3h5u2 2024-03-11T13:57:57,140 Building wheel for sglang (pyproject.toml): started 2024-03-11T13:57:57,141 Running command Building wheel for sglang (pyproject.toml) 2024-03-11T13:57:57,906 running bdist_wheel 2024-03-11T13:57:57,923 running build 2024-03-11T13:57:57,924 running build_py 2024-03-11T13:57:57,929 creating build 2024-03-11T13:57:57,930 creating build/lib 2024-03-11T13:57:57,930 creating build/lib/sglang 2024-03-11T13:57:57,931 copying sglang/global_config.py -> build/lib/sglang 2024-03-11T13:57:57,933 copying sglang/__init__.py -> build/lib/sglang 2024-03-11T13:57:57,936 copying sglang/utils.py -> build/lib/sglang 2024-03-11T13:57:57,940 copying sglang/launch_server.py -> build/lib/sglang 2024-03-11T13:57:57,942 copying sglang/api.py -> build/lib/sglang 2024-03-11T13:57:57,945 creating build/lib/sglang/lang 2024-03-11T13:57:57,947 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-03-11T13:57:57,951 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-03-11T13:57:57,954 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-03-11T13:57:57,956 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-03-11T13:57:57,960 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-03-11T13:57:57,963 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-03-11T13:57:57,967 creating build/lib/sglang/backend 2024-03-11T13:57:57,968 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-03-11T13:57:57,970 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-03-11T13:57:57,973 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-03-11T13:57:57,975 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-03-11T13:57:57,977 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-03-11T13:57:57,979 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-03-11T13:57:57,982 creating build/lib/sglang/srt 2024-03-11T13:57:57,983 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-03-11T13:57:57,987 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-03-11T13:57:58,209 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-03-11T13:57:58,212 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-03-11T13:57:58,213 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-03-11T13:57:58,215 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-03-11T13:57:58,217 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-03-11T13:57:58,220 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-03-11T13:57:58,221 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-03-11T13:57:58,223 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-03-11T13:57:58,225 creating build/lib/sglang/test 2024-03-11T13:57:58,226 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-03-11T13:57:58,228 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-03-11T13:57:58,230 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-03-11T13:57:58,232 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-03-11T13:57:58,234 creating build/lib/sglang/srt/models 2024-03-11T13:57:58,235 copying sglang/srt/models/yivl.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,237 copying sglang/srt/models/gemma.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,240 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,242 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,245 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,247 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,249 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,251 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-03-11T13:57:58,254 creating build/lib/sglang/srt/constrained 2024-03-11T13:57:58,255 copying sglang/srt/constrained/jump_forward.py -> build/lib/sglang/srt/constrained 2024-03-11T13:57:58,257 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-03-11T13:57:58,258 copying sglang/srt/constrained/base_cache.py -> build/lib/sglang/srt/constrained 2024-03-11T13:57:58,260 copying sglang/srt/constrained/__init__.py -> build/lib/sglang/srt/constrained 2024-03-11T13:57:58,262 creating build/lib/sglang/srt/managers 2024-03-11T13:57:58,263 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-03-11T13:57:58,265 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-03-11T13:57:58,267 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-03-11T13:57:58,270 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-03-11T13:57:58,273 creating build/lib/sglang/srt/layers 2024-03-11T13:57:58,274 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-03-11T13:57:58,276 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-03-11T13:57:58,278 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-03-11T13:57:58,281 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-03-11T13:57:58,284 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-03-11T13:57:58,287 creating build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,288 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,291 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,293 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,296 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,298 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,301 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-03-11T13:57:58,304 running egg_info 2024-03-11T13:57:58,308 writing sglang.egg-info/PKG-INFO 2024-03-11T13:57:58,320 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-03-11T13:57:58,326 writing requirements to sglang.egg-info/requires.txt 2024-03-11T13:57:58,327 writing top-level names to sglang.egg-info/top_level.txt 2024-03-11T13:57:58,343 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:58,347 adding license file 'LICENSE' 2024-03-11T13:57:58,351 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-03-11T13:57:58,368 installing to build/bdist.linux-armv7l/wheel 2024-03-11T13:57:58,368 running install 2024-03-11T13:57:58,394 running install_lib 2024-03-11T13:57:58,398 creating build/bdist.linux-armv7l 2024-03-11T13:57:58,399 creating build/bdist.linux-armv7l/wheel 2024-03-11T13:57:58,401 creating build/bdist.linux-armv7l/wheel/sglang 2024-03-11T13:57:58,403 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-11T13:57:58,405 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-11T13:57:58,407 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-11T13:57:58,410 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,411 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,414 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,417 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,419 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,422 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,425 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-03-11T13:57:58,428 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,429 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,432 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,434 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,437 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,439 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,441 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-03-11T13:57:58,443 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-11T13:57:58,446 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,447 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,450 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,453 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,456 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,459 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,461 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,465 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,466 copying build/lib/sglang/srt/models/yivl.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,469 copying build/lib/sglang/srt/models/gemma.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,471 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,474 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,477 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,480 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,482 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,484 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-03-11T13:57:58,487 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,490 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-11T13:57:58,491 copying build/lib/sglang/srt/constrained/jump_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-11T13:57:58,494 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-11T13:57:58,496 copying build/lib/sglang/srt/constrained/base_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-11T13:57:58,498 copying build/lib/sglang/srt/constrained/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-03-11T13:57:58,500 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,503 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,505 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-11T13:57:58,507 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-11T13:57:58,510 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,511 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,513 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,516 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,519 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,521 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,524 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-03-11T13:57:58,527 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-11T13:57:58,529 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-11T13:57:58,532 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-03-11T13:57:58,535 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-03-11T13:57:58,538 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-11T13:57:58,540 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-11T13:57:58,543 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-11T13:57:58,546 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-11T13:57:58,549 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-11T13:57:58,552 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-03-11T13:57:58,555 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-03-11T13:57:58,556 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-11T13:57:58,558 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-11T13:57:58,561 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-11T13:57:58,563 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-03-11T13:57:58,565 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-03-11T13:57:58,568 running install_egg_info 2024-03-11T13:57:58,572 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.13-py3.11.egg-info 2024-03-11T13:57:58,583 running install_scripts 2024-03-11T13:57:58,606 creating build/bdist.linux-armv7l/wheel/sglang-0.1.13.dist-info/WHEEL 2024-03-11T13:57:58,609 creating '/tmp/pip-wheel-eyt3h5u2/.tmp-9hldht4p/sglang-0.1.13-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-03-11T13:57:58,612 adding 'sglang/__init__.py' 2024-03-11T13:57:58,614 adding 'sglang/api.py' 2024-03-11T13:57:58,615 adding 'sglang/global_config.py' 2024-03-11T13:57:58,617 adding 'sglang/launch_server.py' 2024-03-11T13:57:58,619 adding 'sglang/utils.py' 2024-03-11T13:57:58,622 adding 'sglang/backend/__init__.py' 2024-03-11T13:57:58,624 adding 'sglang/backend/anthropic.py' 2024-03-11T13:57:58,626 adding 'sglang/backend/base_backend.py' 2024-03-11T13:57:58,630 adding 'sglang/backend/openai.py' 2024-03-11T13:57:58,632 adding 'sglang/backend/runtime_endpoint.py' 2024-03-11T13:57:58,635 adding 'sglang/backend/vertexai.py' 2024-03-11T13:57:58,638 adding 'sglang/lang/__init__.py' 2024-03-11T13:57:58,641 adding 'sglang/lang/chat_template.py' 2024-03-11T13:57:58,644 adding 'sglang/lang/compiler.py' 2024-03-11T13:57:58,650 adding 'sglang/lang/interpreter.py' 2024-03-11T13:57:58,654 adding 'sglang/lang/ir.py' 2024-03-11T13:57:58,657 adding 'sglang/lang/tracer.py' 2024-03-11T13:57:58,660 adding 'sglang/srt/backend_config.py' 2024-03-11T13:57:58,664 adding 'sglang/srt/conversation.py' 2024-03-11T13:57:58,667 adding 'sglang/srt/hf_transformers_utils.py' 2024-03-11T13:57:58,669 adding 'sglang/srt/memory_pool.py' 2024-03-11T13:57:58,672 adding 'sglang/srt/mm_utils.py' 2024-03-11T13:57:58,675 adding 'sglang/srt/model_config.py' 2024-03-11T13:57:58,677 adding 'sglang/srt/sampling_params.py' 2024-03-11T13:57:58,682 adding 'sglang/srt/server.py' 2024-03-11T13:57:58,686 adding 'sglang/srt/server_args.py' 2024-03-11T13:57:58,689 adding 'sglang/srt/utils.py' 2024-03-11T13:57:58,692 adding 'sglang/srt/constrained/__init__.py' 2024-03-11T13:57:58,694 adding 'sglang/srt/constrained/base_cache.py' 2024-03-11T13:57:58,697 adding 'sglang/srt/constrained/fsm_cache.py' 2024-03-11T13:57:58,699 adding 'sglang/srt/constrained/jump_forward.py' 2024-03-11T13:57:58,702 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-03-11T13:57:58,706 adding 'sglang/srt/layers/extend_attention.py' 2024-03-11T13:57:58,709 adding 'sglang/srt/layers/logits_processor.py' 2024-03-11T13:57:58,711 adding 'sglang/srt/layers/radix_attention.py' 2024-03-11T13:57:58,714 adding 'sglang/srt/layers/token_attention.py' 2024-03-11T13:57:58,718 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-03-11T13:57:58,720 adding 'sglang/srt/managers/io_struct.py' 2024-03-11T13:57:58,723 adding 'sglang/srt/managers/openai_protocol.py' 2024-03-11T13:57:58,725 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-03-11T13:57:58,728 adding 'sglang/srt/managers/router/infer_batch.py' 2024-03-11T13:57:58,730 adding 'sglang/srt/managers/router/manager.py' 2024-03-11T13:57:58,734 adding 'sglang/srt/managers/router/model_rpc.py' 2024-03-11T13:57:58,736 adding 'sglang/srt/managers/router/model_runner.py' 2024-03-11T13:57:58,738 adding 'sglang/srt/managers/router/radix_cache.py' 2024-03-11T13:57:58,739 adding 'sglang/srt/managers/router/scheduler.py' 2024-03-11T13:57:58,742 adding 'sglang/srt/models/gemma.py' 2024-03-11T13:57:58,744 adding 'sglang/srt/models/llama2.py' 2024-03-11T13:57:58,746 adding 'sglang/srt/models/llava.py' 2024-03-11T13:57:58,747 adding 'sglang/srt/models/mistral.py' 2024-03-11T13:57:58,749 adding 'sglang/srt/models/mixtral.py' 2024-03-11T13:57:58,751 adding 'sglang/srt/models/qwen.py' 2024-03-11T13:57:58,752 adding 'sglang/srt/models/qwen2.py' 2024-03-11T13:57:58,754 adding 'sglang/srt/models/yivl.py' 2024-03-11T13:57:58,756 adding 'sglang/test/test_conversation.py' 2024-03-11T13:57:58,757 adding 'sglang/test/test_openai_protocol.py' 2024-03-11T13:57:58,759 adding 'sglang/test/test_programs.py' 2024-03-11T13:57:58,760 adding 'sglang/test/test_utils.py' 2024-03-11T13:57:58,763 adding 'sglang-0.1.13.dist-info/LICENSE' 2024-03-11T13:57:58,767 adding 'sglang-0.1.13.dist-info/METADATA' 2024-03-11T13:57:58,769 adding 'sglang-0.1.13.dist-info/WHEEL' 2024-03-11T13:57:58,769 adding 'sglang-0.1.13.dist-info/top_level.txt' 2024-03-11T13:57:58,771 adding 'sglang-0.1.13.dist-info/RECORD' 2024-03-11T13:57:58,775 removing build/bdist.linux-armv7l/wheel 2024-03-11T13:57:58,909 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-03-11T13:57:58,916 Created wheel for sglang: filename=sglang-0.1.13-py3-none-any.whl size=124285 sha256=a52f32fcdfc81f57c0a67b780dd9560a923e45ee32854410deb59be7893c7ef8 2024-03-11T13:57:58,917 Stored in directory: /tmp/pip-ephem-wheel-cache-m74gik2g/wheels/09/c7/bf/4fc44d621171789abe2658d4f1d2e181edc147dfb6721bb2f5 2024-03-11T13:57:58,940 Successfully built sglang 2024-03-11T13:57:58,947 Removed build tracker: '/tmp/pip-build-tracker-872dfkv3'