2024-02-03T11:07:52,799 Created temporary directory: /tmp/pip-build-tracker-b6iszinu 2024-02-03T11:07:52,800 Initialized build tracking at /tmp/pip-build-tracker-b6iszinu 2024-02-03T11:07:52,801 Created build tracker: /tmp/pip-build-tracker-b6iszinu 2024-02-03T11:07:52,801 Entered build tracker: /tmp/pip-build-tracker-b6iszinu 2024-02-03T11:07:52,802 Created temporary directory: /tmp/pip-wheel-znbjrxvi 2024-02-03T11:07:52,805 Created temporary directory: /tmp/pip-ephem-wheel-cache-e9i9x7ot 2024-02-03T11:07:52,827 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-03T11:07:52,830 2 location(s) to search for versions of sglang: 2024-02-03T11:07:52,830 * https://pypi.org/simple/sglang/ 2024-02-03T11:07:52,830 * https://www.piwheels.org/simple/sglang/ 2024-02-03T11:07:52,831 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-02-03T11:07:52,832 Getting page https://pypi.org/simple/sglang/ 2024-02-03T11:07:52,833 Found index url https://pypi.org/simple/ 2024-02-03T11:07:53,044 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-02-03T11:07:53,048 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,049 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-02-03T11:07:53,050 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,050 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-02-03T11:07:53,051 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,052 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-02-03T11:07:53,053 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,054 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-02-03T11:07:53,055 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,055 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-02-03T11:07:53,056 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,057 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-02-03T11:07:53,058 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,059 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-02-03T11:07:53,059 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e2/c9/cc220d8db8e4a894e51bb6286a3e1b89b2de4b387ff4a2ea5b3809787165/sglang-0.1.11-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,060 Found link https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.11 2024-02-03T11:07:53,061 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-02-03T11:07:53,061 Getting page https://www.piwheels.org/simple/sglang/ 2024-02-03T11:07:53,063 Found index url https://www.piwheels.org/simple/ 2024-02-03T11:07:53,224 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-02-03T11:07:53,227 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.10-py3-none-any.whl#sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,228 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,228 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,228 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,229 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,229 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,230 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-02-03T11:07:53,231 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-02-03T11:07:53,231 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-02-03T11:07:53,250 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-02-03T11:07:53,268 Collecting sglang==0.1.11 2024-02-03T11:07:53,271 Created temporary directory: /tmp/pip-unpack-ocp65lqp 2024-02-03T11:07:53,575 Downloading sglang-0.1.11.tar.gz (111 kB) 2024-02-03T11:07:53,809 Added sglang==0.1.11 from https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz to build tracker '/tmp/pip-build-tracker-b6iszinu' 2024-02-03T11:07:53,814 Created temporary directory: /tmp/pip-build-env-lqjptdpc 2024-02-03T11:07:53,819 Installing build dependencies: started 2024-02-03T11:07:53,820 Running command pip subprocess to install build dependencies 2024-02-03T11:07:54,993 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-02-03T11:07:55,508 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-02-03T11:07:56,913 Collecting setuptools>=61.0 2024-02-03T11:07:56,927 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-02-03T11:07:57,146 Collecting wheel 2024-02-03T11:07:57,160 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-02-03T11:07:59,748 Installing collected packages: wheel, setuptools 2024-02-03T11:07:59,989 Creating /tmp/pip-build-env-lqjptdpc/overlay/local/bin 2024-02-03T11:07:59,991 changing mode of /tmp/pip-build-env-lqjptdpc/overlay/local/bin/wheel to 755 2024-02-03T11:08:02,350 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-02-03T11:08:02,677 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-02-03T11:08:02,677 [notice] To update, run: python3 -m pip install --upgrade pip 2024-02-03T11:08:02,947 Installing build dependencies: finished with status 'done' 2024-02-03T11:08:02,950 Getting requirements to build wheel: started 2024-02-03T11:08:02,952 Running command Getting requirements to build wheel 2024-02-03T11:08:03,760 running egg_info 2024-02-03T11:08:03,765 writing sglang.egg-info/PKG-INFO 2024-02-03T11:08:03,777 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-02-03T11:08:03,783 writing requirements to sglang.egg-info/requires.txt 2024-02-03T11:08:03,784 writing top-level names to sglang.egg-info/top_level.txt 2024-02-03T11:08:03,811 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:03,814 adding license file 'LICENSE' 2024-02-03T11:08:03,819 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:03,937 Getting requirements to build wheel: finished with status 'done' 2024-02-03T11:08:03,946 Created temporary directory: /tmp/pip-modern-metadata-tmv42o5g 2024-02-03T11:08:03,948 Preparing metadata (pyproject.toml): started 2024-02-03T11:08:03,950 Running command Preparing metadata (pyproject.toml) 2024-02-03T11:08:04,716 running dist_info 2024-02-03T11:08:04,721 creating /tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info 2024-02-03T11:08:04,725 writing /tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/PKG-INFO 2024-02-03T11:08:04,736 writing dependency_links to /tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/dependency_links.txt 2024-02-03T11:08:04,742 writing requirements to /tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/requires.txt 2024-02-03T11:08:04,743 writing top-level names to /tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/top_level.txt 2024-02-03T11:08:04,744 writing manifest file '/tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:04,766 reading manifest file '/tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:04,768 adding license file 'LICENSE' 2024-02-03T11:08:04,771 writing manifest file '/tmp/pip-modern-metadata-tmv42o5g/sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:04,772 creating '/tmp/pip-modern-metadata-tmv42o5g/sglang-0.1.11.dist-info' 2024-02-03T11:08:04,927 Preparing metadata (pyproject.toml): finished with status 'done' 2024-02-03T11:08:04,935 Source in /tmp/pip-wheel-znbjrxvi/sglang_275ff2cad6344f2d93dff034d587e316 has version 0.1.11, which satisfies requirement sglang==0.1.11 from https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz 2024-02-03T11:08:04,936 Removed sglang==0.1.11 from https://files.pythonhosted.org/packages/5a/5c/9b4a06cf511531979f7884d26a527fcf95da84a63a8e71eb53718023a190/sglang-0.1.11.tar.gz from build tracker '/tmp/pip-build-tracker-b6iszinu' 2024-02-03T11:08:04,948 Created temporary directory: /tmp/pip-unpack-p268zyks 2024-02-03T11:08:04,949 Created temporary directory: /tmp/pip-unpack-mp5i1rlk 2024-02-03T11:08:05,023 Building wheels for collected packages: sglang 2024-02-03T11:08:05,027 Created temporary directory: /tmp/pip-wheel-dwfk33xv 2024-02-03T11:08:05,028 Destination directory: /tmp/pip-wheel-dwfk33xv 2024-02-03T11:08:05,030 Building wheel for sglang (pyproject.toml): started 2024-02-03T11:08:05,031 Running command Building wheel for sglang (pyproject.toml) 2024-02-03T11:08:05,796 running bdist_wheel 2024-02-03T11:08:05,812 running build 2024-02-03T11:08:05,813 running build_py 2024-02-03T11:08:05,817 creating build 2024-02-03T11:08:05,818 creating build/lib 2024-02-03T11:08:05,818 creating build/lib/sglang 2024-02-03T11:08:05,820 copying sglang/__init__.py -> build/lib/sglang 2024-02-03T11:08:05,822 copying sglang/utils.py -> build/lib/sglang 2024-02-03T11:08:05,824 copying sglang/global_config.py -> build/lib/sglang 2024-02-03T11:08:05,826 copying sglang/api.py -> build/lib/sglang 2024-02-03T11:08:05,829 copying sglang/launch_server.py -> build/lib/sglang 2024-02-03T11:08:05,831 creating build/lib/sglang/srt 2024-02-03T11:08:05,832 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-02-03T11:08:05,835 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-02-03T11:08:05,838 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-02-03T11:08:05,840 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-02-03T11:08:05,843 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-02-03T11:08:05,846 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-02-03T11:08:05,849 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-02-03T11:08:05,851 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-02-03T11:08:05,855 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-02-03T11:08:05,857 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-02-03T11:08:05,861 creating build/lib/sglang/backend 2024-02-03T11:08:05,863 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-02-03T11:08:05,866 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-02-03T11:08:05,868 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-02-03T11:08:05,871 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-02-03T11:08:05,874 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-02-03T11:08:05,878 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-02-03T11:08:05,882 creating build/lib/sglang/test 2024-02-03T11:08:05,883 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-02-03T11:08:05,888 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-02-03T11:08:05,891 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-02-03T11:08:05,893 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-02-03T11:08:05,896 creating build/lib/sglang/lang 2024-02-03T11:08:05,897 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-02-03T11:08:05,900 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-02-03T11:08:05,902 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-02-03T11:08:05,905 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-02-03T11:08:05,909 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-02-03T11:08:05,913 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-02-03T11:08:05,918 creating build/lib/sglang/srt/models 2024-02-03T11:08:05,919 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,924 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,928 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,933 copying sglang/srt/models/yivl.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,938 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,943 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,949 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-02-03T11:08:05,955 creating build/lib/sglang/srt/managers 2024-02-03T11:08:05,957 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-02-03T11:08:05,961 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-02-03T11:08:05,964 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-02-03T11:08:05,967 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-02-03T11:08:05,971 creating build/lib/sglang/srt/layers 2024-02-03T11:08:05,972 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-02-03T11:08:05,975 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-02-03T11:08:05,977 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-02-03T11:08:05,979 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-02-03T11:08:05,981 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-02-03T11:08:05,984 creating build/lib/sglang/srt/constrained 2024-02-03T11:08:05,984 copying sglang/srt/constrained/json_schema.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,987 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,989 copying sglang/srt/constrained/base_cache.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,990 copying sglang/srt/constrained/fast_forward.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,992 copying sglang/srt/constrained/disk_cache.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,993 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,995 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:05,998 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-02-03T11:08:06,000 creating build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,001 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,003 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,006 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,008 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,010 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,012 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-02-03T11:08:06,014 running egg_info 2024-02-03T11:08:06,017 writing sglang.egg-info/PKG-INFO 2024-02-03T11:08:06,028 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-02-03T11:08:06,033 writing requirements to sglang.egg-info/requires.txt 2024-02-03T11:08:06,034 writing top-level names to sglang.egg-info/top_level.txt 2024-02-03T11:08:06,049 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:06,052 adding license file 'LICENSE' 2024-02-03T11:08:06,056 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-02-03T11:08:06,072 installing to build/bdist.linux-armv7l/wheel 2024-02-03T11:08:06,073 running install 2024-02-03T11:08:06,097 running install_lib 2024-02-03T11:08:06,101 creating build/bdist.linux-armv7l 2024-02-03T11:08:06,102 creating build/bdist.linux-armv7l/wheel 2024-02-03T11:08:06,103 creating build/bdist.linux-armv7l/wheel/sglang 2024-02-03T11:08:06,105 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,106 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,109 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,109 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,111 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,113 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,115 copying build/lib/sglang/srt/models/yivl.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,117 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,119 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,121 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-02-03T11:08:06,123 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,125 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,127 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,129 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,132 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-03T11:08:06,133 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-03T11:08:06,135 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-03T11:08:06,137 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-03T11:08:06,139 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-02-03T11:08:06,141 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,142 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,145 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,147 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,150 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,151 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,154 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-02-03T11:08:06,155 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,158 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,159 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,162 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-03T11:08:06,163 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-03T11:08:06,166 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-03T11:08:06,169 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-03T11:08:06,171 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-03T11:08:06,173 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-02-03T11:08:06,176 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,177 copying build/lib/sglang/srt/constrained/json_schema.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,179 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,181 copying build/lib/sglang/srt/constrained/base_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,183 copying build/lib/sglang/srt/constrained/fast_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,185 copying build/lib/sglang/srt/constrained/disk_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,187 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,189 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,191 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-02-03T11:08:06,193 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,194 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-02-03T11:08:06,197 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,198 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,200 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,202 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,204 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,206 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,208 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-02-03T11:08:06,210 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-03T11:08:06,211 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-03T11:08:06,213 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-02-03T11:08:06,214 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-03T11:08:06,217 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-03T11:08:06,218 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-03T11:08:06,220 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-02-03T11:08:06,223 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,224 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,226 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,228 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,230 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,232 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,235 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-02-03T11:08:06,237 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-03T11:08:06,239 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-03T11:08:06,241 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-02-03T11:08:06,242 running install_egg_info 2024-02-03T11:08:06,246 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.11-py3.11.egg-info 2024-02-03T11:08:06,255 running install_scripts 2024-02-03T11:08:06,276 creating build/bdist.linux-armv7l/wheel/sglang-0.1.11.dist-info/WHEEL 2024-02-03T11:08:06,278 creating '/tmp/pip-wheel-dwfk33xv/.tmp-aqqy5mu7/sglang-0.1.11-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-02-03T11:08:06,281 adding 'sglang/__init__.py' 2024-02-03T11:08:06,282 adding 'sglang/api.py' 2024-02-03T11:08:06,283 adding 'sglang/global_config.py' 2024-02-03T11:08:06,284 adding 'sglang/launch_server.py' 2024-02-03T11:08:06,286 adding 'sglang/utils.py' 2024-02-03T11:08:06,288 adding 'sglang/backend/__init__.py' 2024-02-03T11:08:06,289 adding 'sglang/backend/anthropic.py' 2024-02-03T11:08:06,290 adding 'sglang/backend/base_backend.py' 2024-02-03T11:08:06,292 adding 'sglang/backend/openai.py' 2024-02-03T11:08:06,293 adding 'sglang/backend/runtime_endpoint.py' 2024-02-03T11:08:06,295 adding 'sglang/backend/vertexai.py' 2024-02-03T11:08:06,297 adding 'sglang/lang/__init__.py' 2024-02-03T11:08:06,298 adding 'sglang/lang/chat_template.py' 2024-02-03T11:08:06,300 adding 'sglang/lang/compiler.py' 2024-02-03T11:08:06,303 adding 'sglang/lang/interpreter.py' 2024-02-03T11:08:06,305 adding 'sglang/lang/ir.py' 2024-02-03T11:08:06,306 adding 'sglang/lang/tracer.py' 2024-02-03T11:08:06,308 adding 'sglang/srt/backend_config.py' 2024-02-03T11:08:06,310 adding 'sglang/srt/conversation.py' 2024-02-03T11:08:06,312 adding 'sglang/srt/hf_transformers_utils.py' 2024-02-03T11:08:06,313 adding 'sglang/srt/memory_pool.py' 2024-02-03T11:08:06,315 adding 'sglang/srt/mm_utils.py' 2024-02-03T11:08:06,316 adding 'sglang/srt/model_config.py' 2024-02-03T11:08:06,318 adding 'sglang/srt/sampling_params.py' 2024-02-03T11:08:06,320 adding 'sglang/srt/server.py' 2024-02-03T11:08:06,322 adding 'sglang/srt/server_args.py' 2024-02-03T11:08:06,323 adding 'sglang/srt/utils.py' 2024-02-03T11:08:06,325 adding 'sglang/srt/constrained/base_cache.py' 2024-02-03T11:08:06,327 adding 'sglang/srt/constrained/disk_cache.py' 2024-02-03T11:08:06,328 adding 'sglang/srt/constrained/fast_forward.py' 2024-02-03T11:08:06,330 adding 'sglang/srt/constrained/fsm.py' 2024-02-03T11:08:06,331 adding 'sglang/srt/constrained/fsm_cache.py' 2024-02-03T11:08:06,334 adding 'sglang/srt/constrained/json_schema.py' 2024-02-03T11:08:06,336 adding 'sglang/srt/constrained/regex.py' 2024-02-03T11:08:06,338 adding 'sglang/srt/constrained/tokenizer.py' 2024-02-03T11:08:06,340 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-02-03T11:08:06,342 adding 'sglang/srt/layers/extend_attention.py' 2024-02-03T11:08:06,343 adding 'sglang/srt/layers/logits_processor.py' 2024-02-03T11:08:06,345 adding 'sglang/srt/layers/radix_attention.py' 2024-02-03T11:08:06,346 adding 'sglang/srt/layers/token_attention.py' 2024-02-03T11:08:06,348 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-02-03T11:08:06,350 adding 'sglang/srt/managers/io_struct.py' 2024-02-03T11:08:06,351 adding 'sglang/srt/managers/openai_protocol.py' 2024-02-03T11:08:06,353 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-02-03T11:08:06,356 adding 'sglang/srt/managers/router/infer_batch.py' 2024-02-03T11:08:06,357 adding 'sglang/srt/managers/router/manager.py' 2024-02-03T11:08:06,360 adding 'sglang/srt/managers/router/model_rpc.py' 2024-02-03T11:08:06,363 adding 'sglang/srt/managers/router/model_runner.py' 2024-02-03T11:08:06,364 adding 'sglang/srt/managers/router/radix_cache.py' 2024-02-03T11:08:06,366 adding 'sglang/srt/managers/router/scheduler.py' 2024-02-03T11:08:06,368 adding 'sglang/srt/models/llama2.py' 2024-02-03T11:08:06,370 adding 'sglang/srt/models/llava.py' 2024-02-03T11:08:06,372 adding 'sglang/srt/models/mistral.py' 2024-02-03T11:08:06,374 adding 'sglang/srt/models/mixtral.py' 2024-02-03T11:08:06,375 adding 'sglang/srt/models/qwen.py' 2024-02-03T11:08:06,377 adding 'sglang/srt/models/qwen2.py' 2024-02-03T11:08:06,378 adding 'sglang/srt/models/yivl.py' 2024-02-03T11:08:06,380 adding 'sglang/test/test_conversation.py' 2024-02-03T11:08:06,381 adding 'sglang/test/test_openai_protocol.py' 2024-02-03T11:08:06,383 adding 'sglang/test/test_programs.py' 2024-02-03T11:08:06,384 adding 'sglang/test/test_utils.py' 2024-02-03T11:08:06,387 adding 'sglang-0.1.11.dist-info/LICENSE' 2024-02-03T11:08:06,391 adding 'sglang-0.1.11.dist-info/METADATA' 2024-02-03T11:08:06,392 adding 'sglang-0.1.11.dist-info/WHEEL' 2024-02-03T11:08:06,393 adding 'sglang-0.1.11.dist-info/top_level.txt' 2024-02-03T11:08:06,394 adding 'sglang-0.1.11.dist-info/RECORD' 2024-02-03T11:08:06,398 removing build/bdist.linux-armv7l/wheel 2024-02-03T11:08:06,533 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-02-03T11:08:06,540 Created wheel for sglang: filename=sglang-0.1.11-py3-none-any.whl size=130965 sha256=464124ce4f7e5d1ab437a9cef13a7188e0f71f1a6b07ed81c3d3d1e0c818a1b6 2024-02-03T11:08:06,542 Stored in directory: /tmp/pip-ephem-wheel-cache-e9i9x7ot/wheels/c0/64/12/fdf2fc41a59c6ad7594bf897d6fd175ab84c225b6fa800878f 2024-02-03T11:08:06,564 Successfully built sglang 2024-02-03T11:08:06,570 Removed build tracker: '/tmp/pip-build-tracker-b6iszinu'