2024-01-30T16:47:49,842 Created temporary directory: /tmp/pip-build-tracker-xuj5hf_y 2024-01-30T16:47:49,843 Initialized build tracking at /tmp/pip-build-tracker-xuj5hf_y 2024-01-30T16:47:49,844 Created build tracker: /tmp/pip-build-tracker-xuj5hf_y 2024-01-30T16:47:49,844 Entered build tracker: /tmp/pip-build-tracker-xuj5hf_y 2024-01-30T16:47:49,845 Created temporary directory: /tmp/pip-wheel-vysiq1gn 2024-01-30T16:47:49,848 Created temporary directory: /tmp/pip-ephem-wheel-cache-rjmptns7 2024-01-30T16:47:49,872 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-30T16:47:49,875 2 location(s) to search for versions of sglang: 2024-01-30T16:47:49,875 * https://pypi.org/simple/sglang/ 2024-01-30T16:47:49,875 * https://www.piwheels.org/simple/sglang/ 2024-01-30T16:47:49,876 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-01-30T16:47:49,877 Getting page https://pypi.org/simple/sglang/ 2024-01-30T16:47:49,878 Found index url https://pypi.org/simple/ 2024-01-30T16:47:50,094 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-01-30T16:47:50,098 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,099 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-01-30T16:47:50,099 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,100 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-01-30T16:47:50,101 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,102 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-01-30T16:47:50,102 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,103 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-01-30T16:47:50,104 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,105 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-01-30T16:47:50,105 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/87/17/0d464cee3699ffa32a7bd4c303f0101ebd689a6acb8280ee4c639a2e99b6/sglang-0.1.9-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,106 Found link https://files.pythonhosted.org/packages/c4/2a/c38651dd14340e5f8f0831889dd6b01cc066e66653dcdb918930fb811a57/sglang-0.1.9.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.9 2024-01-30T16:47:50,107 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/d0/db/e165ee697ca4587a364318d6875d0805b4db3108c265f6f7ed4ab4b1d772/sglang-0.1.10-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,108 Found link https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.10 2024-01-30T16:47:50,109 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-01-30T16:47:50,109 Getting page https://www.piwheels.org/simple/sglang/ 2024-01-30T16:47:50,110 Found index url https://www.piwheels.org/simple/ 2024-01-30T16:47:50,264 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-01-30T16:47:50,267 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.9-py3-none-any.whl#sha256=81673053b4db8425bc93aeb36396347d3af70a05d4196a0555e0cc2fe0a6b603 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,268 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.7-py3-none-any.whl#sha256=7a5879c93675e35b86be714fc0ce7d63b592b644d1e1cd6b6134ee61f5ba5673 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,268 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.6-py3-none-any.whl#sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,269 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,269 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,270 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-30T16:47:50,270 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-01-30T16:47:50,271 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-01-30T16:47:50,290 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-01-30T16:47:50,308 Collecting sglang==0.1.10 2024-01-30T16:47:50,310 Created temporary directory: /tmp/pip-unpack-hi7uo_2i 2024-01-30T16:47:50,521 Downloading sglang-0.1.10.tar.gz (108 kB) 2024-01-30T16:47:50,729 Added sglang==0.1.10 from https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz to build tracker '/tmp/pip-build-tracker-xuj5hf_y' 2024-01-30T16:47:50,734 Created temporary directory: /tmp/pip-build-env-ajapmgla 2024-01-30T16:47:50,739 Installing build dependencies: started 2024-01-30T16:47:50,740 Running command pip subprocess to install build dependencies 2024-01-30T16:47:51,882 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2024-01-30T16:47:52,381 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-30T16:47:53,785 Collecting setuptools>=61.0 2024-01-30T16:47:53,799 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-01-30T16:47:54,020 Collecting wheel 2024-01-30T16:47:54,036 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-01-30T16:47:56,623 Installing collected packages: wheel, setuptools 2024-01-30T16:47:56,845 Creating /tmp/pip-build-env-ajapmgla/overlay/local/bin 2024-01-30T16:47:56,847 changing mode of /tmp/pip-build-env-ajapmgla/overlay/local/bin/wheel to 755 2024-01-30T16:47:59,091 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-01-30T16:47:59,347 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-01-30T16:47:59,347 [notice] To update, run: python3 -m pip install --upgrade pip 2024-01-30T16:47:59,621 Installing build dependencies: finished with status 'done' 2024-01-30T16:47:59,625 Getting requirements to build wheel: started 2024-01-30T16:47:59,626 Running command Getting requirements to build wheel 2024-01-30T16:48:00,470 running egg_info 2024-01-30T16:48:00,474 writing sglang.egg-info/PKG-INFO 2024-01-30T16:48:00,485 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-30T16:48:00,491 writing requirements to sglang.egg-info/requires.txt 2024-01-30T16:48:00,492 writing top-level names to sglang.egg-info/top_level.txt 2024-01-30T16:48:00,519 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:00,522 adding license file 'LICENSE' 2024-01-30T16:48:00,527 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:00,646 Getting requirements to build wheel: finished with status 'done' 2024-01-30T16:48:00,657 Created temporary directory: /tmp/pip-modern-metadata-6ba_9mrr 2024-01-30T16:48:00,659 Preparing metadata (pyproject.toml): started 2024-01-30T16:48:00,660 Running command Preparing metadata (pyproject.toml) 2024-01-30T16:48:01,439 running dist_info 2024-01-30T16:48:01,444 creating /tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info 2024-01-30T16:48:01,448 writing /tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/PKG-INFO 2024-01-30T16:48:01,460 writing dependency_links to /tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/dependency_links.txt 2024-01-30T16:48:01,465 writing requirements to /tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/requires.txt 2024-01-30T16:48:01,466 writing top-level names to /tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/top_level.txt 2024-01-30T16:48:01,468 writing manifest file '/tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:01,490 reading manifest file '/tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:01,492 adding license file 'LICENSE' 2024-01-30T16:48:01,496 writing manifest file '/tmp/pip-modern-metadata-6ba_9mrr/sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:01,497 creating '/tmp/pip-modern-metadata-6ba_9mrr/sglang-0.1.10.dist-info' 2024-01-30T16:48:01,654 Preparing metadata (pyproject.toml): finished with status 'done' 2024-01-30T16:48:01,662 Source in /tmp/pip-wheel-vysiq1gn/sglang_c6bfe5b351fc400bbd9fb0cfe7a1246c has version 0.1.10, which satisfies requirement sglang==0.1.10 from https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz 2024-01-30T16:48:01,663 Removed sglang==0.1.10 from https://files.pythonhosted.org/packages/56/5c/a980d29b6e83c8ee4b0c3098c8fedbcb910e61b6aa2453d6cfcc34e59512/sglang-0.1.10.tar.gz from build tracker '/tmp/pip-build-tracker-xuj5hf_y' 2024-01-30T16:48:01,674 Created temporary directory: /tmp/pip-unpack-gyk78hrt 2024-01-30T16:48:01,675 Created temporary directory: /tmp/pip-unpack-6g2ytcv2 2024-01-30T16:48:01,748 Building wheels for collected packages: sglang 2024-01-30T16:48:01,752 Created temporary directory: /tmp/pip-wheel-ollw1pkk 2024-01-30T16:48:01,753 Destination directory: /tmp/pip-wheel-ollw1pkk 2024-01-30T16:48:01,755 Building wheel for sglang (pyproject.toml): started 2024-01-30T16:48:01,757 Running command Building wheel for sglang (pyproject.toml) 2024-01-30T16:48:02,504 running bdist_wheel 2024-01-30T16:48:02,520 running build 2024-01-30T16:48:02,520 running build_py 2024-01-30T16:48:02,525 creating build 2024-01-30T16:48:02,526 creating build/lib 2024-01-30T16:48:02,526 creating build/lib/sglang 2024-01-30T16:48:02,527 copying sglang/launch_server.py -> build/lib/sglang 2024-01-30T16:48:02,529 copying sglang/__init__.py -> build/lib/sglang 2024-01-30T16:48:02,531 copying sglang/api.py -> build/lib/sglang 2024-01-30T16:48:02,533 copying sglang/global_config.py -> build/lib/sglang 2024-01-30T16:48:02,534 copying sglang/utils.py -> build/lib/sglang 2024-01-30T16:48:02,537 creating build/lib/sglang/backend 2024-01-30T16:48:02,538 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-01-30T16:48:02,540 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-01-30T16:48:02,542 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-01-30T16:48:02,543 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-01-30T16:48:02,545 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-01-30T16:48:02,547 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-01-30T16:48:02,549 creating build/lib/sglang/test 2024-01-30T16:48:02,550 copying sglang/test/test_openai_protocol.py -> build/lib/sglang/test 2024-01-30T16:48:02,552 copying sglang/test/test_conversation.py -> build/lib/sglang/test 2024-01-30T16:48:02,553 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-01-30T16:48:02,555 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-01-30T16:48:02,558 creating build/lib/sglang/lang 2024-01-30T16:48:02,559 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-01-30T16:48:02,561 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-01-30T16:48:02,563 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-01-30T16:48:02,566 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-01-30T16:48:02,576 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-01-30T16:48:02,578 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-01-30T16:48:02,581 creating build/lib/sglang/srt 2024-01-30T16:48:02,582 copying sglang/srt/mm_utils.py -> build/lib/sglang/srt 2024-01-30T16:48:02,584 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-01-30T16:48:02,586 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-01-30T16:48:02,588 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-01-30T16:48:02,590 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-01-30T16:48:02,593 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-01-30T16:48:02,595 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-01-30T16:48:02,597 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-01-30T16:48:02,599 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-01-30T16:48:02,601 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-01-30T16:48:02,603 creating build/lib/sglang/srt/constrained 2024-01-30T16:48:02,604 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,607 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,609 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,611 copying sglang/srt/constrained/json_schema.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,613 copying sglang/srt/constrained/disk_cache.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,615 copying sglang/srt/constrained/fast_forward.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,617 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-01-30T16:48:02,619 creating build/lib/sglang/srt/managers 2024-01-30T16:48:02,621 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-01-30T16:48:02,623 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-30T16:48:02,625 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-30T16:48:02,627 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-01-30T16:48:02,629 creating build/lib/sglang/srt/layers 2024-01-30T16:48:02,630 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-01-30T16:48:02,633 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-01-30T16:48:02,634 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-01-30T16:48:02,636 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-01-30T16:48:02,639 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-01-30T16:48:02,641 creating build/lib/sglang/srt/models 2024-01-30T16:48:02,642 copying sglang/srt/models/mistral.py -> build/lib/sglang/srt/models 2024-01-30T16:48:02,644 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-01-30T16:48:02,646 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-01-30T16:48:02,649 copying sglang/srt/models/qwen.py -> build/lib/sglang/srt/models 2024-01-30T16:48:02,651 copying sglang/srt/models/qwen2.py -> build/lib/sglang/srt/models 2024-01-30T16:48:02,653 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-01-30T16:48:02,656 creating build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,657 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,659 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,661 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,663 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,666 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,668 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-01-30T16:48:02,671 running egg_info 2024-01-30T16:48:02,674 writing sglang.egg-info/PKG-INFO 2024-01-30T16:48:02,685 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-30T16:48:02,690 writing requirements to sglang.egg-info/requires.txt 2024-01-30T16:48:02,691 writing top-level names to sglang.egg-info/top_level.txt 2024-01-30T16:48:02,706 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:02,709 adding license file 'LICENSE' 2024-01-30T16:48:02,713 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-30T16:48:02,730 installing to build/bdist.linux-armv7l/wheel 2024-01-30T16:48:02,730 running install 2024-01-30T16:48:02,754 running install_lib 2024-01-30T16:48:02,759 creating build/bdist.linux-armv7l 2024-01-30T16:48:02,759 creating build/bdist.linux-armv7l/wheel 2024-01-30T16:48:02,761 creating build/bdist.linux-armv7l/wheel/sglang 2024-01-30T16:48:02,762 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,763 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,766 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,768 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,770 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,771 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,774 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-30T16:48:02,777 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-01-30T16:48:02,778 copying build/lib/sglang/test/test_openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-30T16:48:02,780 copying build/lib/sglang/test/test_conversation.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-30T16:48:02,782 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-30T16:48:02,784 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-30T16:48:02,787 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,787 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,790 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,793 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,795 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,797 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,798 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-30T16:48:02,801 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-30T16:48:02,803 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,804 copying build/lib/sglang/srt/mm_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,806 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,808 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,811 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,811 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,814 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,816 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,818 copying build/lib/sglang/srt/constrained/json_schema.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,821 copying build/lib/sglang/srt/constrained/disk_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,823 copying build/lib/sglang/srt/constrained/fast_forward.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,825 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-30T16:48:02,827 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,830 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-30T16:48:02,831 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-30T16:48:02,833 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-30T16:48:02,835 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-30T16:48:02,838 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,839 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,841 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,843 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,846 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,848 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,851 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-30T16:48:02,853 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-30T16:48:02,855 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-30T16:48:02,856 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-30T16:48:02,858 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-30T16:48:02,860 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-30T16:48:02,862 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-30T16:48:02,865 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-30T16:48:02,867 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,869 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,872 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,874 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,876 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,878 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-30T16:48:02,880 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,881 copying build/lib/sglang/srt/models/mistral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,883 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,885 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,888 copying build/lib/sglang/srt/models/qwen.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,890 copying build/lib/sglang/srt/models/qwen2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,893 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-30T16:48:02,895 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-30T16:48:02,897 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-30T16:48:02,899 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-30T16:48:02,901 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-30T16:48:02,903 running install_egg_info 2024-01-30T16:48:02,906 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.10-py3.11.egg-info 2024-01-30T16:48:02,916 running install_scripts 2024-01-30T16:48:02,937 creating build/bdist.linux-armv7l/wheel/sglang-0.1.10.dist-info/WHEEL 2024-01-30T16:48:02,939 creating '/tmp/pip-wheel-ollw1pkk/.tmp-rekwq8mk/sglang-0.1.10-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-01-30T16:48:02,942 adding 'sglang/__init__.py' 2024-01-30T16:48:02,943 adding 'sglang/api.py' 2024-01-30T16:48:02,945 adding 'sglang/global_config.py' 2024-01-30T16:48:02,946 adding 'sglang/launch_server.py' 2024-01-30T16:48:02,948 adding 'sglang/utils.py' 2024-01-30T16:48:02,949 adding 'sglang/backend/__init__.py' 2024-01-30T16:48:02,951 adding 'sglang/backend/anthropic.py' 2024-01-30T16:48:02,952 adding 'sglang/backend/base_backend.py' 2024-01-30T16:48:02,954 adding 'sglang/backend/openai.py' 2024-01-30T16:48:02,955 adding 'sglang/backend/runtime_endpoint.py' 2024-01-30T16:48:02,957 adding 'sglang/backend/vertexai.py' 2024-01-30T16:48:02,959 adding 'sglang/lang/__init__.py' 2024-01-30T16:48:02,960 adding 'sglang/lang/chat_template.py' 2024-01-30T16:48:02,962 adding 'sglang/lang/compiler.py' 2024-01-30T16:48:02,965 adding 'sglang/lang/interpreter.py' 2024-01-30T16:48:02,967 adding 'sglang/lang/ir.py' 2024-01-30T16:48:02,968 adding 'sglang/lang/tracer.py' 2024-01-30T16:48:02,970 adding 'sglang/srt/backend_config.py' 2024-01-30T16:48:02,972 adding 'sglang/srt/conversation.py' 2024-01-30T16:48:02,973 adding 'sglang/srt/hf_transformers_utils.py' 2024-01-30T16:48:02,975 adding 'sglang/srt/memory_pool.py' 2024-01-30T16:48:02,976 adding 'sglang/srt/mm_utils.py' 2024-01-30T16:48:02,977 adding 'sglang/srt/model_config.py' 2024-01-30T16:48:02,979 adding 'sglang/srt/sampling_params.py' 2024-01-30T16:48:02,981 adding 'sglang/srt/server.py' 2024-01-30T16:48:02,982 adding 'sglang/srt/server_args.py' 2024-01-30T16:48:02,984 adding 'sglang/srt/utils.py' 2024-01-30T16:48:02,986 adding 'sglang/srt/constrained/disk_cache.py' 2024-01-30T16:48:02,987 adding 'sglang/srt/constrained/fast_forward.py' 2024-01-30T16:48:02,989 adding 'sglang/srt/constrained/fsm.py' 2024-01-30T16:48:02,990 adding 'sglang/srt/constrained/fsm_cache.py' 2024-01-30T16:48:02,992 adding 'sglang/srt/constrained/json_schema.py' 2024-01-30T16:48:02,995 adding 'sglang/srt/constrained/regex.py' 2024-01-30T16:48:02,996 adding 'sglang/srt/constrained/tokenizer.py' 2024-01-30T16:48:02,998 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-01-30T16:48:03,000 adding 'sglang/srt/layers/extend_attention.py' 2024-01-30T16:48:03,001 adding 'sglang/srt/layers/logits_processor.py' 2024-01-30T16:48:03,003 adding 'sglang/srt/layers/radix_attention.py' 2024-01-30T16:48:03,004 adding 'sglang/srt/layers/token_attention.py' 2024-01-30T16:48:03,006 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-01-30T16:48:03,007 adding 'sglang/srt/managers/io_struct.py' 2024-01-30T16:48:03,009 adding 'sglang/srt/managers/openai_protocol.py' 2024-01-30T16:48:03,010 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-01-30T16:48:03,013 adding 'sglang/srt/managers/router/infer_batch.py' 2024-01-30T16:48:03,015 adding 'sglang/srt/managers/router/manager.py' 2024-01-30T16:48:03,017 adding 'sglang/srt/managers/router/model_rpc.py' 2024-01-30T16:48:03,020 adding 'sglang/srt/managers/router/model_runner.py' 2024-01-30T16:48:03,021 adding 'sglang/srt/managers/router/radix_cache.py' 2024-01-30T16:48:03,022 adding 'sglang/srt/managers/router/scheduler.py' 2024-01-30T16:48:03,025 adding 'sglang/srt/models/llama2.py' 2024-01-30T16:48:03,027 adding 'sglang/srt/models/llava.py' 2024-01-30T16:48:03,028 adding 'sglang/srt/models/mistral.py' 2024-01-30T16:48:03,030 adding 'sglang/srt/models/mixtral.py' 2024-01-30T16:48:03,032 adding 'sglang/srt/models/qwen.py' 2024-01-30T16:48:03,033 adding 'sglang/srt/models/qwen2.py' 2024-01-30T16:48:03,035 adding 'sglang/test/test_conversation.py' 2024-01-30T16:48:03,037 adding 'sglang/test/test_openai_protocol.py' 2024-01-30T16:48:03,038 adding 'sglang/test/test_programs.py' 2024-01-30T16:48:03,040 adding 'sglang/test/test_utils.py' 2024-01-30T16:48:03,043 adding 'sglang-0.1.10.dist-info/LICENSE' 2024-01-30T16:48:03,046 adding 'sglang-0.1.10.dist-info/METADATA' 2024-01-30T16:48:03,048 adding 'sglang-0.1.10.dist-info/WHEEL' 2024-01-30T16:48:03,049 adding 'sglang-0.1.10.dist-info/top_level.txt' 2024-01-30T16:48:03,050 adding 'sglang-0.1.10.dist-info/RECORD' 2024-01-30T16:48:03,053 removing build/bdist.linux-armv7l/wheel 2024-01-30T16:48:03,191 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-01-30T16:48:03,199 Created wheel for sglang: filename=sglang-0.1.10-py3-none-any.whl size=127250 sha256=d9494e2b06cd8f0c4cb1de8c4109d83fcd660f71bc135a1d417920d84016b865 2024-01-30T16:48:03,200 Stored in directory: /tmp/pip-ephem-wheel-cache-rjmptns7/wheels/ae/93/37/47703ba0b0612e4f7658c170e844457c18111462b164bab72e 2024-01-30T16:48:03,222 Successfully built sglang 2024-01-30T16:48:03,229 Removed build tracker: '/tmp/pip-build-tracker-xuj5hf_y'