2024-01-21T10:34:19,568 Created temporary directory: /tmp/pip-build-tracker-li1byiuj 2024-01-21T10:34:19,570 Initialized build tracking at /tmp/pip-build-tracker-li1byiuj 2024-01-21T10:34:19,571 Created build tracker: /tmp/pip-build-tracker-li1byiuj 2024-01-21T10:34:19,572 Entered build tracker: /tmp/pip-build-tracker-li1byiuj 2024-01-21T10:34:19,573 Created temporary directory: /tmp/pip-wheel-nxas6bre 2024-01-21T10:34:19,576 Created temporary directory: /tmp/pip-ephem-wheel-cache-xzpxhlkx 2024-01-21T10:34:19,598 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-21T10:34:19,601 2 location(s) to search for versions of sglang: 2024-01-21T10:34:19,601 * https://pypi.org/simple/sglang/ 2024-01-21T10:34:19,601 * https://www.piwheels.org/simple/sglang/ 2024-01-21T10:34:19,602 Fetching project page and analyzing links: https://pypi.org/simple/sglang/ 2024-01-21T10:34:19,603 Getting page https://pypi.org/simple/sglang/ 2024-01-21T10:34:19,604 Found index url https://pypi.org/simple/ 2024-01-21T10:34:19,818 Fetched page https://pypi.org/simple/sglang/ as application/vnd.pypi.simple.v1+json 2024-01-21T10:34:19,821 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/48/09/ec2148b11ce6bf61779e10f84512297bc864616186af7218b592843c9c98/sglang-0.1.3-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:19,822 Found link https://files.pythonhosted.org/packages/57/da/de7888a03b055bad078664e7eff5228121139948b5ed89154f786348ebfb/sglang-0.1.3.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.3 2024-01-21T10:34:19,822 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/25/34/2fabea340f542cec32d0ad7a54297fcfadbe6531c15545c7270c5d0cc28e/sglang-0.1.4-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:19,823 Found link https://files.pythonhosted.org/packages/74/45/f7e4a283e5193b6c41bf1ad0a37b793a19e0785ceee0cd683e1fff4c985f/sglang-0.1.4.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.4 2024-01-21T10:34:19,824 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/f8/aa/662724d26d2e2c71679782904b5f861fa997d4db74950d547b2b8920e6b9/sglang-0.1.5-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:19,825 Found link https://files.pythonhosted.org/packages/51/54/c4a181f909bed9a9ae815f6a7c1633d79980eedb539ddee505f5ef8bd585/sglang-0.1.5.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.5 2024-01-21T10:34:19,826 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/e4/fe/80e11a19695d7a4c0f6f2cae18caebfa04f719d4ca1faf2c8fd0193899f4/sglang-0.1.6-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:19,827 Found link https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.6 2024-01-21T10:34:19,827 Skipping link: No binaries permitted for sglang: https://files.pythonhosted.org/packages/bc/f5/fa697f040fe431471b4d9a17b1d7e8d5d9a82c6dfc9d8cc589cd6142fbce/sglang-0.1.7-py3-none-any.whl (from https://pypi.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:19,828 Found link https://files.pythonhosted.org/packages/1e/ef/18d21637138f3cfadd8aa963e76114b17eaa2fd2efa40ed47e16c869134d/sglang-0.1.7.tar.gz (from https://pypi.org/simple/sglang/) (requires-python:>=3.8), version: 0.1.7 2024-01-21T10:34:19,829 Fetching project page and analyzing links: https://www.piwheels.org/simple/sglang/ 2024-01-21T10:34:19,830 Getting page https://www.piwheels.org/simple/sglang/ 2024-01-21T10:34:19,831 Found index url https://www.piwheels.org/simple/ 2024-01-21T10:34:20,011 Fetched page https://www.piwheels.org/simple/sglang/ as text/html 2024-01-21T10:34:20,013 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.5-py3-none-any.whl#sha256=6791409ee36bad6d954df6d8c0bda108bad71ca99c49ff1e977ec26c48ca0d68 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:20,014 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.4-py3-none-any.whl#sha256=1e38d5f137a6a1ff3f01e3d8cffdfcabb4766b14c10c681b61e61ee8bc410ebe (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:20,015 Skipping link: No binaries permitted for sglang: https://www.piwheels.org/simple/sglang/sglang-0.1.3-py3-none-any.whl#sha256=0c32d95f224163ec4f8e7983c989732d96b7dd966f5430b2263e4451c5eaa827 (from https://www.piwheels.org/simple/sglang/) (requires-python:>=3.8) 2024-01-21T10:34:20,015 Skipping link: not a file: https://www.piwheels.org/simple/sglang/ 2024-01-21T10:34:20,016 Skipping link: not a file: https://pypi.org/simple/sglang/ 2024-01-21T10:34:20,036 Given no hashes to check 1 links for project 'sglang': discarding no candidates 2024-01-21T10:34:20,055 Collecting sglang==0.1.6 2024-01-21T10:34:20,057 Created temporary directory: /tmp/pip-unpack-q3mvgdpb 2024-01-21T10:34:20,267 Downloading sglang-0.1.6.tar.gz (92 kB) 2024-01-21T10:34:20,457 Added sglang==0.1.6 from https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz to build tracker '/tmp/pip-build-tracker-li1byiuj' 2024-01-21T10:34:20,463 Created temporary directory: /tmp/pip-build-env-xiaqjahr 2024-01-21T10:34:20,467 Installing build dependencies: started 2024-01-21T10:34:20,469 Running command pip subprocess to install build dependencies 2024-01-21T10:34:21,669 Using pip 23.3.1 from /home/piwheels/.local/lib/python3.11/site-packages/pip (python 3.11) 2024-01-21T10:34:22,216 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-01-21T10:34:23,640 Collecting setuptools>=61.0 2024-01-21T10:34:23,655 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.3-py3-none-any.whl (819 kB) 2024-01-21T10:34:23,894 Collecting wheel 2024-01-21T10:34:23,909 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2024-01-21T10:34:26,647 Installing collected packages: wheel, setuptools 2024-01-21T10:34:26,878 Creating /tmp/pip-build-env-xiaqjahr/overlay/local/bin 2024-01-21T10:34:26,880 changing mode of /tmp/pip-build-env-xiaqjahr/overlay/local/bin/wheel to 755 2024-01-21T10:34:29,184 Successfully installed setuptools-69.0.3 wheel-0.42.0 2024-01-21T10:34:29,449 [notice] A new release of pip is available: 23.3.1 -> 23.3.2 2024-01-21T10:34:29,450 [notice] To update, run: python3 -m pip install --upgrade pip 2024-01-21T10:34:29,719 Installing build dependencies: finished with status 'done' 2024-01-21T10:34:29,722 Getting requirements to build wheel: started 2024-01-21T10:34:29,724 Running command Getting requirements to build wheel 2024-01-21T10:34:30,579 running egg_info 2024-01-21T10:34:30,583 writing sglang.egg-info/PKG-INFO 2024-01-21T10:34:30,593 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-21T10:34:30,598 writing requirements to sglang.egg-info/requires.txt 2024-01-21T10:34:30,599 writing top-level names to sglang.egg-info/top_level.txt 2024-01-21T10:34:30,626 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:30,629 adding license file 'LICENSE' 2024-01-21T10:34:30,633 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:30,751 Getting requirements to build wheel: finished with status 'done' 2024-01-21T10:34:30,761 Created temporary directory: /tmp/pip-modern-metadata-m3obybnt 2024-01-21T10:34:30,764 Preparing metadata (pyproject.toml): started 2024-01-21T10:34:30,765 Running command Preparing metadata (pyproject.toml) 2024-01-21T10:34:31,548 running dist_info 2024-01-21T10:34:31,553 creating /tmp/pip-modern-metadata-m3obybnt/sglang.egg-info 2024-01-21T10:34:31,557 writing /tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/PKG-INFO 2024-01-21T10:34:31,568 writing dependency_links to /tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/dependency_links.txt 2024-01-21T10:34:31,572 writing requirements to /tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/requires.txt 2024-01-21T10:34:31,573 writing top-level names to /tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/top_level.txt 2024-01-21T10:34:31,575 writing manifest file '/tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:31,597 reading manifest file '/tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:31,599 adding license file 'LICENSE' 2024-01-21T10:34:31,602 writing manifest file '/tmp/pip-modern-metadata-m3obybnt/sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:31,603 creating '/tmp/pip-modern-metadata-m3obybnt/sglang-0.1.6.dist-info' 2024-01-21T10:34:31,757 Preparing metadata (pyproject.toml): finished with status 'done' 2024-01-21T10:34:31,765 Source in /tmp/pip-wheel-nxas6bre/sglang_7af7c670d7fa4e2a90ce008660afb9a0 has version 0.1.6, which satisfies requirement sglang==0.1.6 from https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz 2024-01-21T10:34:31,766 Removed sglang==0.1.6 from https://files.pythonhosted.org/packages/60/16/38ec94038aeba72a07879ea336269ef79eff4ec10e523366b642b1f0efbb/sglang-0.1.6.tar.gz from build tracker '/tmp/pip-build-tracker-li1byiuj' 2024-01-21T10:34:31,777 Created temporary directory: /tmp/pip-unpack-gw1pg72a 2024-01-21T10:34:31,778 Created temporary directory: /tmp/pip-unpack-jl61epc2 2024-01-21T10:34:31,838 Building wheels for collected packages: sglang 2024-01-21T10:34:31,843 Created temporary directory: /tmp/pip-wheel-w0uc4os2 2024-01-21T10:34:31,843 Destination directory: /tmp/pip-wheel-w0uc4os2 2024-01-21T10:34:31,845 Building wheel for sglang (pyproject.toml): started 2024-01-21T10:34:31,847 Running command Building wheel for sglang (pyproject.toml) 2024-01-21T10:34:32,602 running bdist_wheel 2024-01-21T10:34:32,619 running build 2024-01-21T10:34:32,619 running build_py 2024-01-21T10:34:32,623 creating build 2024-01-21T10:34:32,624 creating build/lib 2024-01-21T10:34:32,625 creating build/lib/sglang 2024-01-21T10:34:32,626 copying sglang/__init__.py -> build/lib/sglang 2024-01-21T10:34:32,628 copying sglang/utils.py -> build/lib/sglang 2024-01-21T10:34:32,630 copying sglang/api.py -> build/lib/sglang 2024-01-21T10:34:32,632 copying sglang/flush_cache.py -> build/lib/sglang 2024-01-21T10:34:32,634 copying sglang/global_config.py -> build/lib/sglang 2024-01-21T10:34:32,636 copying sglang/launch_server.py -> build/lib/sglang 2024-01-21T10:34:32,638 creating build/lib/sglang/backend 2024-01-21T10:34:32,639 copying sglang/backend/vertexai.py -> build/lib/sglang/backend 2024-01-21T10:34:32,641 copying sglang/backend/anthropic.py -> build/lib/sglang/backend 2024-01-21T10:34:32,643 copying sglang/backend/__init__.py -> build/lib/sglang/backend 2024-01-21T10:34:32,644 copying sglang/backend/base_backend.py -> build/lib/sglang/backend 2024-01-21T10:34:32,646 copying sglang/backend/runtime_endpoint.py -> build/lib/sglang/backend 2024-01-21T10:34:32,648 copying sglang/backend/openai.py -> build/lib/sglang/backend 2024-01-21T10:34:32,651 creating build/lib/sglang/lang 2024-01-21T10:34:32,652 copying sglang/lang/__init__.py -> build/lib/sglang/lang 2024-01-21T10:34:32,653 copying sglang/lang/ir.py -> build/lib/sglang/lang 2024-01-21T10:34:32,656 copying sglang/lang/chat_template.py -> build/lib/sglang/lang 2024-01-21T10:34:32,658 copying sglang/lang/tracer.py -> build/lib/sglang/lang 2024-01-21T10:34:32,660 copying sglang/lang/compiler.py -> build/lib/sglang/lang 2024-01-21T10:34:32,663 copying sglang/lang/interpreter.py -> build/lib/sglang/lang 2024-01-21T10:34:32,666 creating build/lib/sglang/srt 2024-01-21T10:34:32,667 copying sglang/srt/conversation.py -> build/lib/sglang/srt 2024-01-21T10:34:32,669 copying sglang/srt/backend_config.py -> build/lib/sglang/srt 2024-01-21T10:34:32,671 copying sglang/srt/hf_transformers_utils.py -> build/lib/sglang/srt 2024-01-21T10:34:32,673 copying sglang/srt/memory_pool.py -> build/lib/sglang/srt 2024-01-21T10:34:32,675 copying sglang/srt/utils.py -> build/lib/sglang/srt 2024-01-21T10:34:32,677 copying sglang/srt/model_config.py -> build/lib/sglang/srt 2024-01-21T10:34:32,678 copying sglang/srt/server_args.py -> build/lib/sglang/srt 2024-01-21T10:34:32,681 copying sglang/srt/server.py -> build/lib/sglang/srt 2024-01-21T10:34:32,683 copying sglang/srt/sampling_params.py -> build/lib/sglang/srt 2024-01-21T10:34:32,685 creating build/lib/sglang/test 2024-01-21T10:34:32,686 copying sglang/test/test_utils.py -> build/lib/sglang/test 2024-01-21T10:34:32,688 copying sglang/test/test_programs.py -> build/lib/sglang/test 2024-01-21T10:34:32,691 creating build/lib/sglang/srt/layers 2024-01-21T10:34:32,692 copying sglang/srt/layers/context_flashattention_nopad.py -> build/lib/sglang/srt/layers 2024-01-21T10:34:32,694 copying sglang/srt/layers/token_attention.py -> build/lib/sglang/srt/layers 2024-01-21T10:34:32,696 copying sglang/srt/layers/logits_processor.py -> build/lib/sglang/srt/layers 2024-01-21T10:34:32,698 copying sglang/srt/layers/radix_attention.py -> build/lib/sglang/srt/layers 2024-01-21T10:34:32,701 copying sglang/srt/layers/extend_attention.py -> build/lib/sglang/srt/layers 2024-01-21T10:34:32,703 creating build/lib/sglang/srt/models 2024-01-21T10:34:32,704 copying sglang/srt/models/llava.py -> build/lib/sglang/srt/models 2024-01-21T10:34:32,706 copying sglang/srt/models/llama2.py -> build/lib/sglang/srt/models 2024-01-21T10:34:32,709 copying sglang/srt/models/mixtral.py -> build/lib/sglang/srt/models 2024-01-21T10:34:32,712 creating build/lib/sglang/srt/constrained 2024-01-21T10:34:32,712 copying sglang/srt/constrained/fsm.py -> build/lib/sglang/srt/constrained 2024-01-21T10:34:32,715 copying sglang/srt/constrained/tokenizer.py -> build/lib/sglang/srt/constrained 2024-01-21T10:34:32,717 copying sglang/srt/constrained/disk_cache.py -> build/lib/sglang/srt/constrained 2024-01-21T10:34:32,719 copying sglang/srt/constrained/regex.py -> build/lib/sglang/srt/constrained 2024-01-21T10:34:32,721 copying sglang/srt/constrained/fsm_cache.py -> build/lib/sglang/srt/constrained 2024-01-21T10:34:32,723 creating build/lib/sglang/srt/managers 2024-01-21T10:34:32,724 copying sglang/srt/managers/tokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-21T10:34:32,726 copying sglang/srt/managers/openai_protocol.py -> build/lib/sglang/srt/managers 2024-01-21T10:34:32,728 copying sglang/srt/managers/detokenizer_manager.py -> build/lib/sglang/srt/managers 2024-01-21T10:34:32,730 copying sglang/srt/managers/io_struct.py -> build/lib/sglang/srt/managers 2024-01-21T10:34:32,732 creating build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,733 copying sglang/srt/managers/router/scheduler.py -> build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,735 copying sglang/srt/managers/router/model_rpc.py -> build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,738 copying sglang/srt/managers/router/model_runner.py -> build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,740 copying sglang/srt/managers/router/radix_cache.py -> build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,742 copying sglang/srt/managers/router/manager.py -> build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,744 copying sglang/srt/managers/router/infer_batch.py -> build/lib/sglang/srt/managers/router 2024-01-21T10:34:32,746 running egg_info 2024-01-21T10:34:32,750 writing sglang.egg-info/PKG-INFO 2024-01-21T10:34:32,759 writing dependency_links to sglang.egg-info/dependency_links.txt 2024-01-21T10:34:32,763 writing requirements to sglang.egg-info/requires.txt 2024-01-21T10:34:32,764 writing top-level names to sglang.egg-info/top_level.txt 2024-01-21T10:34:32,779 reading manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:32,782 adding license file 'LICENSE' 2024-01-21T10:34:32,785 writing manifest file 'sglang.egg-info/SOURCES.txt' 2024-01-21T10:34:32,801 installing to build/bdist.linux-armv7l/wheel 2024-01-21T10:34:32,802 running install 2024-01-21T10:34:32,825 running install_lib 2024-01-21T10:34:32,829 creating build/bdist.linux-armv7l 2024-01-21T10:34:32,830 creating build/bdist.linux-armv7l/wheel 2024-01-21T10:34:32,831 creating build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,833 creating build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,834 copying build/lib/sglang/backend/vertexai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,836 copying build/lib/sglang/backend/anthropic.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,837 copying build/lib/sglang/backend/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,839 copying build/lib/sglang/backend/base_backend.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,840 copying build/lib/sglang/backend/runtime_endpoint.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,843 copying build/lib/sglang/backend/openai.py -> build/bdist.linux-armv7l/wheel/sglang/backend 2024-01-21T10:34:32,845 copying build/lib/sglang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,846 copying build/lib/sglang/utils.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,848 copying build/lib/sglang/api.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,850 copying build/lib/sglang/flush_cache.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,853 creating build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,853 copying build/lib/sglang/lang/__init__.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,855 copying build/lib/sglang/lang/ir.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,857 copying build/lib/sglang/lang/chat_template.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,860 copying build/lib/sglang/lang/tracer.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,862 copying build/lib/sglang/lang/compiler.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,864 copying build/lib/sglang/lang/interpreter.py -> build/bdist.linux-armv7l/wheel/sglang/lang 2024-01-21T10:34:32,867 copying build/lib/sglang/global_config.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,869 creating build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,870 copying build/lib/sglang/srt/conversation.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,872 copying build/lib/sglang/srt/backend_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,874 copying build/lib/sglang/srt/hf_transformers_utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,876 copying build/lib/sglang/srt/memory_pool.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,878 copying build/lib/sglang/srt/utils.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,881 creating build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T10:34:32,882 copying build/lib/sglang/srt/layers/context_flashattention_nopad.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T10:34:32,884 copying build/lib/sglang/srt/layers/token_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T10:34:32,886 copying build/lib/sglang/srt/layers/logits_processor.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T10:34:32,888 copying build/lib/sglang/srt/layers/radix_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T10:34:32,890 copying build/lib/sglang/srt/layers/extend_attention.py -> build/bdist.linux-armv7l/wheel/sglang/srt/layers 2024-01-21T10:34:32,892 copying build/lib/sglang/srt/model_config.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,894 creating build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T10:34:32,895 copying build/lib/sglang/srt/models/llava.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T10:34:32,898 copying build/lib/sglang/srt/models/llama2.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T10:34:32,900 copying build/lib/sglang/srt/models/mixtral.py -> build/bdist.linux-armv7l/wheel/sglang/srt/models 2024-01-21T10:34:32,903 creating build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T10:34:32,904 copying build/lib/sglang/srt/constrained/fsm.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T10:34:32,906 copying build/lib/sglang/srt/constrained/tokenizer.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T10:34:32,908 copying build/lib/sglang/srt/constrained/disk_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T10:34:32,910 copying build/lib/sglang/srt/constrained/regex.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T10:34:32,916 copying build/lib/sglang/srt/constrained/fsm_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/constrained 2024-01-21T10:34:32,918 copying build/lib/sglang/srt/server_args.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,920 copying build/lib/sglang/srt/server.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,923 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T10:34:32,924 copying build/lib/sglang/srt/managers/tokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T10:34:32,926 creating build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,927 copying build/lib/sglang/srt/managers/router/scheduler.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,930 copying build/lib/sglang/srt/managers/router/model_rpc.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,932 copying build/lib/sglang/srt/managers/router/model_runner.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,935 copying build/lib/sglang/srt/managers/router/radix_cache.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,937 copying build/lib/sglang/srt/managers/router/manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,939 copying build/lib/sglang/srt/managers/router/infer_batch.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers/router 2024-01-21T10:34:32,941 copying build/lib/sglang/srt/managers/openai_protocol.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T10:34:32,943 copying build/lib/sglang/srt/managers/detokenizer_manager.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T10:34:32,945 copying build/lib/sglang/srt/managers/io_struct.py -> build/bdist.linux-armv7l/wheel/sglang/srt/managers 2024-01-21T10:34:32,947 copying build/lib/sglang/srt/sampling_params.py -> build/bdist.linux-armv7l/wheel/sglang/srt 2024-01-21T10:34:32,949 creating build/bdist.linux-armv7l/wheel/sglang/test 2024-01-21T10:34:32,950 copying build/lib/sglang/test/test_utils.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-21T10:34:32,952 copying build/lib/sglang/test/test_programs.py -> build/bdist.linux-armv7l/wheel/sglang/test 2024-01-21T10:34:32,955 copying build/lib/sglang/launch_server.py -> build/bdist.linux-armv7l/wheel/sglang 2024-01-21T10:34:32,956 running install_egg_info 2024-01-21T10:34:32,960 Copying sglang.egg-info to build/bdist.linux-armv7l/wheel/sglang-0.1.6-py3.11.egg-info 2024-01-21T10:34:32,971 running install_scripts 2024-01-21T10:34:32,991 creating build/bdist.linux-armv7l/wheel/sglang-0.1.6.dist-info/WHEEL 2024-01-21T10:34:32,993 creating '/tmp/pip-wheel-w0uc4os2/.tmp-_bxfuh0i/sglang-0.1.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-01-21T10:34:32,995 adding 'sglang/__init__.py' 2024-01-21T10:34:32,997 adding 'sglang/api.py' 2024-01-21T10:34:32,998 adding 'sglang/flush_cache.py' 2024-01-21T10:34:32,999 adding 'sglang/global_config.py' 2024-01-21T10:34:33,000 adding 'sglang/launch_server.py' 2024-01-21T10:34:33,002 adding 'sglang/utils.py' 2024-01-21T10:34:33,003 adding 'sglang/backend/__init__.py' 2024-01-21T10:34:33,005 adding 'sglang/backend/anthropic.py' 2024-01-21T10:34:33,006 adding 'sglang/backend/base_backend.py' 2024-01-21T10:34:33,007 adding 'sglang/backend/openai.py' 2024-01-21T10:34:33,009 adding 'sglang/backend/runtime_endpoint.py' 2024-01-21T10:34:33,010 adding 'sglang/backend/vertexai.py' 2024-01-21T10:34:33,012 adding 'sglang/lang/__init__.py' 2024-01-21T10:34:33,013 adding 'sglang/lang/chat_template.py' 2024-01-21T10:34:33,015 adding 'sglang/lang/compiler.py' 2024-01-21T10:34:33,018 adding 'sglang/lang/interpreter.py' 2024-01-21T10:34:33,020 adding 'sglang/lang/ir.py' 2024-01-21T10:34:33,021 adding 'sglang/lang/tracer.py' 2024-01-21T10:34:33,023 adding 'sglang/srt/backend_config.py' 2024-01-21T10:34:33,025 adding 'sglang/srt/conversation.py' 2024-01-21T10:34:33,027 adding 'sglang/srt/hf_transformers_utils.py' 2024-01-21T10:34:33,028 adding 'sglang/srt/memory_pool.py' 2024-01-21T10:34:33,030 adding 'sglang/srt/model_config.py' 2024-01-21T10:34:33,031 adding 'sglang/srt/sampling_params.py' 2024-01-21T10:34:33,033 adding 'sglang/srt/server.py' 2024-01-21T10:34:33,035 adding 'sglang/srt/server_args.py' 2024-01-21T10:34:33,036 adding 'sglang/srt/utils.py' 2024-01-21T10:34:33,038 adding 'sglang/srt/constrained/disk_cache.py' 2024-01-21T10:34:33,040 adding 'sglang/srt/constrained/fsm.py' 2024-01-21T10:34:33,041 adding 'sglang/srt/constrained/fsm_cache.py' 2024-01-21T10:34:33,044 adding 'sglang/srt/constrained/regex.py' 2024-01-21T10:34:33,045 adding 'sglang/srt/constrained/tokenizer.py' 2024-01-21T10:34:33,047 adding 'sglang/srt/layers/context_flashattention_nopad.py' 2024-01-21T10:34:33,049 adding 'sglang/srt/layers/extend_attention.py' 2024-01-21T10:34:33,051 adding 'sglang/srt/layers/logits_processor.py' 2024-01-21T10:34:33,052 adding 'sglang/srt/layers/radix_attention.py' 2024-01-21T10:34:33,054 adding 'sglang/srt/layers/token_attention.py' 2024-01-21T10:34:33,056 adding 'sglang/srt/managers/detokenizer_manager.py' 2024-01-21T10:34:33,057 adding 'sglang/srt/managers/io_struct.py' 2024-01-21T10:34:33,059 adding 'sglang/srt/managers/openai_protocol.py' 2024-01-21T10:34:33,060 adding 'sglang/srt/managers/tokenizer_manager.py' 2024-01-21T10:34:33,063 adding 'sglang/srt/managers/router/infer_batch.py' 2024-01-21T10:34:33,064 adding 'sglang/srt/managers/router/manager.py' 2024-01-21T10:34:33,067 adding 'sglang/srt/managers/router/model_rpc.py' 2024-01-21T10:34:33,069 adding 'sglang/srt/managers/router/model_runner.py' 2024-01-21T10:34:33,071 adding 'sglang/srt/managers/router/radix_cache.py' 2024-01-21T10:34:33,072 adding 'sglang/srt/managers/router/scheduler.py' 2024-01-21T10:34:33,075 adding 'sglang/srt/models/llama2.py' 2024-01-21T10:34:33,076 adding 'sglang/srt/models/llava.py' 2024-01-21T10:34:33,078 adding 'sglang/srt/models/mixtral.py' 2024-01-21T10:34:33,081 adding 'sglang/test/test_programs.py' 2024-01-21T10:34:33,082 adding 'sglang/test/test_utils.py' 2024-01-21T10:34:33,085 adding 'sglang-0.1.6.dist-info/LICENSE' 2024-01-21T10:34:33,089 adding 'sglang-0.1.6.dist-info/METADATA' 2024-01-21T10:34:33,090 adding 'sglang-0.1.6.dist-info/WHEEL' 2024-01-21T10:34:33,091 adding 'sglang-0.1.6.dist-info/top_level.txt' 2024-01-21T10:34:33,093 adding 'sglang-0.1.6.dist-info/RECORD' 2024-01-21T10:34:33,096 removing build/bdist.linux-armv7l/wheel 2024-01-21T10:34:33,231 Building wheel for sglang (pyproject.toml): finished with status 'done' 2024-01-21T10:34:33,239 Created wheel for sglang: filename=sglang-0.1.6-py3-none-any.whl size=108345 sha256=3aeae8e3d394b778cdf2021c3ded6754cb7bd59a0a2eb30887cc36732d86b37b 2024-01-21T10:34:33,240 Stored in directory: /tmp/pip-ephem-wheel-cache-xzpxhlkx/wheels/74/35/39/64b540ea15d77510b16665ef71a204550558aa38a87000e056 2024-01-21T10:34:33,263 Successfully built sglang 2024-01-21T10:34:33,270 Removed build tracker: '/tmp/pip-build-tracker-li1byiuj'