2023-08-02T19:13:10,949 Created temporary directory: /tmp/pip-build-tracker-waj4o9bi 2023-08-02T19:13:10,950 Initialized build tracking at /tmp/pip-build-tracker-waj4o9bi 2023-08-02T19:13:10,951 Created build tracker: /tmp/pip-build-tracker-waj4o9bi 2023-08-02T19:13:10,951 Entered build tracker: /tmp/pip-build-tracker-waj4o9bi 2023-08-02T19:13:10,951 Created temporary directory: /tmp/pip-wheel-dsfvtdy2 2023-08-02T19:13:10,954 Created temporary directory: /tmp/pip-ephem-wheel-cache-qgvb99tk 2023-08-02T19:13:10,977 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-08-02T19:13:10,981 2 location(s) to search for versions of exllama: 2023-08-02T19:13:10,981 * https://pypi.org/simple/exllama/ 2023-08-02T19:13:10,981 * https://www.piwheels.org/simple/exllama/ 2023-08-02T19:13:10,981 Fetching project page and analyzing links: https://pypi.org/simple/exllama/ 2023-08-02T19:13:10,982 Getting page https://pypi.org/simple/exllama/ 2023-08-02T19:13:10,983 Found index url https://pypi.org/simple/ 2023-08-02T19:13:11,034 Fetched page https://pypi.org/simple/exllama/ as application/vnd.pypi.simple.v1+json 2023-08-02T19:13:11,035 Skipping link: No binaries permitted for exllama: https://files.pythonhosted.org/packages/cd/15/d1c31f0cabab5a66cdfc34b27cac1bbe564213a9be8c077eb49e0ce16b41/exllama-0.1.0-py3-none-any.whl (from https://pypi.org/simple/exllama/) (requires-python:>=3.9) 2023-08-02T19:13:11,036 Found link https://files.pythonhosted.org/packages/09/b5/e9aa9cad4d1d3788ec29b3f9f0858fbebd66892898bc4d29e55c8f22698e/exllama-0.1.0.tar.gz (from https://pypi.org/simple/exllama/) (requires-python:>=3.9), version: 0.1.0 2023-08-02T19:13:11,036 Fetching project page and analyzing links: https://www.piwheels.org/simple/exllama/ 2023-08-02T19:13:11,037 Getting page https://www.piwheels.org/simple/exllama/ 2023-08-02T19:13:11,038 Found index url https://www.piwheels.org/simple/ 2023-08-02T19:13:11,226 Fetched page https://www.piwheels.org/simple/exllama/ as text/html 2023-08-02T19:13:11,227 Skipping link: not a file: https://www.piwheels.org/simple/exllama/ 2023-08-02T19:13:11,227 Skipping link: not a file: https://pypi.org/simple/exllama/ 2023-08-02T19:13:11,245 Given no hashes to check 1 links for project 'exllama': discarding no candidates 2023-08-02T19:13:11,261 Collecting exllama==0.1.0 2023-08-02T19:13:11,263 Created temporary directory: /tmp/pip-unpack-kvqz49ww 2023-08-02T19:13:11,394 Downloading exllama-0.1.0.tar.gz (37 kB) 2023-08-02T19:13:11,490 Added exllama==0.1.0 from https://files.pythonhosted.org/packages/09/b5/e9aa9cad4d1d3788ec29b3f9f0858fbebd66892898bc4d29e55c8f22698e/exllama-0.1.0.tar.gz to build tracker '/tmp/pip-build-tracker-waj4o9bi' 2023-08-02T19:13:11,491 Running setup.py (path:/tmp/pip-wheel-dsfvtdy2/exllama_cbb87c91ca734a728b67b2d891bf3c12/setup.py) egg_info for package exllama 2023-08-02T19:13:11,492 Created temporary directory: /tmp/pip-pip-egg-info-f7jb3mra 2023-08-02T19:13:11,492 Preparing metadata (setup.py): started 2023-08-02T19:13:11,493 Running command python setup.py egg_info 2023-08-02T19:13:12,104 running egg_info 2023-08-02T19:13:12,105 creating /tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info 2023-08-02T19:13:12,132 writing /tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/PKG-INFO 2023-08-02T19:13:12,135 writing dependency_links to /tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/dependency_links.txt 2023-08-02T19:13:12,137 writing requirements to /tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/requires.txt 2023-08-02T19:13:12,138 writing top-level names to /tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/top_level.txt 2023-08-02T19:13:12,139 writing manifest file '/tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/SOURCES.txt' 2023-08-02T19:13:12,227 reading manifest file '/tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/SOURCES.txt' 2023-08-02T19:13:12,232 writing manifest file '/tmp/pip-pip-egg-info-f7jb3mra/exllama.egg-info/SOURCES.txt' 2023-08-02T19:13:12,293 Preparing metadata (setup.py): finished with status 'done' 2023-08-02T19:13:12,298 Source in /tmp/pip-wheel-dsfvtdy2/exllama_cbb87c91ca734a728b67b2d891bf3c12 has version 0.1.0, which satisfies requirement exllama==0.1.0 from https://files.pythonhosted.org/packages/09/b5/e9aa9cad4d1d3788ec29b3f9f0858fbebd66892898bc4d29e55c8f22698e/exllama-0.1.0.tar.gz 2023-08-02T19:13:12,299 Removed exllama==0.1.0 from https://files.pythonhosted.org/packages/09/b5/e9aa9cad4d1d3788ec29b3f9f0858fbebd66892898bc4d29e55c8f22698e/exllama-0.1.0.tar.gz from build tracker '/tmp/pip-build-tracker-waj4o9bi' 2023-08-02T19:13:12,305 Created temporary directory: /tmp/pip-unpack-7rk55w2a 2023-08-02T19:13:12,306 Building wheels for collected packages: exllama 2023-08-02T19:13:12,310 Created temporary directory: /tmp/pip-wheel-bxp7qbm8 2023-08-02T19:13:12,310 Building wheel for exllama (setup.py): started 2023-08-02T19:13:12,311 Destination directory: /tmp/pip-wheel-bxp7qbm8 2023-08-02T19:13:12,312 Running command python setup.py bdist_wheel 2023-08-02T19:13:12,936 running bdist_wheel 2023-08-02T19:13:13,219 running build 2023-08-02T19:13:13,219 running build_py 2023-08-02T19:13:13,248 creating build 2023-08-02T19:13:13,248 creating build/lib 2023-08-02T19:13:13,249 creating build/lib/exllama 2023-08-02T19:13:13,250 copying exllama/tokenizer.py -> build/lib/exllama 2023-08-02T19:13:13,253 copying exllama/cuda_ext.py -> build/lib/exllama 2023-08-02T19:13:13,255 copying exllama/lora.py -> build/lib/exllama 2023-08-02T19:13:13,257 copying exllama/generator.py -> build/lib/exllama 2023-08-02T19:13:13,260 copying exllama/model.py -> build/lib/exllama 2023-08-02T19:13:13,263 copying exllama/__init__.py -> build/lib/exllama 2023-08-02T19:13:13,269 creating build/lib/exllama/exllama_ext 2023-08-02T19:13:13,269 copying exllama/exllama_ext/exllama_ext.cpp -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,272 copying exllama/exllama_ext/matrix.cuh -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,275 copying exllama/exllama_ext/util.cuh -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,277 copying exllama/exllama_ext/tuning.h -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,279 copying exllama/exllama_ext/cuda_compat.cuh -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,282 copying exllama/exllama_ext/cuda_buffers.cu -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,284 copying exllama/exllama_ext/hip_compat.cuh -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,286 copying exllama/exllama_ext/cuda_buffers.cuh -> build/lib/exllama/exllama_ext 2023-08-02T19:13:13,288 creating build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,288 copying exllama/exllama_ext/cuda_func/q4_matmul.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,291 copying exllama/exllama_ext/cuda_func/rms_norm.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,294 copying exllama/exllama_ext/cuda_func/q4_matrix.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,296 copying exllama/exllama_ext/cuda_func/half_matmul.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,298 copying exllama/exllama_ext/cuda_func/column_remap.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,300 copying exllama/exllama_ext/cuda_func/q4_attn.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,302 copying exllama/exllama_ext/cuda_func/rope.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,304 copying exllama/exllama_ext/cuda_func/q4_matmul.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,306 copying exllama/exllama_ext/cuda_func/q4_mlp.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,309 copying exllama/exllama_ext/cuda_func/half_matmul.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,311 copying exllama/exllama_ext/cuda_func/rope.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,313 copying exllama/exllama_ext/cuda_func/q4_attn.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,315 copying exllama/exllama_ext/cuda_func/q4_mlp.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,318 copying exllama/exllama_ext/cuda_func/rms_norm.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,320 copying exllama/exllama_ext/cuda_func/q4_matrix.cu -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,322 copying exllama/exllama_ext/cuda_func/column_remap.cuh -> build/lib/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,324 creating build/lib/exllama/exllama_ext/cpu_func 2023-08-02T19:13:13,325 copying exllama/exllama_ext/cpu_func/rep_penalty.h -> build/lib/exllama/exllama_ext/cpu_func 2023-08-02T19:13:13,328 copying exllama/exllama_ext/cpu_func/rep_penalty.cpp -> build/lib/exllama/exllama_ext/cpu_func 2023-08-02T19:13:13,360 /home/piwheels/.local/lib/python3.9/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-08-02T19:13:13,360 !! 2023-08-02T19:13:13,360 ******************************************************************************** 2023-08-02T19:13:13,360 Please avoid running ``setup.py`` directly. 2023-08-02T19:13:13,361 Instead, use pypa/build, pypa/installer, pypa/build or 2023-08-02T19:13:13,361 other standards-based tools. 2023-08-02T19:13:13,361 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-08-02T19:13:13,361 ******************************************************************************** 2023-08-02T19:13:13,361 !! 2023-08-02T19:13:13,361 self.initialize_options() 2023-08-02T19:13:13,388 installing to build/bdist.linux-armv7l/wheel 2023-08-02T19:13:13,388 running install 2023-08-02T19:13:13,413 running install_lib 2023-08-02T19:13:13,441 creating build/bdist.linux-armv7l 2023-08-02T19:13:13,442 creating build/bdist.linux-armv7l/wheel 2023-08-02T19:13:13,443 creating build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,445 copying build/lib/exllama/tokenizer.py -> build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,447 copying build/lib/exllama/cuda_ext.py -> build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,449 copying build/lib/exllama/lora.py -> build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,451 copying build/lib/exllama/generator.py -> build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,454 copying build/lib/exllama/model.py -> build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,458 creating build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,458 copying build/lib/exllama/exllama_ext/exllama_ext.cpp -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,461 copying build/lib/exllama/exllama_ext/matrix.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,463 copying build/lib/exllama/exllama_ext/util.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,466 creating build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,467 copying build/lib/exllama/exllama_ext/cuda_func/q4_matmul.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,469 copying build/lib/exllama/exllama_ext/cuda_func/rms_norm.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,471 copying build/lib/exllama/exllama_ext/cuda_func/q4_matrix.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,473 copying build/lib/exllama/exllama_ext/cuda_func/half_matmul.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,475 copying build/lib/exllama/exllama_ext/cuda_func/column_remap.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,477 copying build/lib/exllama/exllama_ext/cuda_func/q4_attn.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,479 copying build/lib/exllama/exllama_ext/cuda_func/rope.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,481 copying build/lib/exllama/exllama_ext/cuda_func/q4_matmul.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,483 copying build/lib/exllama/exllama_ext/cuda_func/q4_mlp.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,484 copying build/lib/exllama/exllama_ext/cuda_func/half_matmul.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,487 copying build/lib/exllama/exllama_ext/cuda_func/rope.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,489 copying build/lib/exllama/exllama_ext/cuda_func/q4_attn.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,491 copying build/lib/exllama/exllama_ext/cuda_func/q4_mlp.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,493 copying build/lib/exllama/exllama_ext/cuda_func/rms_norm.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,495 copying build/lib/exllama/exllama_ext/cuda_func/q4_matrix.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,497 copying build/lib/exllama/exllama_ext/cuda_func/column_remap.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cuda_func 2023-08-02T19:13:13,499 copying build/lib/exllama/exllama_ext/tuning.h -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,500 copying build/lib/exllama/exllama_ext/cuda_compat.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,503 creating build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cpu_func 2023-08-02T19:13:13,503 copying build/lib/exllama/exllama_ext/cpu_func/rep_penalty.h -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cpu_func 2023-08-02T19:13:13,505 copying build/lib/exllama/exllama_ext/cpu_func/rep_penalty.cpp -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext/cpu_func 2023-08-02T19:13:13,507 copying build/lib/exllama/exllama_ext/cuda_buffers.cu -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,509 copying build/lib/exllama/exllama_ext/hip_compat.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,511 copying build/lib/exllama/exllama_ext/cuda_buffers.cuh -> build/bdist.linux-armv7l/wheel/exllama/exllama_ext 2023-08-02T19:13:13,513 copying build/lib/exllama/__init__.py -> build/bdist.linux-armv7l/wheel/exllama 2023-08-02T19:13:13,514 running install_egg_info 2023-08-02T19:13:13,578 running egg_info 2023-08-02T19:13:13,603 writing exllama.egg-info/PKG-INFO 2023-08-02T19:13:13,605 writing dependency_links to exllama.egg-info/dependency_links.txt 2023-08-02T19:13:13,607 writing requirements to exllama.egg-info/requires.txt 2023-08-02T19:13:13,608 writing top-level names to exllama.egg-info/top_level.txt 2023-08-02T19:13:13,641 reading manifest file 'exllama.egg-info/SOURCES.txt' 2023-08-02T19:13:13,646 writing manifest file 'exllama.egg-info/SOURCES.txt' 2023-08-02T19:13:13,648 Copying exllama.egg-info to build/bdist.linux-armv7l/wheel/exllama-0.1.0-py3.9.egg-info 2023-08-02T19:13:13,659 running install_scripts 2023-08-02T19:13:13,672 creating build/bdist.linux-armv7l/wheel/exllama-0.1.0.dist-info/WHEEL 2023-08-02T19:13:13,675 creating '/tmp/pip-wheel-bxp7qbm8/exllama-0.1.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-08-02T19:13:13,677 adding 'exllama/__init__.py' 2023-08-02T19:13:13,678 adding 'exllama/cuda_ext.py' 2023-08-02T19:13:13,682 adding 'exllama/generator.py' 2023-08-02T19:13:13,683 adding 'exllama/lora.py' 2023-08-02T19:13:13,688 adding 'exllama/model.py' 2023-08-02T19:13:13,690 adding 'exllama/tokenizer.py' 2023-08-02T19:13:13,692 adding 'exllama/exllama_ext/cuda_buffers.cu' 2023-08-02T19:13:13,693 adding 'exllama/exllama_ext/cuda_buffers.cuh' 2023-08-02T19:13:13,694 adding 'exllama/exllama_ext/cuda_compat.cuh' 2023-08-02T19:13:13,697 adding 'exllama/exllama_ext/exllama_ext.cpp' 2023-08-02T19:13:13,698 adding 'exllama/exllama_ext/hip_compat.cuh' 2023-08-02T19:13:13,700 adding 'exllama/exllama_ext/matrix.cuh' 2023-08-02T19:13:13,701 adding 'exllama/exllama_ext/tuning.h' 2023-08-02T19:13:13,702 adding 'exllama/exllama_ext/util.cuh' 2023-08-02T19:13:13,704 adding 'exllama/exllama_ext/cpu_func/rep_penalty.cpp' 2023-08-02T19:13:13,705 adding 'exllama/exllama_ext/cpu_func/rep_penalty.h' 2023-08-02T19:13:13,707 adding 'exllama/exllama_ext/cuda_func/column_remap.cu' 2023-08-02T19:13:13,709 adding 'exllama/exllama_ext/cuda_func/column_remap.cuh' 2023-08-02T19:13:13,710 adding 'exllama/exllama_ext/cuda_func/half_matmul.cu' 2023-08-02T19:13:13,711 adding 'exllama/exllama_ext/cuda_func/half_matmul.cuh' 2023-08-02T19:13:13,713 adding 'exllama/exllama_ext/cuda_func/q4_attn.cu' 2023-08-02T19:13:13,715 adding 'exllama/exllama_ext/cuda_func/q4_attn.cuh' 2023-08-02T19:13:13,716 adding 'exllama/exllama_ext/cuda_func/q4_matmul.cu' 2023-08-02T19:13:13,718 adding 'exllama/exllama_ext/cuda_func/q4_matmul.cuh' 2023-08-02T19:13:13,719 adding 'exllama/exllama_ext/cuda_func/q4_matrix.cu' 2023-08-02T19:13:13,720 adding 'exllama/exllama_ext/cuda_func/q4_matrix.cuh' 2023-08-02T19:13:13,722 adding 'exllama/exllama_ext/cuda_func/q4_mlp.cu' 2023-08-02T19:13:13,723 adding 'exllama/exllama_ext/cuda_func/q4_mlp.cuh' 2023-08-02T19:13:13,725 adding 'exllama/exllama_ext/cuda_func/rms_norm.cu' 2023-08-02T19:13:13,726 adding 'exllama/exllama_ext/cuda_func/rms_norm.cuh' 2023-08-02T19:13:13,728 adding 'exllama/exllama_ext/cuda_func/rope.cu' 2023-08-02T19:13:13,729 adding 'exllama/exllama_ext/cuda_func/rope.cuh' 2023-08-02T19:13:13,731 adding 'exllama-0.1.0.dist-info/METADATA' 2023-08-02T19:13:13,732 adding 'exllama-0.1.0.dist-info/WHEEL' 2023-08-02T19:13:13,733 adding 'exllama-0.1.0.dist-info/top_level.txt' 2023-08-02T19:13:13,734 adding 'exllama-0.1.0.dist-info/RECORD' 2023-08-02T19:13:13,736 removing build/bdist.linux-armv7l/wheel 2023-08-02T19:13:13,827 Building wheel for exllama (setup.py): finished with status 'done' 2023-08-02T19:13:13,830 Created wheel for exllama: filename=exllama-0.1.0-py3-none-any.whl size=49228 sha256=9ff40f63b4feece081578b52ab26abebb4f45eb423c3a6c845b69460081457bb 2023-08-02T19:13:13,831 Stored in directory: /tmp/pip-ephem-wheel-cache-qgvb99tk/wheels/71/13/13/14ace19c5f43464ecc63096f53e230ef2ec3c3294932c85a70 2023-08-02T19:13:13,842 Successfully built exllama 2023-08-02T19:13:13,847 Removed build tracker: '/tmp/pip-build-tracker-waj4o9bi'