2026-04-28T22:57:08,832 Created temporary directory: /tmp/pip-ephem-wheel-cache-93dlzf4q 2026-04-28T22:57:08,834 Created temporary directory: /tmp/pip-build-tracker-qgg1k0n3 2026-04-28T22:57:08,835 Initialized build tracking at /tmp/pip-build-tracker-qgg1k0n3 2026-04-28T22:57:08,835 Created build tracker: /tmp/pip-build-tracker-qgg1k0n3 2026-04-28T22:57:08,836 Entered build tracker: /tmp/pip-build-tracker-qgg1k0n3 2026-04-28T22:57:08,837 Created temporary directory: /tmp/pip-wheel-3ueut3r_ 2026-04-28T22:57:08,839 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-04-28T22:57:08,842 Created temporary directory: /tmp/pip-ephem-wheel-cache-5xhrfdqy 2026-04-28T22:57:08,864 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-04-28T22:57:08,867 2 location(s) to search for versions of gptqmodel: 2026-04-28T22:57:08,867 * https://pypi.org/simple/gptqmodel/ 2026-04-28T22:57:08,867 * https://www.piwheels.org/simple/gptqmodel/ 2026-04-28T22:57:08,868 Fetching project page and analyzing links: https://pypi.org/simple/gptqmodel/ 2026-04-28T22:57:08,869 Getting page https://pypi.org/simple/gptqmodel/ 2026-04-28T22:57:08,870 Found index url https://pypi.org/simple 2026-04-28T22:57:09,104 Fetched page https://pypi.org/simple/gptqmodel/ as application/vnd.pypi.simple.v1+json 2026-04-28T22:57:09,114 Found link https://files.pythonhosted.org/packages/44/fa/b0947cb5302c85a6dde9eb1d78bf3ad9a5261f513a7e48d4ef36cb5df797/gptqmodel-1.0.1.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.1 2026-04-28T22:57:09,115 Found link https://files.pythonhosted.org/packages/9a/3e/820cc92613503fe1923245fabcb4dfd1923b9009536e85d4d8a6ed5bcecf/gptqmodel-1.0.2.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.2 2026-04-28T22:57:09,116 Found link https://files.pythonhosted.org/packages/43/ee/3ee308adccc7ff62d2d5f6f7f70615028fbdc0d31c862a1c9205dc84fde3/gptqmodel-1.0.3.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.3 2026-04-28T22:57:09,117 Found link https://files.pythonhosted.org/packages/97/6d/4b2cfe1dd8625086e450c1e89626e541e5f40f5ec5ea8de58a4d769649fc/gptqmodel-1.0.4.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.4 2026-04-28T22:57:09,118 Found link https://files.pythonhosted.org/packages/0b/22/1dd583839d0593653eaef48488f3a3df1dada8d1d58020a44c198587676b/gptqmodel-1.0.5.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.5 2026-04-28T22:57:09,120 Found link https://files.pythonhosted.org/packages/6d/71/82783be8bda8ec724cb63b5750c2f6bb79c9fa583a9488d17b2105798978/gptqmodel-1.0.6.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.6 2026-04-28T22:57:09,121 Found link https://files.pythonhosted.org/packages/47/da/e88363b7a3968b8fcdec8dcf6ddd32aefe9d218dedb844afc824beade8e5/gptqmodel-1.0.7.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.8.0), version: 1.0.7 2026-04-28T22:57:09,122 Found link https://files.pythonhosted.org/packages/34/52/a0f6abd3fa83f04848dcc39388d3afdaf6b195e05978e8688901c36725da/gptqmodel-1.0.8.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.0.8 2026-04-28T22:57:09,123 Found link https://files.pythonhosted.org/packages/32/78/124bfa546546f0bd86265b4cc09ff79ba08abdbeccb32f4ce74ba768c8c0/gptqmodel-1.0.9.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.0.9 2026-04-28T22:57:09,124 Found link https://files.pythonhosted.org/packages/a3/a2/5423f41620be17ccf69300bffdf6ab2590fdacf531f2da4d64b1ebf0a654/gptqmodel-1.1.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.1.0 2026-04-28T22:57:09,125 Found link https://files.pythonhosted.org/packages/ee/ad/3ace3e6968d234d4107dd4c5534ead514cb115c496309820ef7ca690a985/gptqmodel-1.2.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.2.0 2026-04-28T22:57:09,126 Found link https://files.pythonhosted.org/packages/c6/b0/f4acf20c0a800c88169dc11cea376841e58cee887c741136fe5d4201ed5b/gptqmodel-1.2.1.dev0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.2.1.dev0 2026-04-28T22:57:09,127 Found link https://files.pythonhosted.org/packages/fb/7c/99c89a8d8ce0d9a1208bde245175f2b5a5a21a875a9a2c371dde26fc50b7/gptqmodel-1.2.1.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.2.1 2026-04-28T22:57:09,128 Found link https://files.pythonhosted.org/packages/97/ad/d631d319006021707d9f4438e8b8ebfce5b42e9f5fc7b7fa7053dc98cadb/gptqmodel-1.2.3.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.2.3 2026-04-28T22:57:09,129 Found link https://files.pythonhosted.org/packages/a3/2e/59cf50045f30f858dc5126fd1a8e809086eb35a2569e25a30d4c01f7f57b/gptqmodel-1.3.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.3.0 2026-04-28T22:57:09,130 Found link https://files.pythonhosted.org/packages/f7/e7/42dad0e2aec63cb73d2f65fc49df74fc1e93f056beb66796eddefadd8bae/gptqmodel-1.3.1.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.3.1 2026-04-28T22:57:09,131 Found link https://files.pythonhosted.org/packages/72/2a/e2f71bde57a79c6a47da71c3f22e56a36c80fd2a8fed489ac2c89b61c50c/gptqmodel-1.4.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.4.0 2026-04-28T22:57:09,132 Found link https://files.pythonhosted.org/packages/81/06/cb818f60147949c89a30198b7e353d16d1a4dae11446c08192e309d1e48e/gptqmodel-1.4.1.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.4.1 2026-04-28T22:57:09,132 Found link https://files.pythonhosted.org/packages/81/ac/916c74b695ac469f4ff8ba39b829ef346ee05745f1575da08643456d2b26/gptqmodel-1.4.2.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.4.2 2026-04-28T22:57:09,133 Found link https://files.pythonhosted.org/packages/8e/6f/f8a5c56fb12a91e20c3a3ad8721792c1643d3d40c2c3cae02d91df47e48f/gptqmodel-1.4.3.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.4.3 2026-04-28T22:57:09,134 Found link https://files.pythonhosted.org/packages/a3/24/180eba577ba52048714eb4bb0c7713455d3aaf032ca7d8f3dd2eb42f5e01/gptqmodel-1.4.4.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.4.4 2026-04-28T22:57:09,135 Found link https://files.pythonhosted.org/packages/04/57/97233296bae98360c2850ba40a39c97e1bc28d163b2865854f83deb95b0c/gptqmodel-1.4.5.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.4.5 2026-04-28T22:57:09,136 Found link https://files.pythonhosted.org/packages/f1/75/86317fa39fc493fe8d060137767e02bda7f5e8bc1c286e9145f02fba109c/gptqmodel-1.5.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.5.0 2026-04-28T22:57:09,137 Found link https://files.pythonhosted.org/packages/c6/76/ea20c4563c08ca7bffc13596f6ab4b22b79e246d5c9de69d5f1dbfcc620c/gptqmodel-1.5.1.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.5.1 2026-04-28T22:57:09,138 Found link https://files.pythonhosted.org/packages/fb/7e/fe80ab7edaed9b86925e1fcae0f40cf53ced32e786f3d4ad47593a9c6c74/gptqmodel-1.6.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.6.0 2026-04-28T22:57:09,139 Found link https://files.pythonhosted.org/packages/ab/fa/aad5d7e71ce6e1c67201d8a7b97db0f04b8086a832494776b4bcf2050c31/gptqmodel-1.7.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.7.0 2026-04-28T22:57:09,140 Found link https://files.pythonhosted.org/packages/28/49/b59926331683f80c814c551b0dfd1948f1cff1524d692eb6b442b940fff0/gptqmodel-1.7.2.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.7.2 2026-04-28T22:57:09,141 Found link https://files.pythonhosted.org/packages/64/9f/ef0e8b7468f97b703b6c123f09952ca94963dc3552e9ea74f2a38f1c6f62/gptqmodel-1.7.3.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.7.3 2026-04-28T22:57:09,142 Found link https://files.pythonhosted.org/packages/b3/03/bbe6e9cd935f24f4a789b8919bcc7948bbe9860b2c67c972d4f474e12632/gptqmodel-1.7.4.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.7.4 2026-04-28T22:57:09,143 Found link https://files.pythonhosted.org/packages/a2/de/aed10b4936b7c56870d3af7892ce51ebcdff2d5d0f13a09cb9b337e91df0/gptqmodel-1.8.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.8.0 2026-04-28T22:57:09,144 Found link https://files.pythonhosted.org/packages/46/30/cb98de206a29807a59e63c10238eb90570143229df9b67a9a7f2342672bd/gptqmodel-1.8.1.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.8.1 2026-04-28T22:57:09,145 Found link https://files.pythonhosted.org/packages/db/b6/348569757042bb3a674935fe20ae059e56866b4c544e0fa354daf47db14f/gptqmodel-1.9.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 1.9.0 2026-04-28T22:57:09,145 Found link https://files.pythonhosted.org/packages/b6/74/472e0ec6d7b5863d3a55f133afa3829cf397a6478396bda7057c5b5b183d/gptqmodel-2.0.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 2.0.0 2026-04-28T22:57:09,146 Found link https://files.pythonhosted.org/packages/04/b3/84f1bedf5c90850715cd29b37476cf87bf71110a8c7af4d1fa791326fb00/gptqmodel-2.1.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 2.1.0 2026-04-28T22:57:09,147 Found link https://files.pythonhosted.org/packages/b6/d5/1bf44ba82226e3f81e875415a0c27ab786d2fc0d4bbdde67d797eebb3266/gptqmodel-2.2.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 2.2.0 2026-04-28T22:57:09,148 Found link https://files.pythonhosted.org/packages/ea/2b/944aead75f558ed3e37f631d5300282a52459c66e7dc72f1c4bc06552e6f/gptqmodel-4.0.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 4.0.0 2026-04-28T22:57:09,149 Found link https://files.pythonhosted.org/packages/34/23/23d80e92bedad752e92c5212c2770f4b92f3beb3b926a847b4536a540e37/gptqmodel-4.1.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 4.1.0 2026-04-28T22:57:09,150 Found link https://files.pythonhosted.org/packages/5f/b4/87edc315d23ff0ec267c46116e30dd85bc817c6a24086812f8f2175f8010/gptqmodel-4.2.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 4.2.0 2026-04-28T22:57:09,151 Found link https://files.pythonhosted.org/packages/d6/0b/38331cb4f80b27dc5d4f9d1de6f97a3cfb875de8ad3fdc7dbee7b28e5e93/gptqmodel-4.2.5.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.9.0), version: 4.2.5 2026-04-28T22:57:09,152 Found link https://files.pythonhosted.org/packages/67/79/409687c7705314fb8fe46299c941628c250fc9f156eeefc18d34639eb1fa/gptqmodel-5.0.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.0.0 2026-04-28T22:57:09,153 Found link https://files.pythonhosted.org/packages/41/a2/f6f3751aafc326c92af1a34ca3a5d5ffbbd84615a31728e6b7d4cae812dc/gptqmodel-5.2.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.2.0 2026-04-28T22:57:09,154 Found link https://files.pythonhosted.org/packages/8d/51/c3940de8871f5df155adaf1c889d7ea39ef7cd92a8ad4328c850e9360f8a/gptqmodel-5.4.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.4.0 2026-04-28T22:57:09,155 Found link https://files.pythonhosted.org/packages/87/05/50b64410af936f89f089caa0b3e2a03d8589128de17202c99263c7e473a0/gptqmodel-5.4.2.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.4.2 2026-04-28T22:57:09,156 Found link https://files.pythonhosted.org/packages/50/f5/9a2d9a21ab007ba3ed930a12b103736f5c7295d25f8781a0c13ab28b99d5/gptqmodel-5.6.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.6.0 2026-04-28T22:57:09,157 Found link https://files.pythonhosted.org/packages/56/c4/089db2d95a0ebfbbf01b85d2dc51878c34e4f35f609cca2cf6b3962b5a60/gptqmodel-5.6.2.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.6.2 2026-04-28T22:57:09,158 Found link https://files.pythonhosted.org/packages/0d/77/17cdaa09376e1da2906eac219666f211de272bde4a0913cb5ca46a6a092f/gptqmodel-5.6.6.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.6.6 2026-04-28T22:57:09,159 Found link https://files.pythonhosted.org/packages/7b/be/2bdc052d45ecf32fa3bbdb7e169c7d575d5d16adfc592297d2042810b734/gptqmodel-5.6.8.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.6.8 2026-04-28T22:57:09,160 Found link https://files.pythonhosted.org/packages/1d/98/fae2fb9928a76711e9d55415f70d4ae927e847244bd7199c9fb7978f7a30/gptqmodel-5.6.10.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.6.10 2026-04-28T22:57:09,161 Found link https://files.pythonhosted.org/packages/a3/0e/4981ce4887f47e7da8e6049d1d3d2d6a7d8bfb30d93620cb864e71acb519/gptqmodel-5.6.12.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.6.12 2026-04-28T22:57:09,162 Found link https://files.pythonhosted.org/packages/37/4a/2496c85c3cb2c9c475bf1241a4c493dbb240fc031ff2c51b6f3e5e41a575/gptqmodel-5.7.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.7.0 2026-04-28T22:57:09,163 Found link https://files.pythonhosted.org/packages/32/00/5d2c0de5633450ff0f22a2cb0d3e3e530cf9c93632dd132703ba893abf4d/gptqmodel-5.8.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 5.8.0 2026-04-28T22:57:09,163 Found link https://files.pythonhosted.org/packages/bd/00/28086eecd59c13b4712e4537a6ae6f067e8b18649183409f8a2438fe09ad/gptqmodel-6.0.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 6.0.0 2026-04-28T22:57:09,164 Found link https://files.pythonhosted.org/packages/91/05/f7fe6f92ebaecf41efc374b15da832eb2a39e417159e2ead4bbf3e3d36fe/gptqmodel-6.0.3.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 6.0.3 2026-04-28T22:57:09,165 Found link https://files.pythonhosted.org/packages/50/ae/880723dd420d2931614a03f76a6c038e9729606aa7a242fe136db1d78665/gptqmodel-7.0.0.tar.gz (from https://pypi.org/simple/gptqmodel/) (requires-python:>=3.10), version: 7.0.0 2026-04-28T22:57:09,166 Fetching project page and analyzing links: https://www.piwheels.org/simple/gptqmodel/ 2026-04-28T22:57:09,167 Getting page https://www.piwheels.org/simple/gptqmodel/ 2026-04-28T22:57:09,168 Found index url https://www.piwheels.org/simple 2026-04-28T22:57:09,351 Fetched page https://www.piwheels.org/simple/gptqmodel/ as text/html 2026-04-28T22:57:09,353 Skipping link: not a file: https://www.piwheels.org/simple/gptqmodel/ 2026-04-28T22:57:09,353 Skipping link: not a file: https://pypi.org/simple/gptqmodel/ 2026-04-28T22:57:09,381 Given no hashes to check 1 links for project 'gptqmodel': discarding no candidates 2026-04-28T22:57:09,400 Collecting gptqmodel==7.0.0 2026-04-28T22:57:09,403 Created temporary directory: /tmp/pip-unpack-45ifivcd 2026-04-28T22:57:09,554 Downloading gptqmodel-7.0.0.tar.gz (979 kB) 2026-04-28T22:57:10,673 Added gptqmodel==7.0.0 from https://files.pythonhosted.org/packages/50/ae/880723dd420d2931614a03f76a6c038e9729606aa7a242fe136db1d78665/gptqmodel-7.0.0.tar.gz to build tracker '/tmp/pip-build-tracker-qgg1k0n3' 2026-04-28T22:57:10,678 Created temporary directory: /tmp/pip-build-env-h8xeuah2 2026-04-28T22:57:10,683 Installing build dependencies: started 2026-04-28T22:57:10,684 Running command pip subprocess to install build dependencies 2026-04-28T22:57:10,715 Error processing line 1 of /home/piwheels/.local/lib/python3.11/site-packages/outofcuda_hook.pth: 2026-04-28T22:57:10,754 Traceback (most recent call last): 2026-04-28T22:57:10,755 File "", line 192, in addpackage 2026-04-28T22:57:10,755 File "", line 1, in 2026-04-28T22:57:10,756 ModuleNotFoundError: No module named 'outofcuda' 2026-04-28T22:57:10,757 Remainder of file ignored 2026-04-28T22:57:11,851 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-04-28T22:57:12,269 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-04-28T22:57:12,292 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-04-28T22:57:14,205 Collecting setuptools<83,>=77.0.1 2026-04-28T22:57:14,302 Using cached https://www.piwheels.org/simple/setuptools/setuptools-82.0.1-py3-none-any.whl (1.0 MB) 2026-04-28T22:57:17,286 Installing collected packages: setuptools 2026-04-28T22:57:20,286 Successfully installed setuptools-82.0.1 2026-04-28T22:57:20,555 Installing build dependencies: finished with status 'done' 2026-04-28T22:57:20,561 Getting requirements to build wheel: started 2026-04-28T22:57:20,562 Running command Getting requirements to build wheel 2026-04-28T22:57:21,329 running egg_info 2026-04-28T22:57:21,335 writing GPTQModel.egg-info/PKG-INFO 2026-04-28T22:57:21,347 writing dependency_links to GPTQModel.egg-info/dependency_links.txt 2026-04-28T22:57:21,354 writing requirements to GPTQModel.egg-info/requires.txt 2026-04-28T22:57:21,355 writing top-level names to GPTQModel.egg-info/top_level.txt 2026-04-28T22:57:21,435 reading manifest file 'GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:21,459 reading manifest template 'MANIFEST.in' 2026-04-28T22:57:21,523 warning: no files found matching '*.hpp' under directory 'gptqmodel_ext/exllamav3' 2026-04-28T22:57:21,595 warning: no files found matching '*.c' under directory 'gptqmodel_ext/exllamav3' 2026-04-28T22:57:21,690 warning: no files found matching '*.cpp' under directory 'gptqmodel_ext/machete' 2026-04-28T22:57:21,699 warning: no files found matching '*.h' under directory 'gptqmodel_ext/cutlass_extensions' 2026-04-28T22:57:21,715 warning: no files found matching '*.cu' under directory 'gptqmodel_ext/cutlass_extensions' 2026-04-28T22:57:21,728 warning: no files found matching '*.cuh' under directory 'gptqmodel_ext/qqq' 2026-04-28T22:57:21,737 warning: no previously-included files matching '__pycache__' found under directory 'gptqmodel_ext' 2026-04-28T22:57:21,739 warning: no previously-included files matching '*.pyc' found under directory 'gptqmodel_ext' 2026-04-28T22:57:21,740 no previously-included directories found matching 'tests' 2026-04-28T22:57:21,741 no previously-included directories found matching 'format' 2026-04-28T22:57:21,742 adding license file 'LICENSE' 2026-04-28T22:57:21,764 writing manifest file 'GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:21,861 Getting requirements to build wheel: finished with status 'done' 2026-04-28T22:57:21,865 Created temporary directory: /tmp/pip-modern-metadata-n4mtqvp9 2026-04-28T22:57:21,868 Preparing metadata (pyproject.toml): started 2026-04-28T22:57:21,869 Running command Preparing metadata (pyproject.toml) 2026-04-28T22:57:22,561 running dist_info 2026-04-28T22:57:22,571 creating /tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info 2026-04-28T22:57:22,572 writing /tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/PKG-INFO 2026-04-28T22:57:22,585 writing dependency_links to /tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/dependency_links.txt 2026-04-28T22:57:22,593 writing requirements to /tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/requires.txt 2026-04-28T22:57:22,594 writing top-level names to /tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/top_level.txt 2026-04-28T22:57:22,596 writing manifest file '/tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:22,665 reading manifest file '/tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:22,667 reading manifest template 'MANIFEST.in' 2026-04-28T22:57:22,732 warning: no files found matching '*.hpp' under directory 'gptqmodel_ext/exllamav3' 2026-04-28T22:57:22,803 warning: no files found matching '*.c' under directory 'gptqmodel_ext/exllamav3' 2026-04-28T22:57:22,905 warning: no files found matching '*.cpp' under directory 'gptqmodel_ext/machete' 2026-04-28T22:57:22,915 warning: no files found matching '*.h' under directory 'gptqmodel_ext/cutlass_extensions' 2026-04-28T22:57:22,932 warning: no files found matching '*.cu' under directory 'gptqmodel_ext/cutlass_extensions' 2026-04-28T22:57:22,947 warning: no files found matching '*.cuh' under directory 'gptqmodel_ext/qqq' 2026-04-28T22:57:22,957 warning: no previously-included files matching '__pycache__' found under directory 'gptqmodel_ext' 2026-04-28T22:57:22,958 warning: no previously-included files matching '*.pyc' found under directory 'gptqmodel_ext' 2026-04-28T22:57:22,959 no previously-included directories found matching 'tests' 2026-04-28T22:57:22,959 no previously-included directories found matching 'format' 2026-04-28T22:57:22,960 adding license file 'LICENSE' 2026-04-28T22:57:22,976 writing manifest file '/tmp/pip-modern-metadata-n4mtqvp9/GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:22,977 creating '/tmp/pip-modern-metadata-n4mtqvp9/gptqmodel-7.0.0.dist-info' 2026-04-28T22:57:23,104 Preparing metadata (pyproject.toml): finished with status 'done' 2026-04-28T22:57:23,112 Source in /tmp/pip-wheel-3ueut3r_/gptqmodel_a01ad2169ceb4b05b0090010c65cfc7b has version 7.0.0, which satisfies requirement gptqmodel==7.0.0 from https://files.pythonhosted.org/packages/50/ae/880723dd420d2931614a03f76a6c038e9729606aa7a242fe136db1d78665/gptqmodel-7.0.0.tar.gz 2026-04-28T22:57:23,114 Removed gptqmodel==7.0.0 from https://files.pythonhosted.org/packages/50/ae/880723dd420d2931614a03f76a6c038e9729606aa7a242fe136db1d78665/gptqmodel-7.0.0.tar.gz from build tracker '/tmp/pip-build-tracker-qgg1k0n3' 2026-04-28T22:57:23,127 Created temporary directory: /tmp/pip-unpack-odl5c_gj 2026-04-28T22:57:23,128 Building wheels for collected packages: gptqmodel 2026-04-28T22:57:23,132 Created temporary directory: /tmp/pip-wheel-huc2s5k6 2026-04-28T22:57:23,133 Destination directory: /tmp/pip-wheel-huc2s5k6 2026-04-28T22:57:23,135 Building wheel for gptqmodel (pyproject.toml): started 2026-04-28T22:57:23,137 Running command Building wheel for gptqmodel (pyproject.toml) 2026-04-28T22:57:23,805 running bdist_wheel 2026-04-28T22:57:23,823 running build 2026-04-28T22:57:23,823 running build_py 2026-04-28T22:57:23,829 creating build/lib/gptqmodel 2026-04-28T22:57:23,832 copying gptqmodel/__init__.py -> build/lib/gptqmodel 2026-04-28T22:57:23,835 copying gptqmodel/version.py -> build/lib/gptqmodel 2026-04-28T22:57:23,837 copying gptqmodel/_banner.py -> build/lib/gptqmodel 2026-04-28T22:57:23,839 copying gptqmodel/extension.py -> build/lib/gptqmodel 2026-04-28T22:57:23,842 creating build/lib/gptqmodel_ext 2026-04-28T22:57:23,843 copying gptqmodel_ext/__init__.py -> build/lib/gptqmodel_ext 2026-04-28T22:57:23,845 creating build/lib/causal_conv1d 2026-04-28T22:57:23,847 copying causal_conv1d/causal_conv1d_varlen.py -> build/lib/causal_conv1d 2026-04-28T22:57:23,849 copying causal_conv1d/causal_conv1d_interface.py -> build/lib/causal_conv1d 2026-04-28T22:57:23,851 copying causal_conv1d/__init__.py -> build/lib/causal_conv1d 2026-04-28T22:57:23,854 creating build/lib/gptqmodel/eora 2026-04-28T22:57:23,855 copying gptqmodel/eora/__init__.py -> build/lib/gptqmodel/eora 2026-04-28T22:57:23,857 copying gptqmodel/eora/eora.py -> build/lib/gptqmodel/eora 2026-04-28T22:57:23,859 creating build/lib/gptqmodel/exllamav3 2026-04-28T22:57:23,860 copying gptqmodel/exllamav3/__init__.py -> build/lib/gptqmodel/exllamav3 2026-04-28T22:57:23,862 copying gptqmodel/exllamav3/ext.py -> build/lib/gptqmodel/exllamav3 2026-04-28T22:57:23,865 creating build/lib/gptqmodel/nn_modules 2026-04-28T22:57:23,866 copying gptqmodel/nn_modules/__init__.py -> build/lib/gptqmodel/nn_modules 2026-04-28T22:57:23,868 copying gptqmodel/nn_modules/exllamav3_torch.py -> build/lib/gptqmodel/nn_modules 2026-04-28T22:57:23,870 copying gptqmodel/nn_modules/exllamav3.py -> build/lib/gptqmodel/nn_modules 2026-04-28T22:57:23,873 copying gptqmodel/nn_modules/converter.py -> build/lib/gptqmodel/nn_modules 2026-04-28T22:57:23,875 copying gptqmodel/nn_modules/hooked_linear.py -> build/lib/gptqmodel/nn_modules 2026-04-28T22:57:23,878 creating build/lib/gptqmodel/quantization 2026-04-28T22:57:23,880 copying gptqmodel/quantization/foem.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,882 copying gptqmodel/quantization/__init__.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,884 copying gptqmodel/quantization/gptq.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,887 copying gptqmodel/quantization/dtype.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,890 copying gptqmodel/quantization/fallback_smooth.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,893 copying gptqmodel/quantization/protocol.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,896 copying gptqmodel/quantization/gptaq.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,898 copying gptqmodel/quantization/qqq.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,901 copying gptqmodel/quantization/config.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,906 copying gptqmodel/quantization/npu_linalg.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,908 copying gptqmodel/quantization/rtn.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,910 copying gptqmodel/quantization/gar_ref.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,912 copying gptqmodel/quantization/gar.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,915 copying gptqmodel/quantization/quantizer.py -> build/lib/gptqmodel/quantization 2026-04-28T22:57:23,917 creating build/lib/gptqmodel/hf_kernels 2026-04-28T22:57:23,918 copying gptqmodel/hf_kernels/__init__.py -> build/lib/gptqmodel/hf_kernels 2026-04-28T22:57:23,921 creating build/lib/gptqmodel/adapter 2026-04-28T22:57:23,922 copying gptqmodel/adapter/__init__.py -> build/lib/gptqmodel/adapter 2026-04-28T22:57:23,923 copying gptqmodel/adapter/peft.py -> build/lib/gptqmodel/adapter 2026-04-28T22:57:23,926 copying gptqmodel/adapter/remote.py -> build/lib/gptqmodel/adapter 2026-04-28T22:57:23,928 copying gptqmodel/adapter/adapter.py -> build/lib/gptqmodel/adapter 2026-04-28T22:57:23,931 creating build/lib/gptqmodel/hf_minimax_m2 2026-04-28T22:57:23,933 copying gptqmodel/hf_minimax_m2/__init__.py -> build/lib/gptqmodel/hf_minimax_m2 2026-04-28T22:57:23,935 copying gptqmodel/hf_minimax_m2/modeling_minimax_m2.py -> build/lib/gptqmodel/hf_minimax_m2 2026-04-28T22:57:23,938 copying gptqmodel/hf_minimax_m2/test_minimax_m2_hf.py -> build/lib/gptqmodel/hf_minimax_m2 2026-04-28T22:57:23,940 copying gptqmodel/hf_minimax_m2/configuration_minimax_m2.py -> build/lib/gptqmodel/hf_minimax_m2 2026-04-28T22:57:23,944 creating build/lib/gptqmodel/utils 2026-04-28T22:57:23,945 copying gptqmodel/utils/openai_server.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,948 copying gptqmodel/utils/data.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,950 copying gptqmodel/utils/nogil_patcher.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,953 copying gptqmodel/utils/exllamav2.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,955 copying gptqmodel/utils/__init__.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,957 copying gptqmodel/utils/ctx.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,959 copying gptqmodel/utils/torch.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,961 copying gptqmodel/utils/importer.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,964 copying gptqmodel/utils/rocm.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,965 copying gptqmodel/utils/sglang.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,967 copying gptqmodel/utils/audio.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,970 copying gptqmodel/utils/module_locks.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,971 copying gptqmodel/utils/tensor.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,973 copying gptqmodel/utils/model_dequant.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,976 copying gptqmodel/utils/jit_compile_baselines.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,978 copying gptqmodel/utils/paroquant_benchmark.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,981 copying gptqmodel/utils/linalg_warmup.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,983 copying gptqmodel/utils/mlx.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,985 copying gptqmodel/utils/memory.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,988 copying gptqmodel/utils/internal_gguf.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,990 copying gptqmodel/utils/hub.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,992 copying gptqmodel/utils/stream.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,995 copying gptqmodel/utils/model.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:23,998 copying gptqmodel/utils/threads.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,000 copying gptqmodel/utils/paroquant.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,003 copying gptqmodel/utils/calibration.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,005 copying gptqmodel/utils/marlin.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,009 copying gptqmodel/utils/looper_helpers.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,011 copying gptqmodel/utils/qqq.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,013 copying gptqmodel/utils/device.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,015 copying gptqmodel/utils/colors.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,017 copying gptqmodel/utils/safe.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,019 copying gptqmodel/utils/disk.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,022 copying gptqmodel/utils/logger.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,024 copying gptqmodel/utils/backend.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,026 copying gptqmodel/utils/image.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,028 copying gptqmodel/utils/machete.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,031 copying gptqmodel/utils/cpp.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,034 copying gptqmodel/utils/vram.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,037 copying gptqmodel/utils/mmlupro.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,039 copying gptqmodel/utils/attn_mask.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,041 copying gptqmodel/utils/terminal.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,043 copying gptqmodel/utils/marlin_scalar_type.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,046 copying gptqmodel/utils/vllm.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,048 copying gptqmodel/utils/cuda_activation_buffer.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,051 copying gptqmodel/utils/threadx.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,054 copying gptqmodel/utils/bitblas.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,056 copying gptqmodel/utils/exllamav3.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,058 copying gptqmodel/utils/inspect.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,061 copying gptqmodel/utils/hf.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,064 copying gptqmodel/utils/random_str.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,066 copying gptqmodel/utils/fallback.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,068 copying gptqmodel/utils/modelscope.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,070 copying gptqmodel/utils/python.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,071 copying gptqmodel/utils/device_telemetry.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,073 copying gptqmodel/utils/safetensor.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,075 copying gptqmodel/utils/structure.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,078 copying gptqmodel/utils/gemv.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,080 copying gptqmodel/utils/awq.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,082 copying gptqmodel/utils/offload.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,085 copying gptqmodel/utils/env.py -> build/lib/gptqmodel/utils 2026-04-28T22:57:24,087 creating build/lib/gptqmodel/models 2026-04-28T22:57:24,088 copying gptqmodel/models/loader.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,092 copying gptqmodel/models/__init__.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,094 copying gptqmodel/models/moe_lifecycle.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,097 copying gptqmodel/models/auto.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,100 copying gptqmodel/models/base.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,105 copying gptqmodel/models/_const.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,107 copying gptqmodel/models/writer.py -> build/lib/gptqmodel/models 2026-04-28T22:57:24,111 creating build/lib/gptqmodel/looper 2026-04-28T22:57:24,112 copying gptqmodel/looper/native_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,115 copying gptqmodel/looper/linear_mode.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,117 copying gptqmodel/looper/__init__.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,118 copying gptqmodel/looper/loop_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,121 copying gptqmodel/looper/paroquant_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,126 copying gptqmodel/looper/module_looper.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,130 copying gptqmodel/looper/stage_layer.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,133 copying gptqmodel/looper/weight_only_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,135 copying gptqmodel/looper/qqq_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,138 copying gptqmodel/looper/forward_executor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,141 copying gptqmodel/looper/gptq_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,144 copying gptqmodel/looper/dequantize_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,146 copying gptqmodel/looper/stage_inputs_capture.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,148 copying gptqmodel/looper/input_cache.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,150 copying gptqmodel/looper/awq_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,154 copying gptqmodel/looper/module_preprocessor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,157 copying gptqmodel/looper/eora_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,159 copying gptqmodel/looper/weight_only_looper.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,162 copying gptqmodel/looper/exllamav3_processor.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,165 copying gptqmodel/looper/stage_subset.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,168 copying gptqmodel/looper/named_module.py -> build/lib/gptqmodel/looper 2026-04-28T22:57:24,171 creating build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,172 copying gptqmodel/exllamav3/util/arch_list.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,175 copying gptqmodel/exllamav3/util/__init__.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,177 copying gptqmodel/exllamav3/util/hadamard.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,179 copying gptqmodel/exllamav3/util/tensor.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,181 copying gptqmodel/exllamav3/util/memory.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,184 copying gptqmodel/exllamav3/util/progress.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,186 copying gptqmodel/exllamav3/util/misc.py -> build/lib/gptqmodel/exllamav3/util 2026-04-28T22:57:24,188 creating build/lib/gptqmodel/exllamav3/modules 2026-04-28T22:57:24,189 copying gptqmodel/exllamav3/modules/__init__.py -> build/lib/gptqmodel/exllamav3/modules 2026-04-28T22:57:24,191 creating build/lib/gptqmodel/exllamav3/modules/quant 2026-04-28T22:57:24,192 copying gptqmodel/exllamav3/modules/quant/__init__.py -> build/lib/gptqmodel/exllamav3/modules/quant 2026-04-28T22:57:24,194 copying gptqmodel/exllamav3/modules/quant/exl3.py -> build/lib/gptqmodel/exllamav3/modules/quant 2026-04-28T22:57:24,197 creating build/lib/gptqmodel/exllamav3/modules/quant/exl3_lib 2026-04-28T22:57:24,198 copying gptqmodel/exllamav3/modules/quant/exl3_lib/__init__.py -> build/lib/gptqmodel/exllamav3/modules/quant/exl3_lib 2026-04-28T22:57:24,199 copying gptqmodel/exllamav3/modules/quant/exl3_lib/quantize.py -> build/lib/gptqmodel/exllamav3/modules/quant/exl3_lib 2026-04-28T22:57:24,203 creating build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,204 copying gptqmodel/nn_modules/qlinear/exllamav2_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,208 copying gptqmodel/nn_modules/qlinear/gemm_awq_triton.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,210 copying gptqmodel/nn_modules/qlinear/exllamav2.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,212 copying gptqmodel/nn_modules/qlinear/__init__.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,216 copying gptqmodel/nn_modules/qlinear/torch.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,219 copying gptqmodel/nn_modules/qlinear/gemv_fast_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,221 copying gptqmodel/nn_modules/qlinear/fp4.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,223 copying gptqmodel/nn_modules/qlinear/lookahead.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,225 copying gptqmodel/nn_modules/qlinear/gemm_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,228 copying gptqmodel/nn_modules/qlinear/paroquant.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,230 copying gptqmodel/nn_modules/qlinear/bitblas_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,233 copying gptqmodel/nn_modules/qlinear/torch_fused.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,235 copying gptqmodel/nn_modules/qlinear/marlin.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,238 copying gptqmodel/nn_modules/qlinear/torch_int8.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,241 copying gptqmodel/nn_modules/qlinear/qqq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,243 copying gptqmodel/nn_modules/qlinear/fp8.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,246 copying gptqmodel/nn_modules/qlinear/gguf_triton.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,250 copying gptqmodel/nn_modules/qlinear/tritonv2.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,252 copying gptqmodel/nn_modules/qlinear/machete.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,255 copying gptqmodel/nn_modules/qlinear/machete_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,257 copying gptqmodel/nn_modules/qlinear/gemv_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,260 copying gptqmodel/nn_modules/qlinear/pack_block_ext.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,262 copying gptqmodel/nn_modules/qlinear/paroquant_triton.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,264 copying gptqmodel/nn_modules/qlinear/gguf.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,268 copying gptqmodel/nn_modules/qlinear/bitblas.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,270 copying gptqmodel/nn_modules/qlinear/bitsandbytes.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,273 copying gptqmodel/nn_modules/qlinear/torch_aten_kernel_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,275 copying gptqmodel/nn_modules/qlinear/gguf_cpp.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,278 copying gptqmodel/nn_modules/qlinear/torch_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,281 copying gptqmodel/nn_modules/qlinear/torch_fused_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,283 copying gptqmodel/nn_modules/qlinear/torch_int8_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,286 copying gptqmodel/nn_modules/qlinear/torch_aten_kernel.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,288 copying gptqmodel/nn_modules/qlinear/bitblas_target_detector.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,290 copying gptqmodel/nn_modules/qlinear/utils.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,292 copying gptqmodel/nn_modules/qlinear/marlin_awq.py -> build/lib/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:24,295 creating build/lib/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:24,296 copying gptqmodel/nn_modules/triton_utils/__init__.py -> build/lib/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:24,298 copying gptqmodel/nn_modules/triton_utils/kernels.py -> build/lib/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:24,301 copying gptqmodel/nn_modules/triton_utils/dequant.py -> build/lib/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:24,303 copying gptqmodel/nn_modules/triton_utils/custom_autotune.py -> build/lib/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:24,306 copying gptqmodel/nn_modules/triton_utils/mixin.py -> build/lib/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:24,308 creating build/lib/gptqmodel/quantization/paroquant 2026-04-28T22:57:24,309 copying gptqmodel/quantization/paroquant/__init__.py -> build/lib/gptqmodel/quantization/paroquant 2026-04-28T22:57:24,311 copying gptqmodel/quantization/paroquant/optimization.py -> build/lib/gptqmodel/quantization/paroquant 2026-04-28T22:57:24,315 creating build/lib/gptqmodel/quantization/awq 2026-04-28T22:57:24,316 copying gptqmodel/quantization/awq/__init__.py -> build/lib/gptqmodel/quantization/awq 2026-04-28T22:57:24,318 creating build/lib/gptqmodel/quantization/rotation 2026-04-28T22:57:24,319 copying gptqmodel/quantization/rotation/__init__.py -> build/lib/gptqmodel/quantization/rotation 2026-04-28T22:57:24,321 copying gptqmodel/quantization/rotation/rotation.py -> build/lib/gptqmodel/quantization/rotation 2026-04-28T22:57:24,324 copying gptqmodel/quantization/rotation/hadamard_utils.py -> build/lib/gptqmodel/quantization/rotation 2026-04-28T22:57:24,336 creating build/lib/gptqmodel/quantization/paroquant/modules 2026-04-28T22:57:24,337 copying gptqmodel/quantization/paroquant/modules/__init__.py -> build/lib/gptqmodel/quantization/paroquant/modules 2026-04-28T22:57:24,340 creating build/lib/gptqmodel/quantization/paroquant/modules/triton 2026-04-28T22:57:24,341 copying gptqmodel/quantization/paroquant/modules/triton/__init__.py -> build/lib/gptqmodel/quantization/paroquant/modules/triton 2026-04-28T22:57:24,343 copying gptqmodel/quantization/paroquant/modules/triton/gemm.py -> build/lib/gptqmodel/quantization/paroquant/modules/triton 2026-04-28T22:57:24,346 creating build/lib/gptqmodel/quantization/awq/quantize 2026-04-28T22:57:24,347 copying gptqmodel/quantization/awq/quantize/__init__.py -> build/lib/gptqmodel/quantization/awq/quantize 2026-04-28T22:57:24,349 copying gptqmodel/quantization/awq/quantize/scale.py -> build/lib/gptqmodel/quantization/awq/quantize 2026-04-28T22:57:24,352 creating build/lib/gptqmodel/quantization/awq/utils 2026-04-28T22:57:24,353 copying gptqmodel/quantization/awq/utils/__init__.py -> build/lib/gptqmodel/quantization/awq/utils 2026-04-28T22:57:24,354 copying gptqmodel/quantization/awq/utils/packing_utils.py -> build/lib/gptqmodel/quantization/awq/utils 2026-04-28T22:57:24,357 copying gptqmodel/quantization/awq/utils/module.py -> build/lib/gptqmodel/quantization/awq/utils 2026-04-28T22:57:24,359 copying gptqmodel/quantization/awq/utils/calib_data.py -> build/lib/gptqmodel/quantization/awq/utils 2026-04-28T22:57:24,361 copying gptqmodel/quantization/awq/utils/utils.py -> build/lib/gptqmodel/quantization/awq/utils 2026-04-28T22:57:24,363 creating build/lib/gptqmodel/quantization/awq/modules 2026-04-28T22:57:24,364 copying gptqmodel/quantization/awq/modules/__init__.py -> build/lib/gptqmodel/quantization/awq/modules 2026-04-28T22:57:24,366 copying gptqmodel/quantization/awq/modules/act.py -> build/lib/gptqmodel/quantization/awq/modules 2026-04-28T22:57:24,368 creating build/lib/gptqmodel/quantization/awq/modules/triton 2026-04-28T22:57:24,369 copying gptqmodel/quantization/awq/modules/triton/__init__.py -> build/lib/gptqmodel/quantization/awq/modules/triton 2026-04-28T22:57:24,371 copying gptqmodel/quantization/awq/modules/triton/gemm.py -> build/lib/gptqmodel/quantization/awq/modules/triton 2026-04-28T22:57:24,374 creating build/lib/gptqmodel/hf_kernels/mamba_ssm 2026-04-28T22:57:24,375 copying gptqmodel/hf_kernels/mamba_ssm/__init__.py -> build/lib/gptqmodel/hf_kernels/mamba_ssm 2026-04-28T22:57:24,377 creating build/lib/gptqmodel/hf_kernels/mamba_ssm/ops 2026-04-28T22:57:24,379 copying gptqmodel/hf_kernels/mamba_ssm/ops/__init__.py -> build/lib/gptqmodel/hf_kernels/mamba_ssm/ops 2026-04-28T22:57:24,381 copying gptqmodel/hf_kernels/mamba_ssm/ops/selective_scan_interface.py -> build/lib/gptqmodel/hf_kernels/mamba_ssm/ops 2026-04-28T22:57:24,383 creating build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:24,385 copying gptqmodel/hf_kernels/mamba_ssm/ops/triton/__init__.py -> build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:24,387 copying gptqmodel/hf_kernels/mamba_ssm/ops/triton/ssd_combined.py -> build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:24,389 copying gptqmodel/hf_kernels/mamba_ssm/ops/triton/selective_state_update.py -> build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:24,394 creating build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,395 copying gptqmodel/models/definitions/glm4v.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,397 copying gptqmodel/models/definitions/mimo.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,398 copying gptqmodel/models/definitions/ernie4_5_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,401 copying gptqmodel/models/definitions/__init__.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,403 copying gptqmodel/models/definitions/gpt_bigcode.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,405 copying gptqmodel/models/definitions/falcon_h1.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,407 copying gptqmodel/models/definitions/gemma3.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,409 copying gptqmodel/models/definitions/minicpm_v.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,411 copying gptqmodel/models/definitions/exaone.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,413 copying gptqmodel/models/definitions/bloom.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,415 copying gptqmodel/models/definitions/qwen2_5_omni.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,416 copying gptqmodel/models/definitions/phi.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,419 copying gptqmodel/models/definitions/qwen2_5_vl.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,420 copying gptqmodel/models/definitions/glmasr.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,422 copying gptqmodel/models/definitions/apertus.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,424 copying gptqmodel/models/definitions/gemma2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,426 copying gptqmodel/models/definitions/mpt.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,428 copying gptqmodel/models/definitions/qwen2_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,430 copying gptqmodel/models/definitions/brumby.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,431 copying gptqmodel/models/definitions/mistral3.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,433 copying gptqmodel/models/definitions/gpt_neox.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,435 copying gptqmodel/models/definitions/codegen.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,437 copying gptqmodel/models/definitions/ernie4_5.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,439 copying gptqmodel/models/definitions/base_qwen2_5_omni.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,441 copying gptqmodel/models/definitions/deepseek_v2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,443 copying gptqmodel/models/definitions/gpt_oss.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,445 copying gptqmodel/models/definitions/llava_qwen2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,447 copying gptqmodel/models/definitions/dbrx_converted.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,449 copying gptqmodel/models/definitions/voxtral.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,450 copying gptqmodel/models/definitions/hymba.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,452 copying gptqmodel/models/definitions/rw.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,454 copying gptqmodel/models/definitions/qwen.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,456 copying gptqmodel/models/definitions/base_qwen3_vl.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,458 copying gptqmodel/models/definitions/phi3.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,460 copying gptqmodel/models/definitions/baichuan.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,462 copying gptqmodel/models/definitions/llama.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,464 copying gptqmodel/models/definitions/minicpm_o.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,467 copying gptqmodel/models/definitions/ovis.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,469 copying gptqmodel/models/definitions/glm_moe_dsa.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,471 copying gptqmodel/models/definitions/grinmoe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,473 copying gptqmodel/models/definitions/gemma4.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,475 copying gptqmodel/models/definitions/qwen3_5.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,477 copying gptqmodel/models/definitions/dbrx.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,479 copying gptqmodel/models/definitions/glm4_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,481 copying gptqmodel/models/definitions/phi4.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,483 copying gptqmodel/models/definitions/llada2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,485 copying gptqmodel/models/definitions/qwen2_vl.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,487 copying gptqmodel/models/definitions/gpt2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,489 copying gptqmodel/models/definitions/xverse.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,491 copying gptqmodel/models/definitions/qwen2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,493 copying gptqmodel/models/definitions/minimax_m2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,495 copying gptqmodel/models/definitions/moss.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,497 copying gptqmodel/models/definitions/qwen3_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,499 copying gptqmodel/models/definitions/deepseek_v3.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,501 copying gptqmodel/models/definitions/lfm2_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,503 copying gptqmodel/models/definitions/afmoe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,505 copying gptqmodel/models/definitions/klear.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,506 copying gptqmodel/models/definitions/internlm2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,508 copying gptqmodel/models/definitions/falcon_mamba.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,511 copying gptqmodel/models/definitions/mobilellm.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,512 copying gptqmodel/models/definitions/dream.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,514 copying gptqmodel/models/definitions/dots1.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,516 copying gptqmodel/models/definitions/bailing_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,518 copying gptqmodel/models/definitions/qwen3_5_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,520 copying gptqmodel/models/definitions/minicpm3.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,522 copying gptqmodel/models/definitions/instella.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,524 copying gptqmodel/models/definitions/decilm.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,526 copying gptqmodel/models/definitions/nemotron_h.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,528 copying gptqmodel/models/definitions/exaone4.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,530 copying gptqmodel/models/definitions/gemma3n.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,533 copying gptqmodel/models/definitions/longcat_flash.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,534 copying gptqmodel/models/definitions/mixtral.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,537 copying gptqmodel/models/definitions/internvl_chat.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,539 copying gptqmodel/models/definitions/qwen3.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,541 copying gptqmodel/models/definitions/minicpm.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,543 copying gptqmodel/models/definitions/glm_ocr.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,545 copying gptqmodel/models/definitions/ovis2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,547 copying gptqmodel/models/definitions/base_qwen2_vl.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,550 copying gptqmodel/models/definitions/granitemoehybrid.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,552 copying gptqmodel/models/definitions/gpt_neo.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,554 copying gptqmodel/models/definitions/llama4.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,556 copying gptqmodel/models/definitions/mllama.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,558 copying gptqmodel/models/definitions/glm4_moe_lite.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,560 copying gptqmodel/models/definitions/glm.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,562 copying gptqmodel/models/definitions/starcoder2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,564 copying gptqmodel/models/definitions/telechat2.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,565 copying gptqmodel/models/definitions/qwen3_vl.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,567 copying gptqmodel/models/definitions/gptj.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,569 copying gptqmodel/models/definitions/olmoe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,571 copying gptqmodel/models/definitions/qwen3_omni_moe.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,573 copying gptqmodel/models/definitions/chatglm.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,575 copying gptqmodel/models/definitions/qwen3_next.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,577 copying gptqmodel/models/definitions/pangu_alpha.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,579 copying gptqmodel/models/definitions/opt.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,581 copying gptqmodel/models/definitions/internlm.py -> build/lib/gptqmodel/models/definitions 2026-04-28T22:57:24,584 creating build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:24,585 copying gptqmodel_ext/cutlass_extensions/__init__.py -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:24,587 copying gptqmodel_ext/cutlass_extensions/vllm_cutlass_library_extension.py -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:24,590 creating build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:24,591 copying gptqmodel_ext/marlin/generate_kernels.py -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:24,594 creating build/lib/gptqmodel_ext/machete 2026-04-28T22:57:24,595 copying gptqmodel_ext/machete/generate.py -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:24,604 running egg_info 2026-04-28T22:57:24,614 writing GPTQModel.egg-info/PKG-INFO 2026-04-28T22:57:24,626 writing dependency_links to GPTQModel.egg-info/dependency_links.txt 2026-04-28T22:57:24,633 writing requirements to GPTQModel.egg-info/requires.txt 2026-04-28T22:57:24,634 writing top-level names to GPTQModel.egg-info/top_level.txt 2026-04-28T22:57:24,691 reading manifest file 'GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:24,715 reading manifest template 'MANIFEST.in' 2026-04-28T22:57:24,778 warning: no files found matching '*.hpp' under directory 'gptqmodel_ext/exllamav3' 2026-04-28T22:57:24,849 warning: no files found matching '*.c' under directory 'gptqmodel_ext/exllamav3' 2026-04-28T22:57:24,954 warning: no files found matching '*.cpp' under directory 'gptqmodel_ext/machete' 2026-04-28T22:57:24,965 warning: no files found matching '*.h' under directory 'gptqmodel_ext/cutlass_extensions' 2026-04-28T22:57:24,983 warning: no files found matching '*.cu' under directory 'gptqmodel_ext/cutlass_extensions' 2026-04-28T22:57:24,998 warning: no files found matching '*.cuh' under directory 'gptqmodel_ext/qqq' 2026-04-28T22:57:25,008 warning: no previously-included files matching '__pycache__' found under directory 'gptqmodel_ext' 2026-04-28T22:57:25,010 warning: no previously-included files matching '*.pyc' found under directory 'gptqmodel_ext' 2026-04-28T22:57:25,011 no previously-included directories found matching 'tests' 2026-04-28T22:57:25,012 no previously-included directories found matching 'format' 2026-04-28T22:57:25,013 adding license file 'LICENSE' 2026-04-28T22:57:25,034 writing manifest file 'GPTQModel.egg-info/SOURCES.txt' 2026-04-28T22:57:25,038 /tmp/pip-build-env-h8xeuah2/overlay/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'gptqmodel.exllamav3.util.hadamard_data' is absent from the `packages` configuration. 2026-04-28T22:57:25,039 !! 2026-04-28T22:57:25,040 ******************************************************************************** 2026-04-28T22:57:25,040 ############################ 2026-04-28T22:57:25,040 # Package would be ignored # 2026-04-28T22:57:25,041 ############################ 2026-04-28T22:57:25,041 Python recognizes 'gptqmodel.exllamav3.util.hadamard_data' as an importable package[^1], 2026-04-28T22:57:25,042 but it is absent from setuptools' `packages` configuration. 2026-04-28T22:57:25,042 This leads to an ambiguous overall configuration. If you want to distribute this 2026-04-28T22:57:25,043 package, please make sure that 'gptqmodel.exllamav3.util.hadamard_data' is explicitly added 2026-04-28T22:57:25,043 to the `packages` configuration field. 2026-04-28T22:57:25,044 Alternatively, you can also rely on setuptools' discovery methods 2026-04-28T22:57:25,044 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-04-28T22:57:25,045 instead of `find_packages(...)`/`find:`). 2026-04-28T22:57:25,046 You can read more about "package discovery" on setuptools documentation page: 2026-04-28T22:57:25,047 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-04-28T22:57:25,048 If you don't want 'gptqmodel.exllamav3.util.hadamard_data' to be distributed and are 2026-04-28T22:57:25,048 already explicitly excluding 'gptqmodel.exllamav3.util.hadamard_data' via 2026-04-28T22:57:25,049 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-04-28T22:57:25,049 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-04-28T22:57:25,050 combination with a more fine grained `package-data` configuration. 2026-04-28T22:57:25,051 You can read more about "package data files" on setuptools documentation page: 2026-04-28T22:57:25,052 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-04-28T22:57:25,054 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-04-28T22:57:25,054 even if it does not contain any `.py` files. 2026-04-28T22:57:25,055 On the other hand, currently there is no concept of package data 2026-04-28T22:57:25,055 directory, all directories are treated like packages. 2026-04-28T22:57:25,056 ******************************************************************************** 2026-04-28T22:57:25,057 !! 2026-04-28T22:57:25,058 check.warn(importable) 2026-04-28T22:57:25,080 copying gptqmodel_ext/floatx_cpu.cpp -> build/lib/gptqmodel_ext 2026-04-28T22:57:25,084 copying gptqmodel_ext/pack_block_cpu.cpp -> build/lib/gptqmodel_ext 2026-04-28T22:57:25,087 creating build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,088 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_1.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,091 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_100.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,093 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_116.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,096 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_156.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,100 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_172.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,103 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_188.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,106 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_236.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,110 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_244.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,114 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_428.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,121 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_52.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,123 copying gptqmodel/exllamav3/util/hadamard_data/hadamard_92.txt -> build/lib/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,126 copying gptqmodel_ext/cutlass_extensions/common.cpp -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,128 copying gptqmodel_ext/cutlass_extensions/common.hpp -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,130 copying gptqmodel_ext/cutlass_extensions/cute_utils.cuh -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,133 copying gptqmodel_ext/cutlass_extensions/torch_utils.hpp -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,135 copying gptqmodel_ext/cutlass_extensions/vllm_collective_builder.cuh -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,138 copying gptqmodel_ext/cutlass_extensions/vllm_custom_types.cuh -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,140 copying gptqmodel_ext/cutlass_extensions/vllm_numeric_conversion.cuh -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,143 copying gptqmodel_ext/cutlass_extensions/vllm_type_utils.cuh -> build/lib/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:25,145 creating build/lib/gptqmodel_ext/awq 2026-04-28T22:57:25,147 copying gptqmodel_ext/awq/gemm_fast_cuda_entry.cu -> build/lib/gptqmodel_ext/awq 2026-04-28T22:57:25,149 copying gptqmodel_ext/awq/gemv_fast_cuda_entry.cu -> build/lib/gptqmodel_ext/awq 2026-04-28T22:57:25,151 copying gptqmodel_ext/awq/torch_bind.cpp -> build/lib/gptqmodel_ext/awq 2026-04-28T22:57:25,154 creating build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,155 copying gptqmodel_ext/exllamav3/bindings.cpp -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,158 copying gptqmodel_ext/exllamav3/hadamard.cpp -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,160 copying gptqmodel_ext/exllamav3/hadamard.h -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,162 copying gptqmodel_ext/exllamav3/hgemm.cu -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,165 copying gptqmodel_ext/exllamav3/hgemm.cuh -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,167 copying gptqmodel_ext/exllamav3/ptx.cuh -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,170 copying gptqmodel_ext/exllamav3/util.cuh -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,172 copying gptqmodel_ext/exllamav3/util.h -> build/lib/gptqmodel_ext/exllamav3 2026-04-28T22:57:25,175 copying gptqmodel_ext/marlin/awq_marlin_repack.cu -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,178 copying gptqmodel_ext/marlin/awq_marlin_repack.cuh -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,185 copying gptqmodel_ext/marlin/dequant.h -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,188 copying gptqmodel_ext/marlin/gptq_marlin.cu -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,191 copying gptqmodel_ext/marlin/gptq_marlin.cuh -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,194 copying gptqmodel_ext/marlin/gptq_marlin_bf16.cu -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,196 copying gptqmodel_ext/marlin/gptq_marlin_fp16.cu -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,198 copying gptqmodel_ext/marlin/gptq_marlin_repack.cu -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,201 copying gptqmodel_ext/marlin/gptq_marlin_repack.cuh -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,203 copying gptqmodel_ext/marlin/kernel.h -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,206 copying gptqmodel_ext/marlin/marlin.cuh -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,209 copying gptqmodel_ext/marlin/marlin_dtypes.cuh -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,211 copying gptqmodel_ext/marlin/marlin_mma.h -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,214 copying gptqmodel_ext/marlin/marlin_template.h -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,218 copying gptqmodel_ext/marlin/marlin_torch_bf16.cpp -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,220 copying gptqmodel_ext/marlin/marlin_torch_fp16.cpp -> build/lib/gptqmodel_ext/marlin 2026-04-28T22:57:25,222 creating build/lib/gptqmodel_ext/qqq 2026-04-28T22:57:25,223 copying gptqmodel_ext/qqq/qqq.cpp -> build/lib/gptqmodel_ext/qqq 2026-04-28T22:57:25,225 copying gptqmodel_ext/qqq/qqq_gemm.cu -> build/lib/gptqmodel_ext/qqq 2026-04-28T22:57:25,229 copying gptqmodel_ext/qqq/qqq_gemm.h -> build/lib/gptqmodel_ext/qqq 2026-04-28T22:57:25,231 copying gptqmodel_ext/machete/machete_collective_builder.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,234 copying gptqmodel_ext/machete/machete_interleaving_utils.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,236 copying gptqmodel_ext/machete/machete_mainloop.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,239 copying gptqmodel_ext/machete/machete_mm_kernel.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,243 copying gptqmodel_ext/machete/machete_mm_launcher.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,245 copying gptqmodel_ext/machete/machete_prepack_kernel.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,248 copying gptqmodel_ext/machete/machete_prepack_launcher.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,251 copying gptqmodel_ext/machete/machete_prepacked_layout.cuh -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,253 copying gptqmodel_ext/machete/machete_pytorch.cu -> build/lib/gptqmodel_ext/machete 2026-04-28T22:57:25,256 creating build/lib/gptqmodel_ext/exllamav2 2026-04-28T22:57:25,257 copying gptqmodel_ext/exllamav2/config.h -> build/lib/gptqmodel_ext/exllamav2 2026-04-28T22:57:25,260 copying gptqmodel_ext/exllamav2/ext.cpp -> build/lib/gptqmodel_ext/exllamav2 2026-04-28T22:57:25,263 copying gptqmodel_ext/exllamav2/ext_awq.cpp -> build/lib/gptqmodel_ext/exllamav2 2026-04-28T22:57:25,266 copying gptqmodel_ext/exllamav2/ext_common.h -> build/lib/gptqmodel_ext/exllamav2 2026-04-28T22:57:25,269 copying gptqmodel_ext/exllamav2/ext_gptq.cpp -> build/lib/gptqmodel_ext/exllamav2 2026-04-28T22:57:25,271 creating build/lib/gptqmodel_ext/awq/quantization_new 2026-04-28T22:57:25,273 copying gptqmodel_ext/awq/quantization_new/dequantize.cuh -> build/lib/gptqmodel_ext/awq/quantization_new 2026-04-28T22:57:25,275 creating build/lib/gptqmodel_ext/awq/quantization 2026-04-28T22:57:25,277 copying gptqmodel_ext/awq/quantization/dequantize.cuh -> build/lib/gptqmodel_ext/awq/quantization 2026-04-28T22:57:25,280 copying gptqmodel_ext/awq/quantization/gemm_cuda.h -> build/lib/gptqmodel_ext/awq/quantization 2026-04-28T22:57:25,283 copying gptqmodel_ext/awq/quantization/gemm_cuda_gen.cu -> build/lib/gptqmodel_ext/awq/quantization 2026-04-28T22:57:25,287 copying gptqmodel_ext/awq/quantization/gemv_cuda.cu -> build/lib/gptqmodel_ext/awq/quantization 2026-04-28T22:57:25,290 copying gptqmodel_ext/awq/quantization/gemv_cuda.h -> build/lib/gptqmodel_ext/awq/quantization 2026-04-28T22:57:25,292 creating build/lib/gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:25,293 copying gptqmodel_ext/awq/quantization_new/gemm/gemm_cuda.cu -> build/lib/gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:25,297 copying gptqmodel_ext/awq/quantization_new/gemm/gemm_cuda.h -> build/lib/gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:25,300 copying gptqmodel_ext/awq/quantization_new/gemm/semaphore.h -> build/lib/gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:25,303 creating build/lib/gptqmodel_ext/awq/quantization_new/gemv 2026-04-28T22:57:25,304 copying gptqmodel_ext/awq/quantization_new/gemv/gemv_cuda.cu -> build/lib/gptqmodel_ext/awq/quantization_new/gemv 2026-04-28T22:57:25,308 copying gptqmodel_ext/awq/quantization_new/gemv/gemv_cuda.h -> build/lib/gptqmodel_ext/awq/quantization_new/gemv 2026-04-28T22:57:25,310 creating build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,311 copying gptqmodel_ext/exllamav3/quant/codebook.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,314 copying gptqmodel_ext/exllamav3/quant/exl3_devctx.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,317 copying gptqmodel_ext/exllamav3/quant/exl3_devctx.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,320 copying gptqmodel_ext/exllamav3/quant/exl3_dq.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,323 copying gptqmodel_ext/exllamav3/quant/exl3_gemm.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,325 copying gptqmodel_ext/exllamav3/quant/exl3_gemm.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,328 copying gptqmodel_ext/exllamav3/quant/exl3_gemm_inner.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,331 copying gptqmodel_ext/exllamav3/quant/exl3_gemm_kernel.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,334 copying gptqmodel_ext/exllamav3/quant/exl3_kernel_map.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,337 copying gptqmodel_ext/exllamav3/quant/exl3_kernel_map.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,339 copying gptqmodel_ext/exllamav3/quant/exl3_kernel_map_packed.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,344 copying gptqmodel_ext/exllamav3/quant/hadamard.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,347 copying gptqmodel_ext/exllamav3/quant/hadamard.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,350 copying gptqmodel_ext/exllamav3/quant/hadamard_inner.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,353 copying gptqmodel_ext/exllamav3/quant/pack.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,356 copying gptqmodel_ext/exllamav3/quant/pack.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,359 copying gptqmodel_ext/exllamav3/quant/quantize.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,362 copying gptqmodel_ext/exllamav3/quant/quantize.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,365 copying gptqmodel_ext/exllamav3/quant/reconstruct.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,368 copying gptqmodel_ext/exllamav3/quant/reconstruct.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,370 copying gptqmodel_ext/exllamav3/quant/util.cu -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,373 copying gptqmodel_ext/exllamav3/quant/util.cuh -> build/lib/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:25,376 creating build/lib/gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:25,377 copying gptqmodel_ext/exllamav3/libtorch/linear.cpp -> build/lib/gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:25,380 copying gptqmodel_ext/exllamav3/libtorch/linear.h -> build/lib/gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:25,383 copying gptqmodel_ext/exllamav3/libtorch/linear_bc.h -> build/lib/gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:25,385 creating build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,387 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_1.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,389 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_1.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,392 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_2.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,395 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_2.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,397 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_3.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,400 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_3.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,403 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_4.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,405 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_4.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,408 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_5.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,410 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_5.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,413 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_6.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,416 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_6.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,418 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_7.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,420 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_7.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,423 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_8.cu -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,425 copying gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_8.cuh -> build/lib/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:25,428 creating build/lib/gptqmodel_ext/marlin/core 2026-04-28T22:57:25,429 copying gptqmodel_ext/marlin/core/registration.h -> build/lib/gptqmodel_ext/marlin/core 2026-04-28T22:57:25,432 copying gptqmodel_ext/marlin/core/scalar_type.hpp -> build/lib/gptqmodel_ext/marlin/core 2026-04-28T22:57:25,435 creating build/lib/gptqmodel_ext/machete/core 2026-04-28T22:57:25,437 copying gptqmodel_ext/machete/core/registration.h -> build/lib/gptqmodel_ext/machete/core 2026-04-28T22:57:25,440 copying gptqmodel_ext/machete/core/scalar_type.hpp -> build/lib/gptqmodel_ext/machete/core 2026-04-28T22:57:25,443 creating build/lib/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:25,444 copying gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_array_c3x.hpp -> build/lib/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:25,448 copying gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_c2x.hpp -> build/lib/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:25,451 copying gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_c3x.hpp -> build/lib/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:25,455 copying gptqmodel_ext/cutlass_extensions/epilogue/scaled_mm_epilogues_c2x.hpp -> build/lib/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:25,458 copying gptqmodel_ext/cutlass_extensions/epilogue/scaled_mm_epilogues_c3x.hpp -> build/lib/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:25,462 creating build/lib/gptqmodel_ext/exllamav2/cpp 2026-04-28T22:57:25,463 copying gptqmodel_ext/exllamav2/cpp/util.h -> build/lib/gptqmodel_ext/exllamav2/cpp 2026-04-28T22:57:25,466 creating build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,467 copying gptqmodel_ext/exllamav2/cuda/compat.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,470 copying gptqmodel_ext/exllamav2/cuda/compat_gemm.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,473 copying gptqmodel_ext/exllamav2/cuda/matrix_view.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,476 copying gptqmodel_ext/exllamav2/cuda/q_gemm.cu -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,479 copying gptqmodel_ext/exllamav2/cuda/q_gemm.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,482 copying gptqmodel_ext/exllamav2/cuda/q_gemm_awq.cu -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,485 copying gptqmodel_ext/exllamav2/cuda/q_gemm_kernel.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,489 copying gptqmodel_ext/exllamav2/cuda/q_gemm_kernel_awq.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,492 copying gptqmodel_ext/exllamav2/cuda/q_gemm_kernel_gptq.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,495 copying gptqmodel_ext/exllamav2/cuda/q_matrix.cu -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,498 copying gptqmodel_ext/exllamav2/cuda/q_matrix.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,501 copying gptqmodel_ext/exllamav2/cuda/q_matrix_awq.cu -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,505 copying gptqmodel_ext/exllamav2/cuda/util.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:25,507 creating build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,509 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_2.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,512 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_3.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,515 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_4.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,518 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_5.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,521 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_6.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,524 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_8.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,527 copying gptqmodel_ext/exllamav2/cuda/quant/qdq_util.cuh -> build/lib/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:25,564 installing to build/bdist.linux-armv7l/wheel 2026-04-28T22:57:25,565 running install 2026-04-28T22:57:25,587 running install_lib 2026-04-28T22:57:25,593 creating build/bdist.linux-armv7l/wheel 2026-04-28T22:57:25,596 creating build/bdist.linux-armv7l/wheel/gptqmodel 2026-04-28T22:57:25,598 creating build/bdist.linux-armv7l/wheel/gptqmodel/eora 2026-04-28T22:57:25,599 copying build/lib/gptqmodel/eora/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/eora 2026-04-28T22:57:25,602 copying build/lib/gptqmodel/eora/eora.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/eora 2026-04-28T22:57:25,604 copying build/lib/gptqmodel/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel 2026-04-28T22:57:25,607 copying build/lib/gptqmodel/version.py -> build/bdist.linux-armv7l/wheel/./gptqmodel 2026-04-28T22:57:25,610 creating build/bdist.linux-armv7l/wheel/gptqmodel/exllamav3 2026-04-28T22:57:25,611 copying build/lib/gptqmodel/exllamav3/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3 2026-04-28T22:57:25,614 creating build/bdist.linux-armv7l/wheel/gptqmodel/exllamav3/util 2026-04-28T22:57:25,615 copying build/lib/gptqmodel/exllamav3/util/arch_list.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,618 copying build/lib/gptqmodel/exllamav3/util/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,620 copying build/lib/gptqmodel/exllamav3/util/hadamard.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,622 copying build/lib/gptqmodel/exllamav3/util/tensor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,625 copying build/lib/gptqmodel/exllamav3/util/memory.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,627 copying build/lib/gptqmodel/exllamav3/util/progress.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,630 creating build/bdist.linux-armv7l/wheel/gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,632 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_52.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,635 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_92.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,638 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_1.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,640 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_156.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,643 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_244.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,646 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_236.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,650 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_428.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,655 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_188.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,658 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_116.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,661 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_172.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,664 copying build/lib/gptqmodel/exllamav3/util/hadamard_data/hadamard_100.txt -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util/hadamard_data 2026-04-28T22:57:25,666 copying build/lib/gptqmodel/exllamav3/util/misc.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/util 2026-04-28T22:57:25,669 copying build/lib/gptqmodel/exllamav3/ext.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3 2026-04-28T22:57:25,672 creating build/bdist.linux-armv7l/wheel/gptqmodel/exllamav3/modules 2026-04-28T22:57:25,673 copying build/lib/gptqmodel/exllamav3/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/modules 2026-04-28T22:57:25,676 creating build/bdist.linux-armv7l/wheel/gptqmodel/exllamav3/modules/quant 2026-04-28T22:57:25,677 copying build/lib/gptqmodel/exllamav3/modules/quant/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/modules/quant 2026-04-28T22:57:25,679 copying build/lib/gptqmodel/exllamav3/modules/quant/exl3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/modules/quant 2026-04-28T22:57:25,682 creating build/bdist.linux-armv7l/wheel/gptqmodel/exllamav3/modules/quant/exl3_lib 2026-04-28T22:57:25,683 copying build/lib/gptqmodel/exllamav3/modules/quant/exl3_lib/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/modules/quant/exl3_lib 2026-04-28T22:57:25,685 copying build/lib/gptqmodel/exllamav3/modules/quant/exl3_lib/quantize.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/exllamav3/modules/quant/exl3_lib 2026-04-28T22:57:25,689 creating build/bdist.linux-armv7l/wheel/gptqmodel/nn_modules 2026-04-28T22:57:25,691 creating build/bdist.linux-armv7l/wheel/gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,693 copying build/lib/gptqmodel/nn_modules/qlinear/exllamav2_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,696 copying build/lib/gptqmodel/nn_modules/qlinear/gemm_awq_triton.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,698 copying build/lib/gptqmodel/nn_modules/qlinear/exllamav2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,701 copying build/lib/gptqmodel/nn_modules/qlinear/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,704 copying build/lib/gptqmodel/nn_modules/qlinear/torch.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,707 copying build/lib/gptqmodel/nn_modules/qlinear/gemv_fast_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,710 copying build/lib/gptqmodel/nn_modules/qlinear/fp4.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,712 copying build/lib/gptqmodel/nn_modules/qlinear/lookahead.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,715 copying build/lib/gptqmodel/nn_modules/qlinear/gemm_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,717 copying build/lib/gptqmodel/nn_modules/qlinear/paroquant.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,720 copying build/lib/gptqmodel/nn_modules/qlinear/bitblas_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,722 copying build/lib/gptqmodel/nn_modules/qlinear/torch_fused.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,725 copying build/lib/gptqmodel/nn_modules/qlinear/marlin.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,727 copying build/lib/gptqmodel/nn_modules/qlinear/torch_int8.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,730 copying build/lib/gptqmodel/nn_modules/qlinear/qqq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,733 copying build/lib/gptqmodel/nn_modules/qlinear/fp8.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,736 copying build/lib/gptqmodel/nn_modules/qlinear/gguf_triton.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,739 copying build/lib/gptqmodel/nn_modules/qlinear/tritonv2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,742 copying build/lib/gptqmodel/nn_modules/qlinear/machete.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,745 copying build/lib/gptqmodel/nn_modules/qlinear/machete_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,747 copying build/lib/gptqmodel/nn_modules/qlinear/gemv_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,750 copying build/lib/gptqmodel/nn_modules/qlinear/pack_block_ext.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,752 copying build/lib/gptqmodel/nn_modules/qlinear/paroquant_triton.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,755 copying build/lib/gptqmodel/nn_modules/qlinear/gguf.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,759 copying build/lib/gptqmodel/nn_modules/qlinear/bitblas.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,762 copying build/lib/gptqmodel/nn_modules/qlinear/bitsandbytes.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,764 copying build/lib/gptqmodel/nn_modules/qlinear/torch_aten_kernel_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,767 copying build/lib/gptqmodel/nn_modules/qlinear/gguf_cpp.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,770 copying build/lib/gptqmodel/nn_modules/qlinear/torch_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,773 copying build/lib/gptqmodel/nn_modules/qlinear/torch_fused_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,775 copying build/lib/gptqmodel/nn_modules/qlinear/torch_int8_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,778 copying build/lib/gptqmodel/nn_modules/qlinear/torch_aten_kernel.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,781 copying build/lib/gptqmodel/nn_modules/qlinear/bitblas_target_detector.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,783 copying build/lib/gptqmodel/nn_modules/qlinear/utils.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,785 copying build/lib/gptqmodel/nn_modules/qlinear/marlin_awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/qlinear 2026-04-28T22:57:25,788 copying build/lib/gptqmodel/nn_modules/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules 2026-04-28T22:57:25,790 creating build/bdist.linux-armv7l/wheel/gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:25,792 copying build/lib/gptqmodel/nn_modules/triton_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:25,794 copying build/lib/gptqmodel/nn_modules/triton_utils/kernels.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:25,797 copying build/lib/gptqmodel/nn_modules/triton_utils/dequant.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:25,800 copying build/lib/gptqmodel/nn_modules/triton_utils/custom_autotune.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:25,802 copying build/lib/gptqmodel/nn_modules/triton_utils/mixin.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules/triton_utils 2026-04-28T22:57:25,805 copying build/lib/gptqmodel/nn_modules/exllamav3_torch.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules 2026-04-28T22:57:25,808 copying build/lib/gptqmodel/nn_modules/exllamav3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules 2026-04-28T22:57:25,810 copying build/lib/gptqmodel/nn_modules/converter.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules 2026-04-28T22:57:25,812 copying build/lib/gptqmodel/nn_modules/hooked_linear.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/nn_modules 2026-04-28T22:57:25,816 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization 2026-04-28T22:57:25,818 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/paroquant 2026-04-28T22:57:25,820 copying build/lib/gptqmodel/quantization/paroquant/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/paroquant 2026-04-28T22:57:25,822 copying build/lib/gptqmodel/quantization/paroquant/optimization.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/paroquant 2026-04-28T22:57:25,826 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/paroquant/modules 2026-04-28T22:57:25,827 copying build/lib/gptqmodel/quantization/paroquant/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/paroquant/modules 2026-04-28T22:57:25,830 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/paroquant/modules/triton 2026-04-28T22:57:25,832 copying build/lib/gptqmodel/quantization/paroquant/modules/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/paroquant/modules/triton 2026-04-28T22:57:25,834 copying build/lib/gptqmodel/quantization/paroquant/modules/triton/gemm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/paroquant/modules/triton 2026-04-28T22:57:25,837 copying build/lib/gptqmodel/quantization/foem.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,840 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/awq 2026-04-28T22:57:25,842 copying build/lib/gptqmodel/quantization/awq/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq 2026-04-28T22:57:25,844 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/awq/quantize 2026-04-28T22:57:25,845 copying build/lib/gptqmodel/quantization/awq/quantize/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/quantize 2026-04-28T22:57:25,848 copying build/lib/gptqmodel/quantization/awq/quantize/scale.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/quantize 2026-04-28T22:57:25,851 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/awq/utils 2026-04-28T22:57:25,852 copying build/lib/gptqmodel/quantization/awq/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/utils 2026-04-28T22:57:25,854 copying build/lib/gptqmodel/quantization/awq/utils/packing_utils.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/utils 2026-04-28T22:57:25,856 copying build/lib/gptqmodel/quantization/awq/utils/module.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/utils 2026-04-28T22:57:25,858 copying build/lib/gptqmodel/quantization/awq/utils/calib_data.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/utils 2026-04-28T22:57:25,860 copying build/lib/gptqmodel/quantization/awq/utils/utils.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/utils 2026-04-28T22:57:25,863 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/awq/modules 2026-04-28T22:57:25,864 copying build/lib/gptqmodel/quantization/awq/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/modules 2026-04-28T22:57:25,866 copying build/lib/gptqmodel/quantization/awq/modules/act.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/modules 2026-04-28T22:57:25,869 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/awq/modules/triton 2026-04-28T22:57:25,870 copying build/lib/gptqmodel/quantization/awq/modules/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/modules/triton 2026-04-28T22:57:25,872 copying build/lib/gptqmodel/quantization/awq/modules/triton/gemm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/awq/modules/triton 2026-04-28T22:57:25,875 copying build/lib/gptqmodel/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,877 copying build/lib/gptqmodel/quantization/gptq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,881 copying build/lib/gptqmodel/quantization/dtype.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,884 creating build/bdist.linux-armv7l/wheel/gptqmodel/quantization/rotation 2026-04-28T22:57:25,885 copying build/lib/gptqmodel/quantization/rotation/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/rotation 2026-04-28T22:57:25,888 copying build/lib/gptqmodel/quantization/rotation/rotation.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/rotation 2026-04-28T22:57:25,890 copying build/lib/gptqmodel/quantization/rotation/hadamard_utils.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization/rotation 2026-04-28T22:57:25,901 copying build/lib/gptqmodel/quantization/fallback_smooth.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,903 copying build/lib/gptqmodel/quantization/protocol.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,906 copying build/lib/gptqmodel/quantization/gptaq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,908 copying build/lib/gptqmodel/quantization/qqq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,910 copying build/lib/gptqmodel/quantization/config.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,915 copying build/lib/gptqmodel/quantization/npu_linalg.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,917 copying build/lib/gptqmodel/quantization/rtn.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,920 copying build/lib/gptqmodel/quantization/gar_ref.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,922 copying build/lib/gptqmodel/quantization/gar.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,924 copying build/lib/gptqmodel/quantization/quantizer.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/quantization 2026-04-28T22:57:25,927 creating build/bdist.linux-armv7l/wheel/gptqmodel/hf_kernels 2026-04-28T22:57:25,928 copying build/lib/gptqmodel/hf_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels 2026-04-28T22:57:25,930 creating build/bdist.linux-armv7l/wheel/gptqmodel/hf_kernels/mamba_ssm 2026-04-28T22:57:25,931 copying build/lib/gptqmodel/hf_kernels/mamba_ssm/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels/mamba_ssm 2026-04-28T22:57:25,933 creating build/bdist.linux-armv7l/wheel/gptqmodel/hf_kernels/mamba_ssm/ops 2026-04-28T22:57:25,934 copying build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels/mamba_ssm/ops 2026-04-28T22:57:25,936 copying build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/selective_scan_interface.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels/mamba_ssm/ops 2026-04-28T22:57:25,938 creating build/bdist.linux-armv7l/wheel/gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:25,939 copying build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:25,941 copying build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton/ssd_combined.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:25,944 copying build/lib/gptqmodel/hf_kernels/mamba_ssm/ops/triton/selective_state_update.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_kernels/mamba_ssm/ops/triton 2026-04-28T22:57:25,945 copying build/lib/gptqmodel/_banner.py -> build/bdist.linux-armv7l/wheel/./gptqmodel 2026-04-28T22:57:25,947 copying build/lib/gptqmodel/extension.py -> build/bdist.linux-armv7l/wheel/./gptqmodel 2026-04-28T22:57:25,950 creating build/bdist.linux-armv7l/wheel/gptqmodel/adapter 2026-04-28T22:57:25,951 copying build/lib/gptqmodel/adapter/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/adapter 2026-04-28T22:57:25,953 copying build/lib/gptqmodel/adapter/peft.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/adapter 2026-04-28T22:57:25,955 copying build/lib/gptqmodel/adapter/remote.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/adapter 2026-04-28T22:57:25,957 copying build/lib/gptqmodel/adapter/adapter.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/adapter 2026-04-28T22:57:25,960 creating build/bdist.linux-armv7l/wheel/gptqmodel/hf_minimax_m2 2026-04-28T22:57:25,961 copying build/lib/gptqmodel/hf_minimax_m2/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_minimax_m2 2026-04-28T22:57:25,963 copying build/lib/gptqmodel/hf_minimax_m2/modeling_minimax_m2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_minimax_m2 2026-04-28T22:57:25,966 copying build/lib/gptqmodel/hf_minimax_m2/test_minimax_m2_hf.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_minimax_m2 2026-04-28T22:57:25,968 copying build/lib/gptqmodel/hf_minimax_m2/configuration_minimax_m2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/hf_minimax_m2 2026-04-28T22:57:25,972 creating build/bdist.linux-armv7l/wheel/gptqmodel/utils 2026-04-28T22:57:25,973 copying build/lib/gptqmodel/utils/openai_server.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,975 copying build/lib/gptqmodel/utils/data.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,978 copying build/lib/gptqmodel/utils/nogil_patcher.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,980 copying build/lib/gptqmodel/utils/exllamav2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,982 copying build/lib/gptqmodel/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,984 copying build/lib/gptqmodel/utils/ctx.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,986 copying build/lib/gptqmodel/utils/torch.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,988 copying build/lib/gptqmodel/utils/importer.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,991 copying build/lib/gptqmodel/utils/rocm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,992 copying build/lib/gptqmodel/utils/sglang.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,994 copying build/lib/gptqmodel/utils/audio.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,996 copying build/lib/gptqmodel/utils/module_locks.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:25,998 copying build/lib/gptqmodel/utils/tensor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,000 copying build/lib/gptqmodel/utils/model_dequant.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,003 copying build/lib/gptqmodel/utils/jit_compile_baselines.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,004 copying build/lib/gptqmodel/utils/paroquant_benchmark.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,007 copying build/lib/gptqmodel/utils/linalg_warmup.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,009 copying build/lib/gptqmodel/utils/mlx.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,011 copying build/lib/gptqmodel/utils/memory.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,013 copying build/lib/gptqmodel/utils/internal_gguf.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,016 copying build/lib/gptqmodel/utils/hub.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,018 copying build/lib/gptqmodel/utils/stream.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,020 copying build/lib/gptqmodel/utils/model.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,023 copying build/lib/gptqmodel/utils/threads.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,025 copying build/lib/gptqmodel/utils/paroquant.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,028 copying build/lib/gptqmodel/utils/calibration.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,030 copying build/lib/gptqmodel/utils/marlin.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,033 copying build/lib/gptqmodel/utils/looper_helpers.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,035 copying build/lib/gptqmodel/utils/qqq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,037 copying build/lib/gptqmodel/utils/device.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,040 copying build/lib/gptqmodel/utils/colors.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,041 copying build/lib/gptqmodel/utils/safe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,043 copying build/lib/gptqmodel/utils/disk.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,045 copying build/lib/gptqmodel/utils/logger.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,047 copying build/lib/gptqmodel/utils/backend.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,050 copying build/lib/gptqmodel/utils/image.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,052 copying build/lib/gptqmodel/utils/machete.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,054 copying build/lib/gptqmodel/utils/cpp.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,057 copying build/lib/gptqmodel/utils/vram.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,059 copying build/lib/gptqmodel/utils/mmlupro.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,062 copying build/lib/gptqmodel/utils/attn_mask.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,063 copying build/lib/gptqmodel/utils/terminal.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,065 copying build/lib/gptqmodel/utils/marlin_scalar_type.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,068 copying build/lib/gptqmodel/utils/vllm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,070 copying build/lib/gptqmodel/utils/cuda_activation_buffer.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,072 copying build/lib/gptqmodel/utils/threadx.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,075 copying build/lib/gptqmodel/utils/bitblas.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,077 copying build/lib/gptqmodel/utils/exllamav3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,079 copying build/lib/gptqmodel/utils/inspect.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,081 copying build/lib/gptqmodel/utils/hf.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,084 copying build/lib/gptqmodel/utils/random_str.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,086 copying build/lib/gptqmodel/utils/fallback.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,088 copying build/lib/gptqmodel/utils/modelscope.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,090 copying build/lib/gptqmodel/utils/python.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,092 copying build/lib/gptqmodel/utils/device_telemetry.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,093 copying build/lib/gptqmodel/utils/safetensor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,095 copying build/lib/gptqmodel/utils/structure.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,099 copying build/lib/gptqmodel/utils/gemv.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,101 copying build/lib/gptqmodel/utils/awq.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,103 copying build/lib/gptqmodel/utils/offload.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,105 copying build/lib/gptqmodel/utils/env.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/utils 2026-04-28T22:57:26,108 creating build/bdist.linux-armv7l/wheel/gptqmodel/models 2026-04-28T22:57:26,109 copying build/lib/gptqmodel/models/loader.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,114 creating build/bdist.linux-armv7l/wheel/gptqmodel/models/definitions 2026-04-28T22:57:26,115 copying build/lib/gptqmodel/models/definitions/glm4v.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,117 copying build/lib/gptqmodel/models/definitions/mimo.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,118 copying build/lib/gptqmodel/models/definitions/ernie4_5_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,121 copying build/lib/gptqmodel/models/definitions/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,123 copying build/lib/gptqmodel/models/definitions/gpt_bigcode.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,124 copying build/lib/gptqmodel/models/definitions/falcon_h1.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,126 copying build/lib/gptqmodel/models/definitions/gemma3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,128 copying build/lib/gptqmodel/models/definitions/minicpm_v.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,130 copying build/lib/gptqmodel/models/definitions/exaone.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,132 copying build/lib/gptqmodel/models/definitions/bloom.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,134 copying build/lib/gptqmodel/models/definitions/qwen2_5_omni.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,135 copying build/lib/gptqmodel/models/definitions/phi.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,137 copying build/lib/gptqmodel/models/definitions/qwen2_5_vl.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,138 copying build/lib/gptqmodel/models/definitions/glmasr.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,140 copying build/lib/gptqmodel/models/definitions/apertus.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,142 copying build/lib/gptqmodel/models/definitions/gemma2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,144 copying build/lib/gptqmodel/models/definitions/mpt.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,145 copying build/lib/gptqmodel/models/definitions/qwen2_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,147 copying build/lib/gptqmodel/models/definitions/brumby.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,149 copying build/lib/gptqmodel/models/definitions/mistral3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,150 copying build/lib/gptqmodel/models/definitions/gpt_neox.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,152 copying build/lib/gptqmodel/models/definitions/codegen.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,154 copying build/lib/gptqmodel/models/definitions/ernie4_5.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,156 copying build/lib/gptqmodel/models/definitions/base_qwen2_5_omni.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,158 copying build/lib/gptqmodel/models/definitions/deepseek_v2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,160 copying build/lib/gptqmodel/models/definitions/gpt_oss.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,161 copying build/lib/gptqmodel/models/definitions/llava_qwen2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,163 copying build/lib/gptqmodel/models/definitions/dbrx_converted.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,165 copying build/lib/gptqmodel/models/definitions/voxtral.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,167 copying build/lib/gptqmodel/models/definitions/hymba.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,169 copying build/lib/gptqmodel/models/definitions/rw.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,171 copying build/lib/gptqmodel/models/definitions/qwen.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,172 copying build/lib/gptqmodel/models/definitions/base_qwen3_vl.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,174 copying build/lib/gptqmodel/models/definitions/phi3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,176 copying build/lib/gptqmodel/models/definitions/baichuan.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,179 copying build/lib/gptqmodel/models/definitions/llama.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,180 copying build/lib/gptqmodel/models/definitions/minicpm_o.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,182 copying build/lib/gptqmodel/models/definitions/ovis.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,185 copying build/lib/gptqmodel/models/definitions/glm_moe_dsa.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,186 copying build/lib/gptqmodel/models/definitions/grinmoe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,188 copying build/lib/gptqmodel/models/definitions/gemma4.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,190 copying build/lib/gptqmodel/models/definitions/qwen3_5.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,192 copying build/lib/gptqmodel/models/definitions/dbrx.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,194 copying build/lib/gptqmodel/models/definitions/glm4_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,196 copying build/lib/gptqmodel/models/definitions/phi4.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,197 copying build/lib/gptqmodel/models/definitions/llada2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,199 copying build/lib/gptqmodel/models/definitions/qwen2_vl.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,201 copying build/lib/gptqmodel/models/definitions/gpt2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,203 copying build/lib/gptqmodel/models/definitions/xverse.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,204 copying build/lib/gptqmodel/models/definitions/qwen2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,206 copying build/lib/gptqmodel/models/definitions/minimax_m2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,208 copying build/lib/gptqmodel/models/definitions/moss.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,210 copying build/lib/gptqmodel/models/definitions/qwen3_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,212 copying build/lib/gptqmodel/models/definitions/deepseek_v3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,213 copying build/lib/gptqmodel/models/definitions/lfm2_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,215 copying build/lib/gptqmodel/models/definitions/afmoe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,217 copying build/lib/gptqmodel/models/definitions/klear.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,219 copying build/lib/gptqmodel/models/definitions/internlm2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,220 copying build/lib/gptqmodel/models/definitions/falcon_mamba.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,223 copying build/lib/gptqmodel/models/definitions/mobilellm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,224 copying build/lib/gptqmodel/models/definitions/dream.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,226 copying build/lib/gptqmodel/models/definitions/dots1.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,228 copying build/lib/gptqmodel/models/definitions/bailing_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,229 copying build/lib/gptqmodel/models/definitions/qwen3_5_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,231 copying build/lib/gptqmodel/models/definitions/minicpm3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,233 copying build/lib/gptqmodel/models/definitions/instella.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,234 copying build/lib/gptqmodel/models/definitions/decilm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,236 copying build/lib/gptqmodel/models/definitions/nemotron_h.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,238 copying build/lib/gptqmodel/models/definitions/exaone4.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,239 copying build/lib/gptqmodel/models/definitions/gemma3n.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,242 copying build/lib/gptqmodel/models/definitions/longcat_flash.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,243 copying build/lib/gptqmodel/models/definitions/mixtral.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,245 copying build/lib/gptqmodel/models/definitions/internvl_chat.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,247 copying build/lib/gptqmodel/models/definitions/qwen3.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,249 copying build/lib/gptqmodel/models/definitions/minicpm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,251 copying build/lib/gptqmodel/models/definitions/glm_ocr.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,253 copying build/lib/gptqmodel/models/definitions/ovis2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,255 copying build/lib/gptqmodel/models/definitions/base_qwen2_vl.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,258 copying build/lib/gptqmodel/models/definitions/granitemoehybrid.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,260 copying build/lib/gptqmodel/models/definitions/gpt_neo.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,261 copying build/lib/gptqmodel/models/definitions/llama4.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,263 copying build/lib/gptqmodel/models/definitions/mllama.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,265 copying build/lib/gptqmodel/models/definitions/glm4_moe_lite.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,266 copying build/lib/gptqmodel/models/definitions/glm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,268 copying build/lib/gptqmodel/models/definitions/starcoder2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,270 copying build/lib/gptqmodel/models/definitions/telechat2.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,272 copying build/lib/gptqmodel/models/definitions/qwen3_vl.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,274 copying build/lib/gptqmodel/models/definitions/gptj.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,276 copying build/lib/gptqmodel/models/definitions/olmoe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,277 copying build/lib/gptqmodel/models/definitions/qwen3_omni_moe.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,280 copying build/lib/gptqmodel/models/definitions/chatglm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,281 copying build/lib/gptqmodel/models/definitions/qwen3_next.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,283 copying build/lib/gptqmodel/models/definitions/pangu_alpha.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,285 copying build/lib/gptqmodel/models/definitions/opt.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,287 copying build/lib/gptqmodel/models/definitions/internlm.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models/definitions 2026-04-28T22:57:26,289 copying build/lib/gptqmodel/models/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,290 copying build/lib/gptqmodel/models/moe_lifecycle.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,293 copying build/lib/gptqmodel/models/auto.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,296 copying build/lib/gptqmodel/models/base.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,300 copying build/lib/gptqmodel/models/_const.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,302 copying build/lib/gptqmodel/models/writer.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/models 2026-04-28T22:57:26,306 creating build/bdist.linux-armv7l/wheel/gptqmodel/looper 2026-04-28T22:57:26,307 copying build/lib/gptqmodel/looper/native_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,309 copying build/lib/gptqmodel/looper/linear_mode.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,311 copying build/lib/gptqmodel/looper/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,313 copying build/lib/gptqmodel/looper/loop_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,316 copying build/lib/gptqmodel/looper/paroquant_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,320 copying build/lib/gptqmodel/looper/module_looper.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,323 copying build/lib/gptqmodel/looper/stage_layer.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,326 copying build/lib/gptqmodel/looper/weight_only_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,328 copying build/lib/gptqmodel/looper/qqq_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,331 copying build/lib/gptqmodel/looper/forward_executor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,334 copying build/lib/gptqmodel/looper/gptq_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,336 copying build/lib/gptqmodel/looper/dequantize_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,339 copying build/lib/gptqmodel/looper/stage_inputs_capture.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,341 copying build/lib/gptqmodel/looper/input_cache.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,343 copying build/lib/gptqmodel/looper/awq_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,347 copying build/lib/gptqmodel/looper/module_preprocessor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,349 copying build/lib/gptqmodel/looper/eora_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,352 copying build/lib/gptqmodel/looper/weight_only_looper.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,354 copying build/lib/gptqmodel/looper/exllamav3_processor.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,357 copying build/lib/gptqmodel/looper/stage_subset.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,360 copying build/lib/gptqmodel/looper/named_module.py -> build/bdist.linux-armv7l/wheel/./gptqmodel/looper 2026-04-28T22:57:26,363 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext 2026-04-28T22:57:26,364 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/awq 2026-04-28T22:57:26,366 copying build/lib/gptqmodel_ext/awq/gemv_fast_cuda_entry.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq 2026-04-28T22:57:26,367 copying build/lib/gptqmodel_ext/awq/torch_bind.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq 2026-04-28T22:57:26,370 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/awq/quantization_new 2026-04-28T22:57:26,372 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:26,373 copying build/lib/gptqmodel_ext/awq/quantization_new/gemm/gemm_cuda.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:26,375 copying build/lib/gptqmodel_ext/awq/quantization_new/gemm/semaphore.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:26,377 copying build/lib/gptqmodel_ext/awq/quantization_new/gemm/gemm_cuda.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization_new/gemm 2026-04-28T22:57:26,381 copying build/lib/gptqmodel_ext/awq/quantization_new/dequantize.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization_new 2026-04-28T22:57:26,383 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/awq/quantization_new/gemv 2026-04-28T22:57:26,384 copying build/lib/gptqmodel_ext/awq/quantization_new/gemv/gemv_cuda.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization_new/gemv 2026-04-28T22:57:26,387 copying build/lib/gptqmodel_ext/awq/quantization_new/gemv/gemv_cuda.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization_new/gemv 2026-04-28T22:57:26,390 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/awq/quantization 2026-04-28T22:57:26,391 copying build/lib/gptqmodel_ext/awq/quantization/gemm_cuda.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization 2026-04-28T22:57:26,393 copying build/lib/gptqmodel_ext/awq/quantization/gemv_cuda.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization 2026-04-28T22:57:26,395 copying build/lib/gptqmodel_ext/awq/quantization/dequantize.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization 2026-04-28T22:57:26,397 copying build/lib/gptqmodel_ext/awq/quantization/gemv_cuda.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization 2026-04-28T22:57:26,399 copying build/lib/gptqmodel_ext/awq/quantization/gemm_cuda_gen.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq/quantization 2026-04-28T22:57:26,403 copying build/lib/gptqmodel_ext/awq/gemm_fast_cuda_entry.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/awq 2026-04-28T22:57:26,405 copying build/lib/gptqmodel_ext/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext 2026-04-28T22:57:26,407 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav3 2026-04-28T22:57:26,409 copying build/lib/gptqmodel_ext/exllamav3/ptx.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,411 copying build/lib/gptqmodel_ext/exllamav3/hadamard.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,413 copying build/lib/gptqmodel_ext/exllamav3/hgemm.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,415 copying build/lib/gptqmodel_ext/exllamav3/util.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,418 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,419 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_gemm.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,421 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_devctx.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,423 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_gemm_inner.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,426 copying build/lib/gptqmodel_ext/exllamav3/quant/util.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,428 copying build/lib/gptqmodel_ext/exllamav3/quant/hadamard.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,430 copying build/lib/gptqmodel_ext/exllamav3/quant/pack.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,432 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_gemm_kernel.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,433 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_dq.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,436 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_gemm.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,438 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_kernel_map.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,441 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,442 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_3.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,444 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_6.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,445 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_6.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,447 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_5.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,449 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_7.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,451 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_1.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,453 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_2.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,455 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_5.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,457 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_8.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,458 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_7.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,460 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_1.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,462 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_8.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,464 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_2.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,466 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_4.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,468 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_3.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,469 copying build/lib/gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_4.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant/comp_units 2026-04-28T22:57:26,471 copying build/lib/gptqmodel_ext/exllamav3/quant/quantize.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,474 copying build/lib/gptqmodel_ext/exllamav3/quant/reconstruct.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,475 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_kernel_map.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,478 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_kernel_map_packed.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,481 copying build/lib/gptqmodel_ext/exllamav3/quant/util.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,483 copying build/lib/gptqmodel_ext/exllamav3/quant/pack.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,485 copying build/lib/gptqmodel_ext/exllamav3/quant/hadamard_inner.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,488 copying build/lib/gptqmodel_ext/exllamav3/quant/hadamard.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,490 copying build/lib/gptqmodel_ext/exllamav3/quant/codebook.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,492 copying build/lib/gptqmodel_ext/exllamav3/quant/reconstruct.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,494 copying build/lib/gptqmodel_ext/exllamav3/quant/quantize.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,496 copying build/lib/gptqmodel_ext/exllamav3/quant/exl3_devctx.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/quant 2026-04-28T22:57:26,498 copying build/lib/gptqmodel_ext/exllamav3/hgemm.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,500 copying build/lib/gptqmodel_ext/exllamav3/util.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,502 copying build/lib/gptqmodel_ext/exllamav3/hadamard.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,504 copying build/lib/gptqmodel_ext/exllamav3/bindings.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3 2026-04-28T22:57:26,507 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:26,508 copying build/lib/gptqmodel_ext/exllamav3/libtorch/linear.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:26,510 copying build/lib/gptqmodel_ext/exllamav3/libtorch/linear.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:26,512 copying build/lib/gptqmodel_ext/exllamav3/libtorch/linear_bc.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav3/libtorch 2026-04-28T22:57:26,514 copying build/lib/gptqmodel_ext/floatx_cpu.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext 2026-04-28T22:57:26,519 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/marlin 2026-04-28T22:57:26,520 copying build/lib/gptqmodel_ext/marlin/marlin_dtypes.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,522 copying build/lib/gptqmodel_ext/marlin/dequant.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,525 copying build/lib/gptqmodel_ext/marlin/marlin_torch_fp16.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,527 copying build/lib/gptqmodel_ext/marlin/generate_kernels.py -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,529 copying build/lib/gptqmodel_ext/marlin/gptq_marlin.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,531 copying build/lib/gptqmodel_ext/marlin/marlin_torch_bf16.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,533 copying build/lib/gptqmodel_ext/marlin/awq_marlin_repack.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,535 copying build/lib/gptqmodel_ext/marlin/marlin_template.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,538 copying build/lib/gptqmodel_ext/marlin/marlin.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,540 copying build/lib/gptqmodel_ext/marlin/gptq_marlin_fp16.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,542 copying build/lib/gptqmodel_ext/marlin/marlin_mma.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,544 copying build/lib/gptqmodel_ext/marlin/gptq_marlin_repack.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,547 copying build/lib/gptqmodel_ext/marlin/gptq_marlin_repack.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,549 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/marlin/core 2026-04-28T22:57:26,550 copying build/lib/gptqmodel_ext/marlin/core/registration.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin/core 2026-04-28T22:57:26,552 copying build/lib/gptqmodel_ext/marlin/core/scalar_type.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin/core 2026-04-28T22:57:26,554 copying build/lib/gptqmodel_ext/marlin/kernel.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,556 copying build/lib/gptqmodel_ext/marlin/gptq_marlin_bf16.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,558 copying build/lib/gptqmodel_ext/marlin/awq_marlin_repack.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,561 copying build/lib/gptqmodel_ext/marlin/gptq_marlin.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/marlin 2026-04-28T22:57:26,564 copying build/lib/gptqmodel_ext/pack_block_cpu.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext 2026-04-28T22:57:26,567 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/qqq 2026-04-28T22:57:26,568 copying build/lib/gptqmodel_ext/qqq/qqq_gemm.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/qqq 2026-04-28T22:57:26,571 copying build/lib/gptqmodel_ext/qqq/qqq_gemm.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/qqq 2026-04-28T22:57:26,573 copying build/lib/gptqmodel_ext/qqq/qqq.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/qqq 2026-04-28T22:57:26,576 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/machete 2026-04-28T22:57:26,577 copying build/lib/gptqmodel_ext/machete/machete_interleaving_utils.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,579 copying build/lib/gptqmodel_ext/machete/machete_prepack_kernel.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,581 copying build/lib/gptqmodel_ext/machete/machete_mm_kernel.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,584 copying build/lib/gptqmodel_ext/machete/machete_prepacked_layout.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,586 copying build/lib/gptqmodel_ext/machete/machete_mm_launcher.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,588 copying build/lib/gptqmodel_ext/machete/machete_pytorch.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,590 copying build/lib/gptqmodel_ext/machete/machete_collective_builder.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,592 copying build/lib/gptqmodel_ext/machete/machete_prepack_launcher.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,595 copying build/lib/gptqmodel_ext/machete/generate.py -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,598 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/machete/core 2026-04-28T22:57:26,599 copying build/lib/gptqmodel_ext/machete/core/registration.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete/core 2026-04-28T22:57:26,601 copying build/lib/gptqmodel_ext/machete/core/scalar_type.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete/core 2026-04-28T22:57:26,603 copying build/lib/gptqmodel_ext/machete/machete_mainloop.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/machete 2026-04-28T22:57:26,607 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,609 copying build/lib/gptqmodel_ext/cutlass_extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,611 copying build/lib/gptqmodel_ext/cutlass_extensions/vllm_type_utils.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,613 copying build/lib/gptqmodel_ext/cutlass_extensions/cute_utils.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,615 copying build/lib/gptqmodel_ext/cutlass_extensions/common.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,617 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:26,619 copying build/lib/gptqmodel_ext/cutlass_extensions/epilogue/scaled_mm_epilogues_c3x.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:26,622 copying build/lib/gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_c2x.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:26,624 copying build/lib/gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_array_c3x.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:26,627 copying build/lib/gptqmodel_ext/cutlass_extensions/epilogue/scaled_mm_epilogues_c2x.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:26,629 copying build/lib/gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_c3x.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions/epilogue 2026-04-28T22:57:26,632 copying build/lib/gptqmodel_ext/cutlass_extensions/torch_utils.hpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,634 copying build/lib/gptqmodel_ext/cutlass_extensions/common.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,636 copying build/lib/gptqmodel_ext/cutlass_extensions/vllm_numeric_conversion.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,640 copying build/lib/gptqmodel_ext/cutlass_extensions/vllm_collective_builder.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,642 copying build/lib/gptqmodel_ext/cutlass_extensions/vllm_cutlass_library_extension.py -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,644 copying build/lib/gptqmodel_ext/cutlass_extensions/vllm_custom_types.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/cutlass_extensions 2026-04-28T22:57:26,646 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav2 2026-04-28T22:57:26,648 copying build/lib/gptqmodel_ext/exllamav2/ext_common.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2 2026-04-28T22:57:26,650 copying build/lib/gptqmodel_ext/exllamav2/ext.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2 2026-04-28T22:57:26,652 copying build/lib/gptqmodel_ext/exllamav2/ext_awq.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2 2026-04-28T22:57:26,654 copying build/lib/gptqmodel_ext/exllamav2/config.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2 2026-04-28T22:57:26,656 copying build/lib/gptqmodel_ext/exllamav2/ext_gptq.cpp -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2 2026-04-28T22:57:26,659 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav2/cpp 2026-04-28T22:57:26,660 copying build/lib/gptqmodel_ext/exllamav2/cpp/util.h -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cpp 2026-04-28T22:57:26,662 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,663 copying build/lib/gptqmodel_ext/exllamav2/cuda/compat.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,665 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_gemm_awq.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,668 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_gemm_kernel_gptq.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,670 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_matrix_awq.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,673 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_matrix.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,675 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_gemm_kernel.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,677 copying build/lib/gptqmodel_ext/exllamav2/cuda/compat_gemm.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,680 creating build/bdist.linux-armv7l/wheel/gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,681 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_5.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,683 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_2.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,685 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_4.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,688 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_3.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,690 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_6.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,692 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_util.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,694 copying build/lib/gptqmodel_ext/exllamav2/cuda/quant/qdq_8.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda/quant 2026-04-28T22:57:26,696 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_gemm_kernel_awq.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,698 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_matrix.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,701 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_gemm.cu -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,703 copying build/lib/gptqmodel_ext/exllamav2/cuda/util.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,705 copying build/lib/gptqmodel_ext/exllamav2/cuda/q_gemm.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,707 copying build/lib/gptqmodel_ext/exllamav2/cuda/matrix_view.cuh -> build/bdist.linux-armv7l/wheel/./gptqmodel_ext/exllamav2/cuda 2026-04-28T22:57:26,710 creating build/bdist.linux-armv7l/wheel/causal_conv1d 2026-04-28T22:57:26,711 copying build/lib/causal_conv1d/causal_conv1d_varlen.py -> build/bdist.linux-armv7l/wheel/./causal_conv1d 2026-04-28T22:57:26,713 copying build/lib/causal_conv1d/causal_conv1d_interface.py -> build/bdist.linux-armv7l/wheel/./causal_conv1d 2026-04-28T22:57:26,715 copying build/lib/causal_conv1d/__init__.py -> build/bdist.linux-armv7l/wheel/./causal_conv1d 2026-04-28T22:57:26,717 running install_egg_info 2026-04-28T22:57:26,722 Copying GPTQModel.egg-info to build/bdist.linux-armv7l/wheel/./GPTQModel-7.0.0-py3.11.egg-info 2026-04-28T22:57:26,734 running install_scripts 2026-04-28T22:57:26,746 creating build/bdist.linux-armv7l/wheel/gptqmodel-7.0.0.dist-info/WHEEL 2026-04-28T22:57:26,749 creating '/tmp/pip-wheel-huc2s5k6/.tmp-i8yugwyr/gptqmodel-7.0.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-04-28T22:57:26,752 adding 'causal_conv1d/__init__.py' 2026-04-28T22:57:26,753 adding 'causal_conv1d/causal_conv1d_interface.py' 2026-04-28T22:57:26,755 adding 'causal_conv1d/causal_conv1d_varlen.py' 2026-04-28T22:57:26,757 adding 'gptqmodel/__init__.py' 2026-04-28T22:57:26,759 adding 'gptqmodel/_banner.py' 2026-04-28T22:57:26,761 adding 'gptqmodel/extension.py' 2026-04-28T22:57:26,762 adding 'gptqmodel/version.py' 2026-04-28T22:57:26,764 adding 'gptqmodel/adapter/__init__.py' 2026-04-28T22:57:26,766 adding 'gptqmodel/adapter/adapter.py' 2026-04-28T22:57:26,769 adding 'gptqmodel/adapter/peft.py' 2026-04-28T22:57:26,771 adding 'gptqmodel/adapter/remote.py' 2026-04-28T22:57:26,773 adding 'gptqmodel/eora/__init__.py' 2026-04-28T22:57:26,774 adding 'gptqmodel/eora/eora.py' 2026-04-28T22:57:26,776 adding 'gptqmodel/exllamav3/__init__.py' 2026-04-28T22:57:26,777 adding 'gptqmodel/exllamav3/ext.py' 2026-04-28T22:57:26,779 adding 'gptqmodel/exllamav3/modules/__init__.py' 2026-04-28T22:57:26,781 adding 'gptqmodel/exllamav3/modules/quant/__init__.py' 2026-04-28T22:57:26,782 adding 'gptqmodel/exllamav3/modules/quant/exl3.py' 2026-04-28T22:57:26,784 adding 'gptqmodel/exllamav3/modules/quant/exl3_lib/__init__.py' 2026-04-28T22:57:26,789 adding 'gptqmodel/exllamav3/modules/quant/exl3_lib/quantize.py' 2026-04-28T22:57:26,791 adding 'gptqmodel/exllamav3/util/__init__.py' 2026-04-28T22:57:26,792 adding 'gptqmodel/exllamav3/util/arch_list.py' 2026-04-28T22:57:26,794 adding 'gptqmodel/exllamav3/util/hadamard.py' 2026-04-28T22:57:26,795 adding 'gptqmodel/exllamav3/util/memory.py' 2026-04-28T22:57:26,797 adding 'gptqmodel/exllamav3/util/misc.py' 2026-04-28T22:57:26,798 adding 'gptqmodel/exllamav3/util/progress.py' 2026-04-28T22:57:26,800 adding 'gptqmodel/exllamav3/util/tensor.py' 2026-04-28T22:57:26,802 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_1.txt' 2026-04-28T22:57:26,804 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_100.txt' 2026-04-28T22:57:26,806 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_116.txt' 2026-04-28T22:57:26,810 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_156.txt' 2026-04-28T22:57:26,813 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_172.txt' 2026-04-28T22:57:26,817 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_188.txt' 2026-04-28T22:57:26,822 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_236.txt' 2026-04-28T22:57:26,827 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_244.txt' 2026-04-28T22:57:26,837 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_428.txt' 2026-04-28T22:57:26,840 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_52.txt' 2026-04-28T22:57:26,843 adding 'gptqmodel/exllamav3/util/hadamard_data/hadamard_92.txt' 2026-04-28T22:57:26,844 adding 'gptqmodel/hf_kernels/__init__.py' 2026-04-28T22:57:26,846 adding 'gptqmodel/hf_kernels/mamba_ssm/__init__.py' 2026-04-28T22:57:26,848 adding 'gptqmodel/hf_kernels/mamba_ssm/ops/__init__.py' 2026-04-28T22:57:26,850 adding 'gptqmodel/hf_kernels/mamba_ssm/ops/selective_scan_interface.py' 2026-04-28T22:57:26,851 adding 'gptqmodel/hf_kernels/mamba_ssm/ops/triton/__init__.py' 2026-04-28T22:57:26,853 adding 'gptqmodel/hf_kernels/mamba_ssm/ops/triton/selective_state_update.py' 2026-04-28T22:57:26,855 adding 'gptqmodel/hf_kernels/mamba_ssm/ops/triton/ssd_combined.py' 2026-04-28T22:57:26,857 adding 'gptqmodel/hf_minimax_m2/__init__.py' 2026-04-28T22:57:26,858 adding 'gptqmodel/hf_minimax_m2/configuration_minimax_m2.py' 2026-04-28T22:57:26,862 adding 'gptqmodel/hf_minimax_m2/modeling_minimax_m2.py' 2026-04-28T22:57:26,864 adding 'gptqmodel/hf_minimax_m2/test_minimax_m2_hf.py' 2026-04-28T22:57:26,866 adding 'gptqmodel/looper/__init__.py' 2026-04-28T22:57:26,875 adding 'gptqmodel/looper/awq_processor.py' 2026-04-28T22:57:26,877 adding 'gptqmodel/looper/dequantize_processor.py' 2026-04-28T22:57:26,880 adding 'gptqmodel/looper/eora_processor.py' 2026-04-28T22:57:26,882 adding 'gptqmodel/looper/exllamav3_processor.py' 2026-04-28T22:57:26,885 adding 'gptqmodel/looper/forward_executor.py' 2026-04-28T22:57:26,888 adding 'gptqmodel/looper/gptq_processor.py' 2026-04-28T22:57:26,889 adding 'gptqmodel/looper/input_cache.py' 2026-04-28T22:57:26,890 adding 'gptqmodel/looper/linear_mode.py' 2026-04-28T22:57:26,894 adding 'gptqmodel/looper/loop_processor.py' 2026-04-28T22:57:26,901 adding 'gptqmodel/looper/module_looper.py' 2026-04-28T22:57:26,903 adding 'gptqmodel/looper/module_preprocessor.py' 2026-04-28T22:57:26,905 adding 'gptqmodel/looper/named_module.py' 2026-04-28T22:57:26,906 adding 'gptqmodel/looper/native_processor.py' 2026-04-28T22:57:26,918 adding 'gptqmodel/looper/paroquant_processor.py' 2026-04-28T22:57:26,921 adding 'gptqmodel/looper/qqq_processor.py' 2026-04-28T22:57:26,923 adding 'gptqmodel/looper/stage_inputs_capture.py' 2026-04-28T22:57:26,928 adding 'gptqmodel/looper/stage_layer.py' 2026-04-28T22:57:26,934 adding 'gptqmodel/looper/stage_subset.py' 2026-04-28T22:57:26,937 adding 'gptqmodel/looper/weight_only_looper.py' 2026-04-28T22:57:26,938 adding 'gptqmodel/looper/weight_only_processor.py' 2026-04-28T22:57:26,940 adding 'gptqmodel/models/__init__.py' 2026-04-28T22:57:26,942 adding 'gptqmodel/models/_const.py' 2026-04-28T22:57:26,945 adding 'gptqmodel/models/auto.py' 2026-04-28T22:57:26,958 adding 'gptqmodel/models/base.py' 2026-04-28T22:57:26,966 adding 'gptqmodel/models/loader.py' 2026-04-28T22:57:26,969 adding 'gptqmodel/models/moe_lifecycle.py' 2026-04-28T22:57:26,974 adding 'gptqmodel/models/writer.py' 2026-04-28T22:57:26,978 adding 'gptqmodel/models/definitions/__init__.py' 2026-04-28T22:57:26,979 adding 'gptqmodel/models/definitions/afmoe.py' 2026-04-28T22:57:26,980 adding 'gptqmodel/models/definitions/apertus.py' 2026-04-28T22:57:26,982 adding 'gptqmodel/models/definitions/baichuan.py' 2026-04-28T22:57:26,983 adding 'gptqmodel/models/definitions/bailing_moe.py' 2026-04-28T22:57:26,985 adding 'gptqmodel/models/definitions/base_qwen2_5_omni.py' 2026-04-28T22:57:26,987 adding 'gptqmodel/models/definitions/base_qwen2_vl.py' 2026-04-28T22:57:26,989 adding 'gptqmodel/models/definitions/base_qwen3_vl.py' 2026-04-28T22:57:26,990 adding 'gptqmodel/models/definitions/bloom.py' 2026-04-28T22:57:26,991 adding 'gptqmodel/models/definitions/brumby.py' 2026-04-28T22:57:26,993 adding 'gptqmodel/models/definitions/chatglm.py' 2026-04-28T22:57:26,994 adding 'gptqmodel/models/definitions/codegen.py' 2026-04-28T22:57:26,995 adding 'gptqmodel/models/definitions/dbrx.py' 2026-04-28T22:57:26,997 adding 'gptqmodel/models/definitions/dbrx_converted.py' 2026-04-28T22:57:26,998 adding 'gptqmodel/models/definitions/decilm.py' 2026-04-28T22:57:26,999 adding 'gptqmodel/models/definitions/deepseek_v2.py' 2026-04-28T22:57:27,001 adding 'gptqmodel/models/definitions/deepseek_v3.py' 2026-04-28T22:57:27,002 adding 'gptqmodel/models/definitions/dots1.py' 2026-04-28T22:57:27,003 adding 'gptqmodel/models/definitions/dream.py' 2026-04-28T22:57:27,004 adding 'gptqmodel/models/definitions/ernie4_5.py' 2026-04-28T22:57:27,006 adding 'gptqmodel/models/definitions/ernie4_5_moe.py' 2026-04-28T22:57:27,007 adding 'gptqmodel/models/definitions/exaone.py' 2026-04-28T22:57:27,009 adding 'gptqmodel/models/definitions/exaone4.py' 2026-04-28T22:57:27,010 adding 'gptqmodel/models/definitions/falcon_h1.py' 2026-04-28T22:57:27,011 adding 'gptqmodel/models/definitions/falcon_mamba.py' 2026-04-28T22:57:27,013 adding 'gptqmodel/models/definitions/gemma2.py' 2026-04-28T22:57:27,014 adding 'gptqmodel/models/definitions/gemma3.py' 2026-04-28T22:57:27,016 adding 'gptqmodel/models/definitions/gemma3n.py' 2026-04-28T22:57:27,017 adding 'gptqmodel/models/definitions/gemma4.py' 2026-04-28T22:57:27,019 adding 'gptqmodel/models/definitions/glm.py' 2026-04-28T22:57:27,020 adding 'gptqmodel/models/definitions/glm4_moe.py' 2026-04-28T22:57:27,021 adding 'gptqmodel/models/definitions/glm4_moe_lite.py' 2026-04-28T22:57:27,022 adding 'gptqmodel/models/definitions/glm4v.py' 2026-04-28T22:57:27,023 adding 'gptqmodel/models/definitions/glm_moe_dsa.py' 2026-04-28T22:57:27,025 adding 'gptqmodel/models/definitions/glm_ocr.py' 2026-04-28T22:57:27,026 adding 'gptqmodel/models/definitions/glmasr.py' 2026-04-28T22:57:27,027 adding 'gptqmodel/models/definitions/gpt2.py' 2026-04-28T22:57:27,028 adding 'gptqmodel/models/definitions/gpt_bigcode.py' 2026-04-28T22:57:27,030 adding 'gptqmodel/models/definitions/gpt_neo.py' 2026-04-28T22:57:27,031 adding 'gptqmodel/models/definitions/gpt_neox.py' 2026-04-28T22:57:27,032 adding 'gptqmodel/models/definitions/gpt_oss.py' 2026-04-28T22:57:27,034 adding 'gptqmodel/models/definitions/gptj.py' 2026-04-28T22:57:27,035 adding 'gptqmodel/models/definitions/granitemoehybrid.py' 2026-04-28T22:57:27,036 adding 'gptqmodel/models/definitions/grinmoe.py' 2026-04-28T22:57:27,037 adding 'gptqmodel/models/definitions/hymba.py' 2026-04-28T22:57:27,039 adding 'gptqmodel/models/definitions/instella.py' 2026-04-28T22:57:27,040 adding 'gptqmodel/models/definitions/internlm.py' 2026-04-28T22:57:27,041 adding 'gptqmodel/models/definitions/internlm2.py' 2026-04-28T22:57:27,043 adding 'gptqmodel/models/definitions/internvl_chat.py' 2026-04-28T22:57:27,044 adding 'gptqmodel/models/definitions/klear.py' 2026-04-28T22:57:27,046 adding 'gptqmodel/models/definitions/lfm2_moe.py' 2026-04-28T22:57:27,047 adding 'gptqmodel/models/definitions/llada2.py' 2026-04-28T22:57:27,048 adding 'gptqmodel/models/definitions/llama.py' 2026-04-28T22:57:27,050 adding 'gptqmodel/models/definitions/llama4.py' 2026-04-28T22:57:27,051 adding 'gptqmodel/models/definitions/llava_qwen2.py' 2026-04-28T22:57:27,052 adding 'gptqmodel/models/definitions/longcat_flash.py' 2026-04-28T22:57:27,053 adding 'gptqmodel/models/definitions/mimo.py' 2026-04-28T22:57:27,055 adding 'gptqmodel/models/definitions/minicpm.py' 2026-04-28T22:57:27,056 adding 'gptqmodel/models/definitions/minicpm3.py' 2026-04-28T22:57:27,058 adding 'gptqmodel/models/definitions/minicpm_o.py' 2026-04-28T22:57:27,060 adding 'gptqmodel/models/definitions/minicpm_v.py' 2026-04-28T22:57:27,061 adding 'gptqmodel/models/definitions/minimax_m2.py' 2026-04-28T22:57:27,062 adding 'gptqmodel/models/definitions/mistral3.py' 2026-04-28T22:57:27,064 adding 'gptqmodel/models/definitions/mixtral.py' 2026-04-28T22:57:27,065 adding 'gptqmodel/models/definitions/mllama.py' 2026-04-28T22:57:27,066 adding 'gptqmodel/models/definitions/mobilellm.py' 2026-04-28T22:57:27,067 adding 'gptqmodel/models/definitions/moss.py' 2026-04-28T22:57:27,069 adding 'gptqmodel/models/definitions/mpt.py' 2026-04-28T22:57:27,070 adding 'gptqmodel/models/definitions/nemotron_h.py' 2026-04-28T22:57:27,072 adding 'gptqmodel/models/definitions/olmoe.py' 2026-04-28T22:57:27,073 adding 'gptqmodel/models/definitions/opt.py' 2026-04-28T22:57:27,075 adding 'gptqmodel/models/definitions/ovis.py' 2026-04-28T22:57:27,076 adding 'gptqmodel/models/definitions/ovis2.py' 2026-04-28T22:57:27,077 adding 'gptqmodel/models/definitions/pangu_alpha.py' 2026-04-28T22:57:27,079 adding 'gptqmodel/models/definitions/phi.py' 2026-04-28T22:57:27,080 adding 'gptqmodel/models/definitions/phi3.py' 2026-04-28T22:57:27,081 adding 'gptqmodel/models/definitions/phi4.py' 2026-04-28T22:57:27,082 adding 'gptqmodel/models/definitions/qwen.py' 2026-04-28T22:57:27,084 adding 'gptqmodel/models/definitions/qwen2.py' 2026-04-28T22:57:27,085 adding 'gptqmodel/models/definitions/qwen2_5_omni.py' 2026-04-28T22:57:27,086 adding 'gptqmodel/models/definitions/qwen2_5_vl.py' 2026-04-28T22:57:27,087 adding 'gptqmodel/models/definitions/qwen2_moe.py' 2026-04-28T22:57:27,088 adding 'gptqmodel/models/definitions/qwen2_vl.py' 2026-04-28T22:57:27,090 adding 'gptqmodel/models/definitions/qwen3.py' 2026-04-28T22:57:27,091 adding 'gptqmodel/models/definitions/qwen3_5.py' 2026-04-28T22:57:27,092 adding 'gptqmodel/models/definitions/qwen3_5_moe.py' 2026-04-28T22:57:27,093 adding 'gptqmodel/models/definitions/qwen3_moe.py' 2026-04-28T22:57:27,095 adding 'gptqmodel/models/definitions/qwen3_next.py' 2026-04-28T22:57:27,096 adding 'gptqmodel/models/definitions/qwen3_omni_moe.py' 2026-04-28T22:57:27,097 adding 'gptqmodel/models/definitions/qwen3_vl.py' 2026-04-28T22:57:27,099 adding 'gptqmodel/models/definitions/rw.py' 2026-04-28T22:57:27,100 adding 'gptqmodel/models/definitions/starcoder2.py' 2026-04-28T22:57:27,101 adding 'gptqmodel/models/definitions/telechat2.py' 2026-04-28T22:57:27,102 adding 'gptqmodel/models/definitions/voxtral.py' 2026-04-28T22:57:27,104 adding 'gptqmodel/models/definitions/xverse.py' 2026-04-28T22:57:27,105 adding 'gptqmodel/nn_modules/__init__.py' 2026-04-28T22:57:27,107 adding 'gptqmodel/nn_modules/converter.py' 2026-04-28T22:57:27,108 adding 'gptqmodel/nn_modules/exllamav3.py' 2026-04-28T22:57:27,110 adding 'gptqmodel/nn_modules/exllamav3_torch.py' 2026-04-28T22:57:27,112 adding 'gptqmodel/nn_modules/hooked_linear.py' 2026-04-28T22:57:27,119 adding 'gptqmodel/nn_modules/qlinear/__init__.py' 2026-04-28T22:57:27,123 adding 'gptqmodel/nn_modules/qlinear/bitblas.py' 2026-04-28T22:57:27,125 adding 'gptqmodel/nn_modules/qlinear/bitblas_awq.py' 2026-04-28T22:57:27,126 adding 'gptqmodel/nn_modules/qlinear/bitblas_target_detector.py' 2026-04-28T22:57:27,129 adding 'gptqmodel/nn_modules/qlinear/bitsandbytes.py' 2026-04-28T22:57:27,131 adding 'gptqmodel/nn_modules/qlinear/exllamav2.py' 2026-04-28T22:57:27,132 adding 'gptqmodel/nn_modules/qlinear/exllamav2_awq.py' 2026-04-28T22:57:27,134 adding 'gptqmodel/nn_modules/qlinear/fp4.py' 2026-04-28T22:57:27,136 adding 'gptqmodel/nn_modules/qlinear/fp8.py' 2026-04-28T22:57:27,138 adding 'gptqmodel/nn_modules/qlinear/gemm_awq.py' 2026-04-28T22:57:27,140 adding 'gptqmodel/nn_modules/qlinear/gemm_awq_triton.py' 2026-04-28T22:57:27,142 adding 'gptqmodel/nn_modules/qlinear/gemv_awq.py' 2026-04-28T22:57:27,143 adding 'gptqmodel/nn_modules/qlinear/gemv_fast_awq.py' 2026-04-28T22:57:27,148 adding 'gptqmodel/nn_modules/qlinear/gguf.py' 2026-04-28T22:57:27,151 adding 'gptqmodel/nn_modules/qlinear/gguf_cpp.py' 2026-04-28T22:57:27,155 adding 'gptqmodel/nn_modules/qlinear/gguf_triton.py' 2026-04-28T22:57:27,157 adding 'gptqmodel/nn_modules/qlinear/lookahead.py' 2026-04-28T22:57:27,159 adding 'gptqmodel/nn_modules/qlinear/machete.py' 2026-04-28T22:57:27,161 adding 'gptqmodel/nn_modules/qlinear/machete_awq.py' 2026-04-28T22:57:27,163 adding 'gptqmodel/nn_modules/qlinear/marlin.py' 2026-04-28T22:57:27,165 adding 'gptqmodel/nn_modules/qlinear/marlin_awq.py' 2026-04-28T22:57:27,166 adding 'gptqmodel/nn_modules/qlinear/pack_block_ext.py' 2026-04-28T22:57:27,168 adding 'gptqmodel/nn_modules/qlinear/paroquant.py' 2026-04-28T22:57:27,170 adding 'gptqmodel/nn_modules/qlinear/paroquant_triton.py' 2026-04-28T22:57:27,173 adding 'gptqmodel/nn_modules/qlinear/qqq.py' 2026-04-28T22:57:27,176 adding 'gptqmodel/nn_modules/qlinear/torch.py' 2026-04-28T22:57:27,178 adding 'gptqmodel/nn_modules/qlinear/torch_aten_kernel.py' 2026-04-28T22:57:27,180 adding 'gptqmodel/nn_modules/qlinear/torch_aten_kernel_awq.py' 2026-04-28T22:57:27,182 adding 'gptqmodel/nn_modules/qlinear/torch_awq.py' 2026-04-28T22:57:27,184 adding 'gptqmodel/nn_modules/qlinear/torch_fused.py' 2026-04-28T22:57:27,187 adding 'gptqmodel/nn_modules/qlinear/torch_fused_awq.py' 2026-04-28T22:57:27,189 adding 'gptqmodel/nn_modules/qlinear/torch_int8.py' 2026-04-28T22:57:27,190 adding 'gptqmodel/nn_modules/qlinear/torch_int8_awq.py' 2026-04-28T22:57:27,192 adding 'gptqmodel/nn_modules/qlinear/tritonv2.py' 2026-04-28T22:57:27,193 adding 'gptqmodel/nn_modules/qlinear/utils.py' 2026-04-28T22:57:27,195 adding 'gptqmodel/nn_modules/triton_utils/__init__.py' 2026-04-28T22:57:27,197 adding 'gptqmodel/nn_modules/triton_utils/custom_autotune.py' 2026-04-28T22:57:27,199 adding 'gptqmodel/nn_modules/triton_utils/dequant.py' 2026-04-28T22:57:27,201 adding 'gptqmodel/nn_modules/triton_utils/kernels.py' 2026-04-28T22:57:27,202 adding 'gptqmodel/nn_modules/triton_utils/mixin.py' 2026-04-28T22:57:27,204 adding 'gptqmodel/quantization/__init__.py' 2026-04-28T22:57:27,220 adding 'gptqmodel/quantization/config.py' 2026-04-28T22:57:27,224 adding 'gptqmodel/quantization/dtype.py' 2026-04-28T22:57:27,226 adding 'gptqmodel/quantization/fallback_smooth.py' 2026-04-28T22:57:27,228 adding 'gptqmodel/quantization/foem.py' 2026-04-28T22:57:27,230 adding 'gptqmodel/quantization/gar.py' 2026-04-28T22:57:27,231 adding 'gptqmodel/quantization/gar_ref.py' 2026-04-28T22:57:27,233 adding 'gptqmodel/quantization/gptaq.py' 2026-04-28T22:57:27,239 adding 'gptqmodel/quantization/gptq.py' 2026-04-28T22:57:27,241 adding 'gptqmodel/quantization/npu_linalg.py' 2026-04-28T22:57:27,244 adding 'gptqmodel/quantization/protocol.py' 2026-04-28T22:57:27,247 adding 'gptqmodel/quantization/qqq.py' 2026-04-28T22:57:27,249 adding 'gptqmodel/quantization/quantizer.py' 2026-04-28T22:57:27,251 adding 'gptqmodel/quantization/rtn.py' 2026-04-28T22:57:27,252 adding 'gptqmodel/quantization/awq/__init__.py' 2026-04-28T22:57:27,254 adding 'gptqmodel/quantization/awq/modules/__init__.py' 2026-04-28T22:57:27,255 adding 'gptqmodel/quantization/awq/modules/act.py' 2026-04-28T22:57:27,257 adding 'gptqmodel/quantization/awq/modules/triton/__init__.py' 2026-04-28T22:57:27,259 adding 'gptqmodel/quantization/awq/modules/triton/gemm.py' 2026-04-28T22:57:27,261 adding 'gptqmodel/quantization/awq/quantize/__init__.py' 2026-04-28T22:57:27,262 adding 'gptqmodel/quantization/awq/quantize/scale.py' 2026-04-28T22:57:27,264 adding 'gptqmodel/quantization/awq/utils/__init__.py' 2026-04-28T22:57:27,266 adding 'gptqmodel/quantization/awq/utils/calib_data.py' 2026-04-28T22:57:27,267 adding 'gptqmodel/quantization/awq/utils/module.py' 2026-04-28T22:57:27,268 adding 'gptqmodel/quantization/awq/utils/packing_utils.py' 2026-04-28T22:57:27,270 adding 'gptqmodel/quantization/awq/utils/utils.py' 2026-04-28T22:57:27,272 adding 'gptqmodel/quantization/paroquant/__init__.py' 2026-04-28T22:57:27,279 adding 'gptqmodel/quantization/paroquant/optimization.py' 2026-04-28T22:57:27,281 adding 'gptqmodel/quantization/paroquant/modules/__init__.py' 2026-04-28T22:57:27,283 adding 'gptqmodel/quantization/paroquant/modules/triton/__init__.py' 2026-04-28T22:57:27,285 adding 'gptqmodel/quantization/paroquant/modules/triton/gemm.py' 2026-04-28T22:57:27,287 adding 'gptqmodel/quantization/rotation/__init__.py' 2026-04-28T22:57:27,320 adding 'gptqmodel/quantization/rotation/hadamard_utils.py' 2026-04-28T22:57:27,324 adding 'gptqmodel/quantization/rotation/rotation.py' 2026-04-28T22:57:27,327 adding 'gptqmodel/utils/__init__.py' 2026-04-28T22:57:27,329 adding 'gptqmodel/utils/attn_mask.py' 2026-04-28T22:57:27,330 adding 'gptqmodel/utils/audio.py' 2026-04-28T22:57:27,332 adding 'gptqmodel/utils/awq.py' 2026-04-28T22:57:27,333 adding 'gptqmodel/utils/backend.py' 2026-04-28T22:57:27,335 adding 'gptqmodel/utils/bitblas.py' 2026-04-28T22:57:27,338 adding 'gptqmodel/utils/calibration.py' 2026-04-28T22:57:27,339 adding 'gptqmodel/utils/colors.py' 2026-04-28T22:57:27,344 adding 'gptqmodel/utils/cpp.py' 2026-04-28T22:57:27,346 adding 'gptqmodel/utils/ctx.py' 2026-04-28T22:57:27,348 adding 'gptqmodel/utils/cuda_activation_buffer.py' 2026-04-28T22:57:27,350 adding 'gptqmodel/utils/data.py' 2026-04-28T22:57:27,352 adding 'gptqmodel/utils/device.py' 2026-04-28T22:57:27,354 adding 'gptqmodel/utils/device_telemetry.py' 2026-04-28T22:57:27,355 adding 'gptqmodel/utils/disk.py' 2026-04-28T22:57:27,356 adding 'gptqmodel/utils/env.py' 2026-04-28T22:57:27,358 adding 'gptqmodel/utils/exllamav2.py' 2026-04-28T22:57:27,359 adding 'gptqmodel/utils/exllamav3.py' 2026-04-28T22:57:27,360 adding 'gptqmodel/utils/fallback.py' 2026-04-28T22:57:27,362 adding 'gptqmodel/utils/gemv.py' 2026-04-28T22:57:27,369 adding 'gptqmodel/utils/hf.py' 2026-04-28T22:57:27,370 adding 'gptqmodel/utils/hub.py' 2026-04-28T22:57:27,371 adding 'gptqmodel/utils/image.py' 2026-04-28T22:57:27,374 adding 'gptqmodel/utils/importer.py' 2026-04-28T22:57:27,376 adding 'gptqmodel/utils/inspect.py' 2026-04-28T22:57:27,379 adding 'gptqmodel/utils/internal_gguf.py' 2026-04-28T22:57:27,380 adding 'gptqmodel/utils/jit_compile_baselines.py' 2026-04-28T22:57:27,382 adding 'gptqmodel/utils/linalg_warmup.py' 2026-04-28T22:57:27,384 adding 'gptqmodel/utils/logger.py' 2026-04-28T22:57:27,386 adding 'gptqmodel/utils/looper_helpers.py' 2026-04-28T22:57:27,389 adding 'gptqmodel/utils/machete.py' 2026-04-28T22:57:27,392 adding 'gptqmodel/utils/marlin.py' 2026-04-28T22:57:27,394 adding 'gptqmodel/utils/marlin_scalar_type.py' 2026-04-28T22:57:27,396 adding 'gptqmodel/utils/memory.py' 2026-04-28T22:57:27,398 adding 'gptqmodel/utils/mlx.py' 2026-04-28T22:57:27,400 adding 'gptqmodel/utils/mmlupro.py' 2026-04-28T22:57:27,408 adding 'gptqmodel/utils/model.py' 2026-04-28T22:57:27,413 adding 'gptqmodel/utils/model_dequant.py' 2026-04-28T22:57:27,414 adding 'gptqmodel/utils/modelscope.py' 2026-04-28T22:57:27,416 adding 'gptqmodel/utils/module_locks.py' 2026-04-28T22:57:27,418 adding 'gptqmodel/utils/nogil_patcher.py' 2026-04-28T22:57:27,420 adding 'gptqmodel/utils/offload.py' 2026-04-28T22:57:27,422 adding 'gptqmodel/utils/openai_server.py' 2026-04-28T22:57:27,424 adding 'gptqmodel/utils/paroquant.py' 2026-04-28T22:57:27,428 adding 'gptqmodel/utils/paroquant_benchmark.py' 2026-04-28T22:57:27,430 adding 'gptqmodel/utils/python.py' 2026-04-28T22:57:27,431 adding 'gptqmodel/utils/qqq.py' 2026-04-28T22:57:27,432 adding 'gptqmodel/utils/random_str.py' 2026-04-28T22:57:27,433 adding 'gptqmodel/utils/rocm.py' 2026-04-28T22:57:27,435 adding 'gptqmodel/utils/safe.py' 2026-04-28T22:57:27,436 adding 'gptqmodel/utils/safetensor.py' 2026-04-28T22:57:27,437 adding 'gptqmodel/utils/sglang.py' 2026-04-28T22:57:27,439 adding 'gptqmodel/utils/stream.py' 2026-04-28T22:57:27,449 adding 'gptqmodel/utils/structure.py' 2026-04-28T22:57:27,451 adding 'gptqmodel/utils/tensor.py' 2026-04-28T22:57:27,452 adding 'gptqmodel/utils/terminal.py' 2026-04-28T22:57:27,454 adding 'gptqmodel/utils/threads.py' 2026-04-28T22:57:27,464 adding 'gptqmodel/utils/threadx.py' 2026-04-28T22:57:27,466 adding 'gptqmodel/utils/torch.py' 2026-04-28T22:57:27,468 adding 'gptqmodel/utils/vllm.py' 2026-04-28T22:57:27,470 adding 'gptqmodel/utils/vram.py' 2026-04-28T22:57:27,473 adding 'gptqmodel-7.0.0.dist-info/licenses/LICENSE' 2026-04-28T22:57:27,475 adding 'gptqmodel_ext/__init__.py' 2026-04-28T22:57:27,481 adding 'gptqmodel_ext/floatx_cpu.cpp' 2026-04-28T22:57:27,484 adding 'gptqmodel_ext/pack_block_cpu.cpp' 2026-04-28T22:57:27,485 adding 'gptqmodel_ext/awq/gemm_fast_cuda_entry.cu' 2026-04-28T22:57:27,486 adding 'gptqmodel_ext/awq/gemv_fast_cuda_entry.cu' 2026-04-28T22:57:27,488 adding 'gptqmodel_ext/awq/torch_bind.cpp' 2026-04-28T22:57:27,490 adding 'gptqmodel_ext/awq/quantization/dequantize.cuh' 2026-04-28T22:57:27,491 adding 'gptqmodel_ext/awq/quantization/gemm_cuda.h' 2026-04-28T22:57:27,497 adding 'gptqmodel_ext/awq/quantization/gemm_cuda_gen.cu' 2026-04-28T22:57:27,499 adding 'gptqmodel_ext/awq/quantization/gemv_cuda.cu' 2026-04-28T22:57:27,500 adding 'gptqmodel_ext/awq/quantization/gemv_cuda.h' 2026-04-28T22:57:27,502 adding 'gptqmodel_ext/awq/quantization_new/dequantize.cuh' 2026-04-28T22:57:27,507 adding 'gptqmodel_ext/awq/quantization_new/gemm/gemm_cuda.cu' 2026-04-28T22:57:27,509 adding 'gptqmodel_ext/awq/quantization_new/gemm/gemm_cuda.h' 2026-04-28T22:57:27,510 adding 'gptqmodel_ext/awq/quantization_new/gemm/semaphore.h' 2026-04-28T22:57:27,512 adding 'gptqmodel_ext/awq/quantization_new/gemv/gemv_cuda.cu' 2026-04-28T22:57:27,514 adding 'gptqmodel_ext/awq/quantization_new/gemv/gemv_cuda.h' 2026-04-28T22:57:27,515 adding 'gptqmodel_ext/cutlass_extensions/__init__.py' 2026-04-28T22:57:27,516 adding 'gptqmodel_ext/cutlass_extensions/common.cpp' 2026-04-28T22:57:27,518 adding 'gptqmodel_ext/cutlass_extensions/common.hpp' 2026-04-28T22:57:27,519 adding 'gptqmodel_ext/cutlass_extensions/cute_utils.cuh' 2026-04-28T22:57:27,521 adding 'gptqmodel_ext/cutlass_extensions/torch_utils.hpp' 2026-04-28T22:57:27,522 adding 'gptqmodel_ext/cutlass_extensions/vllm_collective_builder.cuh' 2026-04-28T22:57:27,523 adding 'gptqmodel_ext/cutlass_extensions/vllm_custom_types.cuh' 2026-04-28T22:57:27,524 adding 'gptqmodel_ext/cutlass_extensions/vllm_cutlass_library_extension.py' 2026-04-28T22:57:27,528 adding 'gptqmodel_ext/cutlass_extensions/vllm_numeric_conversion.cuh' 2026-04-28T22:57:27,529 adding 'gptqmodel_ext/cutlass_extensions/vllm_type_utils.cuh' 2026-04-28T22:57:27,532 adding 'gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_array_c3x.hpp' 2026-04-28T22:57:27,534 adding 'gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_c2x.hpp' 2026-04-28T22:57:27,536 adding 'gptqmodel_ext/cutlass_extensions/epilogue/broadcast_load_epilogue_c3x.hpp' 2026-04-28T22:57:27,538 adding 'gptqmodel_ext/cutlass_extensions/epilogue/scaled_mm_epilogues_c2x.hpp' 2026-04-28T22:57:27,540 adding 'gptqmodel_ext/cutlass_extensions/epilogue/scaled_mm_epilogues_c3x.hpp' 2026-04-28T22:57:27,542 adding 'gptqmodel_ext/exllamav2/config.h' 2026-04-28T22:57:27,544 adding 'gptqmodel_ext/exllamav2/ext.cpp' 2026-04-28T22:57:27,545 adding 'gptqmodel_ext/exllamav2/ext_awq.cpp' 2026-04-28T22:57:27,546 adding 'gptqmodel_ext/exllamav2/ext_common.h' 2026-04-28T22:57:27,548 adding 'gptqmodel_ext/exllamav2/ext_gptq.cpp' 2026-04-28T22:57:27,549 adding 'gptqmodel_ext/exllamav2/cpp/util.h' 2026-04-28T22:57:27,551 adding 'gptqmodel_ext/exllamav2/cuda/compat.cuh' 2026-04-28T22:57:27,553 adding 'gptqmodel_ext/exllamav2/cuda/compat_gemm.cuh' 2026-04-28T22:57:27,554 adding 'gptqmodel_ext/exllamav2/cuda/matrix_view.cuh' 2026-04-28T22:57:27,555 adding 'gptqmodel_ext/exllamav2/cuda/q_gemm.cu' 2026-04-28T22:57:27,557 adding 'gptqmodel_ext/exllamav2/cuda/q_gemm.cuh' 2026-04-28T22:57:27,558 adding 'gptqmodel_ext/exllamav2/cuda/q_gemm_awq.cu' 2026-04-28T22:57:27,560 adding 'gptqmodel_ext/exllamav2/cuda/q_gemm_kernel.cuh' 2026-04-28T22:57:27,562 adding 'gptqmodel_ext/exllamav2/cuda/q_gemm_kernel_awq.cuh' 2026-04-28T22:57:27,563 adding 'gptqmodel_ext/exllamav2/cuda/q_gemm_kernel_gptq.cuh' 2026-04-28T22:57:27,566 adding 'gptqmodel_ext/exllamav2/cuda/q_matrix.cu' 2026-04-28T22:57:27,567 adding 'gptqmodel_ext/exllamav2/cuda/q_matrix.cuh' 2026-04-28T22:57:27,569 adding 'gptqmodel_ext/exllamav2/cuda/q_matrix_awq.cu' 2026-04-28T22:57:27,571 adding 'gptqmodel_ext/exllamav2/cuda/util.cuh' 2026-04-28T22:57:27,573 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_2.cuh' 2026-04-28T22:57:27,574 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_3.cuh' 2026-04-28T22:57:27,575 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_4.cuh' 2026-04-28T22:57:27,577 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_5.cuh' 2026-04-28T22:57:27,578 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_6.cuh' 2026-04-28T22:57:27,580 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_8.cuh' 2026-04-28T22:57:27,581 adding 'gptqmodel_ext/exllamav2/cuda/quant/qdq_util.cuh' 2026-04-28T22:57:27,583 adding 'gptqmodel_ext/exllamav3/bindings.cpp' 2026-04-28T22:57:27,584 adding 'gptqmodel_ext/exllamav3/hadamard.cpp' 2026-04-28T22:57:27,585 adding 'gptqmodel_ext/exllamav3/hadamard.h' 2026-04-28T22:57:27,587 adding 'gptqmodel_ext/exllamav3/hgemm.cu' 2026-04-28T22:57:27,588 adding 'gptqmodel_ext/exllamav3/hgemm.cuh' 2026-04-28T22:57:27,589 adding 'gptqmodel_ext/exllamav3/ptx.cuh' 2026-04-28T22:57:27,591 adding 'gptqmodel_ext/exllamav3/util.cuh' 2026-04-28T22:57:27,592 adding 'gptqmodel_ext/exllamav3/util.h' 2026-04-28T22:57:27,594 adding 'gptqmodel_ext/exllamav3/libtorch/linear.cpp' 2026-04-28T22:57:27,595 adding 'gptqmodel_ext/exllamav3/libtorch/linear.h' 2026-04-28T22:57:27,596 adding 'gptqmodel_ext/exllamav3/libtorch/linear_bc.h' 2026-04-28T22:57:27,598 adding 'gptqmodel_ext/exllamav3/quant/codebook.cuh' 2026-04-28T22:57:27,599 adding 'gptqmodel_ext/exllamav3/quant/exl3_devctx.cu' 2026-04-28T22:57:27,601 adding 'gptqmodel_ext/exllamav3/quant/exl3_devctx.cuh' 2026-04-28T22:57:27,602 adding 'gptqmodel_ext/exllamav3/quant/exl3_dq.cuh' 2026-04-28T22:57:27,604 adding 'gptqmodel_ext/exllamav3/quant/exl3_gemm.cu' 2026-04-28T22:57:27,605 adding 'gptqmodel_ext/exllamav3/quant/exl3_gemm.cuh' 2026-04-28T22:57:27,607 adding 'gptqmodel_ext/exllamav3/quant/exl3_gemm_inner.cuh' 2026-04-28T22:57:27,608 adding 'gptqmodel_ext/exllamav3/quant/exl3_gemm_kernel.cuh' 2026-04-28T22:57:27,610 adding 'gptqmodel_ext/exllamav3/quant/exl3_kernel_map.cu' 2026-04-28T22:57:27,611 adding 'gptqmodel_ext/exllamav3/quant/exl3_kernel_map.cuh' 2026-04-28T22:57:27,622 adding 'gptqmodel_ext/exllamav3/quant/exl3_kernel_map_packed.cuh' 2026-04-28T22:57:27,624 adding 'gptqmodel_ext/exllamav3/quant/hadamard.cu' 2026-04-28T22:57:27,625 adding 'gptqmodel_ext/exllamav3/quant/hadamard.cuh' 2026-04-28T22:57:27,627 adding 'gptqmodel_ext/exllamav3/quant/hadamard_inner.cuh' 2026-04-28T22:57:27,628 adding 'gptqmodel_ext/exllamav3/quant/pack.cu' 2026-04-28T22:57:27,630 adding 'gptqmodel_ext/exllamav3/quant/pack.cuh' 2026-04-28T22:57:27,632 adding 'gptqmodel_ext/exllamav3/quant/quantize.cu' 2026-04-28T22:57:27,633 adding 'gptqmodel_ext/exllamav3/quant/quantize.cuh' 2026-04-28T22:57:27,634 adding 'gptqmodel_ext/exllamav3/quant/reconstruct.cu' 2026-04-28T22:57:27,636 adding 'gptqmodel_ext/exllamav3/quant/reconstruct.cuh' 2026-04-28T22:57:27,637 adding 'gptqmodel_ext/exllamav3/quant/util.cu' 2026-04-28T22:57:27,638 adding 'gptqmodel_ext/exllamav3/quant/util.cuh' 2026-04-28T22:57:27,640 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_1.cu' 2026-04-28T22:57:27,641 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_1.cuh' 2026-04-28T22:57:27,642 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_2.cu' 2026-04-28T22:57:27,643 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_2.cuh' 2026-04-28T22:57:27,644 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_3.cu' 2026-04-28T22:57:27,646 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_3.cuh' 2026-04-28T22:57:27,647 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_4.cu' 2026-04-28T22:57:27,648 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_4.cuh' 2026-04-28T22:57:27,649 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_5.cu' 2026-04-28T22:57:27,650 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_5.cuh' 2026-04-28T22:57:27,651 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_6.cu' 2026-04-28T22:57:27,653 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_6.cuh' 2026-04-28T22:57:27,654 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_7.cu' 2026-04-28T22:57:27,655 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_7.cuh' 2026-04-28T22:57:27,656 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_8.cu' 2026-04-28T22:57:27,657 adding 'gptqmodel_ext/exllamav3/quant/comp_units/exl3_comp_unit_8.cuh' 2026-04-28T22:57:27,661 adding 'gptqmodel_ext/machete/generate.py' 2026-04-28T22:57:27,662 adding 'gptqmodel_ext/machete/machete_collective_builder.cuh' 2026-04-28T22:57:27,663 adding 'gptqmodel_ext/machete/machete_interleaving_utils.cuh' 2026-04-28T22:57:27,670 adding 'gptqmodel_ext/machete/machete_mainloop.cuh' 2026-04-28T22:57:27,673 adding 'gptqmodel_ext/machete/machete_mm_kernel.cuh' 2026-04-28T22:57:27,674 adding 'gptqmodel_ext/machete/machete_mm_launcher.cuh' 2026-04-28T22:57:27,675 adding 'gptqmodel_ext/machete/machete_prepack_kernel.cuh' 2026-04-28T22:57:27,677 adding 'gptqmodel_ext/machete/machete_prepack_launcher.cuh' 2026-04-28T22:57:27,678 adding 'gptqmodel_ext/machete/machete_prepacked_layout.cuh' 2026-04-28T22:57:27,680 adding 'gptqmodel_ext/machete/machete_pytorch.cu' 2026-04-28T22:57:27,681 adding 'gptqmodel_ext/machete/core/registration.h' 2026-04-28T22:57:27,683 adding 'gptqmodel_ext/machete/core/scalar_type.hpp' 2026-04-28T22:57:27,686 adding 'gptqmodel_ext/marlin/awq_marlin_repack.cu' 2026-04-28T22:57:27,687 adding 'gptqmodel_ext/marlin/awq_marlin_repack.cuh' 2026-04-28T22:57:27,689 adding 'gptqmodel_ext/marlin/dequant.h' 2026-04-28T22:57:27,690 adding 'gptqmodel_ext/marlin/generate_kernels.py' 2026-04-28T22:57:27,695 adding 'gptqmodel_ext/marlin/gptq_marlin.cu' 2026-04-28T22:57:27,697 adding 'gptqmodel_ext/marlin/gptq_marlin.cuh' 2026-04-28T22:57:27,698 adding 'gptqmodel_ext/marlin/gptq_marlin_bf16.cu' 2026-04-28T22:57:27,699 adding 'gptqmodel_ext/marlin/gptq_marlin_fp16.cu' 2026-04-28T22:57:27,701 adding 'gptqmodel_ext/marlin/gptq_marlin_repack.cu' 2026-04-28T22:57:27,702 adding 'gptqmodel_ext/marlin/gptq_marlin_repack.cuh' 2026-04-28T22:57:27,703 adding 'gptqmodel_ext/marlin/kernel.h' 2026-04-28T22:57:27,705 adding 'gptqmodel_ext/marlin/marlin.cuh' 2026-04-28T22:57:27,706 adding 'gptqmodel_ext/marlin/marlin_dtypes.cuh' 2026-04-28T22:57:27,707 adding 'gptqmodel_ext/marlin/marlin_mma.h' 2026-04-28T22:57:27,715 adding 'gptqmodel_ext/marlin/marlin_template.h' 2026-04-28T22:57:27,717 adding 'gptqmodel_ext/marlin/marlin_torch_bf16.cpp' 2026-04-28T22:57:27,718 adding 'gptqmodel_ext/marlin/marlin_torch_fp16.cpp' 2026-04-28T22:57:27,720 adding 'gptqmodel_ext/marlin/core/registration.h' 2026-04-28T22:57:27,722 adding 'gptqmodel_ext/marlin/core/scalar_type.hpp' 2026-04-28T22:57:27,724 adding 'gptqmodel_ext/qqq/qqq.cpp' 2026-04-28T22:57:27,730 adding 'gptqmodel_ext/qqq/qqq_gemm.cu' 2026-04-28T22:57:27,731 adding 'gptqmodel_ext/qqq/qqq_gemm.h' 2026-04-28T22:57:27,739 adding 'gptqmodel-7.0.0.dist-info/METADATA' 2026-04-28T22:57:27,740 adding 'gptqmodel-7.0.0.dist-info/WHEEL' 2026-04-28T22:57:27,741 adding 'gptqmodel-7.0.0.dist-info/top_level.txt' 2026-04-28T22:57:27,748 adding 'gptqmodel-7.0.0.dist-info/RECORD' 2026-04-28T22:57:27,767 removing build/bdist.linux-armv7l/wheel 2026-04-28T22:57:27,974 Building wheel for gptqmodel (pyproject.toml): finished with status 'done' 2026-04-28T22:57:28,000 Created wheel for gptqmodel: filename=gptqmodel-7.0.0-py3-none-any.whl size=1168394 sha256=728ef71ca795334f6deff3cc0ec288b2a778b9888b938f290a93a8ee7ee50213 2026-04-28T22:57:28,001 Stored in directory: /tmp/pip-ephem-wheel-cache-5xhrfdqy/wheels/4e/95/d0/99778650cc15c6e7926f59a6e87364357ade75cd8660dea68e 2026-04-28T22:57:28,039 Successfully built gptqmodel 2026-04-28T22:57:28,075 Removed build tracker: '/tmp/pip-build-tracker-qgg1k0n3'