2023-09-25T14:37:51,138 Created temporary directory: /tmp/pip-build-tracker-46huk_mf 2023-09-25T14:37:51,140 Initialized build tracking at /tmp/pip-build-tracker-46huk_mf 2023-09-25T14:37:51,140 Created build tracker: /tmp/pip-build-tracker-46huk_mf 2023-09-25T14:37:51,141 Entered build tracker: /tmp/pip-build-tracker-46huk_mf 2023-09-25T14:37:51,141 Created temporary directory: /tmp/pip-wheel-vatfl9ks 2023-09-25T14:37:51,144 Created temporary directory: /tmp/pip-ephem-wheel-cache-6d_e91tj 2023-09-25T14:37:51,166 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-09-25T14:37:51,170 2 location(s) to search for versions of alpaca-eval: 2023-09-25T14:37:51,170 * https://pypi.org/simple/alpaca-eval/ 2023-09-25T14:37:51,170 * https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T14:37:51,171 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/ 2023-09-25T14:37:51,171 Getting page https://pypi.org/simple/alpaca-eval/ 2023-09-25T14:37:51,173 Found index url https://pypi.org/simple/ 2023-09-25T14:37:51,336 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json 2023-09-25T14:37:51,344 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T14:37:51,345 Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0 2023-09-25T14:37:51,346 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T14:37:51,347 Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1 2023-09-25T14:37:51,347 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T14:37:51,348 Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2 2023-09-25T14:37:51,349 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,350 Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3 2023-09-25T14:37:51,350 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,351 Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5 2023-09-25T14:37:51,352 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,353 Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6 2023-09-25T14:37:51,353 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,354 Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7 2023-09-25T14:37:51,355 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,355 Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8 2023-09-25T14:37:51,356 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,357 Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0 2023-09-25T14:37:51,358 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,358 Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1 2023-09-25T14:37:51,359 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,360 Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2 2023-09-25T14:37:51,360 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,361 Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3 2023-09-25T14:37:51,362 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,364 Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4 2023-09-25T14:37:51,365 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,366 Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5 2023-09-25T14:37:51,366 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,367 Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6 2023-09-25T14:37:51,368 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,369 Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7 2023-09-25T14:37:51,369 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,370 Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8 2023-09-25T14:37:51,371 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,371 Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9 2023-09-25T14:37:51,372 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,373 Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0 2023-09-25T14:37:51,373 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,374 Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1 2023-09-25T14:37:51,375 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T14:37:51,376 Getting page https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T14:37:51,377 Found index url https://www.piwheels.org/simple/ 2023-09-25T14:37:51,561 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html 2023-09-25T14:37:51,564 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,564 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T14:37:51,565 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T14:37:51,565 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T14:37:51,566 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T14:37:51,566 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T14:37:51,567 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/ 2023-09-25T14:37:51,587 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates 2023-09-25T14:37:51,605 Collecting alpaca-eval==0.2.1 2023-09-25T14:37:51,608 Created temporary directory: /tmp/pip-unpack-p8ba4h3z 2023-09-25T14:37:51,748 Downloading alpaca_eval-0.2.1.tar.gz (285 kB) 2023-09-25T14:37:52,142 Added alpaca-eval==0.2.1 from https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz to build tracker '/tmp/pip-build-tracker-46huk_mf' 2023-09-25T14:37:52,143 Running setup.py (path:/tmp/pip-wheel-vatfl9ks/alpaca-eval_42e8c89c980c4437a8ff90a206d79943/setup.py) egg_info for package alpaca-eval 2023-09-25T14:37:52,144 Created temporary directory: /tmp/pip-pip-egg-info-178r2php 2023-09-25T14:37:52,145 Preparing metadata (setup.py): started 2023-09-25T14:37:52,146 Running command python setup.py egg_info 2023-09-25T14:37:53,173 running egg_info 2023-09-25T14:37:53,174 creating /tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info 2023-09-25T14:37:53,198 writing /tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/PKG-INFO 2023-09-25T14:37:53,215 writing dependency_links to /tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/dependency_links.txt 2023-09-25T14:37:53,217 writing entry points to /tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/entry_points.txt 2023-09-25T14:37:53,224 writing requirements to /tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/requires.txt 2023-09-25T14:37:53,225 writing top-level names to /tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/top_level.txt 2023-09-25T14:37:53,227 writing manifest file '/tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T14:37:53,303 reading manifest file '/tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T14:37:53,304 reading manifest template 'MANIFEST.in' 2023-09-25T14:37:53,375 adding license file 'LICENSE' 2023-09-25T14:37:53,381 writing manifest file '/tmp/pip-pip-egg-info-178r2php/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T14:37:53,489 Preparing metadata (setup.py): finished with status 'done' 2023-09-25T14:37:53,497 Source in /tmp/pip-wheel-vatfl9ks/alpaca-eval_42e8c89c980c4437a8ff90a206d79943 has version 0.2.1, which satisfies requirement alpaca-eval==0.2.1 from https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz 2023-09-25T14:37:53,498 Removed alpaca-eval==0.2.1 from https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz from build tracker '/tmp/pip-build-tracker-46huk_mf' 2023-09-25T14:37:53,510 Created temporary directory: /tmp/pip-unpack-bmwq98ay 2023-09-25T14:37:53,511 Created temporary directory: /tmp/pip-unpack-25xra_1l 2023-09-25T14:37:53,635 Building wheels for collected packages: alpaca-eval 2023-09-25T14:37:53,639 Created temporary directory: /tmp/pip-wheel-28j_ogel 2023-09-25T14:37:53,640 Building wheel for alpaca-eval (setup.py): started 2023-09-25T14:37:53,641 Destination directory: /tmp/pip-wheel-28j_ogel 2023-09-25T14:37:53,642 Running command python setup.py bdist_wheel 2023-09-25T14:37:54,652 running bdist_wheel 2023-09-25T14:37:54,742 running build 2023-09-25T14:37:54,743 running build_py 2023-09-25T14:37:54,769 creating build 2023-09-25T14:37:54,769 creating build/lib 2023-09-25T14:37:54,770 creating build/lib/alpaca_eval 2023-09-25T14:37:54,771 copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,773 copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,775 copying src/alpaca_eval/types.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,776 copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,778 copying src/alpaca_eval/main.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,780 copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,783 copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,785 copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,787 copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval 2023-09-25T14:37:54,790 creating build/lib/alpaca_eval/annotators 2023-09-25T14:37:54,791 copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators 2023-09-25T14:37:54,794 copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators 2023-09-25T14:37:54,796 creating build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,797 copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,799 copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,801 copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,803 copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,805 copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,807 copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders 2023-09-25T14:37:54,808 running egg_info 2023-09-25T14:37:54,863 writing src/alpaca_eval.egg-info/PKG-INFO 2023-09-25T14:37:54,880 writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt 2023-09-25T14:37:54,882 writing entry points to src/alpaca_eval.egg-info/entry_points.txt 2023-09-25T14:37:54,890 writing requirements to src/alpaca_eval.egg-info/requires.txt 2023-09-25T14:37:54,891 writing top-level names to src/alpaca_eval.egg-info/top_level.txt 2023-09-25T14:37:54,918 reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T14:37:54,922 reading manifest template 'MANIFEST.in' 2023-09-25T14:37:54,977 adding license file 'LICENSE' 2023-09-25T14:37:54,984 writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T14:37:54,987 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration. 2023-09-25T14:37:54,987 !! 2023-09-25T14:37:54,989 ******************************************************************************** 2023-09-25T14:37:54,989 ############################ 2023-09-25T14:37:54,990 # Package would be ignored # 2023-09-25T14:37:54,991 ############################ 2023-09-25T14:37:54,991 Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1], 2023-09-25T14:37:54,992 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:54,992 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:54,993 package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added 2023-09-25T14:37:54,994 to the `packages` configuration field. 2023-09-25T14:37:54,994 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:54,995 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:54,995 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:54,996 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:54,997 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:54,998 If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are 2023-09-25T14:37:54,998 already explicitly excluding 'alpaca_eval.evaluators_configs' via 2023-09-25T14:37:54,999 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:54,999 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:54,999 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,000 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,001 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,002 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,003 even if it does not contain any `.py` files. 2023-09-25T14:37:55,003 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,003 directory, all directories are treated like packages. 2023-09-25T14:37:55,004 ******************************************************************************** 2023-09-25T14:37:55,005 !! 2023-09-25T14:37:55,005 check.warn(importable) 2023-09-25T14:37:55,006 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,006 !! 2023-09-25T14:37:55,007 ******************************************************************************** 2023-09-25T14:37:55,008 ############################ 2023-09-25T14:37:55,008 # Package would be ignored # 2023-09-25T14:37:55,009 ############################ 2023-09-25T14:37:55,009 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1], 2023-09-25T14:37:55,010 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,010 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,011 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added 2023-09-25T14:37:55,011 to the `packages` configuration field. 2023-09-25T14:37:55,012 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,013 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,014 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,015 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,016 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,017 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are 2023-09-25T14:37:55,017 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via 2023-09-25T14:37:55,017 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,018 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,018 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,019 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,019 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,020 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,021 even if it does not contain any `.py` files. 2023-09-25T14:37:55,021 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,021 directory, all directories are treated like packages. 2023-09-25T14:37:55,022 ******************************************************************************** 2023-09-25T14:37:55,023 !! 2023-09-25T14:37:55,023 check.warn(importable) 2023-09-25T14:37:55,023 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration. 2023-09-25T14:37:55,024 !! 2023-09-25T14:37:55,025 ******************************************************************************** 2023-09-25T14:37:55,025 ############################ 2023-09-25T14:37:55,025 # Package would be ignored # 2023-09-25T14:37:55,026 ############################ 2023-09-25T14:37:55,026 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1], 2023-09-25T14:37:55,027 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,028 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,028 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added 2023-09-25T14:37:55,029 to the `packages` configuration field. 2023-09-25T14:37:55,029 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,030 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,030 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,031 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,032 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,033 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are 2023-09-25T14:37:55,033 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via 2023-09-25T14:37:55,034 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,034 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,035 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,036 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,037 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,038 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,039 even if it does not contain any `.py` files. 2023-09-25T14:37:55,039 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,040 directory, all directories are treated like packages. 2023-09-25T14:37:55,041 ******************************************************************************** 2023-09-25T14:37:55,041 !! 2023-09-25T14:37:55,042 check.warn(importable) 2023-09-25T14:37:55,042 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration. 2023-09-25T14:37:55,042 !! 2023-09-25T14:37:55,043 ******************************************************************************** 2023-09-25T14:37:55,043 ############################ 2023-09-25T14:37:55,044 # Package would be ignored # 2023-09-25T14:37:55,044 ############################ 2023-09-25T14:37:55,044 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1], 2023-09-25T14:37:55,045 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,045 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,046 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added 2023-09-25T14:37:55,046 to the `packages` configuration field. 2023-09-25T14:37:55,047 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,047 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,048 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,048 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,049 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,050 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are 2023-09-25T14:37:55,050 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via 2023-09-25T14:37:55,051 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,051 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,052 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,052 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,053 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,055 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,055 even if it does not contain any `.py` files. 2023-09-25T14:37:55,055 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,056 directory, all directories are treated like packages. 2023-09-25T14:37:55,056 ******************************************************************************** 2023-09-25T14:37:55,057 !! 2023-09-25T14:37:55,058 check.warn(importable) 2023-09-25T14:37:55,058 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,059 !! 2023-09-25T14:37:55,059 ******************************************************************************** 2023-09-25T14:37:55,060 ############################ 2023-09-25T14:37:55,060 # Package would be ignored # 2023-09-25T14:37:55,061 ############################ 2023-09-25T14:37:55,061 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1], 2023-09-25T14:37:55,062 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,063 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,063 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added 2023-09-25T14:37:55,064 to the `packages` configuration field. 2023-09-25T14:37:55,064 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,065 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,065 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,066 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,066 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,067 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are 2023-09-25T14:37:55,068 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via 2023-09-25T14:37:55,068 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,068 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,069 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,070 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,070 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,072 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,072 even if it does not contain any `.py` files. 2023-09-25T14:37:55,073 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,073 directory, all directories are treated like packages. 2023-09-25T14:37:55,073 ******************************************************************************** 2023-09-25T14:37:55,074 !! 2023-09-25T14:37:55,075 check.warn(importable) 2023-09-25T14:37:55,075 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,076 !! 2023-09-25T14:37:55,077 ******************************************************************************** 2023-09-25T14:37:55,077 ############################ 2023-09-25T14:37:55,077 # Package would be ignored # 2023-09-25T14:37:55,078 ############################ 2023-09-25T14:37:55,078 Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1], 2023-09-25T14:37:55,079 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,080 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,080 package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added 2023-09-25T14:37:55,081 to the `packages` configuration field. 2023-09-25T14:37:55,082 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,082 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,082 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,083 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,084 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,085 If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are 2023-09-25T14:37:55,086 already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via 2023-09-25T14:37:55,086 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,087 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,087 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,088 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,089 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,090 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,090 even if it does not contain any `.py` files. 2023-09-25T14:37:55,090 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,091 directory, all directories are treated like packages. 2023-09-25T14:37:55,091 ******************************************************************************** 2023-09-25T14:37:55,092 !! 2023-09-25T14:37:55,092 check.warn(importable) 2023-09-25T14:37:55,092 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration. 2023-09-25T14:37:55,093 !! 2023-09-25T14:37:55,094 ******************************************************************************** 2023-09-25T14:37:55,094 ############################ 2023-09-25T14:37:55,094 # Package would be ignored # 2023-09-25T14:37:55,095 ############################ 2023-09-25T14:37:55,095 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1], 2023-09-25T14:37:55,096 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,096 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,097 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added 2023-09-25T14:37:55,097 to the `packages` configuration field. 2023-09-25T14:37:55,098 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,098 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,099 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,100 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,101 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,102 If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are 2023-09-25T14:37:55,102 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via 2023-09-25T14:37:55,103 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,103 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,103 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,104 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,105 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,107 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,107 even if it does not contain any `.py` files. 2023-09-25T14:37:55,108 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,108 directory, all directories are treated like packages. 2023-09-25T14:37:55,109 ******************************************************************************** 2023-09-25T14:37:55,110 !! 2023-09-25T14:37:55,110 check.warn(importable) 2023-09-25T14:37:55,111 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration. 2023-09-25T14:37:55,111 !! 2023-09-25T14:37:55,112 ******************************************************************************** 2023-09-25T14:37:55,113 ############################ 2023-09-25T14:37:55,113 # Package would be ignored # 2023-09-25T14:37:55,113 ############################ 2023-09-25T14:37:55,114 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1], 2023-09-25T14:37:55,114 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,115 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,115 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added 2023-09-25T14:37:55,115 to the `packages` configuration field. 2023-09-25T14:37:55,116 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,116 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,117 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,118 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,118 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,119 If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are 2023-09-25T14:37:55,119 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via 2023-09-25T14:37:55,120 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,120 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,121 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,122 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,122 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,124 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,124 even if it does not contain any `.py` files. 2023-09-25T14:37:55,125 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,125 directory, all directories are treated like packages. 2023-09-25T14:37:55,125 ******************************************************************************** 2023-09-25T14:37:55,126 !! 2023-09-25T14:37:55,127 check.warn(importable) 2023-09-25T14:37:55,127 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration. 2023-09-25T14:37:55,127 !! 2023-09-25T14:37:55,128 ******************************************************************************** 2023-09-25T14:37:55,129 ############################ 2023-09-25T14:37:55,129 # Package would be ignored # 2023-09-25T14:37:55,130 ############################ 2023-09-25T14:37:55,130 Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1], 2023-09-25T14:37:55,130 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,131 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,132 package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added 2023-09-25T14:37:55,132 to the `packages` configuration field. 2023-09-25T14:37:55,133 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,133 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,134 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,135 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,136 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,136 If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are 2023-09-25T14:37:55,137 already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via 2023-09-25T14:37:55,137 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,138 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,138 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,139 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,140 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,141 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,141 even if it does not contain any `.py` files. 2023-09-25T14:37:55,142 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,142 directory, all directories are treated like packages. 2023-09-25T14:37:55,142 ******************************************************************************** 2023-09-25T14:37:55,143 !! 2023-09-25T14:37:55,144 check.warn(importable) 2023-09-25T14:37:55,144 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration. 2023-09-25T14:37:55,144 !! 2023-09-25T14:37:55,145 ******************************************************************************** 2023-09-25T14:37:55,146 ############################ 2023-09-25T14:37:55,146 # Package would be ignored # 2023-09-25T14:37:55,147 ############################ 2023-09-25T14:37:55,147 Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1], 2023-09-25T14:37:55,148 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,149 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,149 package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added 2023-09-25T14:37:55,150 to the `packages` configuration field. 2023-09-25T14:37:55,151 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,151 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,152 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,153 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,154 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,154 If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are 2023-09-25T14:37:55,155 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via 2023-09-25T14:37:55,155 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,156 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,156 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,157 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,158 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,160 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,161 even if it does not contain any `.py` files. 2023-09-25T14:37:55,161 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,162 directory, all directories are treated like packages. 2023-09-25T14:37:55,162 ******************************************************************************** 2023-09-25T14:37:55,163 !! 2023-09-25T14:37:55,163 check.warn(importable) 2023-09-25T14:37:55,164 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration. 2023-09-25T14:37:55,164 !! 2023-09-25T14:37:55,165 ******************************************************************************** 2023-09-25T14:37:55,165 ############################ 2023-09-25T14:37:55,166 # Package would be ignored # 2023-09-25T14:37:55,166 ############################ 2023-09-25T14:37:55,167 Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1], 2023-09-25T14:37:55,167 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,168 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,168 package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added 2023-09-25T14:37:55,169 to the `packages` configuration field. 2023-09-25T14:37:55,170 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,170 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,171 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,172 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,173 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,174 If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are 2023-09-25T14:37:55,174 already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via 2023-09-25T14:37:55,174 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,175 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,175 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,176 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,177 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,179 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,179 even if it does not contain any `.py` files. 2023-09-25T14:37:55,180 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,180 directory, all directories are treated like packages. 2023-09-25T14:37:55,180 ******************************************************************************** 2023-09-25T14:37:55,181 !! 2023-09-25T14:37:55,182 check.warn(importable) 2023-09-25T14:37:55,182 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,183 !! 2023-09-25T14:37:55,184 ******************************************************************************** 2023-09-25T14:37:55,184 ############################ 2023-09-25T14:37:55,185 # Package would be ignored # 2023-09-25T14:37:55,185 ############################ 2023-09-25T14:37:55,185 Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1], 2023-09-25T14:37:55,186 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,187 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,187 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added 2023-09-25T14:37:55,188 to the `packages` configuration field. 2023-09-25T14:37:55,188 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,189 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,189 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,190 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,190 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,191 If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are 2023-09-25T14:37:55,191 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via 2023-09-25T14:37:55,192 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,192 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,193 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,193 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,194 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,195 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,196 even if it does not contain any `.py` files. 2023-09-25T14:37:55,196 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,197 directory, all directories are treated like packages. 2023-09-25T14:37:55,197 ******************************************************************************** 2023-09-25T14:37:55,198 !! 2023-09-25T14:37:55,198 check.warn(importable) 2023-09-25T14:37:55,199 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration. 2023-09-25T14:37:55,199 !! 2023-09-25T14:37:55,200 ******************************************************************************** 2023-09-25T14:37:55,201 ############################ 2023-09-25T14:37:55,201 # Package would be ignored # 2023-09-25T14:37:55,201 ############################ 2023-09-25T14:37:55,202 Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1], 2023-09-25T14:37:55,202 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,203 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,204 package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added 2023-09-25T14:37:55,204 to the `packages` configuration field. 2023-09-25T14:37:55,205 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,206 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,206 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,207 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,208 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,209 If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are 2023-09-25T14:37:55,210 already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via 2023-09-25T14:37:55,211 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,211 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,212 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,213 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,213 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,215 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,215 even if it does not contain any `.py` files. 2023-09-25T14:37:55,216 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,216 directory, all directories are treated like packages. 2023-09-25T14:37:55,217 ******************************************************************************** 2023-09-25T14:37:55,218 !! 2023-09-25T14:37:55,218 check.warn(importable) 2023-09-25T14:37:55,218 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,219 !! 2023-09-25T14:37:55,220 ******************************************************************************** 2023-09-25T14:37:55,220 ############################ 2023-09-25T14:37:55,220 # Package would be ignored # 2023-09-25T14:37:55,221 ############################ 2023-09-25T14:37:55,221 Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1], 2023-09-25T14:37:55,222 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,223 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,223 package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added 2023-09-25T14:37:55,224 to the `packages` configuration field. 2023-09-25T14:37:55,225 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,225 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,226 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,226 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,227 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,228 If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are 2023-09-25T14:37:55,229 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via 2023-09-25T14:37:55,229 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,230 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,230 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,231 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,232 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,234 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,234 even if it does not contain any `.py` files. 2023-09-25T14:37:55,235 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,235 directory, all directories are treated like packages. 2023-09-25T14:37:55,236 ******************************************************************************** 2023-09-25T14:37:55,237 !! 2023-09-25T14:37:55,237 check.warn(importable) 2023-09-25T14:37:55,238 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,238 !! 2023-09-25T14:37:55,239 ******************************************************************************** 2023-09-25T14:37:55,240 ############################ 2023-09-25T14:37:55,240 # Package would be ignored # 2023-09-25T14:37:55,241 ############################ 2023-09-25T14:37:55,241 Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1], 2023-09-25T14:37:55,241 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,242 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,243 package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added 2023-09-25T14:37:55,243 to the `packages` configuration field. 2023-09-25T14:37:55,244 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,244 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,245 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,246 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,246 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,247 If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are 2023-09-25T14:37:55,248 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via 2023-09-25T14:37:55,248 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,249 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,249 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,250 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,251 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,252 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,253 even if it does not contain any `.py` files. 2023-09-25T14:37:55,253 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,254 directory, all directories are treated like packages. 2023-09-25T14:37:55,254 ******************************************************************************** 2023-09-25T14:37:55,255 !! 2023-09-25T14:37:55,256 check.warn(importable) 2023-09-25T14:37:55,256 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,257 !! 2023-09-25T14:37:55,258 ******************************************************************************** 2023-09-25T14:37:55,258 ############################ 2023-09-25T14:37:55,259 # Package would be ignored # 2023-09-25T14:37:55,259 ############################ 2023-09-25T14:37:55,260 Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1], 2023-09-25T14:37:55,260 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,261 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,262 package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added 2023-09-25T14:37:55,262 to the `packages` configuration field. 2023-09-25T14:37:55,264 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,264 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,264 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,265 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,266 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,266 If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are 2023-09-25T14:37:55,267 already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via 2023-09-25T14:37:55,267 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,268 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,268 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,269 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,270 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,271 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,271 even if it does not contain any `.py` files. 2023-09-25T14:37:55,272 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,272 directory, all directories are treated like packages. 2023-09-25T14:37:55,273 ******************************************************************************** 2023-09-25T14:37:55,273 !! 2023-09-25T14:37:55,274 check.warn(importable) 2023-09-25T14:37:55,274 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration. 2023-09-25T14:37:55,275 !! 2023-09-25T14:37:55,276 ******************************************************************************** 2023-09-25T14:37:55,276 ############################ 2023-09-25T14:37:55,277 # Package would be ignored # 2023-09-25T14:37:55,277 ############################ 2023-09-25T14:37:55,278 Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1], 2023-09-25T14:37:55,278 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,279 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,280 package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added 2023-09-25T14:37:55,280 to the `packages` configuration field. 2023-09-25T14:37:55,281 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,282 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,282 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,283 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,284 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,285 If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are 2023-09-25T14:37:55,285 already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via 2023-09-25T14:37:55,286 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,286 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,287 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,288 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,289 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,290 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,291 even if it does not contain any `.py` files. 2023-09-25T14:37:55,291 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,292 directory, all directories are treated like packages. 2023-09-25T14:37:55,292 ******************************************************************************** 2023-09-25T14:37:55,293 !! 2023-09-25T14:37:55,293 check.warn(importable) 2023-09-25T14:37:55,294 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration. 2023-09-25T14:37:55,294 !! 2023-09-25T14:37:55,295 ******************************************************************************** 2023-09-25T14:37:55,295 ############################ 2023-09-25T14:37:55,296 # Package would be ignored # 2023-09-25T14:37:55,296 ############################ 2023-09-25T14:37:55,297 Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1], 2023-09-25T14:37:55,297 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,298 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,298 package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added 2023-09-25T14:37:55,299 to the `packages` configuration field. 2023-09-25T14:37:55,300 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,300 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,301 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,301 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,302 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,303 If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are 2023-09-25T14:37:55,304 already explicitly excluding 'alpaca_eval.evaluators_configs.test' via 2023-09-25T14:37:55,304 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,305 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,305 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,306 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,307 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,308 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,309 even if it does not contain any `.py` files. 2023-09-25T14:37:55,309 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,310 directory, all directories are treated like packages. 2023-09-25T14:37:55,310 ******************************************************************************** 2023-09-25T14:37:55,311 !! 2023-09-25T14:37:55,312 check.warn(importable) 2023-09-25T14:37:55,312 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration. 2023-09-25T14:37:55,313 !! 2023-09-25T14:37:55,314 ******************************************************************************** 2023-09-25T14:37:55,314 ############################ 2023-09-25T14:37:55,314 # Package would be ignored # 2023-09-25T14:37:55,315 ############################ 2023-09-25T14:37:55,316 Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1], 2023-09-25T14:37:55,316 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,317 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,317 package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added 2023-09-25T14:37:55,318 to the `packages` configuration field. 2023-09-25T14:37:55,318 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,319 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,319 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,320 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,321 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,321 If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are 2023-09-25T14:37:55,322 already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via 2023-09-25T14:37:55,322 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,323 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,323 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,324 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,325 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,326 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,327 even if it does not contain any `.py` files. 2023-09-25T14:37:55,327 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,328 directory, all directories are treated like packages. 2023-09-25T14:37:55,328 ******************************************************************************** 2023-09-25T14:37:55,329 !! 2023-09-25T14:37:55,330 check.warn(importable) 2023-09-25T14:37:55,330 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration. 2023-09-25T14:37:55,331 !! 2023-09-25T14:37:55,331 ******************************************************************************** 2023-09-25T14:37:55,332 ############################ 2023-09-25T14:37:55,332 # Package would be ignored # 2023-09-25T14:37:55,333 ############################ 2023-09-25T14:37:55,333 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1], 2023-09-25T14:37:55,334 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,335 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,335 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added 2023-09-25T14:37:55,336 to the `packages` configuration field. 2023-09-25T14:37:55,337 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,337 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,338 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,338 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,340 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,341 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are 2023-09-25T14:37:55,341 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via 2023-09-25T14:37:55,342 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,342 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,343 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,343 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,344 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,345 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,346 even if it does not contain any `.py` files. 2023-09-25T14:37:55,346 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,347 directory, all directories are treated like packages. 2023-09-25T14:37:55,347 ******************************************************************************** 2023-09-25T14:37:55,348 !! 2023-09-25T14:37:55,348 check.warn(importable) 2023-09-25T14:37:55,349 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration. 2023-09-25T14:37:55,349 !! 2023-09-25T14:37:55,350 ******************************************************************************** 2023-09-25T14:37:55,350 ############################ 2023-09-25T14:37:55,351 # Package would be ignored # 2023-09-25T14:37:55,351 ############################ 2023-09-25T14:37:55,352 Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1], 2023-09-25T14:37:55,352 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,353 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,353 package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added 2023-09-25T14:37:55,354 to the `packages` configuration field. 2023-09-25T14:37:55,355 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,355 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,356 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,357 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,358 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,359 If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are 2023-09-25T14:37:55,359 already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via 2023-09-25T14:37:55,359 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,360 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,360 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,361 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,362 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,364 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,364 even if it does not contain any `.py` files. 2023-09-25T14:37:55,365 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,365 directory, all directories are treated like packages. 2023-09-25T14:37:55,366 ******************************************************************************** 2023-09-25T14:37:55,367 !! 2023-09-25T14:37:55,367 check.warn(importable) 2023-09-25T14:37:55,368 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration. 2023-09-25T14:37:55,368 !! 2023-09-25T14:37:55,369 ******************************************************************************** 2023-09-25T14:37:55,369 ############################ 2023-09-25T14:37:55,370 # Package would be ignored # 2023-09-25T14:37:55,370 ############################ 2023-09-25T14:37:55,370 Python recognizes 'alpaca_eval.models_configs' as an importable package[^1], 2023-09-25T14:37:55,371 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,372 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,372 package, please make sure that 'alpaca_eval.models_configs' is explicitly added 2023-09-25T14:37:55,372 to the `packages` configuration field. 2023-09-25T14:37:55,373 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,374 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,374 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,375 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,376 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,377 If you don't want 'alpaca_eval.models_configs' to be distributed and are 2023-09-25T14:37:55,377 already explicitly excluding 'alpaca_eval.models_configs' via 2023-09-25T14:37:55,377 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,378 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,378 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,379 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,380 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,381 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,382 even if it does not contain any `.py` files. 2023-09-25T14:37:55,383 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,383 directory, all directories are treated like packages. 2023-09-25T14:37:55,383 ******************************************************************************** 2023-09-25T14:37:55,384 !! 2023-09-25T14:37:55,385 check.warn(importable) 2023-09-25T14:37:55,385 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration. 2023-09-25T14:37:55,386 !! 2023-09-25T14:37:55,387 ******************************************************************************** 2023-09-25T14:37:55,387 ############################ 2023-09-25T14:37:55,388 # Package would be ignored # 2023-09-25T14:37:55,388 ############################ 2023-09-25T14:37:55,388 Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1], 2023-09-25T14:37:55,389 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,390 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,390 package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added 2023-09-25T14:37:55,391 to the `packages` configuration field. 2023-09-25T14:37:55,392 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,392 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,393 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,393 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,394 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,395 If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are 2023-09-25T14:37:55,395 already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via 2023-09-25T14:37:55,396 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,396 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,396 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,397 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,398 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,400 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,400 even if it does not contain any `.py` files. 2023-09-25T14:37:55,400 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,401 directory, all directories are treated like packages. 2023-09-25T14:37:55,401 ******************************************************************************** 2023-09-25T14:37:55,402 !! 2023-09-25T14:37:55,403 check.warn(importable) 2023-09-25T14:37:55,403 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration. 2023-09-25T14:37:55,404 !! 2023-09-25T14:37:55,404 ******************************************************************************** 2023-09-25T14:37:55,405 ############################ 2023-09-25T14:37:55,405 # Package would be ignored # 2023-09-25T14:37:55,406 ############################ 2023-09-25T14:37:55,406 Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1], 2023-09-25T14:37:55,407 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,408 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,408 package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added 2023-09-25T14:37:55,409 to the `packages` configuration field. 2023-09-25T14:37:55,410 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,410 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,411 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,412 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,413 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,413 If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are 2023-09-25T14:37:55,414 already explicitly excluding 'alpaca_eval.models_configs.claude' via 2023-09-25T14:37:55,414 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,415 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,416 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,417 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,418 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,419 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,419 even if it does not contain any `.py` files. 2023-09-25T14:37:55,420 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,420 directory, all directories are treated like packages. 2023-09-25T14:37:55,421 ******************************************************************************** 2023-09-25T14:37:55,421 !! 2023-09-25T14:37:55,422 check.warn(importable) 2023-09-25T14:37:55,422 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration. 2023-09-25T14:37:55,422 !! 2023-09-25T14:37:55,423 ******************************************************************************** 2023-09-25T14:37:55,424 ############################ 2023-09-25T14:37:55,424 # Package would be ignored # 2023-09-25T14:37:55,425 ############################ 2023-09-25T14:37:55,425 Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1], 2023-09-25T14:37:55,425 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,426 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,427 package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added 2023-09-25T14:37:55,427 to the `packages` configuration field. 2023-09-25T14:37:55,428 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,428 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,429 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,430 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,430 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,431 If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are 2023-09-25T14:37:55,432 already explicitly excluding 'alpaca_eval.models_configs.cohere' via 2023-09-25T14:37:55,432 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,433 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,433 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,434 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,435 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,436 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,437 even if it does not contain any `.py` files. 2023-09-25T14:37:55,437 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,438 directory, all directories are treated like packages. 2023-09-25T14:37:55,438 ******************************************************************************** 2023-09-25T14:37:55,439 !! 2023-09-25T14:37:55,440 check.warn(importable) 2023-09-25T14:37:55,440 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration. 2023-09-25T14:37:55,441 !! 2023-09-25T14:37:55,442 ******************************************************************************** 2023-09-25T14:37:55,442 ############################ 2023-09-25T14:37:55,443 # Package would be ignored # 2023-09-25T14:37:55,443 ############################ 2023-09-25T14:37:55,444 Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1], 2023-09-25T14:37:55,445 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,445 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,446 package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added 2023-09-25T14:37:55,446 to the `packages` configuration field. 2023-09-25T14:37:55,447 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,448 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,448 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,449 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,450 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,450 If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are 2023-09-25T14:37:55,451 already explicitly excluding 'alpaca_eval.models_configs.gpt4' via 2023-09-25T14:37:55,451 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,452 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,452 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,453 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,454 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,455 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,456 even if it does not contain any `.py` files. 2023-09-25T14:37:55,456 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,456 directory, all directories are treated like packages. 2023-09-25T14:37:55,457 ******************************************************************************** 2023-09-25T14:37:55,458 !! 2023-09-25T14:37:55,458 check.warn(importable) 2023-09-25T14:37:55,459 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration. 2023-09-25T14:37:55,459 !! 2023-09-25T14:37:55,460 ******************************************************************************** 2023-09-25T14:37:55,461 ############################ 2023-09-25T14:37:55,461 # Package would be ignored # 2023-09-25T14:37:55,462 ############################ 2023-09-25T14:37:55,462 Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1], 2023-09-25T14:37:55,463 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,464 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,464 package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added 2023-09-25T14:37:55,465 to the `packages` configuration field. 2023-09-25T14:37:55,466 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,466 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,467 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,468 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,469 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,470 If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are 2023-09-25T14:37:55,471 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via 2023-09-25T14:37:55,471 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,472 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,473 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,474 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,475 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,476 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,477 even if it does not contain any `.py` files. 2023-09-25T14:37:55,477 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,478 directory, all directories are treated like packages. 2023-09-25T14:37:55,478 ******************************************************************************** 2023-09-25T14:37:55,479 !! 2023-09-25T14:37:55,480 check.warn(importable) 2023-09-25T14:37:55,481 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration. 2023-09-25T14:37:55,481 !! 2023-09-25T14:37:55,483 ******************************************************************************** 2023-09-25T14:37:55,483 ############################ 2023-09-25T14:37:55,484 # Package would be ignored # 2023-09-25T14:37:55,484 ############################ 2023-09-25T14:37:55,485 Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1], 2023-09-25T14:37:55,485 but it is absent from setuptools' `packages` configuration. 2023-09-25T14:37:55,487 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T14:37:55,487 package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added 2023-09-25T14:37:55,488 to the `packages` configuration field. 2023-09-25T14:37:55,489 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T14:37:55,490 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T14:37:55,490 instead of `find_packages(...)`/`find:`). 2023-09-25T14:37:55,492 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T14:37:55,493 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T14:37:55,494 If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are 2023-09-25T14:37:55,495 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via 2023-09-25T14:37:55,495 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T14:37:55,496 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T14:37:55,496 combination with a more fine grained `package-data` configuration. 2023-09-25T14:37:55,498 You can read more about "package data files" on setuptools documentation page: 2023-09-25T14:37:55,499 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T14:37:55,501 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T14:37:55,502 even if it does not contain any `.py` files. 2023-09-25T14:37:55,502 On the other hand, currently there is no concept of package data 2023-09-25T14:37:55,503 directory, all directories are treated like packages. 2023-09-25T14:37:55,503 ******************************************************************************** 2023-09-25T14:37:55,505 !! 2023-09-25T14:37:55,505 check.warn(importable) 2023-09-25T14:37:55,506 creating build/lib/alpaca_eval/evaluators_configs 2023-09-25T14:37:55,507 copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs 2023-09-25T14:37:55,507 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T14:37:55,508 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T14:37:55,508 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T14:37:55,509 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T14:37:55,509 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T14:37:55,510 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T14:37:55,511 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,511 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,512 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,512 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,513 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,513 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,514 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,515 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,515 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,516 copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,516 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,517 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,518 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,518 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,519 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T14:37:55,520 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T14:37:55,520 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T14:37:55,521 creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T14:37:55,521 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T14:37:55,522 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T14:37:55,523 creating build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T14:37:55,524 copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T14:37:55,524 copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T14:37:55,525 creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T14:37:55,525 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T14:37:55,526 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T14:37:55,526 creating build/lib/alpaca_eval/evaluators_configs/claude 2023-09-25T14:37:55,527 copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude 2023-09-25T14:37:55,527 copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude 2023-09-25T14:37:55,528 creating build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T14:37:55,528 copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T14:37:55,529 copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T14:37:55,530 creating build/lib/alpaca_eval/evaluators_configs/cohere 2023-09-25T14:37:55,530 copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere 2023-09-25T14:37:55,531 creating build/lib/alpaca_eval/evaluators_configs/gpt4 2023-09-25T14:37:55,531 copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4 2023-09-25T14:37:55,532 creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T14:37:55,533 copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T14:37:55,533 copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T14:37:55,534 creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T14:37:55,534 copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T14:37:55,535 creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T14:37:55,536 copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T14:37:55,536 creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T14:37:55,537 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T14:37:55,538 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T14:37:55,538 creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T14:37:55,539 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T14:37:55,540 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T14:37:55,540 creating build/lib/alpaca_eval/evaluators_configs/test 2023-09-25T14:37:55,541 copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test 2023-09-25T14:37:55,542 creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T14:37:55,543 copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T14:37:55,543 copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T14:37:55,544 creating build/lib/alpaca_eval/leaderboards 2023-09-25T14:37:55,544 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,545 copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,545 copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,546 copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,546 copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,547 creating build/lib/alpaca_eval/leaderboards/evaluators 2023-09-25T14:37:55,548 copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators 2023-09-25T14:37:55,548 creating build/lib/alpaca_eval/models_configs 2023-09-25T14:37:55,549 creating build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-25T14:37:55,549 copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-25T14:37:55,550 copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-25T14:37:55,550 creating build/lib/alpaca_eval/models_configs/airoboros-65b 2023-09-25T14:37:55,551 copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b 2023-09-25T14:37:55,551 creating build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-25T14:37:55,552 copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-25T14:37:55,553 copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-25T14:37:55,553 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T14:37:55,554 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T14:37:55,554 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T14:37:55,555 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T14:37:55,555 creating build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T14:37:55,556 copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T14:37:55,557 copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T14:37:55,557 creating build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T14:37:55,558 copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T14:37:55,558 creating build/lib/alpaca_eval/models_configs/chatgpt 2023-09-25T14:37:55,559 copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt 2023-09-25T14:37:55,559 creating build/lib/alpaca_eval/models_configs/claude 2023-09-25T14:37:55,560 copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude 2023-09-25T14:37:55,561 copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude 2023-09-25T14:37:55,561 creating build/lib/alpaca_eval/models_configs/cohere 2023-09-25T14:37:55,562 copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere 2023-09-25T14:37:55,563 copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere 2023-09-25T14:37:55,563 creating build/lib/alpaca_eval/models_configs/cohere-chat 2023-09-25T14:37:55,564 copying src/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere-chat 2023-09-25T14:37:55,564 creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T14:37:55,565 copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T14:37:55,565 creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T14:37:55,566 copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T14:37:55,566 creating build/lib/alpaca_eval/models_configs/gpt4 2023-09-25T14:37:55,567 copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4 2023-09-25T14:37:55,567 copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4 2023-09-25T14:37:55,568 creating build/lib/alpaca_eval/models_configs/guanaco-13b 2023-09-25T14:37:55,568 copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b 2023-09-25T14:37:55,569 creating build/lib/alpaca_eval/models_configs/guanaco-33b 2023-09-25T14:37:55,569 copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b 2023-09-25T14:37:55,570 creating build/lib/alpaca_eval/models_configs/guanaco-65b 2023-09-25T14:37:55,570 copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b 2023-09-25T14:37:55,571 creating build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-25T14:37:55,571 copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-25T14:37:55,572 copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-25T14:37:55,572 creating build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-25T14:37:55,573 copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-25T14:37:55,573 copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-25T14:37:55,574 creating build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T14:37:55,574 copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T14:37:55,575 copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T14:37:55,575 creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T14:37:55,576 copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T14:37:55,576 creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T14:37:55,577 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T14:37:55,577 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T14:37:55,578 creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T14:37:55,578 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T14:37:55,579 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T14:37:55,580 creating build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-25T14:37:55,580 copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-25T14:37:55,581 copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-25T14:37:55,581 creating build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T14:37:55,582 copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T14:37:55,582 creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T14:37:55,583 copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T14:37:55,583 creating build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T14:37:55,583 copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T14:37:55,584 creating build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T14:37:55,584 copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T14:37:55,585 creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T14:37:55,585 copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T14:37:55,586 creating build/lib/alpaca_eval/models_configs/text_davinci_001 2023-09-25T14:37:55,586 copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001 2023-09-25T14:37:55,587 creating build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-25T14:37:55,587 copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-25T14:37:55,588 copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-25T14:37:55,588 creating build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-25T14:37:55,589 copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-25T14:37:55,589 copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-25T14:37:55,590 creating build/lib/alpaca_eval/models_configs/vicuna-13b 2023-09-25T14:37:55,590 copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b 2023-09-25T14:37:55,591 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T14:37:55,591 copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T14:37:55,592 creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T14:37:55,592 copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T14:37:55,593 creating build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-25T14:37:55,593 copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-25T14:37:55,594 copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-25T14:37:55,594 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T14:37:55,595 copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T14:37:55,595 creating build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T14:37:55,597 copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T14:37:55,597 copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T14:37:55,597 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T14:37:55,598 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T14:37:55,598 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-09-25T14:37:55,599 !! 2023-09-25T14:37:55,600 ******************************************************************************** 2023-09-25T14:37:55,600 Please avoid running ``setup.py`` directly. 2023-09-25T14:37:55,601 Instead, use pypa/build, pypa/installer or other 2023-09-25T14:37:55,601 standards-based tools. 2023-09-25T14:37:55,602 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-09-25T14:37:55,603 ******************************************************************************** 2023-09-25T14:37:55,604 !! 2023-09-25T14:37:55,604 self.initialize_options() 2023-09-25T14:37:55,605 installing to build/bdist.linux-armv7l/wheel 2023-09-25T14:37:55,605 running install 2023-09-25T14:37:55,606 running install_lib 2023-09-25T14:37:55,608 creating build/bdist.linux-armv7l 2023-09-25T14:37:55,608 creating build/bdist.linux-armv7l/wheel 2023-09-25T14:37:55,616 creating build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,623 creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T14:37:55,626 copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T14:37:55,634 copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T14:37:55,639 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-09-25T14:37:55,642 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T14:37:55,644 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T14:37:55,648 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T14:37:55,652 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T14:37:55,653 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T14:37:55,657 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T14:37:55,661 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-25T14:37:55,663 copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-25T14:37:55,667 copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-25T14:37:55,672 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T14:37:55,674 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T14:37:55,679 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T14:37:55,685 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T14:37:55,687 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T14:37:55,693 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T14:37:55,700 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T14:37:55,702 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T14:37:55,709 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T14:37:55,711 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T14:37:55,712 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T14:37:55,714 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T14:37:55,715 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-09-25T14:37:55,716 copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-09-25T14:37:55,718 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T14:37:55,719 copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T14:37:55,721 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T14:37:55,722 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T14:37:55,725 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T14:37:55,727 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T14:37:55,728 copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T14:37:55,730 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T14:37:55,731 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T14:37:55,732 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T14:37:55,734 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-09-25T14:37:55,735 copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-09-25T14:37:55,738 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T14:37:55,739 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T14:37:55,740 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T14:37:55,742 copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-09-25T14:37:55,745 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T14:37:55,745 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T14:37:55,747 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T14:37:55,749 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-09-25T14:37:55,750 copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-09-25T14:37:55,752 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T14:37:55,753 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T14:37:55,754 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T14:37:55,756 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,757 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,759 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,761 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,763 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,765 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,767 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,769 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,771 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,773 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,775 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,777 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,779 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,781 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T14:37:55,783 copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,785 copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,787 copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,788 copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,790 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards 2023-09-25T14:37:55,792 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-09-25T14:37:55,793 copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-09-25T14:37:55,795 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,796 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,797 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,799 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,801 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T14:37:55,803 copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,805 copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,807 copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,810 copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,813 copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T14:37:55,816 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs 2023-09-25T14:37:55,817 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T14:37:55,818 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T14:37:55,820 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T14:37:55,821 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T14:37:55,823 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-25T14:37:55,824 copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-25T14:37:55,826 copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-25T14:37:55,828 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-09-25T14:37:55,829 copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-09-25T14:37:55,831 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T14:37:55,832 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T14:37:55,834 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T14:37:55,836 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-25T14:37:55,837 copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-25T14:37:55,839 copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-25T14:37:55,841 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-09-25T14:37:55,842 copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-09-25T14:37:55,844 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T14:37:55,845 copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T14:37:55,847 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-09-25T14:37:55,848 copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-09-25T14:37:55,851 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T14:37:55,852 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T14:37:55,854 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-25T14:37:55,855 copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-25T14:37:55,856 copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-25T14:37:55,859 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T14:37:55,860 copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T14:37:55,862 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T14:37:55,862 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T14:37:55,865 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T14:37:55,865 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T14:37:55,868 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat 2023-09-25T14:37:55,869 copying build/lib/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat 2023-09-25T14:37:55,871 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-25T14:37:55,872 copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-25T14:37:55,874 copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-25T14:37:55,876 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-09-25T14:37:55,877 copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-09-25T14:37:55,879 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T14:37:55,880 copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T14:37:55,883 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-09-25T14:37:55,884 copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-09-25T14:37:55,886 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T14:37:55,887 copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T14:37:55,889 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-25T14:37:55,890 copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-25T14:37:55,892 copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-25T14:37:55,894 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T14:37:55,895 copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T14:37:55,897 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T14:37:55,898 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T14:37:55,899 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T14:37:55,901 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T14:37:55,902 copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T14:37:55,905 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-25T14:37:55,905 copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-25T14:37:55,907 copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-25T14:37:55,909 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-25T14:37:55,910 copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-25T14:37:55,912 copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-25T14:37:55,914 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T14:37:55,915 copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T14:37:55,917 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T14:37:55,918 copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T14:37:55,920 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-25T14:37:55,921 copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-25T14:37:55,923 copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-25T14:37:55,925 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T14:37:55,926 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T14:37:55,928 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T14:37:55,930 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T14:37:55,931 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T14:37:55,933 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T14:37:55,935 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-09-25T14:37:55,936 copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-09-25T14:37:55,938 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T14:37:55,939 copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T14:37:55,941 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-25T14:37:55,942 copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-25T14:37:55,944 copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-25T14:37:55,946 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-25T14:37:55,947 copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-25T14:37:55,948 copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-25T14:37:55,950 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T14:37:55,951 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T14:37:55,953 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T14:37:55,955 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-25T14:37:55,956 copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-25T14:37:55,958 copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-25T14:37:55,960 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T14:37:55,961 copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T14:37:55,963 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-09-25T14:37:55,964 copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-09-25T14:37:55,966 creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,967 copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,969 copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,971 copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,973 copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,975 copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,977 copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T14:37:55,979 running install_egg_info 2023-09-25T14:37:56,008 Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.2.1-py3.11.egg-info 2023-09-25T14:37:56,020 running install_scripts 2023-09-25T14:37:56,056 creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.2.1.dist-info/WHEEL 2023-09-25T14:37:56,059 creating '/tmp/pip-wheel-28j_ogel/alpaca_eval-0.2.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-09-25T14:37:56,061 adding 'alpaca_eval/__init__.py' 2023-09-25T14:37:56,063 adding 'alpaca_eval/analyze.py' 2023-09-25T14:37:56,065 adding 'alpaca_eval/completion_parsers.py' 2023-09-25T14:37:56,066 adding 'alpaca_eval/constants.py' 2023-09-25T14:37:56,069 adding 'alpaca_eval/main.py' 2023-09-25T14:37:56,071 adding 'alpaca_eval/metrics.py' 2023-09-25T14:37:56,073 adding 'alpaca_eval/plotting.py' 2023-09-25T14:37:56,075 adding 'alpaca_eval/types.py' 2023-09-25T14:37:56,077 adding 'alpaca_eval/utils.py' 2023-09-25T14:37:56,079 adding 'alpaca_eval/annotators/__init__.py' 2023-09-25T14:37:56,082 adding 'alpaca_eval/annotators/pairwise_evaluator.py' 2023-09-25T14:37:56,084 adding 'alpaca_eval/decoders/__init__.py' 2023-09-25T14:37:56,086 adding 'alpaca_eval/decoders/anthropic.py' 2023-09-25T14:37:56,087 adding 'alpaca_eval/decoders/cohere.py' 2023-09-25T14:37:56,089 adding 'alpaca_eval/decoders/huggingface_api.py' 2023-09-25T14:37:56,090 adding 'alpaca_eval/decoders/huggingface_local.py' 2023-09-25T14:37:56,092 adding 'alpaca_eval/decoders/openai.py' 2023-09-25T14:37:56,094 adding 'alpaca_eval/evaluators_configs/README.md' 2023-09-25T14:37:56,096 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt' 2023-09-25T14:37:56,097 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml' 2023-09-25T14:37:56,099 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt' 2023-09-25T14:37:56,100 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml' 2023-09-25T14:37:56,102 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt' 2023-09-25T14:37:56,104 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt' 2023-09-25T14:37:56,105 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt' 2023-09-25T14:37:56,106 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt' 2023-09-25T14:37:56,108 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt' 2023-09-25T14:37:56,110 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt' 2023-09-25T14:37:56,111 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt' 2023-09-25T14:37:56,113 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt' 2023-09-25T14:37:56,114 adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml' 2023-09-25T14:37:56,115 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt' 2023-09-25T14:37:56,117 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt' 2023-09-25T14:37:56,118 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt' 2023-09-25T14:37:56,120 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt' 2023-09-25T14:37:56,122 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt' 2023-09-25T14:37:56,123 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml' 2023-09-25T14:37:56,125 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt' 2023-09-25T14:37:56,126 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml' 2023-09-25T14:37:56,128 adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt' 2023-09-25T14:37:56,129 adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml' 2023-09-25T14:37:56,130 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt' 2023-09-25T14:37:56,132 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml' 2023-09-25T14:37:56,133 adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt' 2023-09-25T14:37:56,134 adding 'alpaca_eval/evaluators_configs/claude/configs.yaml' 2023-09-25T14:37:56,136 adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml' 2023-09-25T14:37:56,137 adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt' 2023-09-25T14:37:56,139 adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml' 2023-09-25T14:37:56,140 adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml' 2023-09-25T14:37:56,142 adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt' 2023-09-25T14:37:56,143 adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml' 2023-09-25T14:37:56,145 adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml' 2023-09-25T14:37:56,147 adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml' 2023-09-25T14:37:56,148 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml' 2023-09-25T14:37:56,149 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt' 2023-09-25T14:37:56,151 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt' 2023-09-25T14:37:56,152 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml' 2023-09-25T14:37:56,154 adding 'alpaca_eval/evaluators_configs/test/configs.yaml' 2023-09-25T14:37:56,155 adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt' 2023-09-25T14:37:56,156 adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml' 2023-09-25T14:37:56,159 adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv' 2023-09-25T14:37:56,160 adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv' 2023-09-25T14:37:56,161 adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv' 2023-09-25T14:37:56,162 adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv' 2023-09-25T14:37:56,164 adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv' 2023-09-25T14:37:56,167 adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml' 2023-09-25T14:37:56,168 adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt' 2023-09-25T14:37:56,170 adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml' 2023-09-25T14:37:56,171 adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml' 2023-09-25T14:37:56,173 adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt' 2023-09-25T14:37:56,174 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml' 2023-09-25T14:37:56,176 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml' 2023-09-25T14:37:56,177 adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml' 2023-09-25T14:37:56,179 adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt' 2023-09-25T14:37:56,180 adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml' 2023-09-25T14:37:56,182 adding 'alpaca_eval/models_configs/chatgpt/configs.yaml' 2023-09-25T14:37:56,183 adding 'alpaca_eval/models_configs/claude/configs.yaml' 2023-09-25T14:37:56,184 adding 'alpaca_eval/models_configs/claude/prompt.txt' 2023-09-25T14:37:56,186 adding 'alpaca_eval/models_configs/cohere/configs.yaml' 2023-09-25T14:37:56,187 adding 'alpaca_eval/models_configs/cohere/prompt.txt' 2023-09-25T14:37:56,189 adding 'alpaca_eval/models_configs/cohere-chat/configs.yaml' 2023-09-25T14:37:56,191 adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml' 2023-09-25T14:37:56,192 adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml' 2023-09-25T14:37:56,194 adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt' 2023-09-25T14:37:56,195 adding 'alpaca_eval/models_configs/gpt4/configs.yaml' 2023-09-25T14:37:56,196 adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml' 2023-09-25T14:37:56,198 adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml' 2023-09-25T14:37:56,199 adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml' 2023-09-25T14:37:56,201 adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml' 2023-09-25T14:37:56,202 adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt' 2023-09-25T14:37:56,204 adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml' 2023-09-25T14:37:56,205 adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt' 2023-09-25T14:37:56,206 adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml' 2023-09-25T14:37:56,208 adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt' 2023-09-25T14:37:56,209 adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml' 2023-09-25T14:37:56,211 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml' 2023-09-25T14:37:56,212 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt' 2023-09-25T14:37:56,213 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml' 2023-09-25T14:37:56,214 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt' 2023-09-25T14:37:56,216 adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml' 2023-09-25T14:37:56,217 adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt' 2023-09-25T14:37:56,218 adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml' 2023-09-25T14:37:56,220 adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml' 2023-09-25T14:37:56,222 adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml' 2023-09-25T14:37:56,223 adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml' 2023-09-25T14:37:56,225 adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml' 2023-09-25T14:37:56,227 adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml' 2023-09-25T14:37:56,229 adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml' 2023-09-25T14:37:56,230 adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt' 2023-09-25T14:37:56,231 adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml' 2023-09-25T14:37:56,232 adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt' 2023-09-25T14:37:56,234 adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml' 2023-09-25T14:37:56,236 adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml' 2023-09-25T14:37:56,238 adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml' 2023-09-25T14:37:56,239 adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml' 2023-09-25T14:37:56,241 adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt' 2023-09-25T14:37:56,242 adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml' 2023-09-25T14:37:56,244 adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml' 2023-09-25T14:37:56,245 adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt' 2023-09-25T14:37:56,247 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml' 2023-09-25T14:37:56,250 adding 'alpaca_eval-0.2.1.dist-info/LICENSE' 2023-09-25T14:37:56,259 adding 'alpaca_eval-0.2.1.dist-info/METADATA' 2023-09-25T14:37:56,261 adding 'alpaca_eval-0.2.1.dist-info/WHEEL' 2023-09-25T14:37:56,262 adding 'alpaca_eval-0.2.1.dist-info/entry_points.txt' 2023-09-25T14:37:56,263 adding 'alpaca_eval-0.2.1.dist-info/top_level.txt' 2023-09-25T14:37:56,265 adding 'alpaca_eval-0.2.1.dist-info/RECORD' 2023-09-25T14:37:56,269 removing build/bdist.linux-armv7l/wheel 2023-09-25T14:37:56,430 Building wheel for alpaca-eval (setup.py): finished with status 'done' 2023-09-25T14:37:56,434 Created wheel for alpaca-eval: filename=alpaca_eval-0.2.1-py3-none-any.whl size=143159 sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 2023-09-25T14:37:56,435 Stored in directory: /tmp/pip-ephem-wheel-cache-6d_e91tj/wheels/6c/95/c7/6f3f15435e40c92726b641d0752f8f9ca05287ab006a0e4569 2023-09-25T14:37:56,462 Successfully built alpaca-eval 2023-09-25T14:37:56,468 Removed build tracker: '/tmp/pip-build-tracker-46huk_mf'