2023-09-25T16:59:59,560 Created temporary directory: /tmp/pip-build-tracker-xzwcksny
2023-09-25T16:59:59,561 Initialized build tracking at /tmp/pip-build-tracker-xzwcksny
2023-09-25T16:59:59,562 Created build tracker: /tmp/pip-build-tracker-xzwcksny
2023-09-25T16:59:59,562 Entered build tracker: /tmp/pip-build-tracker-xzwcksny
2023-09-25T16:59:59,563 Created temporary directory: /tmp/pip-wheel-8mdo6wuv
2023-09-25T16:59:59,566 Created temporary directory: /tmp/pip-ephem-wheel-cache-l9ommbz0
2023-09-25T16:59:59,588 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-09-25T16:59:59,591 2 location(s) to search for versions of alpaca-eval:
2023-09-25T16:59:59,591 * https://pypi.org/simple/alpaca-eval/
2023-09-25T16:59:59,591 * https://www.piwheels.org/simple/alpaca-eval/
2023-09-25T16:59:59,592 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2023-09-25T16:59:59,593 Getting page https://pypi.org/simple/alpaca-eval/
2023-09-25T16:59:59,594 Found index url https://pypi.org/simple/
2023-09-25T16:59:59,733 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2023-09-25T16:59:59,742   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2023-09-25T16:59:59,743   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2023-09-25T16:59:59,743   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2023-09-25T16:59:59,744   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2023-09-25T16:59:59,745   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2023-09-25T16:59:59,746   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2023-09-25T16:59:59,747   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,748   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2023-09-25T16:59:59,748   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,749   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2023-09-25T16:59:59,750   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,751   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2023-09-25T16:59:59,752   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,752   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2023-09-25T16:59:59,753   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,754   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2023-09-25T16:59:59,754   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,755   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2023-09-25T16:59:59,756   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,757   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2023-09-25T16:59:59,757   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,758   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2023-09-25T16:59:59,759   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,760   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2023-09-25T16:59:59,761   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,761   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2023-09-25T16:59:59,762   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,763   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2023-09-25T16:59:59,764   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,765   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2023-09-25T16:59:59,765   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,766   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2023-09-25T16:59:59,767   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,767   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2023-09-25T16:59:59,768   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,769   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2023-09-25T16:59:59,770   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,770   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2023-09-25T16:59:59,771   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,772   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2023-09-25T16:59:59,773 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2023-09-25T16:59:59,773 Getting page https://www.piwheels.org/simple/alpaca-eval/
2023-09-25T16:59:59,774 Found index url https://www.piwheels.org/simple/
2023-09-25T16:59:59,932 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2023-09-25T16:59:59,935   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,935   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,936   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2023-09-25T16:59:59,936   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2023-09-25T16:59:59,937   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2023-09-25T16:59:59,937   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2023-09-25T16:59:59,938 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2023-09-25T16:59:59,938 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2023-09-25T16:59:59,961 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2023-09-25T16:59:59,979 Collecting alpaca-eval==0.2.2
2023-09-25T16:59:59,981   Created temporary directory: /tmp/pip-unpack-bzkit7zz
2023-09-25T17:00:00,119   Downloading alpaca_eval-0.2.2.tar.gz (286 kB)
2023-09-25T17:00:00,538   Added alpaca-eval==0.2.2 from https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz to build tracker '/tmp/pip-build-tracker-xzwcksny'
2023-09-25T17:00:00,540   Running setup.py (path:/tmp/pip-wheel-8mdo6wuv/alpaca-eval_3818e1cc6796473f98b8308eac7e1379/setup.py) egg_info for package alpaca-eval
2023-09-25T17:00:00,541   Created temporary directory: /tmp/pip-pip-egg-info-2xyfud5e
2023-09-25T17:00:00,541   Preparing metadata (setup.py): started
2023-09-25T17:00:00,543   Running command python setup.py egg_info
2023-09-25T17:00:01,549   running egg_info
2023-09-25T17:00:01,550   creating /tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info
2023-09-25T17:00:01,573   writing /tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/PKG-INFO
2023-09-25T17:00:01,591   writing dependency_links to /tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/dependency_links.txt
2023-09-25T17:00:01,592   writing entry points to /tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/entry_points.txt
2023-09-25T17:00:01,600   writing requirements to /tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/requires.txt
2023-09-25T17:00:01,601   writing top-level names to /tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/top_level.txt
2023-09-25T17:00:01,602   writing manifest file '/tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/SOURCES.txt'
2023-09-25T17:00:01,679   reading manifest file '/tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/SOURCES.txt'
2023-09-25T17:00:01,680   reading manifest template 'MANIFEST.in'
2023-09-25T17:00:01,755   adding license file 'LICENSE'
2023-09-25T17:00:01,760   writing manifest file '/tmp/pip-pip-egg-info-2xyfud5e/alpaca_eval.egg-info/SOURCES.txt'
2023-09-25T17:00:01,868   Preparing metadata (setup.py): finished with status 'done'
2023-09-25T17:00:01,876   Source in /tmp/pip-wheel-8mdo6wuv/alpaca-eval_3818e1cc6796473f98b8308eac7e1379 has version 0.2.2, which satisfies requirement alpaca-eval==0.2.2 from https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz
2023-09-25T17:00:01,877   Removed alpaca-eval==0.2.2 from https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz from build tracker '/tmp/pip-build-tracker-xzwcksny'
2023-09-25T17:00:01,889 Created temporary directory: /tmp/pip-unpack-sabdkxnm
2023-09-25T17:00:01,890 Created temporary directory: /tmp/pip-unpack-oy_7rh4q
2023-09-25T17:00:02,017 Building wheels for collected packages: alpaca-eval
2023-09-25T17:00:02,021   Created temporary directory: /tmp/pip-wheel-4fff2b0e
2023-09-25T17:00:02,022   Building wheel for alpaca-eval (setup.py): started
2023-09-25T17:00:02,023   Destination directory: /tmp/pip-wheel-4fff2b0e
2023-09-25T17:00:02,024   Running command python setup.py bdist_wheel
2023-09-25T17:00:03,016   running bdist_wheel
2023-09-25T17:00:03,109   running build
2023-09-25T17:00:03,109   running build_py
2023-09-25T17:00:03,135   creating build
2023-09-25T17:00:03,136   creating build/lib
2023-09-25T17:00:03,137   creating build/lib/alpaca_eval
2023-09-25T17:00:03,138   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,140   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,142   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,145   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,147   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,149   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,152   copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,154   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,155   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2023-09-25T17:00:03,158   creating build/lib/alpaca_eval/annotators
2023-09-25T17:00:03,159   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2023-09-25T17:00:03,161   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2023-09-25T17:00:03,164   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2023-09-25T17:00:03,167   creating build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,168   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,170   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,172   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,174   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,176   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,178   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2023-09-25T17:00:03,180   running egg_info
2023-09-25T17:00:03,236   writing src/alpaca_eval.egg-info/PKG-INFO
2023-09-25T17:00:03,254   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2023-09-25T17:00:03,255   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2023-09-25T17:00:03,263   writing requirements to src/alpaca_eval.egg-info/requires.txt
2023-09-25T17:00:03,265   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2023-09-25T17:00:03,292   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2023-09-25T17:00:03,297   reading manifest template 'MANIFEST.in'
2023-09-25T17:00:03,565   adding license file 'LICENSE'
2023-09-25T17:00:03,573   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2023-09-25T17:00:03,575   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2023-09-25T17:00:03,576   !!

2023-09-25T17:00:03,577           ********************************************************************************
2023-09-25T17:00:03,577           ############################
2023-09-25T17:00:03,577           # Package would be ignored #
2023-09-25T17:00:03,578           ############################
2023-09-25T17:00:03,578           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2023-09-25T17:00:03,579           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,580           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,580           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2023-09-25T17:00:03,581           to the `packages` configuration field.

2023-09-25T17:00:03,582           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,582           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,583           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,584           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,585           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,586           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2023-09-25T17:00:03,586           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2023-09-25T17:00:03,587           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,587           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,588           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,589           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,590           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,591           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,592                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,592                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,593                 directory, all directories are treated like packages.
2023-09-25T17:00:03,593           ********************************************************************************

2023-09-25T17:00:03,594   !!
2023-09-25T17:00:03,594     check.warn(importable)
2023-09-25T17:00:03,595   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,595   !!

2023-09-25T17:00:03,597           ********************************************************************************
2023-09-25T17:00:03,597           ############################
2023-09-25T17:00:03,598           # Package would be ignored #
2023-09-25T17:00:03,598           ############################
2023-09-25T17:00:03,599           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2023-09-25T17:00:03,599           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,600           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,601           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2023-09-25T17:00:03,601           to the `packages` configuration field.

2023-09-25T17:00:03,602           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,603           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,603           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,604           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,605           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,605           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2023-09-25T17:00:03,606           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2023-09-25T17:00:03,606           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,606           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,607           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,607           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,608           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,609           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,610                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,610                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,610                 directory, all directories are treated like packages.
2023-09-25T17:00:03,611           ********************************************************************************

2023-09-25T17:00:03,612   !!
2023-09-25T17:00:03,612     check.warn(importable)
2023-09-25T17:00:03,613   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2023-09-25T17:00:03,613   !!

2023-09-25T17:00:03,614           ********************************************************************************
2023-09-25T17:00:03,614           ############################
2023-09-25T17:00:03,615           # Package would be ignored #
2023-09-25T17:00:03,615           ############################
2023-09-25T17:00:03,616           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2023-09-25T17:00:03,616           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,617           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,618           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2023-09-25T17:00:03,618           to the `packages` configuration field.

2023-09-25T17:00:03,619           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,619           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,620           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,621           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,622           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,623           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2023-09-25T17:00:03,623           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2023-09-25T17:00:03,624           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,624           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,625           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,626           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,627           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,627           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,628                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,628                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,628                 directory, all directories are treated like packages.
2023-09-25T17:00:03,629           ********************************************************************************

2023-09-25T17:00:03,629   !!
2023-09-25T17:00:03,630     check.warn(importable)
2023-09-25T17:00:03,630   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2023-09-25T17:00:03,630   !!

2023-09-25T17:00:03,631           ********************************************************************************
2023-09-25T17:00:03,632           ############################
2023-09-25T17:00:03,632           # Package would be ignored #
2023-09-25T17:00:03,632           ############################
2023-09-25T17:00:03,633           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2023-09-25T17:00:03,633           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,634           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,634           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2023-09-25T17:00:03,635           to the `packages` configuration field.

2023-09-25T17:00:03,636           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,636           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,637           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,637           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,638           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,639           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2023-09-25T17:00:03,640           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2023-09-25T17:00:03,640           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,641           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,641           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,642           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,643           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,645           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,645                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,646                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,646                 directory, all directories are treated like packages.
2023-09-25T17:00:03,647           ********************************************************************************

2023-09-25T17:00:03,647   !!
2023-09-25T17:00:03,648     check.warn(importable)
2023-09-25T17:00:03,649   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,649   !!

2023-09-25T17:00:03,650           ********************************************************************************
2023-09-25T17:00:03,651           ############################
2023-09-25T17:00:03,651           # Package would be ignored #
2023-09-25T17:00:03,652           ############################
2023-09-25T17:00:03,652           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2023-09-25T17:00:03,652           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,653           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,653           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2023-09-25T17:00:03,654           to the `packages` configuration field.

2023-09-25T17:00:03,654           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,655           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,655           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,656           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,657           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,658           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2023-09-25T17:00:03,658           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2023-09-25T17:00:03,658           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,659           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,659           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,661           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,662           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,663           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,664                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,664                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,665                 directory, all directories are treated like packages.
2023-09-25T17:00:03,665           ********************************************************************************

2023-09-25T17:00:03,666   !!
2023-09-25T17:00:03,667     check.warn(importable)
2023-09-25T17:00:03,667   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,668   !!

2023-09-25T17:00:03,669           ********************************************************************************
2023-09-25T17:00:03,669           ############################
2023-09-25T17:00:03,670           # Package would be ignored #
2023-09-25T17:00:03,670           ############################
2023-09-25T17:00:03,671           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2023-09-25T17:00:03,671           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,672           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,673           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2023-09-25T17:00:03,673           to the `packages` configuration field.

2023-09-25T17:00:03,674           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,675           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,675           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,676           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,678           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,678           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2023-09-25T17:00:03,679           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2023-09-25T17:00:03,679           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,679           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,680           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,680           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,683                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,683                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,683                 directory, all directories are treated like packages.
2023-09-25T17:00:03,684           ********************************************************************************

2023-09-25T17:00:03,684   !!
2023-09-25T17:00:03,685     check.warn(importable)
2023-09-25T17:00:03,685   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2023-09-25T17:00:03,686   !!

2023-09-25T17:00:03,686           ********************************************************************************
2023-09-25T17:00:03,687           ############################
2023-09-25T17:00:03,687           # Package would be ignored #
2023-09-25T17:00:03,688           ############################
2023-09-25T17:00:03,688           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2023-09-25T17:00:03,689           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,690           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,690           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2023-09-25T17:00:03,691           to the `packages` configuration field.

2023-09-25T17:00:03,692           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,692           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,693           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,694           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,695           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,695           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2023-09-25T17:00:03,696           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2023-09-25T17:00:03,696           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,697           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,697           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,698           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,699           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,701           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,702                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,702                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,703                 directory, all directories are treated like packages.
2023-09-25T17:00:03,704           ********************************************************************************

2023-09-25T17:00:03,704   !!
2023-09-25T17:00:03,705     check.warn(importable)
2023-09-25T17:00:03,705   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2023-09-25T17:00:03,705   !!

2023-09-25T17:00:03,706           ********************************************************************************
2023-09-25T17:00:03,706           ############################
2023-09-25T17:00:03,707           # Package would be ignored #
2023-09-25T17:00:03,707           ############################
2023-09-25T17:00:03,708           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2023-09-25T17:00:03,708           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,709           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,709           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2023-09-25T17:00:03,709           to the `packages` configuration field.

2023-09-25T17:00:03,710           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,711           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,711           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,712           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,713           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,714           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2023-09-25T17:00:03,714           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2023-09-25T17:00:03,715           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,715           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,716           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,717           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,718           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,719           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,720                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,720                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,721                 directory, all directories are treated like packages.
2023-09-25T17:00:03,721           ********************************************************************************

2023-09-25T17:00:03,722   !!
2023-09-25T17:00:03,723     check.warn(importable)
2023-09-25T17:00:03,723   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2023-09-25T17:00:03,724   !!

2023-09-25T17:00:03,725           ********************************************************************************
2023-09-25T17:00:03,725           ############################
2023-09-25T17:00:03,726           # Package would be ignored #
2023-09-25T17:00:03,726           ############################
2023-09-25T17:00:03,726           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2023-09-25T17:00:03,727           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,728           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,728           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2023-09-25T17:00:03,729           to the `packages` configuration field.

2023-09-25T17:00:03,730           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,730           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,731           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,731           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,732           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,734           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2023-09-25T17:00:03,734           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2023-09-25T17:00:03,734           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,735           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,735           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,737           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,738           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,739           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,739                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,740                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,740                 directory, all directories are treated like packages.
2023-09-25T17:00:03,741           ********************************************************************************

2023-09-25T17:00:03,741   !!
2023-09-25T17:00:03,742     check.warn(importable)
2023-09-25T17:00:03,743   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2023-09-25T17:00:03,743   !!

2023-09-25T17:00:03,744           ********************************************************************************
2023-09-25T17:00:03,745           ############################
2023-09-25T17:00:03,745           # Package would be ignored #
2023-09-25T17:00:03,746           ############################
2023-09-25T17:00:03,746           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2023-09-25T17:00:03,747           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,748           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,748           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2023-09-25T17:00:03,748           to the `packages` configuration field.

2023-09-25T17:00:03,749           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,750           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,750           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,751           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,752           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,753           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2023-09-25T17:00:03,754           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2023-09-25T17:00:03,754           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,755           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,756           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,757           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,758           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,759           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,759                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,759                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,760                 directory, all directories are treated like packages.
2023-09-25T17:00:03,760           ********************************************************************************

2023-09-25T17:00:03,761   !!
2023-09-25T17:00:03,761     check.warn(importable)
2023-09-25T17:00:03,761   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2023-09-25T17:00:03,762   !!

2023-09-25T17:00:03,763           ********************************************************************************
2023-09-25T17:00:03,763           ############################
2023-09-25T17:00:03,763           # Package would be ignored #
2023-09-25T17:00:03,764           ############################
2023-09-25T17:00:03,764           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2023-09-25T17:00:03,764           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,765           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,766           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2023-09-25T17:00:03,766           to the `packages` configuration field.

2023-09-25T17:00:03,767           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,767           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,768           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,769           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,770           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,771           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2023-09-25T17:00:03,771           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2023-09-25T17:00:03,772           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,772           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,773           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,773           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,774           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,776           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,776                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,777                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,777                 directory, all directories are treated like packages.
2023-09-25T17:00:03,778           ********************************************************************************

2023-09-25T17:00:03,779   !!
2023-09-25T17:00:03,779     check.warn(importable)
2023-09-25T17:00:03,780   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2023-09-25T17:00:03,780   !!

2023-09-25T17:00:03,781           ********************************************************************************
2023-09-25T17:00:03,782           ############################
2023-09-25T17:00:03,782           # Package would be ignored #
2023-09-25T17:00:03,782           ############################
2023-09-25T17:00:03,783           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2023-09-25T17:00:03,783           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,784           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,784           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2023-09-25T17:00:03,784           to the `packages` configuration field.

2023-09-25T17:00:03,785           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,786           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,786           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,787           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,788           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,789           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2023-09-25T17:00:03,789           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2023-09-25T17:00:03,789           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,790           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,790           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,791           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,792           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,794           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,794                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,794                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,795                 directory, all directories are treated like packages.
2023-09-25T17:00:03,795           ********************************************************************************

2023-09-25T17:00:03,796   !!
2023-09-25T17:00:03,797     check.warn(importable)
2023-09-25T17:00:03,797   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,798   !!

2023-09-25T17:00:03,799           ********************************************************************************
2023-09-25T17:00:03,799           ############################
2023-09-25T17:00:03,799           # Package would be ignored #
2023-09-25T17:00:03,800           ############################
2023-09-25T17:00:03,800           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2023-09-25T17:00:03,801           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,802           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,802           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2023-09-25T17:00:03,803           to the `packages` configuration field.

2023-09-25T17:00:03,804           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,805           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,805           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,806           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,807           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,808           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2023-09-25T17:00:03,808           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2023-09-25T17:00:03,809           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,809           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,810           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,810           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,811           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,813           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,813                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,814                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,814                 directory, all directories are treated like packages.
2023-09-25T17:00:03,815           ********************************************************************************

2023-09-25T17:00:03,816   !!
2023-09-25T17:00:03,816     check.warn(importable)
2023-09-25T17:00:03,817   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2023-09-25T17:00:03,818   !!

2023-09-25T17:00:03,819           ********************************************************************************
2023-09-25T17:00:03,819           ############################
2023-09-25T17:00:03,820           # Package would be ignored #
2023-09-25T17:00:03,820           ############################
2023-09-25T17:00:03,821           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2023-09-25T17:00:03,821           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,823           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,823           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2023-09-25T17:00:03,824           to the `packages` configuration field.

2023-09-25T17:00:03,825           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,826           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,826           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,827           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,828           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,829           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2023-09-25T17:00:03,830           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2023-09-25T17:00:03,830           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,831           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,832           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,833           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,834           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,836           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,836                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,837                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,838                 directory, all directories are treated like packages.
2023-09-25T17:00:03,838           ********************************************************************************

2023-09-25T17:00:03,839   !!
2023-09-25T17:00:03,840     check.warn(importable)
2023-09-25T17:00:03,840   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,840   !!

2023-09-25T17:00:03,842           ********************************************************************************
2023-09-25T17:00:03,842           ############################
2023-09-25T17:00:03,843           # Package would be ignored #
2023-09-25T17:00:03,843           ############################
2023-09-25T17:00:03,844           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2023-09-25T17:00:03,844           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,845           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,846           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2023-09-25T17:00:03,846           to the `packages` configuration field.

2023-09-25T17:00:03,848           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,848           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,849           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,850           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,851           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,852           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2023-09-25T17:00:03,853           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2023-09-25T17:00:03,853           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,854           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,855           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,856           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,857           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,858           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,859                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,859                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,860                 directory, all directories are treated like packages.
2023-09-25T17:00:03,860           ********************************************************************************

2023-09-25T17:00:03,862   !!
2023-09-25T17:00:03,862     check.warn(importable)
2023-09-25T17:00:03,863   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,863   !!

2023-09-25T17:00:03,864           ********************************************************************************
2023-09-25T17:00:03,865           ############################
2023-09-25T17:00:03,866           # Package would be ignored #
2023-09-25T17:00:03,866           ############################
2023-09-25T17:00:03,867           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2023-09-25T17:00:03,867           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,869           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,869           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2023-09-25T17:00:03,870           to the `packages` configuration field.

2023-09-25T17:00:03,871           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,871           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,872           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,873           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,874           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,875           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2023-09-25T17:00:03,875           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2023-09-25T17:00:03,876           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,876           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,877           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,878           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,879           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,880           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,880                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,881                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,882                 directory, all directories are treated like packages.
2023-09-25T17:00:03,882           ********************************************************************************

2023-09-25T17:00:03,883   !!
2023-09-25T17:00:03,884     check.warn(importable)
2023-09-25T17:00:03,884   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:03,885   !!

2023-09-25T17:00:03,886           ********************************************************************************
2023-09-25T17:00:03,886           ############################
2023-09-25T17:00:03,887           # Package would be ignored #
2023-09-25T17:00:03,887           ############################
2023-09-25T17:00:03,888           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2023-09-25T17:00:03,889           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,890           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,890           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2023-09-25T17:00:03,891           to the `packages` configuration field.

2023-09-25T17:00:03,892           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,893           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,893           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,894           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,895           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,897           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2023-09-25T17:00:03,897           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2023-09-25T17:00:03,898           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,899           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,899           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,900           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,901           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,903           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,903                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,904                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,904                 directory, all directories are treated like packages.
2023-09-25T17:00:03,905           ********************************************************************************

2023-09-25T17:00:03,906   !!
2023-09-25T17:00:03,906     check.warn(importable)
2023-09-25T17:00:03,907   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2023-09-25T17:00:03,908   !!

2023-09-25T17:00:03,909           ********************************************************************************
2023-09-25T17:00:03,909           ############################
2023-09-25T17:00:03,910           # Package would be ignored #
2023-09-25T17:00:03,910           ############################
2023-09-25T17:00:03,911           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2023-09-25T17:00:03,911           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,912           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,913           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2023-09-25T17:00:03,913           to the `packages` configuration field.

2023-09-25T17:00:03,914           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,915           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,915           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,916           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,918           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,919           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2023-09-25T17:00:03,919           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2023-09-25T17:00:03,920           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,921           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,921           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,922           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,923           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,925           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,925                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,926                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,926                 directory, all directories are treated like packages.
2023-09-25T17:00:03,927           ********************************************************************************

2023-09-25T17:00:03,928   !!
2023-09-25T17:00:03,928     check.warn(importable)
2023-09-25T17:00:03,929   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2023-09-25T17:00:03,929   !!

2023-09-25T17:00:03,930           ********************************************************************************
2023-09-25T17:00:03,931           ############################
2023-09-25T17:00:03,931           # Package would be ignored #
2023-09-25T17:00:03,932           ############################
2023-09-25T17:00:03,932           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2023-09-25T17:00:03,932           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,933           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,934           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2023-09-25T17:00:03,934           to the `packages` configuration field.

2023-09-25T17:00:03,935           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,936           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,936           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,937           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,938           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,939           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2023-09-25T17:00:03,939           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2023-09-25T17:00:03,940           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,940           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,941           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,942           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,943           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,944           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,945                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,945                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,946                 directory, all directories are treated like packages.
2023-09-25T17:00:03,946           ********************************************************************************

2023-09-25T17:00:03,947   !!
2023-09-25T17:00:03,948     check.warn(importable)
2023-09-25T17:00:03,948   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2023-09-25T17:00:03,949   !!

2023-09-25T17:00:03,950           ********************************************************************************
2023-09-25T17:00:03,950           ############################
2023-09-25T17:00:03,951           # Package would be ignored #
2023-09-25T17:00:03,951           ############################
2023-09-25T17:00:03,952           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2023-09-25T17:00:03,952           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,953           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,954           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2023-09-25T17:00:03,955           to the `packages` configuration field.

2023-09-25T17:00:03,955           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,956           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,957           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,958           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,958           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,959           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2023-09-25T17:00:03,960           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2023-09-25T17:00:03,960           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,961           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,961           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,962           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,963           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,964           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,965                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,965                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,966                 directory, all directories are treated like packages.
2023-09-25T17:00:03,967           ********************************************************************************

2023-09-25T17:00:03,968   !!
2023-09-25T17:00:03,968     check.warn(importable)
2023-09-25T17:00:03,968   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2023-09-25T17:00:03,969   !!

2023-09-25T17:00:03,970           ********************************************************************************
2023-09-25T17:00:03,971           ############################
2023-09-25T17:00:03,972           # Package would be ignored #
2023-09-25T17:00:03,972           ############################
2023-09-25T17:00:03,973           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2023-09-25T17:00:03,974           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:03,975           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:03,976           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2023-09-25T17:00:03,976           to the `packages` configuration field.

2023-09-25T17:00:03,978           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:03,978           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:03,979           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:03,980           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:03,981           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:03,983           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2023-09-25T17:00:03,983           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2023-09-25T17:00:03,984           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:03,985           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:03,985           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:03,987           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:03,988           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:03,990           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:03,991                 even if it does not contain any `.py` files.
2023-09-25T17:00:03,991                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:03,992                 directory, all directories are treated like packages.
2023-09-25T17:00:03,992           ********************************************************************************

2023-09-25T17:00:03,994   !!
2023-09-25T17:00:03,994     check.warn(importable)
2023-09-25T17:00:03,995   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2023-09-25T17:00:03,995   !!

2023-09-25T17:00:03,997           ********************************************************************************
2023-09-25T17:00:03,997           ############################
2023-09-25T17:00:03,998           # Package would be ignored #
2023-09-25T17:00:03,998           ############################
2023-09-25T17:00:03,999           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2023-09-25T17:00:03,999           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,000           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,001           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2023-09-25T17:00:04,002           to the `packages` configuration field.

2023-09-25T17:00:04,003           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,004           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,004           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,006           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,007           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,008           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2023-09-25T17:00:04,009           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2023-09-25T17:00:04,009           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,010           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,010           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,012           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,013           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,015           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,016                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,016                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,017                 directory, all directories are treated like packages.
2023-09-25T17:00:04,018           ********************************************************************************

2023-09-25T17:00:04,019   !!
2023-09-25T17:00:04,020     check.warn(importable)
2023-09-25T17:00:04,020   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2023-09-25T17:00:04,021   !!

2023-09-25T17:00:04,022           ********************************************************************************
2023-09-25T17:00:04,023           ############################
2023-09-25T17:00:04,024           # Package would be ignored #
2023-09-25T17:00:04,024           ############################
2023-09-25T17:00:04,025           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2023-09-25T17:00:04,026           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,027           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,027           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2023-09-25T17:00:04,028           to the `packages` configuration field.

2023-09-25T17:00:04,029           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,030           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,030           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,031           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,032           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,033           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2023-09-25T17:00:04,034           already explicitly excluding 'alpaca_eval.models_configs' via
2023-09-25T17:00:04,035           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,035           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,036           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,037           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,038           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,040           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,040                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,041                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,042                 directory, all directories are treated like packages.
2023-09-25T17:00:04,042           ********************************************************************************

2023-09-25T17:00:04,044   !!
2023-09-25T17:00:04,044     check.warn(importable)
2023-09-25T17:00:04,045   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration.
2023-09-25T17:00:04,046   !!

2023-09-25T17:00:04,047           ********************************************************************************
2023-09-25T17:00:04,048           ############################
2023-09-25T17:00:04,048           # Package would be ignored #
2023-09-25T17:00:04,049           ############################
2023-09-25T17:00:04,050           Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1],
2023-09-25T17:00:04,050           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,052           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,053           package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added
2023-09-25T17:00:04,054           to the `packages` configuration field.

2023-09-25T17:00:04,055           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,056           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,056           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,058           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,059           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,060           If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are
2023-09-25T17:00:04,061           already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via
2023-09-25T17:00:04,062           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,063           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,063           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,065           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,066           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,068           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,068                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,069                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,069                 directory, all directories are treated like packages.
2023-09-25T17:00:04,070           ********************************************************************************

2023-09-25T17:00:04,071   !!
2023-09-25T17:00:04,071     check.warn(importable)
2023-09-25T17:00:04,072   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2023-09-25T17:00:04,072   !!

2023-09-25T17:00:04,073           ********************************************************************************
2023-09-25T17:00:04,074           ############################
2023-09-25T17:00:04,074           # Package would be ignored #
2023-09-25T17:00:04,075           ############################
2023-09-25T17:00:04,075           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2023-09-25T17:00:04,075           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,076           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,077           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2023-09-25T17:00:04,077           to the `packages` configuration field.

2023-09-25T17:00:04,078           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,079           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,079           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,080           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,081           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,082           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2023-09-25T17:00:04,082           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2023-09-25T17:00:04,083           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,083           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,084           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,085           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,086           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,088           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,088                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,089                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,089                 directory, all directories are treated like packages.
2023-09-25T17:00:04,090           ********************************************************************************

2023-09-25T17:00:04,091   !!
2023-09-25T17:00:04,091     check.warn(importable)
2023-09-25T17:00:04,092   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2023-09-25T17:00:04,093   !!

2023-09-25T17:00:04,094           ********************************************************************************
2023-09-25T17:00:04,094           ############################
2023-09-25T17:00:04,095           # Package would be ignored #
2023-09-25T17:00:04,095           ############################
2023-09-25T17:00:04,095           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2023-09-25T17:00:04,096           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,097           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,097           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2023-09-25T17:00:04,098           to the `packages` configuration field.

2023-09-25T17:00:04,098           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,099           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,099           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,100           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,101           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,102           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2023-09-25T17:00:04,102           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2023-09-25T17:00:04,103           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,103           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,104           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,104           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,105           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,107           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,107                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,108                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,108                 directory, all directories are treated like packages.
2023-09-25T17:00:04,108           ********************************************************************************

2023-09-25T17:00:04,109   !!
2023-09-25T17:00:04,110     check.warn(importable)
2023-09-25T17:00:04,111   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2023-09-25T17:00:04,111   !!

2023-09-25T17:00:04,112           ********************************************************************************
2023-09-25T17:00:04,113           ############################
2023-09-25T17:00:04,113           # Package would be ignored #
2023-09-25T17:00:04,114           ############################
2023-09-25T17:00:04,114           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2023-09-25T17:00:04,115           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,116           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,116           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2023-09-25T17:00:04,117           to the `packages` configuration field.

2023-09-25T17:00:04,118           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,118           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,119           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,120           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,121           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,122           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2023-09-25T17:00:04,122           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2023-09-25T17:00:04,123           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,123           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,124           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,124           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,125           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,127           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,127                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,128                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,128                 directory, all directories are treated like packages.
2023-09-25T17:00:04,129           ********************************************************************************

2023-09-25T17:00:04,130   !!
2023-09-25T17:00:04,130     check.warn(importable)
2023-09-25T17:00:04,131   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2023-09-25T17:00:04,131   !!

2023-09-25T17:00:04,132           ********************************************************************************
2023-09-25T17:00:04,133           ############################
2023-09-25T17:00:04,133           # Package would be ignored #
2023-09-25T17:00:04,134           ############################
2023-09-25T17:00:04,134           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2023-09-25T17:00:04,135           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,136           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,136           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2023-09-25T17:00:04,137           to the `packages` configuration field.

2023-09-25T17:00:04,138           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,138           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,139           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,140           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,141           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,142           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2023-09-25T17:00:04,142           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2023-09-25T17:00:04,143           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,143           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,144           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,145           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,146           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,148           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,148                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,149                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,149                 directory, all directories are treated like packages.
2023-09-25T17:00:04,150           ********************************************************************************

2023-09-25T17:00:04,150   !!
2023-09-25T17:00:04,151     check.warn(importable)
2023-09-25T17:00:04,151   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2023-09-25T17:00:04,151   !!

2023-09-25T17:00:04,152           ********************************************************************************
2023-09-25T17:00:04,153           ############################
2023-09-25T17:00:04,153           # Package would be ignored #
2023-09-25T17:00:04,154           ############################
2023-09-25T17:00:04,154           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2023-09-25T17:00:04,155           but it is absent from setuptools' `packages` configuration.

2023-09-25T17:00:04,156           This leads to an ambiguous overall configuration. If you want to distribute this
2023-09-25T17:00:04,156           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2023-09-25T17:00:04,157           to the `packages` configuration field.

2023-09-25T17:00:04,158           Alternatively, you can also rely on setuptools' discovery methods
2023-09-25T17:00:04,158           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-09-25T17:00:04,159           instead of `find_packages(...)`/`find:`).

2023-09-25T17:00:04,160           You can read more about "package discovery" on setuptools documentation page:

2023-09-25T17:00:04,161           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-09-25T17:00:04,162           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2023-09-25T17:00:04,162           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2023-09-25T17:00:04,163           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-09-25T17:00:04,164           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-09-25T17:00:04,164           combination with a more fine grained `package-data` configuration.

2023-09-25T17:00:04,165           You can read more about "package data files" on setuptools documentation page:

2023-09-25T17:00:04,166           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-09-25T17:00:04,168           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-09-25T17:00:04,169                 even if it does not contain any `.py` files.
2023-09-25T17:00:04,169                 On the other hand, currently there is no concept of package data
2023-09-25T17:00:04,170                 directory, all directories are treated like packages.
2023-09-25T17:00:04,170           ********************************************************************************

2023-09-25T17:00:04,171   !!
2023-09-25T17:00:04,172     check.warn(importable)
2023-09-25T17:00:04,172   creating build/lib/alpaca_eval/evaluators_configs
2023-09-25T17:00:04,173   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2023-09-25T17:00:04,173   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2023-09-25T17:00:04,174   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2023-09-25T17:00:04,175   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2023-09-25T17:00:04,175   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2023-09-25T17:00:04,176   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2023-09-25T17:00:04,176   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2023-09-25T17:00:04,177   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,177   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,178   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,178   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,179   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,179   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,179   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,180   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,180   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,181   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,181   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,182   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,182   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,183   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,183   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2023-09-25T17:00:04,184   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2023-09-25T17:00:04,185   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2023-09-25T17:00:04,185   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2023-09-25T17:00:04,186   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2023-09-25T17:00:04,186   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2023-09-25T17:00:04,187   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2023-09-25T17:00:04,187   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2023-09-25T17:00:04,188   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2023-09-25T17:00:04,188   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2023-09-25T17:00:04,189   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2023-09-25T17:00:04,189   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2023-09-25T17:00:04,190   creating build/lib/alpaca_eval/evaluators_configs/claude
2023-09-25T17:00:04,190   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2023-09-25T17:00:04,191   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2023-09-25T17:00:04,191   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2023-09-25T17:00:04,192   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2023-09-25T17:00:04,192   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2023-09-25T17:00:04,193   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2023-09-25T17:00:04,193   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2023-09-25T17:00:04,193   creating build/lib/alpaca_eval/evaluators_configs/cohere
2023-09-25T17:00:04,194   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2023-09-25T17:00:04,195   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2023-09-25T17:00:04,195   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2023-09-25T17:00:04,196   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2023-09-25T17:00:04,196   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2023-09-25T17:00:04,197   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2023-09-25T17:00:04,197   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2023-09-25T17:00:04,198   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2023-09-25T17:00:04,198   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2023-09-25T17:00:04,199   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2023-09-25T17:00:04,200   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2023-09-25T17:00:04,200   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2023-09-25T17:00:04,201   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2023-09-25T17:00:04,201   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2023-09-25T17:00:04,202   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2023-09-25T17:00:04,203   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2023-09-25T17:00:04,203   creating build/lib/alpaca_eval/evaluators_configs/test
2023-09-25T17:00:04,204   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2023-09-25T17:00:04,204   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2023-09-25T17:00:04,205   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2023-09-25T17:00:04,205   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2023-09-25T17:00:04,206   creating build/lib/alpaca_eval/leaderboards
2023-09-25T17:00:04,206   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,207   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,208   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,208   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,209   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,209   creating build/lib/alpaca_eval/leaderboards/evaluators
2023-09-25T17:00:04,210   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2023-09-25T17:00:04,210   creating build/lib/alpaca_eval/models_configs
2023-09-25T17:00:04,210   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2023-09-25T17:00:04,211   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2023-09-25T17:00:04,212   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2023-09-25T17:00:04,212   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2023-09-25T17:00:04,213   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2023-09-25T17:00:04,213   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2023-09-25T17:00:04,214   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2023-09-25T17:00:04,214   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2023-09-25T17:00:04,215   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2023-09-25T17:00:04,215   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2023-09-25T17:00:04,216   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2023-09-25T17:00:04,216   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2023-09-25T17:00:04,217   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2023-09-25T17:00:04,217   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2023-09-25T17:00:04,218   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2023-09-25T17:00:04,218   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2023-09-25T17:00:04,219   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2023-09-25T17:00:04,219   creating build/lib/alpaca_eval/models_configs/chatgpt
2023-09-25T17:00:04,220   copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt
2023-09-25T17:00:04,221   creating build/lib/alpaca_eval/models_configs/claude
2023-09-25T17:00:04,221   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2023-09-25T17:00:04,222   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2023-09-25T17:00:04,222   creating build/lib/alpaca_eval/models_configs/claude-2
2023-09-25T17:00:04,223   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2023-09-25T17:00:04,223   creating build/lib/alpaca_eval/models_configs/cohere
2023-09-25T17:00:04,224   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2023-09-25T17:00:04,225   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2023-09-25T17:00:04,225   creating build/lib/alpaca_eval/models_configs/cohere-chat
2023-09-25T17:00:04,226   copying src/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere-chat
2023-09-25T17:00:04,226   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2023-09-25T17:00:04,227   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2023-09-25T17:00:04,227   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2023-09-25T17:00:04,228   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2023-09-25T17:00:04,228   creating build/lib/alpaca_eval/models_configs/gpt4
2023-09-25T17:00:04,229   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2023-09-25T17:00:04,229   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2023-09-25T17:00:04,230   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2023-09-25T17:00:04,230   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2023-09-25T17:00:04,231   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2023-09-25T17:00:04,231   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2023-09-25T17:00:04,231   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2023-09-25T17:00:04,232   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2023-09-25T17:00:04,232   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2023-09-25T17:00:04,233   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2023-09-25T17:00:04,234   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2023-09-25T17:00:04,234   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2023-09-25T17:00:04,235   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2023-09-25T17:00:04,235   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2023-09-25T17:00:04,236   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2023-09-25T17:00:04,237   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2023-09-25T17:00:04,237   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2023-09-25T17:00:04,238   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2023-09-25T17:00:04,238   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2023-09-25T17:00:04,239   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2023-09-25T17:00:04,240   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2023-09-25T17:00:04,240   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2023-09-25T17:00:04,241   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2023-09-25T17:00:04,241   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2023-09-25T17:00:04,242   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2023-09-25T17:00:04,242   creating build/lib/alpaca_eval/models_configs/openchat-13b
2023-09-25T17:00:04,243   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2023-09-25T17:00:04,244   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2023-09-25T17:00:04,244   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2023-09-25T17:00:04,244   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2023-09-25T17:00:04,245   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2023-09-25T17:00:04,245   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2023-09-25T17:00:04,246   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2023-09-25T17:00:04,246   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2023-09-25T17:00:04,247   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2023-09-25T17:00:04,247   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2023-09-25T17:00:04,248   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2023-09-25T17:00:04,248   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2023-09-25T17:00:04,249   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2023-09-25T17:00:04,249   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2023-09-25T17:00:04,250   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2023-09-25T17:00:04,250   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2023-09-25T17:00:04,251   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2023-09-25T17:00:04,251   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2023-09-25T17:00:04,252   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2023-09-25T17:00:04,252   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2023-09-25T17:00:04,253   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2023-09-25T17:00:04,253   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2023-09-25T17:00:04,254   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2023-09-25T17:00:04,255   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2023-09-25T17:00:04,255   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2023-09-25T17:00:04,256   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2023-09-25T17:00:04,256   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2023-09-25T17:00:04,257   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2023-09-25T17:00:04,257   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2023-09-25T17:00:04,258   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2023-09-25T17:00:04,258   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2023-09-25T17:00:04,259   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2023-09-25T17:00:04,259   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2023-09-25T17:00:04,260   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2023-09-25T17:00:04,260   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2023-09-25T17:00:04,261   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2023-09-25T17:00:04,262   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2023-09-25T17:00:04,262   !!

2023-09-25T17:00:04,263           ********************************************************************************
2023-09-25T17:00:04,263           Please avoid running ``setup.py`` directly.
2023-09-25T17:00:04,264           Instead, use pypa/build, pypa/installer or other
2023-09-25T17:00:04,264           standards-based tools.

2023-09-25T17:00:04,265           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2023-09-25T17:00:04,266           ********************************************************************************

2023-09-25T17:00:04,266   !!
2023-09-25T17:00:04,267     self.initialize_options()
2023-09-25T17:00:04,267   installing to build/bdist.linux-armv7l/wheel
2023-09-25T17:00:04,268   running install
2023-09-25T17:00:04,268   running install_lib
2023-09-25T17:00:04,288   creating build/bdist.linux-armv7l
2023-09-25T17:00:04,289   creating build/bdist.linux-armv7l/wheel
2023-09-25T17:00:04,290   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,291   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,294   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,296   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,299   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,301   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,304   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2023-09-25T17:00:04,305   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,307   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,309   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,310   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,312   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2023-09-25T17:00:04,314   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2023-09-25T17:00:04,315   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2023-09-25T17:00:04,318   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,321   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2023-09-25T17:00:04,323   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2023-09-25T17:00:04,324   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2023-09-25T17:00:04,326   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2023-09-25T17:00:04,328   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2023-09-25T17:00:04,329   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2023-09-25T17:00:04,332   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2023-09-25T17:00:04,333   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2023-09-25T17:00:04,335   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2023-09-25T17:00:04,336   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2023-09-25T17:00:04,337   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2023-09-25T17:00:04,339   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2023-09-25T17:00:04,340   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2023-09-25T17:00:04,342   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2023-09-25T17:00:04,343   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2023-09-25T17:00:04,345   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2023-09-25T17:00:04,346   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2023-09-25T17:00:04,347   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2023-09-25T17:00:04,350   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2023-09-25T17:00:04,350   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2023-09-25T17:00:04,352   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2023-09-25T17:00:04,353   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2023-09-25T17:00:04,355   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2023-09-25T17:00:04,357   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2023-09-25T17:00:04,358   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2023-09-25T17:00:04,360   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2023-09-25T17:00:04,361   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2023-09-25T17:00:04,364   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2023-09-25T17:00:04,365   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2023-09-25T17:00:04,367   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat
2023-09-25T17:00:04,368   copying build/lib/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat
2023-09-25T17:00:04,370   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2023-09-25T17:00:04,371   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2023-09-25T17:00:04,374   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2023-09-25T17:00:04,374   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2023-09-25T17:00:04,376   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2023-09-25T17:00:04,378   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2023-09-25T17:00:04,379   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2023-09-25T17:00:04,381   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2023-09-25T17:00:04,383   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2023-09-25T17:00:04,384   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2023-09-25T17:00:04,398   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2023-09-25T17:00:04,400   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2023-09-25T17:00:04,401   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2023-09-25T17:00:04,403   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2023-09-25T17:00:04,405   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2023-09-25T17:00:04,405   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2023-09-25T17:00:04,408   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2023-09-25T17:00:04,409   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2023-09-25T17:00:04,411   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2023-09-25T17:00:04,412   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2023-09-25T17:00:04,414   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2023-09-25T17:00:04,415   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2023-09-25T17:00:04,417   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2023-09-25T17:00:04,418   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2023-09-25T17:00:04,420   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2023-09-25T17:00:04,421   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2023-09-25T17:00:04,423   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2023-09-25T17:00:04,425   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2023-09-25T17:00:04,426   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2023-09-25T17:00:04,428   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2023-09-25T17:00:04,430   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2023-09-25T17:00:04,431   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2023-09-25T17:00:04,433   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2023-09-25T17:00:04,434   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2023-09-25T17:00:04,436   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt
2023-09-25T17:00:04,437   copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt
2023-09-25T17:00:04,439   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2023-09-25T17:00:04,440   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2023-09-25T17:00:04,442   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2023-09-25T17:00:04,443   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2023-09-25T17:00:04,445   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2023-09-25T17:00:04,446   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2023-09-25T17:00:04,448   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2023-09-25T17:00:04,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2023-09-25T17:00:04,451   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2023-09-25T17:00:04,453   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2023-09-25T17:00:04,454   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2023-09-25T17:00:04,456   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2023-09-25T17:00:04,457   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2023-09-25T17:00:04,459   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2023-09-25T17:00:04,460   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2023-09-25T17:00:04,462   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2023-09-25T17:00:04,464   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2023-09-25T17:00:04,465   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2023-09-25T17:00:04,467   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2023-09-25T17:00:04,469   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2023-09-25T17:00:04,470   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2023-09-25T17:00:04,472   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2023-09-25T17:00:04,474   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2023-09-25T17:00:04,475   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2023-09-25T17:00:04,477   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2023-09-25T17:00:04,478   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2023-09-25T17:00:04,479   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2023-09-25T17:00:04,481   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2023-09-25T17:00:04,482   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2023-09-25T17:00:04,484   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2023-09-25T17:00:04,487   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2023-09-25T17:00:04,488   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2023-09-25T17:00:04,490   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2023-09-25T17:00:04,492   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2023-09-25T17:00:04,495   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,496   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,498   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,500   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,502   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,504   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,506   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2023-09-25T17:00:04,509   copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,511   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,512   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2023-09-25T17:00:04,515   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2023-09-25T17:00:04,516   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2023-09-25T17:00:04,517   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2023-09-25T17:00:04,519   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2023-09-25T17:00:04,520   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2023-09-25T17:00:04,523   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2023-09-25T17:00:04,524   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2023-09-25T17:00:04,525   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2023-09-25T17:00:04,528   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2023-09-25T17:00:04,528   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2023-09-25T17:00:04,530   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2023-09-25T17:00:04,532   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2023-09-25T17:00:04,533   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2023-09-25T17:00:04,535   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2023-09-25T17:00:04,536   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2023-09-25T17:00:04,538   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2023-09-25T17:00:04,539   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2023-09-25T17:00:04,541   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2023-09-25T17:00:04,543   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2023-09-25T17:00:04,544   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2023-09-25T17:00:04,546   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2023-09-25T17:00:04,549   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,550   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,552   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,555   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,558   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,560   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,562   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,564   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,566   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,568   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,570   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,572   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,574   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,577   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2023-09-25T17:00:04,580   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2023-09-25T17:00:04,582   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2023-09-25T17:00:04,583   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2023-09-25T17:00:04,586   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2023-09-25T17:00:04,592   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2023-09-25T17:00:04,594   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2023-09-25T17:00:04,598   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2023-09-25T17:00:04,601   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2023-09-25T17:00:04,602   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2023-09-25T17:00:04,604   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2023-09-25T17:00:04,606   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2023-09-25T17:00:04,607   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2023-09-25T17:00:04,609   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2023-09-25T17:00:04,611   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2023-09-25T17:00:04,613   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2023-09-25T17:00:04,616   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2023-09-25T17:00:04,616   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2023-09-25T17:00:04,619   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2023-09-25T17:00:04,621   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2023-09-25T17:00:04,622   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2023-09-25T17:00:04,624   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2023-09-25T17:00:04,627   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2023-09-25T17:00:04,628   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2023-09-25T17:00:04,630   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2023-09-25T17:00:04,634   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2023-09-25T17:00:04,635   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2023-09-25T17:00:04,637   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2023-09-25T17:00:04,638   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2023-09-25T17:00:04,640   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2023-09-25T17:00:04,641   running install_egg_info
2023-09-25T17:00:04,671   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.2.2-py3.11.egg-info
2023-09-25T17:00:04,685   running install_scripts
2023-09-25T17:00:04,724   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.2.2.dist-info/WHEEL
2023-09-25T17:00:04,726   creating '/tmp/pip-wheel-4fff2b0e/alpaca_eval-0.2.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-09-25T17:00:04,728   adding 'alpaca_eval/__init__.py'
2023-09-25T17:00:04,731   adding 'alpaca_eval/analyze.py'
2023-09-25T17:00:04,733   adding 'alpaca_eval/completion_parsers.py'
2023-09-25T17:00:04,734   adding 'alpaca_eval/constants.py'
2023-09-25T17:00:04,737   adding 'alpaca_eval/main.py'
2023-09-25T17:00:04,738   adding 'alpaca_eval/metrics.py'
2023-09-25T17:00:04,741   adding 'alpaca_eval/plotting.py'
2023-09-25T17:00:04,742   adding 'alpaca_eval/types.py'
2023-09-25T17:00:04,744   adding 'alpaca_eval/utils.py'
2023-09-25T17:00:04,746   adding 'alpaca_eval/annotators/__init__.py'
2023-09-25T17:00:04,749   adding 'alpaca_eval/annotators/base.py'
2023-09-25T17:00:04,752   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2023-09-25T17:00:04,754   adding 'alpaca_eval/decoders/__init__.py'
2023-09-25T17:00:04,756   adding 'alpaca_eval/decoders/anthropic.py'
2023-09-25T17:00:04,757   adding 'alpaca_eval/decoders/cohere.py'
2023-09-25T17:00:04,759   adding 'alpaca_eval/decoders/huggingface_api.py'
2023-09-25T17:00:04,760   adding 'alpaca_eval/decoders/huggingface_local.py'
2023-09-25T17:00:04,763   adding 'alpaca_eval/decoders/openai.py'
2023-09-25T17:00:04,765   adding 'alpaca_eval/evaluators_configs/README.md'
2023-09-25T17:00:04,767   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2023-09-25T17:00:04,768   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2023-09-25T17:00:04,770   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2023-09-25T17:00:04,771   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2023-09-25T17:00:04,773   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2023-09-25T17:00:04,775   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2023-09-25T17:00:04,777   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2023-09-25T17:00:04,778   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2023-09-25T17:00:04,779   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2023-09-25T17:00:04,781   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2023-09-25T17:00:04,783   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2023-09-25T17:00:04,785   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2023-09-25T17:00:04,786   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2023-09-25T17:00:04,788   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2023-09-25T17:00:04,789   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2023-09-25T17:00:04,791   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2023-09-25T17:00:04,792   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2023-09-25T17:00:04,794   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2023-09-25T17:00:04,796   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2023-09-25T17:00:04,798   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2023-09-25T17:00:04,799   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2023-09-25T17:00:04,800   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2023-09-25T17:00:04,801   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2023-09-25T17:00:04,803   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2023-09-25T17:00:04,804   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2023-09-25T17:00:04,806   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2023-09-25T17:00:04,807   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2023-09-25T17:00:04,808   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2023-09-25T17:00:04,810   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2023-09-25T17:00:04,811   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2023-09-25T17:00:04,813   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2023-09-25T17:00:04,815   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2023-09-25T17:00:04,816   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2023-09-25T17:00:04,817   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2023-09-25T17:00:04,819   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2023-09-25T17:00:04,821   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2023-09-25T17:00:04,822   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2023-09-25T17:00:04,823   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2023-09-25T17:00:04,825   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2023-09-25T17:00:04,826   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2023-09-25T17:00:04,828   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2023-09-25T17:00:04,830   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2023-09-25T17:00:04,831   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2023-09-25T17:00:04,833   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2023-09-25T17:00:04,834   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2023-09-25T17:00:04,836   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2023-09-25T17:00:04,837   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2023-09-25T17:00:04,839   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2023-09-25T17:00:04,841   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2023-09-25T17:00:04,842   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2023-09-25T17:00:04,844   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2023-09-25T17:00:04,846   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2023-09-25T17:00:04,847   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2023-09-25T17:00:04,849   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2023-09-25T17:00:04,850   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2023-09-25T17:00:04,852   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2023-09-25T17:00:04,853   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2023-09-25T17:00:04,855   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2023-09-25T17:00:04,857   adding 'alpaca_eval/models_configs/chatgpt/configs.yaml'
2023-09-25T17:00:04,858   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2023-09-25T17:00:04,859   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2023-09-25T17:00:04,861   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2023-09-25T17:00:04,863   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2023-09-25T17:00:04,864   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2023-09-25T17:00:04,866   adding 'alpaca_eval/models_configs/cohere-chat/configs.yaml'
2023-09-25T17:00:04,867   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2023-09-25T17:00:04,869   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2023-09-25T17:00:04,870   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2023-09-25T17:00:04,871   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2023-09-25T17:00:04,873   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2023-09-25T17:00:04,875   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2023-09-25T17:00:04,876   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2023-09-25T17:00:04,878   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2023-09-25T17:00:04,879   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2023-09-25T17:00:04,881   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2023-09-25T17:00:04,882   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2023-09-25T17:00:04,884   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2023-09-25T17:00:04,885   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2023-09-25T17:00:04,887   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2023-09-25T17:00:04,888   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2023-09-25T17:00:04,889   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2023-09-25T17:00:04,891   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2023-09-25T17:00:04,892   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2023-09-25T17:00:04,894   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2023-09-25T17:00:04,895   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2023-09-25T17:00:04,896   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2023-09-25T17:00:04,898   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2023-09-25T17:00:04,900   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2023-09-25T17:00:04,901   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2023-09-25T17:00:04,903   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2023-09-25T17:00:04,905   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2023-09-25T17:00:04,906   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2023-09-25T17:00:04,907   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2023-09-25T17:00:04,910   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2023-09-25T17:00:04,911   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2023-09-25T17:00:04,913   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2023-09-25T17:00:04,914   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2023-09-25T17:00:04,916   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2023-09-25T17:00:04,918   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2023-09-25T17:00:04,919   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2023-09-25T17:00:04,921   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2023-09-25T17:00:04,922   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2023-09-25T17:00:04,924   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2023-09-25T17:00:04,925   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2023-09-25T17:00:04,928   adding 'alpaca_eval-0.2.2.dist-info/LICENSE'
2023-09-25T17:00:04,937   adding 'alpaca_eval-0.2.2.dist-info/METADATA'
2023-09-25T17:00:04,939   adding 'alpaca_eval-0.2.2.dist-info/WHEEL'
2023-09-25T17:00:04,940   adding 'alpaca_eval-0.2.2.dist-info/entry_points.txt'
2023-09-25T17:00:04,941   adding 'alpaca_eval-0.2.2.dist-info/top_level.txt'
2023-09-25T17:00:04,943   adding 'alpaca_eval-0.2.2.dist-info/RECORD'
2023-09-25T17:00:04,947   removing build/bdist.linux-armv7l/wheel
2023-09-25T17:00:05,107   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2023-09-25T17:00:05,111   Created wheel for alpaca-eval: filename=alpaca_eval-0.2.2-py3-none-any.whl size=145688 sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124
2023-09-25T17:00:05,113   Stored in directory: /tmp/pip-ephem-wheel-cache-l9ommbz0/wheels/31/34/20/e58e0a903be1e6ebafd8129e843864e3d6c81998ecbf21d8eb
2023-09-25T17:00:05,139 Successfully built alpaca-eval
2023-09-25T17:00:05,145 Removed build tracker: '/tmp/pip-build-tracker-xzwcksny'