2023-09-27T10:02:12,388 Created temporary directory: /tmp/pip-build-tracker-fludr_m9 2023-09-27T10:02:12,390 Initialized build tracking at /tmp/pip-build-tracker-fludr_m9 2023-09-27T10:02:12,390 Created build tracker: /tmp/pip-build-tracker-fludr_m9 2023-09-27T10:02:12,391 Entered build tracker: /tmp/pip-build-tracker-fludr_m9 2023-09-27T10:02:12,391 Created temporary directory: /tmp/pip-wheel-5jshbebj 2023-09-27T10:02:12,394 Created temporary directory: /tmp/pip-ephem-wheel-cache-h1u2vo5p 2023-09-27T10:02:12,416 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-09-27T10:02:12,420 2 location(s) to search for versions of alpaca-eval: 2023-09-27T10:02:12,420 * https://pypi.org/simple/alpaca-eval/ 2023-09-27T10:02:12,420 * https://www.piwheels.org/simple/alpaca-eval/ 2023-09-27T10:02:12,421 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/ 2023-09-27T10:02:12,422 Getting page https://pypi.org/simple/alpaca-eval/ 2023-09-27T10:02:12,423 Found index url https://pypi.org/simple/ 2023-09-27T10:02:12,644 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json 2023-09-27T10:02:12,652 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-27T10:02:12,653 Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0 2023-09-27T10:02:12,654 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-27T10:02:12,655 Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1 2023-09-27T10:02:12,656 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-27T10:02:12,657 Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2 2023-09-27T10:02:12,657 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,659 Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3 2023-09-27T10:02:12,659 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,660 Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5 2023-09-27T10:02:12,661 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,662 Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6 2023-09-27T10:02:12,663 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,664 Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7 2023-09-27T10:02:12,665 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,665 Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8 2023-09-27T10:02:12,666 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,667 Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0 2023-09-27T10:02:12,668 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,669 Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1 2023-09-27T10:02:12,670 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,671 Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2 2023-09-27T10:02:12,672 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,673 Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3 2023-09-27T10:02:12,673 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,674 Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4 2023-09-27T10:02:12,675 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,677 Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5 2023-09-27T10:02:12,677 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,678 Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6 2023-09-27T10:02:12,679 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,680 Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7 2023-09-27T10:02:12,681 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,681 Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8 2023-09-27T10:02:12,682 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,683 Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9 2023-09-27T10:02:12,684 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,685 Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0 2023-09-27T10:02:12,686 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,687 Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1 2023-09-27T10:02:12,688 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/ 2023-09-27T10:02:12,689 Getting page https://www.piwheels.org/simple/alpaca-eval/ 2023-09-27T10:02:12,691 Found index url https://www.piwheels.org/simple/ 2023-09-27T10:02:12,847 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html 2023-09-27T10:02:12,852 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,853 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,853 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,854 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,854 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,855 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,855 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,856 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,856 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,857 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,858 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-27T10:02:12,858 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-27T10:02:12,859 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-27T10:02:12,859 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-27T10:02:12,861 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/ 2023-09-27T10:02:12,861 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/ 2023-09-27T10:02:12,882 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates 2023-09-27T10:02:12,900 Collecting alpaca-eval==0.3.0 2023-09-27T10:02:12,902 Created temporary directory: /tmp/pip-unpack-cb855wwv 2023-09-27T10:02:13,171 Downloading alpaca_eval-0.3.0.tar.gz (301 kB) 2023-09-27T10:02:13,648 Added alpaca-eval==0.3.0 from https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz to build tracker '/tmp/pip-build-tracker-fludr_m9' 2023-09-27T10:02:13,651 Running setup.py (path:/tmp/pip-wheel-5jshbebj/alpaca-eval_e8b510fd227049e7b62ea272639bb749/setup.py) egg_info for package alpaca-eval 2023-09-27T10:02:13,652 Created temporary directory: /tmp/pip-pip-egg-info-wpqfd304 2023-09-27T10:02:13,653 Preparing metadata (setup.py): started 2023-09-27T10:02:13,655 Running command python setup.py egg_info 2023-09-27T10:02:14,742 running egg_info 2023-09-27T10:02:14,744 creating /tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info 2023-09-27T10:02:14,767 writing /tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/PKG-INFO 2023-09-27T10:02:14,785 writing dependency_links to /tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/dependency_links.txt 2023-09-27T10:02:14,786 writing entry points to /tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/entry_points.txt 2023-09-27T10:02:14,794 writing requirements to /tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/requires.txt 2023-09-27T10:02:14,795 writing top-level names to /tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/top_level.txt 2023-09-27T10:02:14,797 writing manifest file '/tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/SOURCES.txt' 2023-09-27T10:02:14,873 reading manifest file '/tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/SOURCES.txt' 2023-09-27T10:02:14,874 reading manifest template 'MANIFEST.in' 2023-09-27T10:02:14,962 adding license file 'LICENSE' 2023-09-27T10:02:14,969 writing manifest file '/tmp/pip-pip-egg-info-wpqfd304/alpaca_eval.egg-info/SOURCES.txt' 2023-09-27T10:02:15,091 Preparing metadata (setup.py): finished with status 'done' 2023-09-27T10:02:15,100 Source in /tmp/pip-wheel-5jshbebj/alpaca-eval_e8b510fd227049e7b62ea272639bb749 has version 0.3.0, which satisfies requirement alpaca-eval==0.3.0 from https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz 2023-09-27T10:02:15,101 Removed alpaca-eval==0.3.0 from https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz from build tracker '/tmp/pip-build-tracker-fludr_m9' 2023-09-27T10:02:15,117 Created temporary directory: /tmp/pip-unpack-vqjfnumo 2023-09-27T10:02:15,118 Created temporary directory: /tmp/pip-unpack-qon8z963 2023-09-27T10:02:15,248 Building wheels for collected packages: alpaca-eval 2023-09-27T10:02:15,252 Created temporary directory: /tmp/pip-wheel-cdmbogjz 2023-09-27T10:02:15,253 Building wheel for alpaca-eval (setup.py): started 2023-09-27T10:02:15,254 Destination directory: /tmp/pip-wheel-cdmbogjz 2023-09-27T10:02:15,255 Running command python setup.py bdist_wheel 2023-09-27T10:02:16,258 running bdist_wheel 2023-09-27T10:02:16,349 running build 2023-09-27T10:02:16,350 running build_py 2023-09-27T10:02:16,376 creating build 2023-09-27T10:02:16,377 creating build/lib 2023-09-27T10:02:16,377 creating build/lib/alpaca_eval 2023-09-27T10:02:16,378 copying src/alpaca_eval/main.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,381 copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,383 copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,384 copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,386 copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,389 copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,391 copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,393 copying src/alpaca_eval/types.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,394 copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,397 copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval 2023-09-27T10:02:16,400 creating build/lib/alpaca_eval/annotators 2023-09-27T10:02:16,400 copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators 2023-09-27T10:02:16,403 copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators 2023-09-27T10:02:16,404 copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators 2023-09-27T10:02:16,408 creating build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,409 copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,411 copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,413 copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,414 copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,416 copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,419 copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,420 copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,422 copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,424 copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders 2023-09-27T10:02:16,425 running egg_info 2023-09-27T10:02:16,481 writing src/alpaca_eval.egg-info/PKG-INFO 2023-09-27T10:02:16,499 writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt 2023-09-27T10:02:16,501 writing entry points to src/alpaca_eval.egg-info/entry_points.txt 2023-09-27T10:02:16,509 writing requirements to src/alpaca_eval.egg-info/requires.txt 2023-09-27T10:02:16,510 writing top-level names to src/alpaca_eval.egg-info/top_level.txt 2023-09-27T10:02:16,538 reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-09-27T10:02:16,544 reading manifest template 'MANIFEST.in' 2023-09-27T10:02:16,621 adding license file 'LICENSE' 2023-09-27T10:02:16,629 writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-09-27T10:02:16,633 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration. 2023-09-27T10:02:16,633 !! 2023-09-27T10:02:16,635 ******************************************************************************** 2023-09-27T10:02:16,635 ############################ 2023-09-27T10:02:16,636 # Package would be ignored # 2023-09-27T10:02:16,636 ############################ 2023-09-27T10:02:16,637 Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1], 2023-09-27T10:02:16,637 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,639 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,639 package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added 2023-09-27T10:02:16,640 to the `packages` configuration field. 2023-09-27T10:02:16,641 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,641 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,642 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,642 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,643 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,644 If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are 2023-09-27T10:02:16,644 already explicitly excluding 'alpaca_eval.evaluators_configs' via 2023-09-27T10:02:16,644 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,645 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,645 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,646 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,646 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,647 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,648 even if it does not contain any `.py` files. 2023-09-27T10:02:16,648 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,648 directory, all directories are treated like packages. 2023-09-27T10:02:16,649 ******************************************************************************** 2023-09-27T10:02:16,650 !! 2023-09-27T10:02:16,650 check.warn(importable) 2023-09-27T10:02:16,651 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,652 !! 2023-09-27T10:02:16,653 ******************************************************************************** 2023-09-27T10:02:16,653 ############################ 2023-09-27T10:02:16,653 # Package would be ignored # 2023-09-27T10:02:16,654 ############################ 2023-09-27T10:02:16,654 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1], 2023-09-27T10:02:16,655 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,656 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,656 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added 2023-09-27T10:02:16,657 to the `packages` configuration field. 2023-09-27T10:02:16,658 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,658 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,659 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,659 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,660 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,661 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are 2023-09-27T10:02:16,662 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via 2023-09-27T10:02:16,662 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,662 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,663 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,664 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,665 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,666 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,667 even if it does not contain any `.py` files. 2023-09-27T10:02:16,667 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,667 directory, all directories are treated like packages. 2023-09-27T10:02:16,668 ******************************************************************************** 2023-09-27T10:02:16,668 !! 2023-09-27T10:02:16,669 check.warn(importable) 2023-09-27T10:02:16,669 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration. 2023-09-27T10:02:16,669 !! 2023-09-27T10:02:16,670 ******************************************************************************** 2023-09-27T10:02:16,670 ############################ 2023-09-27T10:02:16,671 # Package would be ignored # 2023-09-27T10:02:16,671 ############################ 2023-09-27T10:02:16,672 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1], 2023-09-27T10:02:16,672 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,673 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,673 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added 2023-09-27T10:02:16,674 to the `packages` configuration field. 2023-09-27T10:02:16,675 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,675 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,675 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,676 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,677 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,678 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are 2023-09-27T10:02:16,679 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via 2023-09-27T10:02:16,679 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,680 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,680 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,681 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,682 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,683 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,684 even if it does not contain any `.py` files. 2023-09-27T10:02:16,684 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,685 directory, all directories are treated like packages. 2023-09-27T10:02:16,685 ******************************************************************************** 2023-09-27T10:02:16,686 !! 2023-09-27T10:02:16,687 check.warn(importable) 2023-09-27T10:02:16,687 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration. 2023-09-27T10:02:16,688 !! 2023-09-27T10:02:16,689 ******************************************************************************** 2023-09-27T10:02:16,689 ############################ 2023-09-27T10:02:16,690 # Package would be ignored # 2023-09-27T10:02:16,691 ############################ 2023-09-27T10:02:16,691 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1], 2023-09-27T10:02:16,691 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,692 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,692 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added 2023-09-27T10:02:16,693 to the `packages` configuration field. 2023-09-27T10:02:16,693 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,694 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,694 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,695 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,696 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,696 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are 2023-09-27T10:02:16,697 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via 2023-09-27T10:02:16,697 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,697 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,698 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,699 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,700 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,701 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,702 even if it does not contain any `.py` files. 2023-09-27T10:02:16,702 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,703 directory, all directories are treated like packages. 2023-09-27T10:02:16,703 ******************************************************************************** 2023-09-27T10:02:16,704 !! 2023-09-27T10:02:16,705 check.warn(importable) 2023-09-27T10:02:16,705 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration. 2023-09-27T10:02:16,706 !! 2023-09-27T10:02:16,707 ******************************************************************************** 2023-09-27T10:02:16,707 ############################ 2023-09-27T10:02:16,708 # Package would be ignored # 2023-09-27T10:02:16,709 ############################ 2023-09-27T10:02:16,709 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1], 2023-09-27T10:02:16,709 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,710 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,711 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added 2023-09-27T10:02:16,711 to the `packages` configuration field. 2023-09-27T10:02:16,712 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,713 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,713 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,714 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,716 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,716 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are 2023-09-27T10:02:16,717 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via 2023-09-27T10:02:16,717 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,717 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,718 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,718 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,719 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,720 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,721 even if it does not contain any `.py` files. 2023-09-27T10:02:16,721 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,721 directory, all directories are treated like packages. 2023-09-27T10:02:16,722 ******************************************************************************** 2023-09-27T10:02:16,722 !! 2023-09-27T10:02:16,723 check.warn(importable) 2023-09-27T10:02:16,723 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration. 2023-09-27T10:02:16,723 !! 2023-09-27T10:02:16,725 ******************************************************************************** 2023-09-27T10:02:16,725 ############################ 2023-09-27T10:02:16,725 # Package would be ignored # 2023-09-27T10:02:16,726 ############################ 2023-09-27T10:02:16,726 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1], 2023-09-27T10:02:16,727 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,728 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,728 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added 2023-09-27T10:02:16,729 to the `packages` configuration field. 2023-09-27T10:02:16,729 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,730 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,730 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,731 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,732 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,733 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are 2023-09-27T10:02:16,733 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via 2023-09-27T10:02:16,734 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,734 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,735 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,736 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,737 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,738 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,739 even if it does not contain any `.py` files. 2023-09-27T10:02:16,739 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,740 directory, all directories are treated like packages. 2023-09-27T10:02:16,741 ******************************************************************************** 2023-09-27T10:02:16,742 !! 2023-09-27T10:02:16,742 check.warn(importable) 2023-09-27T10:02:16,742 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,742 !! 2023-09-27T10:02:16,743 ******************************************************************************** 2023-09-27T10:02:16,743 ############################ 2023-09-27T10:02:16,744 # Package would be ignored # 2023-09-27T10:02:16,744 ############################ 2023-09-27T10:02:16,744 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1], 2023-09-27T10:02:16,745 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,745 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,746 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added 2023-09-27T10:02:16,746 to the `packages` configuration field. 2023-09-27T10:02:16,747 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,747 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,747 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,749 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,750 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,751 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are 2023-09-27T10:02:16,751 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via 2023-09-27T10:02:16,752 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,752 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,753 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,754 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,755 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,756 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,756 even if it does not contain any `.py` files. 2023-09-27T10:02:16,757 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,757 directory, all directories are treated like packages. 2023-09-27T10:02:16,758 ******************************************************************************** 2023-09-27T10:02:16,759 !! 2023-09-27T10:02:16,759 check.warn(importable) 2023-09-27T10:02:16,760 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,760 !! 2023-09-27T10:02:16,761 ******************************************************************************** 2023-09-27T10:02:16,761 ############################ 2023-09-27T10:02:16,762 # Package would be ignored # 2023-09-27T10:02:16,762 ############################ 2023-09-27T10:02:16,763 Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1], 2023-09-27T10:02:16,763 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,764 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,765 package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added 2023-09-27T10:02:16,765 to the `packages` configuration field. 2023-09-27T10:02:16,766 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,766 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,766 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,767 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,768 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,768 If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are 2023-09-27T10:02:16,769 already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via 2023-09-27T10:02:16,769 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,769 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,770 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,770 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,771 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,772 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,773 even if it does not contain any `.py` files. 2023-09-27T10:02:16,773 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,774 directory, all directories are treated like packages. 2023-09-27T10:02:16,774 ******************************************************************************** 2023-09-27T10:02:16,775 !! 2023-09-27T10:02:16,776 check.warn(importable) 2023-09-27T10:02:16,776 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration. 2023-09-27T10:02:16,777 !! 2023-09-27T10:02:16,778 ******************************************************************************** 2023-09-27T10:02:16,779 ############################ 2023-09-27T10:02:16,779 # Package would be ignored # 2023-09-27T10:02:16,780 ############################ 2023-09-27T10:02:16,780 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1], 2023-09-27T10:02:16,781 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,782 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,782 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added 2023-09-27T10:02:16,783 to the `packages` configuration field. 2023-09-27T10:02:16,784 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,784 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,784 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,786 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,787 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,788 If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are 2023-09-27T10:02:16,789 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via 2023-09-27T10:02:16,789 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,790 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,790 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,791 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,792 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,793 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,793 even if it does not contain any `.py` files. 2023-09-27T10:02:16,793 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,794 directory, all directories are treated like packages. 2023-09-27T10:02:16,794 ******************************************************************************** 2023-09-27T10:02:16,795 !! 2023-09-27T10:02:16,795 check.warn(importable) 2023-09-27T10:02:16,795 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration. 2023-09-27T10:02:16,796 !! 2023-09-27T10:02:16,796 ******************************************************************************** 2023-09-27T10:02:16,797 ############################ 2023-09-27T10:02:16,797 # Package would be ignored # 2023-09-27T10:02:16,797 ############################ 2023-09-27T10:02:16,798 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1], 2023-09-27T10:02:16,798 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,799 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,800 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added 2023-09-27T10:02:16,800 to the `packages` configuration field. 2023-09-27T10:02:16,801 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,801 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,802 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,803 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,803 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,804 If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are 2023-09-27T10:02:16,805 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via 2023-09-27T10:02:16,805 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,806 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,806 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,807 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,808 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,809 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,810 even if it does not contain any `.py` files. 2023-09-27T10:02:16,810 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,811 directory, all directories are treated like packages. 2023-09-27T10:02:16,811 ******************************************************************************** 2023-09-27T10:02:16,812 !! 2023-09-27T10:02:16,813 check.warn(importable) 2023-09-27T10:02:16,813 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration. 2023-09-27T10:02:16,814 !! 2023-09-27T10:02:16,815 ******************************************************************************** 2023-09-27T10:02:16,815 ############################ 2023-09-27T10:02:16,816 # Package would be ignored # 2023-09-27T10:02:16,816 ############################ 2023-09-27T10:02:16,816 Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1], 2023-09-27T10:02:16,817 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,817 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,818 package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added 2023-09-27T10:02:16,818 to the `packages` configuration field. 2023-09-27T10:02:16,819 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,819 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,819 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,820 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,821 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,821 If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are 2023-09-27T10:02:16,822 already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via 2023-09-27T10:02:16,822 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,822 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,823 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,824 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,825 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,826 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,827 even if it does not contain any `.py` files. 2023-09-27T10:02:16,827 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,828 directory, all directories are treated like packages. 2023-09-27T10:02:16,828 ******************************************************************************** 2023-09-27T10:02:16,830 !! 2023-09-27T10:02:16,830 check.warn(importable) 2023-09-27T10:02:16,831 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration. 2023-09-27T10:02:16,831 !! 2023-09-27T10:02:16,832 ******************************************************************************** 2023-09-27T10:02:16,833 ############################ 2023-09-27T10:02:16,833 # Package would be ignored # 2023-09-27T10:02:16,834 ############################ 2023-09-27T10:02:16,834 Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1], 2023-09-27T10:02:16,835 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,836 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,836 package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added 2023-09-27T10:02:16,837 to the `packages` configuration field. 2023-09-27T10:02:16,838 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,838 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,839 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,840 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,841 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,841 If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are 2023-09-27T10:02:16,842 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via 2023-09-27T10:02:16,842 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,842 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,842 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,843 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,844 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,845 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,845 even if it does not contain any `.py` files. 2023-09-27T10:02:16,846 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,846 directory, all directories are treated like packages. 2023-09-27T10:02:16,846 ******************************************************************************** 2023-09-27T10:02:16,847 !! 2023-09-27T10:02:16,847 check.warn(importable) 2023-09-27T10:02:16,848 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration. 2023-09-27T10:02:16,848 !! 2023-09-27T10:02:16,849 ******************************************************************************** 2023-09-27T10:02:16,849 ############################ 2023-09-27T10:02:16,850 # Package would be ignored # 2023-09-27T10:02:16,850 ############################ 2023-09-27T10:02:16,851 Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1], 2023-09-27T10:02:16,852 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,853 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,853 package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added 2023-09-27T10:02:16,854 to the `packages` configuration field. 2023-09-27T10:02:16,855 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,855 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,856 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,857 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,858 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,859 If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are 2023-09-27T10:02:16,859 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via 2023-09-27T10:02:16,860 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,860 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,861 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,862 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,863 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,865 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,865 even if it does not contain any `.py` files. 2023-09-27T10:02:16,866 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,866 directory, all directories are treated like packages. 2023-09-27T10:02:16,867 ******************************************************************************** 2023-09-27T10:02:16,868 !! 2023-09-27T10:02:16,868 check.warn(importable) 2023-09-27T10:02:16,869 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration. 2023-09-27T10:02:16,869 !! 2023-09-27T10:02:16,870 ******************************************************************************** 2023-09-27T10:02:16,870 ############################ 2023-09-27T10:02:16,871 # Package would be ignored # 2023-09-27T10:02:16,871 ############################ 2023-09-27T10:02:16,872 Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1], 2023-09-27T10:02:16,872 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,873 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,873 package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added 2023-09-27T10:02:16,874 to the `packages` configuration field. 2023-09-27T10:02:16,875 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,875 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,876 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,877 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,878 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,879 If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are 2023-09-27T10:02:16,879 already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via 2023-09-27T10:02:16,880 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,880 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,881 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,882 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,883 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,884 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,885 even if it does not contain any `.py` files. 2023-09-27T10:02:16,885 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,886 directory, all directories are treated like packages. 2023-09-27T10:02:16,886 ******************************************************************************** 2023-09-27T10:02:16,887 !! 2023-09-27T10:02:16,887 check.warn(importable) 2023-09-27T10:02:16,888 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,888 !! 2023-09-27T10:02:16,889 ******************************************************************************** 2023-09-27T10:02:16,890 ############################ 2023-09-27T10:02:16,890 # Package would be ignored # 2023-09-27T10:02:16,891 ############################ 2023-09-27T10:02:16,892 Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1], 2023-09-27T10:02:16,892 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,893 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,894 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added 2023-09-27T10:02:16,894 to the `packages` configuration field. 2023-09-27T10:02:16,895 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,895 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,896 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,897 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,897 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,899 If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are 2023-09-27T10:02:16,899 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via 2023-09-27T10:02:16,899 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,900 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,900 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,901 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,902 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,904 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,904 even if it does not contain any `.py` files. 2023-09-27T10:02:16,905 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,905 directory, all directories are treated like packages. 2023-09-27T10:02:16,906 ******************************************************************************** 2023-09-27T10:02:16,907 !! 2023-09-27T10:02:16,907 check.warn(importable) 2023-09-27T10:02:16,908 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration. 2023-09-27T10:02:16,909 !! 2023-09-27T10:02:16,910 ******************************************************************************** 2023-09-27T10:02:16,910 ############################ 2023-09-27T10:02:16,911 # Package would be ignored # 2023-09-27T10:02:16,911 ############################ 2023-09-27T10:02:16,912 Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1], 2023-09-27T10:02:16,912 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,914 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,914 package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added 2023-09-27T10:02:16,914 to the `packages` configuration field. 2023-09-27T10:02:16,915 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,916 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,916 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,917 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,919 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,920 If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are 2023-09-27T10:02:16,920 already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via 2023-09-27T10:02:16,921 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,921 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,922 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,923 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,923 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,924 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,925 even if it does not contain any `.py` files. 2023-09-27T10:02:16,925 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,926 directory, all directories are treated like packages. 2023-09-27T10:02:16,926 ******************************************************************************** 2023-09-27T10:02:16,927 !! 2023-09-27T10:02:16,927 check.warn(importable) 2023-09-27T10:02:16,928 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,928 !! 2023-09-27T10:02:16,929 ******************************************************************************** 2023-09-27T10:02:16,929 ############################ 2023-09-27T10:02:16,930 # Package would be ignored # 2023-09-27T10:02:16,930 ############################ 2023-09-27T10:02:16,930 Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1], 2023-09-27T10:02:16,931 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,932 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,932 package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added 2023-09-27T10:02:16,933 to the `packages` configuration field. 2023-09-27T10:02:16,934 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,934 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,935 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,935 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,936 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,937 If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are 2023-09-27T10:02:16,938 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via 2023-09-27T10:02:16,938 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,939 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,939 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,940 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,941 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,942 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,943 even if it does not contain any `.py` files. 2023-09-27T10:02:16,943 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,944 directory, all directories are treated like packages. 2023-09-27T10:02:16,944 ******************************************************************************** 2023-09-27T10:02:16,945 !! 2023-09-27T10:02:16,946 check.warn(importable) 2023-09-27T10:02:16,946 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,947 !! 2023-09-27T10:02:16,948 ******************************************************************************** 2023-09-27T10:02:16,949 ############################ 2023-09-27T10:02:16,949 # Package would be ignored # 2023-09-27T10:02:16,950 ############################ 2023-09-27T10:02:16,950 Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1], 2023-09-27T10:02:16,951 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,952 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,952 package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added 2023-09-27T10:02:16,953 to the `packages` configuration field. 2023-09-27T10:02:16,953 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,954 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,954 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,955 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,956 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,957 If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are 2023-09-27T10:02:16,957 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via 2023-09-27T10:02:16,958 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,958 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,959 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,959 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,960 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,962 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,962 even if it does not contain any `.py` files. 2023-09-27T10:02:16,962 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,963 directory, all directories are treated like packages. 2023-09-27T10:02:16,963 ******************************************************************************** 2023-09-27T10:02:16,964 !! 2023-09-27T10:02:16,965 check.warn(importable) 2023-09-27T10:02:16,966 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:16,966 !! 2023-09-27T10:02:16,967 ******************************************************************************** 2023-09-27T10:02:16,967 ############################ 2023-09-27T10:02:16,968 # Package would be ignored # 2023-09-27T10:02:16,968 ############################ 2023-09-27T10:02:16,969 Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1], 2023-09-27T10:02:16,969 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:16,970 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:16,971 package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added 2023-09-27T10:02:16,971 to the `packages` configuration field. 2023-09-27T10:02:16,972 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:16,973 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:16,974 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:16,974 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:16,975 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:16,976 If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are 2023-09-27T10:02:16,976 already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via 2023-09-27T10:02:16,977 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:16,977 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:16,977 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:16,978 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:16,991 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:16,992 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:16,992 even if it does not contain any `.py` files. 2023-09-27T10:02:16,993 On the other hand, currently there is no concept of package data 2023-09-27T10:02:16,993 directory, all directories are treated like packages. 2023-09-27T10:02:16,994 ******************************************************************************** 2023-09-27T10:02:16,995 !! 2023-09-27T10:02:16,995 check.warn(importable) 2023-09-27T10:02:16,996 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration. 2023-09-27T10:02:16,996 !! 2023-09-27T10:02:16,997 ******************************************************************************** 2023-09-27T10:02:16,997 ############################ 2023-09-27T10:02:16,998 # Package would be ignored # 2023-09-27T10:02:16,998 ############################ 2023-09-27T10:02:16,999 Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1], 2023-09-27T10:02:16,999 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,000 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,001 package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added 2023-09-27T10:02:17,001 to the `packages` configuration field. 2023-09-27T10:02:17,003 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,004 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,004 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,005 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,006 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,007 If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are 2023-09-27T10:02:17,007 already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via 2023-09-27T10:02:17,008 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,009 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,009 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,010 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,011 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,013 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,013 even if it does not contain any `.py` files. 2023-09-27T10:02:17,014 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,014 directory, all directories are treated like packages. 2023-09-27T10:02:17,014 ******************************************************************************** 2023-09-27T10:02:17,015 !! 2023-09-27T10:02:17,015 check.warn(importable) 2023-09-27T10:02:17,016 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration. 2023-09-27T10:02:17,016 !! 2023-09-27T10:02:17,017 ******************************************************************************** 2023-09-27T10:02:17,018 ############################ 2023-09-27T10:02:17,018 # Package would be ignored # 2023-09-27T10:02:17,018 ############################ 2023-09-27T10:02:17,019 Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1], 2023-09-27T10:02:17,019 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,020 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,020 package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added 2023-09-27T10:02:17,021 to the `packages` configuration field. 2023-09-27T10:02:17,022 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,022 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,023 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,023 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,024 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,025 If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are 2023-09-27T10:02:17,026 already explicitly excluding 'alpaca_eval.evaluators_configs.test' via 2023-09-27T10:02:17,026 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,027 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,027 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,028 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,029 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,030 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,031 even if it does not contain any `.py` files. 2023-09-27T10:02:17,031 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,032 directory, all directories are treated like packages. 2023-09-27T10:02:17,032 ******************************************************************************** 2023-09-27T10:02:17,033 !! 2023-09-27T10:02:17,034 check.warn(importable) 2023-09-27T10:02:17,034 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration. 2023-09-27T10:02:17,035 !! 2023-09-27T10:02:17,036 ******************************************************************************** 2023-09-27T10:02:17,037 ############################ 2023-09-27T10:02:17,037 # Package would be ignored # 2023-09-27T10:02:17,037 ############################ 2023-09-27T10:02:17,038 Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1], 2023-09-27T10:02:17,039 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,039 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,040 package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added 2023-09-27T10:02:17,040 to the `packages` configuration field. 2023-09-27T10:02:17,041 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,041 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,042 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,043 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,043 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,044 If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are 2023-09-27T10:02:17,045 already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via 2023-09-27T10:02:17,045 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,048 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,048 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,050 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,051 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,053 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,055 even if it does not contain any `.py` files. 2023-09-27T10:02:17,055 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,056 directory, all directories are treated like packages. 2023-09-27T10:02:17,056 ******************************************************************************** 2023-09-27T10:02:17,058 !! 2023-09-27T10:02:17,059 check.warn(importable) 2023-09-27T10:02:17,059 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration. 2023-09-27T10:02:17,060 !! 2023-09-27T10:02:17,062 ******************************************************************************** 2023-09-27T10:02:17,062 ############################ 2023-09-27T10:02:17,063 # Package would be ignored # 2023-09-27T10:02:17,064 ############################ 2023-09-27T10:02:17,065 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1], 2023-09-27T10:02:17,066 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,067 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,068 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added 2023-09-27T10:02:17,069 to the `packages` configuration field. 2023-09-27T10:02:17,070 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,071 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,072 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,073 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,075 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,076 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are 2023-09-27T10:02:17,077 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via 2023-09-27T10:02:17,078 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,079 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,079 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,080 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,081 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,083 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,084 even if it does not contain any `.py` files. 2023-09-27T10:02:17,084 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,085 directory, all directories are treated like packages. 2023-09-27T10:02:17,085 ******************************************************************************** 2023-09-27T10:02:17,086 !! 2023-09-27T10:02:17,087 check.warn(importable) 2023-09-27T10:02:17,088 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration. 2023-09-27T10:02:17,088 !! 2023-09-27T10:02:17,089 ******************************************************************************** 2023-09-27T10:02:17,090 ############################ 2023-09-27T10:02:17,091 # Package would be ignored # 2023-09-27T10:02:17,091 ############################ 2023-09-27T10:02:17,092 Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1], 2023-09-27T10:02:17,093 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,094 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,095 package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added 2023-09-27T10:02:17,095 to the `packages` configuration field. 2023-09-27T10:02:17,098 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,098 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,099 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,101 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,102 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,104 If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are 2023-09-27T10:02:17,105 already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via 2023-09-27T10:02:17,105 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,106 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,107 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,108 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,109 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,111 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,112 even if it does not contain any `.py` files. 2023-09-27T10:02:17,112 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,113 directory, all directories are treated like packages. 2023-09-27T10:02:17,114 ******************************************************************************** 2023-09-27T10:02:17,115 !! 2023-09-27T10:02:17,116 check.warn(importable) 2023-09-27T10:02:17,116 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration. 2023-09-27T10:02:17,117 !! 2023-09-27T10:02:17,118 ******************************************************************************** 2023-09-27T10:02:17,118 ############################ 2023-09-27T10:02:17,119 # Package would be ignored # 2023-09-27T10:02:17,119 ############################ 2023-09-27T10:02:17,120 Python recognizes 'alpaca_eval.models_configs' as an importable package[^1], 2023-09-27T10:02:17,120 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,121 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,122 package, please make sure that 'alpaca_eval.models_configs' is explicitly added 2023-09-27T10:02:17,122 to the `packages` configuration field. 2023-09-27T10:02:17,123 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,124 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,125 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,126 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,127 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,128 If you don't want 'alpaca_eval.models_configs' to be distributed and are 2023-09-27T10:02:17,129 already explicitly excluding 'alpaca_eval.models_configs' via 2023-09-27T10:02:17,129 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,130 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,130 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,132 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,133 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,135 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,136 even if it does not contain any `.py` files. 2023-09-27T10:02:17,137 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,137 directory, all directories are treated like packages. 2023-09-27T10:02:17,138 ******************************************************************************** 2023-09-27T10:02:17,139 !! 2023-09-27T10:02:17,140 check.warn(importable) 2023-09-27T10:02:17,140 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration. 2023-09-27T10:02:17,141 !! 2023-09-27T10:02:17,142 ******************************************************************************** 2023-09-27T10:02:17,143 ############################ 2023-09-27T10:02:17,143 # Package would be ignored # 2023-09-27T10:02:17,144 ############################ 2023-09-27T10:02:17,145 Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1], 2023-09-27T10:02:17,145 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,146 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,147 package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added 2023-09-27T10:02:17,148 to the `packages` configuration field. 2023-09-27T10:02:17,149 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,150 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,151 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,151 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,152 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,153 If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are 2023-09-27T10:02:17,153 already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via 2023-09-27T10:02:17,154 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,154 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,155 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,156 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,156 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,158 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,158 even if it does not contain any `.py` files. 2023-09-27T10:02:17,158 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,159 directory, all directories are treated like packages. 2023-09-27T10:02:17,159 ******************************************************************************** 2023-09-27T10:02:17,160 !! 2023-09-27T10:02:17,161 check.warn(importable) 2023-09-27T10:02:17,161 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration. 2023-09-27T10:02:17,162 !! 2023-09-27T10:02:17,163 ******************************************************************************** 2023-09-27T10:02:17,163 ############################ 2023-09-27T10:02:17,164 # Package would be ignored # 2023-09-27T10:02:17,164 ############################ 2023-09-27T10:02:17,165 Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1], 2023-09-27T10:02:17,165 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,166 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,166 package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added 2023-09-27T10:02:17,167 to the `packages` configuration field. 2023-09-27T10:02:17,168 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,169 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,169 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,170 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,171 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,172 If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are 2023-09-27T10:02:17,173 already explicitly excluding 'alpaca_eval.models_configs.claude' via 2023-09-27T10:02:17,173 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,174 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,174 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,175 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,176 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,178 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,178 even if it does not contain any `.py` files. 2023-09-27T10:02:17,179 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,179 directory, all directories are treated like packages. 2023-09-27T10:02:17,180 ******************************************************************************** 2023-09-27T10:02:17,180 !! 2023-09-27T10:02:17,181 check.warn(importable) 2023-09-27T10:02:17,181 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration. 2023-09-27T10:02:17,182 !! 2023-09-27T10:02:17,183 ******************************************************************************** 2023-09-27T10:02:17,183 ############################ 2023-09-27T10:02:17,184 # Package would be ignored # 2023-09-27T10:02:17,185 ############################ 2023-09-27T10:02:17,185 Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1], 2023-09-27T10:02:17,186 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,187 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,188 package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added 2023-09-27T10:02:17,188 to the `packages` configuration field. 2023-09-27T10:02:17,190 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,190 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,191 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,192 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,193 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,194 If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are 2023-09-27T10:02:17,195 already explicitly excluding 'alpaca_eval.models_configs.cohere' via 2023-09-27T10:02:17,195 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,196 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,197 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,198 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,199 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,201 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,201 even if it does not contain any `.py` files. 2023-09-27T10:02:17,202 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,203 directory, all directories are treated like packages. 2023-09-27T10:02:17,203 ******************************************************************************** 2023-09-27T10:02:17,204 !! 2023-09-27T10:02:17,205 check.warn(importable) 2023-09-27T10:02:17,205 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration. 2023-09-27T10:02:17,206 !! 2023-09-27T10:02:17,207 ******************************************************************************** 2023-09-27T10:02:17,208 ############################ 2023-09-27T10:02:17,208 # Package would be ignored # 2023-09-27T10:02:17,209 ############################ 2023-09-27T10:02:17,209 Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1], 2023-09-27T10:02:17,210 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,211 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,211 package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added 2023-09-27T10:02:17,212 to the `packages` configuration field. 2023-09-27T10:02:17,212 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,213 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,213 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,214 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,215 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,216 If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are 2023-09-27T10:02:17,216 already explicitly excluding 'alpaca_eval.models_configs.gpt4' via 2023-09-27T10:02:17,217 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,217 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,218 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,219 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,219 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,221 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,221 even if it does not contain any `.py` files. 2023-09-27T10:02:17,222 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,222 directory, all directories are treated like packages. 2023-09-27T10:02:17,223 ******************************************************************************** 2023-09-27T10:02:17,224 !! 2023-09-27T10:02:17,224 check.warn(importable) 2023-09-27T10:02:17,225 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration. 2023-09-27T10:02:17,225 !! 2023-09-27T10:02:17,226 ******************************************************************************** 2023-09-27T10:02:17,227 ############################ 2023-09-27T10:02:17,227 # Package would be ignored # 2023-09-27T10:02:17,228 ############################ 2023-09-27T10:02:17,228 Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1], 2023-09-27T10:02:17,229 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,230 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,230 package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added 2023-09-27T10:02:17,231 to the `packages` configuration field. 2023-09-27T10:02:17,232 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,232 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,232 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,234 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,235 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,236 If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are 2023-09-27T10:02:17,236 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via 2023-09-27T10:02:17,237 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,238 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,238 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,239 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,240 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,241 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,241 even if it does not contain any `.py` files. 2023-09-27T10:02:17,242 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,242 directory, all directories are treated like packages. 2023-09-27T10:02:17,243 ******************************************************************************** 2023-09-27T10:02:17,243 !! 2023-09-27T10:02:17,244 check.warn(importable) 2023-09-27T10:02:17,244 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration. 2023-09-27T10:02:17,245 !! 2023-09-27T10:02:17,246 ******************************************************************************** 2023-09-27T10:02:17,246 ############################ 2023-09-27T10:02:17,247 # Package would be ignored # 2023-09-27T10:02:17,247 ############################ 2023-09-27T10:02:17,248 Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1], 2023-09-27T10:02:17,248 but it is absent from setuptools' `packages` configuration. 2023-09-27T10:02:17,249 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-27T10:02:17,249 package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added 2023-09-27T10:02:17,250 to the `packages` configuration field. 2023-09-27T10:02:17,251 Alternatively, you can also rely on setuptools' discovery methods 2023-09-27T10:02:17,251 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-27T10:02:17,252 instead of `find_packages(...)`/`find:`). 2023-09-27T10:02:17,253 You can read more about "package discovery" on setuptools documentation page: 2023-09-27T10:02:17,254 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-27T10:02:17,255 If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are 2023-09-27T10:02:17,255 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via 2023-09-27T10:02:17,256 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-27T10:02:17,256 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-27T10:02:17,257 combination with a more fine grained `package-data` configuration. 2023-09-27T10:02:17,258 You can read more about "package data files" on setuptools documentation page: 2023-09-27T10:02:17,259 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-27T10:02:17,261 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-27T10:02:17,261 even if it does not contain any `.py` files. 2023-09-27T10:02:17,262 On the other hand, currently there is no concept of package data 2023-09-27T10:02:17,262 directory, all directories are treated like packages. 2023-09-27T10:02:17,263 ******************************************************************************** 2023-09-27T10:02:17,264 !! 2023-09-27T10:02:17,264 check.warn(importable) 2023-09-27T10:02:17,265 creating build/lib/alpaca_eval/evaluators_configs 2023-09-27T10:02:17,266 copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs 2023-09-27T10:02:17,266 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-27T10:02:17,266 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-27T10:02:17,267 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-27T10:02:17,267 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-09-27T10:02:17,268 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-09-27T10:02:17,268 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-09-27T10:02:17,269 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-09-27T10:02:17,269 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-27T10:02:17,269 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-27T10:02:17,270 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-27T10:02:17,270 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,271 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,271 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,272 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,272 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,273 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,273 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,274 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,274 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,275 copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,276 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,276 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,277 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,277 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,278 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-27T10:02:17,278 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-27T10:02:17,279 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-27T10:02:17,279 creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-27T10:02:17,280 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-27T10:02:17,280 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-27T10:02:17,281 creating build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-27T10:02:17,281 copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-27T10:02:17,281 copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-27T10:02:17,282 creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-27T10:02:17,282 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-27T10:02:17,282 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-27T10:02:17,283 creating build/lib/alpaca_eval/evaluators_configs/claude 2023-09-27T10:02:17,283 copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude 2023-09-27T10:02:17,284 copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude 2023-09-27T10:02:17,284 creating build/lib/alpaca_eval/evaluators_configs/claude_2 2023-09-27T10:02:17,285 copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2 2023-09-27T10:02:17,285 creating build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-27T10:02:17,286 copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-27T10:02:17,286 copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-27T10:02:17,287 creating build/lib/alpaca_eval/evaluators_configs/cohere 2023-09-27T10:02:17,287 copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere 2023-09-27T10:02:17,288 creating build/lib/alpaca_eval/evaluators_configs/gpt4 2023-09-27T10:02:17,288 copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4 2023-09-27T10:02:17,289 creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-27T10:02:17,289 copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-27T10:02:17,290 copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-27T10:02:17,290 creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-27T10:02:17,291 copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-27T10:02:17,291 creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-27T10:02:17,292 copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-27T10:02:17,292 creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-27T10:02:17,293 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-27T10:02:17,293 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-27T10:02:17,294 creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-27T10:02:17,295 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-27T10:02:17,295 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-27T10:02:17,295 creating build/lib/alpaca_eval/evaluators_configs/test 2023-09-27T10:02:17,296 copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test 2023-09-27T10:02:17,296 creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-27T10:02:17,297 copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-27T10:02:17,297 copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-27T10:02:17,298 creating build/lib/alpaca_eval/leaderboards 2023-09-27T10:02:17,298 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,299 copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,299 copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,299 copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,300 copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,300 creating build/lib/alpaca_eval/leaderboards/evaluators 2023-09-27T10:02:17,301 copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators 2023-09-27T10:02:17,301 creating build/lib/alpaca_eval/models_configs 2023-09-27T10:02:17,302 creating build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-27T10:02:17,302 copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-27T10:02:17,303 copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-27T10:02:17,303 creating build/lib/alpaca_eval/models_configs/airoboros-65b 2023-09-27T10:02:17,304 copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b 2023-09-27T10:02:17,305 creating build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-27T10:02:17,305 copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-27T10:02:17,306 copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-27T10:02:17,306 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-27T10:02:17,307 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-27T10:02:17,307 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-27T10:02:17,308 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-27T10:02:17,308 creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-27T10:02:17,309 copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-27T10:02:17,309 copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-27T10:02:17,310 creating build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-27T10:02:17,310 copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-27T10:02:17,311 copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-27T10:02:17,311 creating build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-09-27T10:02:17,312 copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-09-27T10:02:17,312 creating build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-09-27T10:02:17,312 copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-09-27T10:02:17,313 copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-09-27T10:02:17,313 creating build/lib/alpaca_eval/models_configs/chatgpt 2023-09-27T10:02:17,314 copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt 2023-09-27T10:02:17,314 creating build/lib/alpaca_eval/models_configs/claude 2023-09-27T10:02:17,315 copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude 2023-09-27T10:02:17,315 copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude 2023-09-27T10:02:17,315 creating build/lib/alpaca_eval/models_configs/claude-2 2023-09-27T10:02:17,316 copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2 2023-09-27T10:02:17,316 creating build/lib/alpaca_eval/models_configs/cohere 2023-09-27T10:02:17,317 copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere 2023-09-27T10:02:17,317 copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere 2023-09-27T10:02:17,318 creating build/lib/alpaca_eval/models_configs/cohere-chat 2023-09-27T10:02:17,319 copying src/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere-chat 2023-09-27T10:02:17,319 creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-27T10:02:17,320 copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-27T10:02:17,320 creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-27T10:02:17,321 copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-27T10:02:17,321 creating build/lib/alpaca_eval/models_configs/gpt4 2023-09-27T10:02:17,322 copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4 2023-09-27T10:02:17,323 copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4 2023-09-27T10:02:17,323 creating build/lib/alpaca_eval/models_configs/guanaco-13b 2023-09-27T10:02:17,324 copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b 2023-09-27T10:02:17,324 creating build/lib/alpaca_eval/models_configs/guanaco-33b 2023-09-27T10:02:17,325 copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b 2023-09-27T10:02:17,326 creating build/lib/alpaca_eval/models_configs/guanaco-33b-api 2023-09-27T10:02:17,326 copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api 2023-09-27T10:02:17,327 creating build/lib/alpaca_eval/models_configs/guanaco-65b 2023-09-27T10:02:17,327 copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b 2023-09-27T10:02:17,328 creating build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-27T10:02:17,329 copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-27T10:02:17,330 copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-27T10:02:17,330 creating build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-09-27T10:02:17,331 copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-09-27T10:02:17,331 copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-09-27T10:02:17,332 creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2023-09-27T10:02:17,333 copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2023-09-27T10:02:17,333 creating build/lib/alpaca_eval/models_configs/jina-chat 2023-09-27T10:02:17,334 copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat 2023-09-27T10:02:17,335 copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat 2023-09-27T10:02:17,335 creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-27T10:02:17,336 copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-27T10:02:17,336 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-27T10:02:17,337 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-27T10:02:17,337 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-27T10:02:17,338 creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-27T10:02:17,339 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-27T10:02:17,340 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-27T10:02:17,340 creating build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-27T10:02:17,341 copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-27T10:02:17,342 copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-27T10:02:17,342 creating build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-27T10:02:17,343 copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-27T10:02:17,344 copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-27T10:02:17,344 creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-27T10:02:17,345 copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-27T10:02:17,346 creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-27T10:02:17,346 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-27T10:02:17,347 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-27T10:02:17,347 creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-27T10:02:17,348 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-27T10:02:17,349 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-27T10:02:17,350 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-09-27T10:02:17,351 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-09-27T10:02:17,351 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-09-27T10:02:17,352 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-09-27T10:02:17,352 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-09-27T10:02:17,353 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-09-27T10:02:17,354 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-09-27T10:02:17,354 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-09-27T10:02:17,355 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-09-27T10:02:17,356 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-09-27T10:02:17,356 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-09-27T10:02:17,357 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-09-27T10:02:17,357 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-09-27T10:02:17,358 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-09-27T10:02:17,359 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-09-27T10:02:17,359 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-09-27T10:02:17,360 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-09-27T10:02:17,361 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-09-27T10:02:17,361 creating build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-27T10:02:17,362 copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-27T10:02:17,363 copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-27T10:02:17,363 creating build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-09-27T10:02:17,364 copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-09-27T10:02:17,365 creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-27T10:02:17,365 copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-27T10:02:17,366 creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2023-09-27T10:02:17,367 copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2023-09-27T10:02:17,368 creating build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-09-27T10:02:17,368 copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-09-27T10:02:17,369 creating build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-09-27T10:02:17,370 copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-09-27T10:02:17,371 creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-27T10:02:17,371 copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-27T10:02:17,372 creating build/lib/alpaca_eval/models_configs/text_davinci_001 2023-09-27T10:02:17,372 copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001 2023-09-27T10:02:17,373 creating build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-27T10:02:17,373 copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-27T10:02:17,374 copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-27T10:02:17,375 creating build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-27T10:02:17,375 copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-27T10:02:17,376 copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-27T10:02:17,376 creating build/lib/alpaca_eval/models_configs/vicuna-13b 2023-09-27T10:02:17,377 copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b 2023-09-27T10:02:17,377 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-27T10:02:17,378 copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-27T10:02:17,379 creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-27T10:02:17,379 copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-27T10:02:17,380 creating build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-27T10:02:17,380 copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-27T10:02:17,381 copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-27T10:02:17,382 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-27T10:02:17,382 copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-27T10:02:17,383 creating build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-27T10:02:17,384 copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-27T10:02:17,384 copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-27T10:02:17,385 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-27T10:02:17,386 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-27T10:02:17,386 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-09-27T10:02:17,387 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-09-27T10:02:17,388 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-09-27T10:02:17,388 !! 2023-09-27T10:02:17,390 ******************************************************************************** 2023-09-27T10:02:17,390 Please avoid running ``setup.py`` directly. 2023-09-27T10:02:17,391 Instead, use pypa/build, pypa/installer or other 2023-09-27T10:02:17,392 standards-based tools. 2023-09-27T10:02:17,393 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-09-27T10:02:17,394 ******************************************************************************** 2023-09-27T10:02:17,395 !! 2023-09-27T10:02:17,396 self.initialize_options() 2023-09-27T10:02:17,403 installing to build/bdist.linux-armv7l/wheel 2023-09-27T10:02:17,404 running install 2023-09-27T10:02:17,435 running install_lib 2023-09-27T10:02:17,459 creating build/bdist.linux-armv7l 2023-09-27T10:02:17,460 creating build/bdist.linux-armv7l/wheel 2023-09-27T10:02:17,461 creating build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,462 copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,465 copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,466 copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,468 copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,470 copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,473 creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-27T10:02:17,474 copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-27T10:02:17,477 copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-27T10:02:17,478 copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-27T10:02:17,481 copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,483 creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,484 copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,486 copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,489 copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,491 copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,493 copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,496 copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,497 copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,499 copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,501 copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-27T10:02:17,503 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards 2023-09-27T10:02:17,505 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-09-27T10:02:17,506 copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-09-27T10:02:17,508 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,509 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,511 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,513 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,514 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-27T10:02:17,518 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs 2023-09-27T10:02:17,519 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-09-27T10:02:17,520 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-09-27T10:02:17,522 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-09-27T10:02:17,523 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-27T10:02:17,524 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-27T10:02:17,526 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-27T10:02:17,528 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-27T10:02:17,529 copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-27T10:02:17,531 copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-27T10:02:17,533 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-27T10:02:17,534 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-27T10:02:17,536 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-27T10:02:17,538 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-27T10:02:17,539 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-27T10:02:17,541 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-27T10:02:17,543 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-09-27T10:02:17,544 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-09-27T10:02:17,546 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-09-27T10:02:17,548 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-27T10:02:17,549 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-27T10:02:17,551 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-27T10:02:17,553 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-09-27T10:02:17,554 copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-09-27T10:02:17,556 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-09-27T10:02:17,557 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-09-27T10:02:17,559 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-09-27T10:02:17,561 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-27T10:02:17,562 copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-27T10:02:17,564 copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-27T10:02:17,566 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2023-09-27T10:02:17,567 copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2023-09-27T10:02:17,569 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-09-27T10:02:17,570 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-09-27T10:02:17,571 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-09-27T10:02:17,573 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-27T10:02:17,574 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-27T10:02:17,576 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-27T10:02:17,578 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-27T10:02:17,579 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-27T10:02:17,581 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-09-27T10:02:17,582 copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-09-27T10:02:17,584 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-27T10:02:17,585 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-27T10:02:17,587 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-09-27T10:02:17,588 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-09-27T10:02:17,590 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-09-27T10:02:17,592 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-27T10:02:17,593 copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-27T10:02:17,596 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2023-09-27T10:02:17,597 copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2023-09-27T10:02:17,599 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-27T10:02:17,600 copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-27T10:02:17,602 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-09-27T10:02:17,603 copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-09-27T10:02:17,605 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-27T10:02:17,606 copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-27T10:02:17,608 copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-27T10:02:17,610 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-27T10:02:17,610 copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-27T10:02:17,612 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-27T10:02:17,613 copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-27T10:02:17,615 copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-27T10:02:17,617 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-09-27T10:02:17,618 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-09-27T10:02:17,620 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-09-27T10:02:17,622 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-09-27T10:02:17,623 copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-09-27T10:02:17,625 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-27T10:02:17,626 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-27T10:02:17,628 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-27T10:02:17,630 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-27T10:02:17,631 copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-27T10:02:17,633 copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-27T10:02:17,635 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-27T10:02:17,636 copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-27T10:02:17,637 copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-27T10:02:17,640 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-27T10:02:17,641 copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-27T10:02:17,642 copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-27T10:02:17,645 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-27T10:02:17,645 copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-27T10:02:17,647 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-27T10:02:17,648 copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-27T10:02:17,650 copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-27T10:02:17,652 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-27T10:02:17,653 copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-27T10:02:17,654 copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-27T10:02:17,656 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-27T10:02:17,657 copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-27T10:02:17,659 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-27T10:02:17,660 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-27T10:02:17,662 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-27T10:02:17,664 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-27T10:02:17,665 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-27T10:02:17,667 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-09-27T10:02:17,668 copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-09-27T10:02:17,670 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-27T10:02:17,671 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-27T10:02:17,673 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-27T10:02:17,674 copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-27T10:02:17,676 copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-27T10:02:17,678 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-09-27T10:02:17,679 copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-09-27T10:02:17,681 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-09-27T10:02:17,682 copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-09-27T10:02:17,684 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-27T10:02:17,685 copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-27T10:02:17,687 copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-27T10:02:17,689 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2023-09-27T10:02:17,690 copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2023-09-27T10:02:17,692 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-27T10:02:17,693 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-27T10:02:17,695 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-27T10:02:17,697 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-09-27T10:02:17,698 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-09-27T10:02:17,699 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-09-27T10:02:17,702 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-09-27T10:02:17,702 copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-09-27T10:02:17,705 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-09-27T10:02:17,706 copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-09-27T10:02:17,708 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-09-27T10:02:17,709 copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-09-27T10:02:17,711 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat 2023-09-27T10:02:17,712 copying build/lib/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat 2023-09-27T10:02:17,714 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-27T10:02:17,715 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-27T10:02:17,717 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-09-27T10:02:17,718 copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-09-27T10:02:17,720 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-27T10:02:17,721 copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-27T10:02:17,724 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-09-27T10:02:17,725 copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-09-27T10:02:17,727 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-09-27T10:02:17,728 copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-09-27T10:02:17,730 copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-09-27T10:02:17,732 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-09-27T10:02:17,733 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-09-27T10:02:17,735 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-09-27T10:02:17,737 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-09-27T10:02:17,737 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-09-27T10:02:17,739 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-27T10:02:17,740 copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-27T10:02:17,742 copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,745 copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,746 copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,749 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-09-27T10:02:17,750 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-27T10:02:17,751 copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-27T10:02:17,753 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-27T10:02:17,754 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-27T10:02:17,756 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-27T10:02:17,758 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-27T10:02:17,759 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-27T10:02:17,761 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-27T10:02:17,763 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-27T10:02:17,764 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-27T10:02:17,765 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-27T10:02:17,768 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-27T10:02:17,769 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-27T10:02:17,770 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-27T10:02:17,773 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-09-27T10:02:17,773 copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-09-27T10:02:17,776 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-27T10:02:17,777 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-27T10:02:17,779 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-27T10:02:17,781 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-27T10:02:17,782 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-27T10:02:17,783 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-27T10:02:17,786 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-09-27T10:02:17,786 copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-09-27T10:02:17,789 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-09-27T10:02:17,789 copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-09-27T10:02:17,791 copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-09-27T10:02:17,794 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-09-27T10:02:17,794 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-09-27T10:02:17,797 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-27T10:02:17,797 copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-27T10:02:17,799 copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-27T10:02:17,802 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-27T10:02:17,802 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-27T10:02:17,804 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-27T10:02:17,807 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-27T10:02:17,808 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-27T10:02:17,810 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-27T10:02:17,812 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-09-27T10:02:17,813 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-09-27T10:02:17,815 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-09-27T10:02:17,816 copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-09-27T10:02:17,818 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-27T10:02:17,819 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-27T10:02:17,821 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-27T10:02:17,823 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-27T10:02:17,824 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-27T10:02:17,825 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-27T10:02:17,827 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-27T10:02:17,828 copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-27T10:02:17,830 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-27T10:02:17,831 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-27T10:02:17,833 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-27T10:02:17,836 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,837 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,839 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,841 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,842 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,844 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,847 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,849 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,851 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,853 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,855 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,857 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,859 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,861 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-27T10:02:17,863 copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-27T10:02:17,865 running install_egg_info 2023-09-27T10:02:17,895 Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.3.0-py3.11.egg-info 2023-09-27T10:02:17,907 running install_scripts 2023-09-27T10:02:17,946 creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.3.0.dist-info/WHEEL 2023-09-27T10:02:17,948 creating '/tmp/pip-wheel-cdmbogjz/alpaca_eval-0.3.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-09-27T10:02:17,950 adding 'alpaca_eval/__init__.py' 2023-09-27T10:02:17,953 adding 'alpaca_eval/analyze.py' 2023-09-27T10:02:17,955 adding 'alpaca_eval/completion_parsers.py' 2023-09-27T10:02:17,957 adding 'alpaca_eval/constants.py' 2023-09-27T10:02:17,960 adding 'alpaca_eval/main.py' 2023-09-27T10:02:17,961 adding 'alpaca_eval/metrics.py' 2023-09-27T10:02:17,964 adding 'alpaca_eval/plotting.py' 2023-09-27T10:02:17,966 adding 'alpaca_eval/processors.py' 2023-09-27T10:02:17,967 adding 'alpaca_eval/types.py' 2023-09-27T10:02:17,969 adding 'alpaca_eval/utils.py' 2023-09-27T10:02:17,971 adding 'alpaca_eval/annotators/__init__.py' 2023-09-27T10:02:17,975 adding 'alpaca_eval/annotators/base.py' 2023-09-27T10:02:17,977 adding 'alpaca_eval/annotators/pairwise_evaluator.py' 2023-09-27T10:02:17,979 adding 'alpaca_eval/decoders/__init__.py' 2023-09-27T10:02:17,981 adding 'alpaca_eval/decoders/anthropic.py' 2023-09-27T10:02:17,982 adding 'alpaca_eval/decoders/cohere.py' 2023-09-27T10:02:17,983 adding 'alpaca_eval/decoders/huggingface_api.py' 2023-09-27T10:02:17,985 adding 'alpaca_eval/decoders/huggingface_local.py' 2023-09-27T10:02:17,986 adding 'alpaca_eval/decoders/jinachat.py' 2023-09-27T10:02:17,989 adding 'alpaca_eval/decoders/openai.py' 2023-09-27T10:02:17,990 adding 'alpaca_eval/decoders/replicate.py' 2023-09-27T10:02:17,991 adding 'alpaca_eval/decoders/vllm_local.py' 2023-09-27T10:02:17,994 adding 'alpaca_eval/evaluators_configs/README.md' 2023-09-27T10:02:17,995 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt' 2023-09-27T10:02:17,997 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml' 2023-09-27T10:02:17,998 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml' 2023-09-27T10:02:18,000 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml' 2023-09-27T10:02:18,002 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt' 2023-09-27T10:02:18,003 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml' 2023-09-27T10:02:18,005 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt' 2023-09-27T10:02:18,007 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt' 2023-09-27T10:02:18,008 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt' 2023-09-27T10:02:18,010 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt' 2023-09-27T10:02:18,011 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt' 2023-09-27T10:02:18,013 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt' 2023-09-27T10:02:18,015 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt' 2023-09-27T10:02:18,017 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt' 2023-09-27T10:02:18,018 adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml' 2023-09-27T10:02:18,020 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt' 2023-09-27T10:02:18,021 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt' 2023-09-27T10:02:18,023 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt' 2023-09-27T10:02:18,025 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt' 2023-09-27T10:02:18,027 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt' 2023-09-27T10:02:18,028 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml' 2023-09-27T10:02:18,030 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt' 2023-09-27T10:02:18,031 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml' 2023-09-27T10:02:18,032 adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt' 2023-09-27T10:02:18,033 adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml' 2023-09-27T10:02:18,035 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt' 2023-09-27T10:02:18,036 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml' 2023-09-27T10:02:18,038 adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt' 2023-09-27T10:02:18,039 adding 'alpaca_eval/evaluators_configs/claude/configs.yaml' 2023-09-27T10:02:18,041 adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml' 2023-09-27T10:02:18,042 adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml' 2023-09-27T10:02:18,044 adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt' 2023-09-27T10:02:18,046 adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml' 2023-09-27T10:02:18,047 adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml' 2023-09-27T10:02:18,049 adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt' 2023-09-27T10:02:18,050 adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml' 2023-09-27T10:02:18,052 adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml' 2023-09-27T10:02:18,053 adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml' 2023-09-27T10:02:18,055 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml' 2023-09-27T10:02:18,057 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt' 2023-09-27T10:02:18,060 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt' 2023-09-27T10:02:18,062 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml' 2023-09-27T10:02:18,064 adding 'alpaca_eval/evaluators_configs/test/configs.yaml' 2023-09-27T10:02:18,066 adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt' 2023-09-27T10:02:18,068 adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml' 2023-09-27T10:02:18,071 adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv' 2023-09-27T10:02:18,073 adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv' 2023-09-27T10:02:18,075 adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv' 2023-09-27T10:02:18,076 adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv' 2023-09-27T10:02:18,079 adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv' 2023-09-27T10:02:18,082 adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml' 2023-09-27T10:02:18,084 adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt' 2023-09-27T10:02:18,086 adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml' 2023-09-27T10:02:18,088 adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml' 2023-09-27T10:02:18,090 adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt' 2023-09-27T10:02:18,092 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml' 2023-09-27T10:02:18,094 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml' 2023-09-27T10:02:18,098 adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml' 2023-09-27T10:02:18,099 adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt' 2023-09-27T10:02:18,101 adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml' 2023-09-27T10:02:18,103 adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt' 2023-09-27T10:02:18,105 adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml' 2023-09-27T10:02:18,107 adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml' 2023-09-27T10:02:18,108 adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt' 2023-09-27T10:02:18,110 adding 'alpaca_eval/models_configs/chatgpt/configs.yaml' 2023-09-27T10:02:18,112 adding 'alpaca_eval/models_configs/claude/configs.yaml' 2023-09-27T10:02:18,113 adding 'alpaca_eval/models_configs/claude/prompt.txt' 2023-09-27T10:02:18,115 adding 'alpaca_eval/models_configs/claude-2/configs.yaml' 2023-09-27T10:02:18,117 adding 'alpaca_eval/models_configs/cohere/configs.yaml' 2023-09-27T10:02:18,118 adding 'alpaca_eval/models_configs/cohere/prompt.txt' 2023-09-27T10:02:18,120 adding 'alpaca_eval/models_configs/cohere-chat/configs.yaml' 2023-09-27T10:02:18,121 adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml' 2023-09-27T10:02:18,123 adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml' 2023-09-27T10:02:18,125 adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt' 2023-09-27T10:02:18,126 adding 'alpaca_eval/models_configs/gpt4/configs.yaml' 2023-09-27T10:02:18,128 adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml' 2023-09-27T10:02:18,129 adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml' 2023-09-27T10:02:18,131 adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml' 2023-09-27T10:02:18,133 adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml' 2023-09-27T10:02:18,135 adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml' 2023-09-27T10:02:18,136 adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt' 2023-09-27T10:02:18,138 adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml' 2023-09-27T10:02:18,139 adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt' 2023-09-27T10:02:18,141 adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml' 2023-09-27T10:02:18,143 adding 'alpaca_eval/models_configs/jina-chat/configs.yaml' 2023-09-27T10:02:18,145 adding 'alpaca_eval/models_configs/jina-chat/prompt.txt' 2023-09-27T10:02:18,146 adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml' 2023-09-27T10:02:18,148 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml' 2023-09-27T10:02:18,149 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt' 2023-09-27T10:02:18,151 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml' 2023-09-27T10:02:18,152 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt' 2023-09-27T10:02:18,154 adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml' 2023-09-27T10:02:18,155 adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt' 2023-09-27T10:02:18,157 adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml' 2023-09-27T10:02:18,158 adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt' 2023-09-27T10:02:18,160 adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml' 2023-09-27T10:02:18,162 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml' 2023-09-27T10:02:18,163 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt' 2023-09-27T10:02:18,165 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml' 2023-09-27T10:02:18,166 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt' 2023-09-27T10:02:18,167 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml' 2023-09-27T10:02:18,168 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt' 2023-09-27T10:02:18,170 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml' 2023-09-27T10:02:18,171 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt' 2023-09-27T10:02:18,173 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml' 2023-09-27T10:02:18,174 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt' 2023-09-27T10:02:18,176 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml' 2023-09-27T10:02:18,177 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt' 2023-09-27T10:02:18,179 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml' 2023-09-27T10:02:18,180 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt' 2023-09-27T10:02:18,181 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml' 2023-09-27T10:02:18,182 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt' 2023-09-27T10:02:18,184 adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml' 2023-09-27T10:02:18,185 adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt' 2023-09-27T10:02:18,186 adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml' 2023-09-27T10:02:18,188 adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml' 2023-09-27T10:02:18,189 adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml' 2023-09-27T10:02:18,191 adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml' 2023-09-27T10:02:18,193 adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml' 2023-09-27T10:02:18,195 adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml' 2023-09-27T10:02:18,196 adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml' 2023-09-27T10:02:18,198 adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml' 2023-09-27T10:02:18,199 adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt' 2023-09-27T10:02:18,200 adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml' 2023-09-27T10:02:18,201 adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt' 2023-09-27T10:02:18,203 adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml' 2023-09-27T10:02:18,205 adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml' 2023-09-27T10:02:18,206 adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml' 2023-09-27T10:02:18,208 adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml' 2023-09-27T10:02:18,209 adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt' 2023-09-27T10:02:18,210 adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml' 2023-09-27T10:02:18,212 adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml' 2023-09-27T10:02:18,213 adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt' 2023-09-27T10:02:18,215 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml' 2023-09-27T10:02:18,216 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml' 2023-09-27T10:02:18,219 adding 'alpaca_eval-0.3.0.dist-info/LICENSE' 2023-09-27T10:02:18,229 adding 'alpaca_eval-0.3.0.dist-info/METADATA' 2023-09-27T10:02:18,230 adding 'alpaca_eval-0.3.0.dist-info/WHEEL' 2023-09-27T10:02:18,231 adding 'alpaca_eval-0.3.0.dist-info/entry_points.txt' 2023-09-27T10:02:18,232 adding 'alpaca_eval-0.3.0.dist-info/top_level.txt' 2023-09-27T10:02:18,235 adding 'alpaca_eval-0.3.0.dist-info/RECORD' 2023-09-27T10:02:18,240 removing build/bdist.linux-armv7l/wheel 2023-09-27T10:02:18,412 Building wheel for alpaca-eval (setup.py): finished with status 'done' 2023-09-27T10:02:18,417 Created wheel for alpaca-eval: filename=alpaca_eval-0.3.0-py3-none-any.whl size=171896 sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 2023-09-27T10:02:18,418 Stored in directory: /tmp/pip-ephem-wheel-cache-h1u2vo5p/wheels/f4/4f/68/fd3b18e085683d095689103c972fc8b225c986dfcf86628b4b 2023-09-27T10:02:18,445 Successfully built alpaca-eval 2023-09-27T10:02:18,452 Removed build tracker: '/tmp/pip-build-tracker-fludr_m9'