2023-11-08T08:00:31,988 Created temporary directory: /tmp/pip-build-tracker-pq_55pdn 2023-11-08T08:00:31,989 Initialized build tracking at /tmp/pip-build-tracker-pq_55pdn 2023-11-08T08:00:31,989 Created build tracker: /tmp/pip-build-tracker-pq_55pdn 2023-11-08T08:00:31,990 Entered build tracker: /tmp/pip-build-tracker-pq_55pdn 2023-11-08T08:00:31,991 Created temporary directory: /tmp/pip-wheel-ydo44g_f 2023-11-08T08:00:31,994 Created temporary directory: /tmp/pip-ephem-wheel-cache-j0jbcisl 2023-11-08T08:00:32,016 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-08T08:00:32,019 2 location(s) to search for versions of alpaca-eval: 2023-11-08T08:00:32,019 * https://pypi.org/simple/alpaca-eval/ 2023-11-08T08:00:32,019 * https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T08:00:32,020 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/ 2023-11-08T08:00:32,021 Getting page https://pypi.org/simple/alpaca-eval/ 2023-11-08T08:00:32,023 Found index url https://pypi.org/simple/ 2023-11-08T08:00:32,240 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json 2023-11-08T08:00:32,248 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T08:00:32,249 Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0 2023-11-08T08:00:32,250 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T08:00:32,251 Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1 2023-11-08T08:00:32,252 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T08:00:32,253 Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2 2023-11-08T08:00:32,253 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,254 Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3 2023-11-08T08:00:32,255 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,256 Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5 2023-11-08T08:00:32,256 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,257 Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6 2023-11-08T08:00:32,258 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,259 Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7 2023-11-08T08:00:32,259 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,260 Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8 2023-11-08T08:00:32,261 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,262 Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0 2023-11-08T08:00:32,262 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,263 Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1 2023-11-08T08:00:32,264 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,265 Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2 2023-11-08T08:00:32,266 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,266 Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3 2023-11-08T08:00:32,267 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,268 Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4 2023-11-08T08:00:32,269 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,270 Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5 2023-11-08T08:00:32,271 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,271 Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6 2023-11-08T08:00:32,272 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,273 Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7 2023-11-08T08:00:32,273 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,274 Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8 2023-11-08T08:00:32,275 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,276 Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9 2023-11-08T08:00:32,277 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,278 Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0 2023-11-08T08:00:32,278 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,279 Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1 2023-11-08T08:00:32,280 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,281 Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2 2023-11-08T08:00:32,282 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T08:00:32,283 Getting page https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T08:00:32,284 Found index url https://www.piwheels.org/simple/ 2023-11-08T08:00:32,442 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html 2023-11-08T08:00:32,447 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,448 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,449 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,449 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,450 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,450 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,451 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,451 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,452 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,453 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,453 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,454 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,455 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T08:00:32,456 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T08:00:32,456 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T08:00:32,457 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T08:00:32,457 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T08:00:32,458 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/ 2023-11-08T08:00:32,480 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates 2023-11-08T08:00:32,500 Collecting alpaca-eval==0.3.2 2023-11-08T08:00:32,502 Created temporary directory: /tmp/pip-unpack-cnx41kc7 2023-11-08T08:00:32,729 Downloading alpaca_eval-0.3.2.tar.gz (306 kB) 2023-11-08T08:00:33,268 Added alpaca-eval==0.3.2 from https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz to build tracker '/tmp/pip-build-tracker-pq_55pdn' 2023-11-08T08:00:33,271 Running setup.py (path:/tmp/pip-wheel-ydo44g_f/alpaca-eval_68e535a12be54a68b4560da55075446e/setup.py) egg_info for package alpaca-eval 2023-11-08T08:00:33,272 Created temporary directory: /tmp/pip-pip-egg-info-85drcxnh 2023-11-08T08:00:33,273 Preparing metadata (setup.py): started 2023-11-08T08:00:33,275 Running command python setup.py egg_info 2023-11-08T08:00:34,337 running egg_info 2023-11-08T08:00:34,338 creating /tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info 2023-11-08T08:00:34,365 writing /tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/PKG-INFO 2023-11-08T08:00:34,383 writing dependency_links to /tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/dependency_links.txt 2023-11-08T08:00:34,385 writing entry points to /tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/entry_points.txt 2023-11-08T08:00:34,393 writing requirements to /tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/requires.txt 2023-11-08T08:00:34,394 writing top-level names to /tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/top_level.txt 2023-11-08T08:00:34,396 writing manifest file '/tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T08:00:34,473 reading manifest file '/tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T08:00:34,475 reading manifest template 'MANIFEST.in' 2023-11-08T08:00:34,671 adding license file 'LICENSE' 2023-11-08T08:00:34,678 writing manifest file '/tmp/pip-pip-egg-info-85drcxnh/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T08:00:34,795 Preparing metadata (setup.py): finished with status 'done' 2023-11-08T08:00:34,805 Source in /tmp/pip-wheel-ydo44g_f/alpaca-eval_68e535a12be54a68b4560da55075446e has version 0.3.2, which satisfies requirement alpaca-eval==0.3.2 from https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz 2023-11-08T08:00:34,810 Removed alpaca-eval==0.3.2 from https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz from build tracker '/tmp/pip-build-tracker-pq_55pdn' 2023-11-08T08:00:34,834 Created temporary directory: /tmp/pip-unpack-5t6pjwwc 2023-11-08T08:00:34,839 Created temporary directory: /tmp/pip-unpack-rxasd9g_ 2023-11-08T08:00:34,979 Building wheels for collected packages: alpaca-eval 2023-11-08T08:00:34,995 Created temporary directory: /tmp/pip-wheel-hklqz8l8 2023-11-08T08:00:34,995 Building wheel for alpaca-eval (setup.py): started 2023-11-08T08:00:35,195 Destination directory: /tmp/pip-wheel-hklqz8l8 2023-11-08T08:00:35,197 Running command python setup.py bdist_wheel 2023-11-08T08:00:37,043 running bdist_wheel 2023-11-08T08:00:37,153 running build 2023-11-08T08:00:37,153 running build_py 2023-11-08T08:00:37,190 creating build 2023-11-08T08:00:37,190 creating build/lib 2023-11-08T08:00:37,192 creating build/lib/alpaca_eval 2023-11-08T08:00:37,194 copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,197 copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,202 copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,208 copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,212 copying src/alpaca_eval/main.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,219 copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,223 copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,227 copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,242 copying src/alpaca_eval/types.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,245 copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval 2023-11-08T08:00:37,251 creating build/lib/alpaca_eval/annotators 2023-11-08T08:00:37,253 copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators 2023-11-08T08:00:37,255 copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators 2023-11-08T08:00:37,258 copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators 2023-11-08T08:00:37,263 creating build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,267 copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,276 copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,282 copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,285 copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,287 copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,290 copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,292 copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,295 copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,300 copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,305 copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders 2023-11-08T08:00:37,309 running egg_info 2023-11-08T08:00:37,444 writing src/alpaca_eval.egg-info/PKG-INFO 2023-11-08T08:00:37,464 writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt 2023-11-08T08:00:37,466 writing entry points to src/alpaca_eval.egg-info/entry_points.txt 2023-11-08T08:00:37,475 writing requirements to src/alpaca_eval.egg-info/requires.txt 2023-11-08T08:00:37,477 writing top-level names to src/alpaca_eval.egg-info/top_level.txt 2023-11-08T08:00:37,548 reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T08:00:37,602 reading manifest template 'MANIFEST.in' 2023-11-08T08:00:37,970 adding license file 'LICENSE' 2023-11-08T08:00:37,980 writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T08:00:37,983 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration. 2023-11-08T08:00:37,984 !! 2023-11-08T08:00:37,985 ******************************************************************************** 2023-11-08T08:00:37,985 ############################ 2023-11-08T08:00:37,986 # Package would be ignored # 2023-11-08T08:00:37,986 ############################ 2023-11-08T08:00:37,987 Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1], 2023-11-08T08:00:37,988 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:37,989 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:37,989 package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added 2023-11-08T08:00:37,990 to the `packages` configuration field. 2023-11-08T08:00:37,991 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:37,991 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:37,992 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:37,993 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:37,994 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:37,995 If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are 2023-11-08T08:00:37,996 already explicitly excluding 'alpaca_eval.evaluators_configs' via 2023-11-08T08:00:37,997 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:37,997 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:37,998 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:37,999 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,000 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,002 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,002 even if it does not contain any `.py` files. 2023-11-08T08:00:38,006 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,007 directory, all directories are treated like packages. 2023-11-08T08:00:38,007 ******************************************************************************** 2023-11-08T08:00:38,009 !! 2023-11-08T08:00:38,009 check.warn(importable) 2023-11-08T08:00:38,010 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,011 !! 2023-11-08T08:00:38,012 ******************************************************************************** 2023-11-08T08:00:38,013 ############################ 2023-11-08T08:00:38,013 # Package would be ignored # 2023-11-08T08:00:38,014 ############################ 2023-11-08T08:00:38,015 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1], 2023-11-08T08:00:38,015 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,017 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,017 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added 2023-11-08T08:00:38,018 to the `packages` configuration field. 2023-11-08T08:00:38,023 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,023 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,024 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,025 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,026 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,027 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are 2023-11-08T08:00:38,027 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via 2023-11-08T08:00:38,029 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,029 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,030 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,031 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,032 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,033 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,033 even if it does not contain any `.py` files. 2023-11-08T08:00:38,034 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,034 directory, all directories are treated like packages. 2023-11-08T08:00:38,038 ******************************************************************************** 2023-11-08T08:00:38,039 !! 2023-11-08T08:00:38,040 check.warn(importable) 2023-11-08T08:00:38,041 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration. 2023-11-08T08:00:38,041 !! 2023-11-08T08:00:38,042 ******************************************************************************** 2023-11-08T08:00:38,043 ############################ 2023-11-08T08:00:38,050 # Package would be ignored # 2023-11-08T08:00:38,051 ############################ 2023-11-08T08:00:38,054 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1], 2023-11-08T08:00:38,055 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,056 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,057 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added 2023-11-08T08:00:38,057 to the `packages` configuration field. 2023-11-08T08:00:38,059 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,059 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,060 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,061 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,062 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,063 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are 2023-11-08T08:00:38,064 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via 2023-11-08T08:00:38,065 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,066 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,067 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,069 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,069 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,074 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,075 even if it does not contain any `.py` files. 2023-11-08T08:00:38,075 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,076 directory, all directories are treated like packages. 2023-11-08T08:00:38,076 ******************************************************************************** 2023-11-08T08:00:38,077 !! 2023-11-08T08:00:38,078 check.warn(importable) 2023-11-08T08:00:38,078 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration. 2023-11-08T08:00:38,079 !! 2023-11-08T08:00:38,079 ******************************************************************************** 2023-11-08T08:00:38,080 ############################ 2023-11-08T08:00:38,080 # Package would be ignored # 2023-11-08T08:00:38,082 ############################ 2023-11-08T08:00:38,083 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1], 2023-11-08T08:00:38,084 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,085 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,085 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added 2023-11-08T08:00:38,086 to the `packages` configuration field. 2023-11-08T08:00:38,087 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,087 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,088 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,089 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,091 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,092 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are 2023-11-08T08:00:38,092 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via 2023-11-08T08:00:38,097 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,098 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,099 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,106 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,107 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,115 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,115 even if it does not contain any `.py` files. 2023-11-08T08:00:38,116 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,116 directory, all directories are treated like packages. 2023-11-08T08:00:38,117 ******************************************************************************** 2023-11-08T08:00:38,122 !! 2023-11-08T08:00:38,126 check.warn(importable) 2023-11-08T08:00:38,127 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration. 2023-11-08T08:00:38,128 !! 2023-11-08T08:00:38,129 ******************************************************************************** 2023-11-08T08:00:38,129 ############################ 2023-11-08T08:00:38,130 # Package would be ignored # 2023-11-08T08:00:38,130 ############################ 2023-11-08T08:00:38,131 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1], 2023-11-08T08:00:38,132 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,133 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,134 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added 2023-11-08T08:00:38,134 to the `packages` configuration field. 2023-11-08T08:00:38,135 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,136 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,136 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,137 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,138 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,139 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are 2023-11-08T08:00:38,140 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via 2023-11-08T08:00:38,140 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,141 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,141 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,143 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,144 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,146 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,146 even if it does not contain any `.py` files. 2023-11-08T08:00:38,147 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,147 directory, all directories are treated like packages. 2023-11-08T08:00:38,148 ******************************************************************************** 2023-11-08T08:00:38,149 !! 2023-11-08T08:00:38,150 check.warn(importable) 2023-11-08T08:00:38,150 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration. 2023-11-08T08:00:38,151 !! 2023-11-08T08:00:38,152 ******************************************************************************** 2023-11-08T08:00:38,153 ############################ 2023-11-08T08:00:38,153 # Package would be ignored # 2023-11-08T08:00:38,154 ############################ 2023-11-08T08:00:38,155 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1], 2023-11-08T08:00:38,155 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,157 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,157 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added 2023-11-08T08:00:38,159 to the `packages` configuration field. 2023-11-08T08:00:38,160 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,161 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,161 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,163 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,164 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,165 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are 2023-11-08T08:00:38,166 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via 2023-11-08T08:00:38,166 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,166 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,167 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,168 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,169 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,170 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,171 even if it does not contain any `.py` files. 2023-11-08T08:00:38,171 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,172 directory, all directories are treated like packages. 2023-11-08T08:00:38,172 ******************************************************************************** 2023-11-08T08:00:38,173 !! 2023-11-08T08:00:38,174 check.warn(importable) 2023-11-08T08:00:38,175 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,175 !! 2023-11-08T08:00:38,176 ******************************************************************************** 2023-11-08T08:00:38,177 ############################ 2023-11-08T08:00:38,178 # Package would be ignored # 2023-11-08T08:00:38,178 ############################ 2023-11-08T08:00:38,179 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1], 2023-11-08T08:00:38,179 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,181 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,181 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added 2023-11-08T08:00:38,182 to the `packages` configuration field. 2023-11-08T08:00:38,183 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,184 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,185 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,187 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,188 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,195 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are 2023-11-08T08:00:38,196 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via 2023-11-08T08:00:38,197 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,198 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,202 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,207 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,209 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,214 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,216 even if it does not contain any `.py` files. 2023-11-08T08:00:38,222 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,223 directory, all directories are treated like packages. 2023-11-08T08:00:38,224 ******************************************************************************** 2023-11-08T08:00:38,225 !! 2023-11-08T08:00:38,226 check.warn(importable) 2023-11-08T08:00:38,227 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,228 !! 2023-11-08T08:00:38,231 ******************************************************************************** 2023-11-08T08:00:38,232 ############################ 2023-11-08T08:00:38,233 # Package would be ignored # 2023-11-08T08:00:38,233 ############################ 2023-11-08T08:00:38,234 Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1], 2023-11-08T08:00:38,235 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,239 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,240 package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added 2023-11-08T08:00:38,241 to the `packages` configuration field. 2023-11-08T08:00:38,242 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,243 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,244 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,246 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,250 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,255 If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are 2023-11-08T08:00:38,256 already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via 2023-11-08T08:00:38,257 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,258 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,259 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,263 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,265 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,268 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,274 even if it does not contain any `.py` files. 2023-11-08T08:00:38,275 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,276 directory, all directories are treated like packages. 2023-11-08T08:00:38,277 ******************************************************************************** 2023-11-08T08:00:38,278 !! 2023-11-08T08:00:38,280 check.warn(importable) 2023-11-08T08:00:38,282 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration. 2023-11-08T08:00:38,283 !! 2023-11-08T08:00:38,285 ******************************************************************************** 2023-11-08T08:00:38,286 ############################ 2023-11-08T08:00:38,287 # Package would be ignored # 2023-11-08T08:00:38,288 ############################ 2023-11-08T08:00:38,289 Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1], 2023-11-08T08:00:38,290 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,291 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,292 package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added 2023-11-08T08:00:38,293 to the `packages` configuration field. 2023-11-08T08:00:38,294 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,295 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,295 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,297 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,298 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,299 If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are 2023-11-08T08:00:38,300 already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via 2023-11-08T08:00:38,301 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,301 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,302 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,304 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,305 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,307 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,308 even if it does not contain any `.py` files. 2023-11-08T08:00:38,309 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,311 directory, all directories are treated like packages. 2023-11-08T08:00:38,311 ******************************************************************************** 2023-11-08T08:00:38,313 !! 2023-11-08T08:00:38,314 check.warn(importable) 2023-11-08T08:00:38,315 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration. 2023-11-08T08:00:38,315 !! 2023-11-08T08:00:38,317 ******************************************************************************** 2023-11-08T08:00:38,318 ############################ 2023-11-08T08:00:38,322 # Package would be ignored # 2023-11-08T08:00:38,323 ############################ 2023-11-08T08:00:38,324 Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1], 2023-11-08T08:00:38,325 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,326 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,327 package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added 2023-11-08T08:00:38,328 to the `packages` configuration field. 2023-11-08T08:00:38,329 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,330 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,334 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,339 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,341 If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are 2023-11-08T08:00:38,341 already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via 2023-11-08T08:00:38,342 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,344 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,345 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,346 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,347 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,349 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,350 even if it does not contain any `.py` files. 2023-11-08T08:00:38,351 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,352 directory, all directories are treated like packages. 2023-11-08T08:00:38,352 ******************************************************************************** 2023-11-08T08:00:38,353 !! 2023-11-08T08:00:38,354 check.warn(importable) 2023-11-08T08:00:38,355 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration. 2023-11-08T08:00:38,355 !! 2023-11-08T08:00:38,359 ******************************************************************************** 2023-11-08T08:00:38,360 ############################ 2023-11-08T08:00:38,360 # Package would be ignored # 2023-11-08T08:00:38,361 ############################ 2023-11-08T08:00:38,362 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1], 2023-11-08T08:00:38,362 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,364 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,365 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added 2023-11-08T08:00:38,366 to the `packages` configuration field. 2023-11-08T08:00:38,370 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,371 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,372 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,374 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,379 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,383 If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are 2023-11-08T08:00:38,384 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via 2023-11-08T08:00:38,385 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,386 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,386 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,388 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,389 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,394 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,395 even if it does not contain any `.py` files. 2023-11-08T08:00:38,396 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,396 directory, all directories are treated like packages. 2023-11-08T08:00:38,397 ******************************************************************************** 2023-11-08T08:00:38,399 !! 2023-11-08T08:00:38,400 check.warn(importable) 2023-11-08T08:00:38,402 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration. 2023-11-08T08:00:38,403 !! 2023-11-08T08:00:38,404 ******************************************************************************** 2023-11-08T08:00:38,404 ############################ 2023-11-08T08:00:38,405 # Package would be ignored # 2023-11-08T08:00:38,405 ############################ 2023-11-08T08:00:38,406 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1], 2023-11-08T08:00:38,406 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,408 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,408 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added 2023-11-08T08:00:38,409 to the `packages` configuration field. 2023-11-08T08:00:38,410 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,410 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,411 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,412 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,413 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,414 If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are 2023-11-08T08:00:38,415 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via 2023-11-08T08:00:38,416 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,417 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,417 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,422 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,426 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,428 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,429 even if it does not contain any `.py` files. 2023-11-08T08:00:38,430 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,430 directory, all directories are treated like packages. 2023-11-08T08:00:38,431 ******************************************************************************** 2023-11-08T08:00:38,433 !! 2023-11-08T08:00:38,434 check.warn(importable) 2023-11-08T08:00:38,435 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration. 2023-11-08T08:00:38,436 !! 2023-11-08T08:00:38,437 ******************************************************************************** 2023-11-08T08:00:38,438 ############################ 2023-11-08T08:00:38,438 # Package would be ignored # 2023-11-08T08:00:38,439 ############################ 2023-11-08T08:00:38,439 Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1], 2023-11-08T08:00:38,440 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,442 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,442 package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added 2023-11-08T08:00:38,443 to the `packages` configuration field. 2023-11-08T08:00:38,454 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,455 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,457 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,458 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,462 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,464 If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are 2023-11-08T08:00:38,464 already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via 2023-11-08T08:00:38,465 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,465 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,466 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,467 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,474 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,476 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,477 even if it does not contain any `.py` files. 2023-11-08T08:00:38,477 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,478 directory, all directories are treated like packages. 2023-11-08T08:00:38,478 ******************************************************************************** 2023-11-08T08:00:38,480 !! 2023-11-08T08:00:38,480 check.warn(importable) 2023-11-08T08:00:38,481 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration. 2023-11-08T08:00:38,482 !! 2023-11-08T08:00:38,484 ******************************************************************************** 2023-11-08T08:00:38,485 ############################ 2023-11-08T08:00:38,486 # Package would be ignored # 2023-11-08T08:00:38,486 ############################ 2023-11-08T08:00:38,487 Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1], 2023-11-08T08:00:38,490 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,492 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,493 package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added 2023-11-08T08:00:38,494 to the `packages` configuration field. 2023-11-08T08:00:38,499 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,500 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,501 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,502 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,504 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,507 If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are 2023-11-08T08:00:38,508 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via 2023-11-08T08:00:38,509 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,509 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,510 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,512 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,514 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,527 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,527 even if it does not contain any `.py` files. 2023-11-08T08:00:38,528 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,528 directory, all directories are treated like packages. 2023-11-08T08:00:38,529 ******************************************************************************** 2023-11-08T08:00:38,531 !! 2023-11-08T08:00:38,531 check.warn(importable) 2023-11-08T08:00:38,532 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration. 2023-11-08T08:00:38,532 !! 2023-11-08T08:00:38,534 ******************************************************************************** 2023-11-08T08:00:38,534 ############################ 2023-11-08T08:00:38,535 # Package would be ignored # 2023-11-08T08:00:38,536 ############################ 2023-11-08T08:00:38,537 Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1], 2023-11-08T08:00:38,537 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,539 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,539 package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added 2023-11-08T08:00:38,540 to the `packages` configuration field. 2023-11-08T08:00:38,542 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,542 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,543 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,545 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,547 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,548 If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are 2023-11-08T08:00:38,549 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via 2023-11-08T08:00:38,550 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,551 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,551 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,553 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,558 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,563 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,564 even if it does not contain any `.py` files. 2023-11-08T08:00:38,564 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,565 directory, all directories are treated like packages. 2023-11-08T08:00:38,566 ******************************************************************************** 2023-11-08T08:00:38,567 !! 2023-11-08T08:00:38,568 check.warn(importable) 2023-11-08T08:00:38,569 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration. 2023-11-08T08:00:38,570 !! 2023-11-08T08:00:38,572 ******************************************************************************** 2023-11-08T08:00:38,572 ############################ 2023-11-08T08:00:38,573 # Package would be ignored # 2023-11-08T08:00:38,574 ############################ 2023-11-08T08:00:38,575 Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1], 2023-11-08T08:00:38,576 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,577 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,578 package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added 2023-11-08T08:00:38,579 to the `packages` configuration field. 2023-11-08T08:00:38,580 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,580 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,581 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,582 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,584 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,585 If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are 2023-11-08T08:00:38,586 already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via 2023-11-08T08:00:38,586 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,587 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,588 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,589 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,590 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,592 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,593 even if it does not contain any `.py` files. 2023-11-08T08:00:38,598 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,602 directory, all directories are treated like packages. 2023-11-08T08:00:38,606 ******************************************************************************** 2023-11-08T08:00:38,608 !! 2023-11-08T08:00:38,609 check.warn(importable) 2023-11-08T08:00:38,610 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration. 2023-11-08T08:00:38,610 !! 2023-11-08T08:00:38,613 ******************************************************************************** 2023-11-08T08:00:38,613 ############################ 2023-11-08T08:00:38,614 # Package would be ignored # 2023-11-08T08:00:38,615 ############################ 2023-11-08T08:00:38,618 Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1], 2023-11-08T08:00:38,619 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,622 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,623 package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added 2023-11-08T08:00:38,624 to the `packages` configuration field. 2023-11-08T08:00:38,626 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,627 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,628 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,633 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,634 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,636 If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are 2023-11-08T08:00:38,637 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via 2023-11-08T08:00:38,638 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,642 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,643 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,644 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,645 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,647 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,648 even if it does not contain any `.py` files. 2023-11-08T08:00:38,648 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,649 directory, all directories are treated like packages. 2023-11-08T08:00:38,650 ******************************************************************************** 2023-11-08T08:00:38,651 !! 2023-11-08T08:00:38,652 check.warn(importable) 2023-11-08T08:00:38,652 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,653 !! 2023-11-08T08:00:38,654 ******************************************************************************** 2023-11-08T08:00:38,655 ############################ 2023-11-08T08:00:38,655 # Package would be ignored # 2023-11-08T08:00:38,656 ############################ 2023-11-08T08:00:38,657 Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1], 2023-11-08T08:00:38,657 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,658 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,659 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added 2023-11-08T08:00:38,660 to the `packages` configuration field. 2023-11-08T08:00:38,661 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,663 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,664 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,665 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,667 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,668 If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are 2023-11-08T08:00:38,669 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via 2023-11-08T08:00:38,670 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,670 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,671 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,672 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,674 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,676 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,679 even if it does not contain any `.py` files. 2023-11-08T08:00:38,679 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,680 directory, all directories are treated like packages. 2023-11-08T08:00:38,681 ******************************************************************************** 2023-11-08T08:00:38,686 !! 2023-11-08T08:00:38,686 check.warn(importable) 2023-11-08T08:00:38,687 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration. 2023-11-08T08:00:38,688 !! 2023-11-08T08:00:38,689 ******************************************************************************** 2023-11-08T08:00:38,689 ############################ 2023-11-08T08:00:38,690 # Package would be ignored # 2023-11-08T08:00:38,691 ############################ 2023-11-08T08:00:38,691 Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1], 2023-11-08T08:00:38,692 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,693 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,693 package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added 2023-11-08T08:00:38,694 to the `packages` configuration field. 2023-11-08T08:00:38,695 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,696 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,696 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,698 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,699 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,700 If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are 2023-11-08T08:00:38,700 already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via 2023-11-08T08:00:38,701 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,702 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,702 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,704 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,705 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,707 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,708 even if it does not contain any `.py` files. 2023-11-08T08:00:38,709 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,709 directory, all directories are treated like packages. 2023-11-08T08:00:38,710 ******************************************************************************** 2023-11-08T08:00:38,711 !! 2023-11-08T08:00:38,712 check.warn(importable) 2023-11-08T08:00:38,713 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,713 !! 2023-11-08T08:00:38,714 ******************************************************************************** 2023-11-08T08:00:38,715 ############################ 2023-11-08T08:00:38,716 # Package would be ignored # 2023-11-08T08:00:38,716 ############################ 2023-11-08T08:00:38,717 Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1], 2023-11-08T08:00:38,718 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,719 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,722 package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added 2023-11-08T08:00:38,723 to the `packages` configuration field. 2023-11-08T08:00:38,725 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,726 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,726 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,731 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,732 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,733 If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are 2023-11-08T08:00:38,734 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via 2023-11-08T08:00:38,734 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,735 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,735 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,737 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,738 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,740 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,740 even if it does not contain any `.py` files. 2023-11-08T08:00:38,741 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,742 directory, all directories are treated like packages. 2023-11-08T08:00:38,742 ******************************************************************************** 2023-11-08T08:00:38,744 !! 2023-11-08T08:00:38,745 check.warn(importable) 2023-11-08T08:00:38,745 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,746 !! 2023-11-08T08:00:38,747 ******************************************************************************** 2023-11-08T08:00:38,748 ############################ 2023-11-08T08:00:38,755 # Package would be ignored # 2023-11-08T08:00:38,755 ############################ 2023-11-08T08:00:38,756 Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1], 2023-11-08T08:00:38,762 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,764 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,765 package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added 2023-11-08T08:00:38,766 to the `packages` configuration field. 2023-11-08T08:00:38,769 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,770 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,774 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,776 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,779 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,780 If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are 2023-11-08T08:00:38,786 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via 2023-11-08T08:00:38,787 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,788 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,789 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,795 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,799 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,801 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,802 even if it does not contain any `.py` files. 2023-11-08T08:00:38,803 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,804 directory, all directories are treated like packages. 2023-11-08T08:00:38,805 ******************************************************************************** 2023-11-08T08:00:38,807 !! 2023-11-08T08:00:38,810 check.warn(importable) 2023-11-08T08:00:38,811 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:38,812 !! 2023-11-08T08:00:38,814 ******************************************************************************** 2023-11-08T08:00:38,816 ############################ 2023-11-08T08:00:38,817 # Package would be ignored # 2023-11-08T08:00:38,819 ############################ 2023-11-08T08:00:38,822 Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1], 2023-11-08T08:00:38,827 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,828 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,829 package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added 2023-11-08T08:00:38,830 to the `packages` configuration field. 2023-11-08T08:00:38,832 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,833 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,834 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,835 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,837 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,838 If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are 2023-11-08T08:00:38,843 already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via 2023-11-08T08:00:38,847 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,848 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,848 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,850 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,851 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,853 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,854 even if it does not contain any `.py` files. 2023-11-08T08:00:38,855 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,856 directory, all directories are treated like packages. 2023-11-08T08:00:38,856 ******************************************************************************** 2023-11-08T08:00:38,858 !! 2023-11-08T08:00:38,858 check.warn(importable) 2023-11-08T08:00:38,859 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration. 2023-11-08T08:00:38,860 !! 2023-11-08T08:00:38,862 ******************************************************************************** 2023-11-08T08:00:38,862 ############################ 2023-11-08T08:00:38,864 # Package would be ignored # 2023-11-08T08:00:38,865 ############################ 2023-11-08T08:00:38,866 Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1], 2023-11-08T08:00:38,867 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,868 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,869 package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added 2023-11-08T08:00:38,870 to the `packages` configuration field. 2023-11-08T08:00:38,872 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,873 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,874 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,879 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,881 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,883 If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are 2023-11-08T08:00:38,887 already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via 2023-11-08T08:00:38,888 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,888 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,889 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,891 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,893 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,895 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,896 even if it does not contain any `.py` files. 2023-11-08T08:00:38,901 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,901 directory, all directories are treated like packages. 2023-11-08T08:00:38,902 ******************************************************************************** 2023-11-08T08:00:38,904 !! 2023-11-08T08:00:38,905 check.warn(importable) 2023-11-08T08:00:38,906 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration. 2023-11-08T08:00:38,907 !! 2023-11-08T08:00:38,908 ******************************************************************************** 2023-11-08T08:00:38,909 ############################ 2023-11-08T08:00:38,910 # Package would be ignored # 2023-11-08T08:00:38,911 ############################ 2023-11-08T08:00:38,912 Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1], 2023-11-08T08:00:38,913 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,915 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,915 package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added 2023-11-08T08:00:38,922 to the `packages` configuration field. 2023-11-08T08:00:38,924 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,925 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,926 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,928 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,930 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,931 If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are 2023-11-08T08:00:38,933 already explicitly excluding 'alpaca_eval.evaluators_configs.test' via 2023-11-08T08:00:38,933 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,939 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,939 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,941 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,943 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:38,948 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:38,949 even if it does not contain any `.py` files. 2023-11-08T08:00:38,954 On the other hand, currently there is no concept of package data 2023-11-08T08:00:38,955 directory, all directories are treated like packages. 2023-11-08T08:00:38,956 ******************************************************************************** 2023-11-08T08:00:38,958 !! 2023-11-08T08:00:38,959 check.warn(importable) 2023-11-08T08:00:38,962 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration. 2023-11-08T08:00:38,963 !! 2023-11-08T08:00:38,965 ******************************************************************************** 2023-11-08T08:00:38,970 ############################ 2023-11-08T08:00:38,975 # Package would be ignored # 2023-11-08T08:00:38,978 ############################ 2023-11-08T08:00:38,979 Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1], 2023-11-08T08:00:38,980 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:38,981 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:38,982 package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added 2023-11-08T08:00:38,983 to the `packages` configuration field. 2023-11-08T08:00:38,984 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:38,985 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:38,986 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:38,988 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:38,990 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:38,992 If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are 2023-11-08T08:00:38,993 already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via 2023-11-08T08:00:38,993 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:38,994 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:38,995 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:38,996 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:38,998 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,001 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,001 even if it does not contain any `.py` files. 2023-11-08T08:00:39,002 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,003 directory, all directories are treated like packages. 2023-11-08T08:00:39,004 ******************************************************************************** 2023-11-08T08:00:39,006 !! 2023-11-08T08:00:39,006 check.warn(importable) 2023-11-08T08:00:39,007 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration. 2023-11-08T08:00:39,008 !! 2023-11-08T08:00:39,010 ******************************************************************************** 2023-11-08T08:00:39,042 ############################ 2023-11-08T08:00:39,043 # Package would be ignored # 2023-11-08T08:00:39,044 ############################ 2023-11-08T08:00:39,045 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1], 2023-11-08T08:00:39,046 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,047 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,048 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added 2023-11-08T08:00:39,049 to the `packages` configuration field. 2023-11-08T08:00:39,050 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,052 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,053 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,054 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,063 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,071 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are 2023-11-08T08:00:39,072 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via 2023-11-08T08:00:39,072 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,073 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,074 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,076 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,078 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,080 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,081 even if it does not contain any `.py` files. 2023-11-08T08:00:39,081 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,082 directory, all directories are treated like packages. 2023-11-08T08:00:39,083 ******************************************************************************** 2023-11-08T08:00:39,085 !! 2023-11-08T08:00:39,085 check.warn(importable) 2023-11-08T08:00:39,086 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration. 2023-11-08T08:00:39,087 !! 2023-11-08T08:00:39,089 ******************************************************************************** 2023-11-08T08:00:39,089 ############################ 2023-11-08T08:00:39,090 # Package would be ignored # 2023-11-08T08:00:39,091 ############################ 2023-11-08T08:00:39,092 Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1], 2023-11-08T08:00:39,093 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,095 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,096 package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added 2023-11-08T08:00:39,097 to the `packages` configuration field. 2023-11-08T08:00:39,099 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,099 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,100 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,102 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,104 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,112 If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are 2023-11-08T08:00:39,112 already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via 2023-11-08T08:00:39,113 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,114 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,115 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,117 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,118 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,121 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,122 even if it does not contain any `.py` files. 2023-11-08T08:00:39,123 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,124 directory, all directories are treated like packages. 2023-11-08T08:00:39,124 ******************************************************************************** 2023-11-08T08:00:39,126 !! 2023-11-08T08:00:39,128 check.warn(importable) 2023-11-08T08:00:39,129 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration. 2023-11-08T08:00:39,130 !! 2023-11-08T08:00:39,132 ******************************************************************************** 2023-11-08T08:00:39,132 ############################ 2023-11-08T08:00:39,133 # Package would be ignored # 2023-11-08T08:00:39,134 ############################ 2023-11-08T08:00:39,135 Python recognizes 'alpaca_eval.models_configs' as an importable package[^1], 2023-11-08T08:00:39,136 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,138 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,139 package, please make sure that 'alpaca_eval.models_configs' is explicitly added 2023-11-08T08:00:39,139 to the `packages` configuration field. 2023-11-08T08:00:39,141 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,142 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,143 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,145 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,147 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,148 If you don't want 'alpaca_eval.models_configs' to be distributed and are 2023-11-08T08:00:39,149 already explicitly excluding 'alpaca_eval.models_configs' via 2023-11-08T08:00:39,150 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,151 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,152 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,153 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,155 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,157 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,157 even if it does not contain any `.py` files. 2023-11-08T08:00:39,158 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,159 directory, all directories are treated like packages. 2023-11-08T08:00:39,160 ******************************************************************************** 2023-11-08T08:00:39,161 !! 2023-11-08T08:00:39,162 check.warn(importable) 2023-11-08T08:00:39,163 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration. 2023-11-08T08:00:39,164 !! 2023-11-08T08:00:39,165 ******************************************************************************** 2023-11-08T08:00:39,166 ############################ 2023-11-08T08:00:39,167 # Package would be ignored # 2023-11-08T08:00:39,167 ############################ 2023-11-08T08:00:39,168 Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1], 2023-11-08T08:00:39,169 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,170 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,171 package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added 2023-11-08T08:00:39,172 to the `packages` configuration field. 2023-11-08T08:00:39,173 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,174 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,175 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,177 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,178 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,180 If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are 2023-11-08T08:00:39,180 already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via 2023-11-08T08:00:39,181 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,182 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,183 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,184 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,187 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,190 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,195 even if it does not contain any `.py` files. 2023-11-08T08:00:39,195 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,196 directory, all directories are treated like packages. 2023-11-08T08:00:39,197 ******************************************************************************** 2023-11-08T08:00:39,199 !! 2023-11-08T08:00:39,200 check.warn(importable) 2023-11-08T08:00:39,201 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration. 2023-11-08T08:00:39,201 !! 2023-11-08T08:00:39,203 ******************************************************************************** 2023-11-08T08:00:39,204 ############################ 2023-11-08T08:00:39,211 # Package would be ignored # 2023-11-08T08:00:39,211 ############################ 2023-11-08T08:00:39,212 Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1], 2023-11-08T08:00:39,213 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,214 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,214 package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added 2023-11-08T08:00:39,218 to the `packages` configuration field. 2023-11-08T08:00:39,219 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,220 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,221 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,222 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,223 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,224 If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are 2023-11-08T08:00:39,225 already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via 2023-11-08T08:00:39,226 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,226 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,227 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,228 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,230 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,232 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,233 even if it does not contain any `.py` files. 2023-11-08T08:00:39,233 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,234 directory, all directories are treated like packages. 2023-11-08T08:00:39,237 ******************************************************************************** 2023-11-08T08:00:39,283 !! 2023-11-08T08:00:39,284 check.warn(importable) 2023-11-08T08:00:39,285 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration. 2023-11-08T08:00:39,286 !! 2023-11-08T08:00:39,287 ******************************************************************************** 2023-11-08T08:00:39,288 ############################ 2023-11-08T08:00:39,289 # Package would be ignored # 2023-11-08T08:00:39,289 ############################ 2023-11-08T08:00:39,290 Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1], 2023-11-08T08:00:39,291 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,293 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,293 package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added 2023-11-08T08:00:39,294 to the `packages` configuration field. 2023-11-08T08:00:39,296 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,297 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,298 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,300 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,302 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,303 If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are 2023-11-08T08:00:39,304 already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via 2023-11-08T08:00:39,305 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,306 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,307 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,308 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,312 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,314 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,314 even if it does not contain any `.py` files. 2023-11-08T08:00:39,315 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,316 directory, all directories are treated like packages. 2023-11-08T08:00:39,317 ******************************************************************************** 2023-11-08T08:00:39,322 !! 2023-11-08T08:00:39,326 check.warn(importable) 2023-11-08T08:00:39,327 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration. 2023-11-08T08:00:39,328 !! 2023-11-08T08:00:39,329 ******************************************************************************** 2023-11-08T08:00:39,335 ############################ 2023-11-08T08:00:39,335 # Package would be ignored # 2023-11-08T08:00:39,336 ############################ 2023-11-08T08:00:39,337 Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1], 2023-11-08T08:00:39,338 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,339 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,340 package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added 2023-11-08T08:00:39,347 to the `packages` configuration field. 2023-11-08T08:00:39,348 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,349 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,350 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,352 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,353 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,355 If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are 2023-11-08T08:00:39,356 already explicitly excluding 'alpaca_eval.models_configs.claude' via 2023-11-08T08:00:39,357 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,358 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,358 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,361 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,363 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,366 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,367 even if it does not contain any `.py` files. 2023-11-08T08:00:39,367 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,368 directory, all directories are treated like packages. 2023-11-08T08:00:39,369 ******************************************************************************** 2023-11-08T08:00:39,371 !! 2023-11-08T08:00:39,378 check.warn(importable) 2023-11-08T08:00:39,383 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration. 2023-11-08T08:00:39,384 !! 2023-11-08T08:00:39,385 ******************************************************************************** 2023-11-08T08:00:39,385 ############################ 2023-11-08T08:00:39,390 # Package would be ignored # 2023-11-08T08:00:39,391 ############################ 2023-11-08T08:00:39,392 Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1], 2023-11-08T08:00:39,393 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,398 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,399 package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added 2023-11-08T08:00:39,400 to the `packages` configuration field. 2023-11-08T08:00:39,401 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,402 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,402 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,404 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,405 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,410 If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are 2023-11-08T08:00:39,411 already explicitly excluding 'alpaca_eval.models_configs.cohere' via 2023-11-08T08:00:39,412 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,413 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,414 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,415 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,417 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,419 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,420 even if it does not contain any `.py` files. 2023-11-08T08:00:39,421 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,421 directory, all directories are treated like packages. 2023-11-08T08:00:39,422 ******************************************************************************** 2023-11-08T08:00:39,424 !! 2023-11-08T08:00:39,425 check.warn(importable) 2023-11-08T08:00:39,425 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration. 2023-11-08T08:00:39,427 !! 2023-11-08T08:00:39,428 ******************************************************************************** 2023-11-08T08:00:39,429 ############################ 2023-11-08T08:00:39,430 # Package would be ignored # 2023-11-08T08:00:39,431 ############################ 2023-11-08T08:00:39,431 Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1], 2023-11-08T08:00:39,432 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,434 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,435 package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added 2023-11-08T08:00:39,436 to the `packages` configuration field. 2023-11-08T08:00:39,437 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,438 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,439 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,440 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,441 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,443 If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are 2023-11-08T08:00:39,443 already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via 2023-11-08T08:00:39,444 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,445 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,446 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,447 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,449 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,451 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,452 even if it does not contain any `.py` files. 2023-11-08T08:00:39,453 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,454 directory, all directories are treated like packages. 2023-11-08T08:00:39,454 ******************************************************************************** 2023-11-08T08:00:39,471 !! 2023-11-08T08:00:39,475 check.warn(importable) 2023-11-08T08:00:39,487 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration. 2023-11-08T08:00:39,491 !! 2023-11-08T08:00:39,499 ******************************************************************************** 2023-11-08T08:00:39,503 ############################ 2023-11-08T08:00:39,503 # Package would be ignored # 2023-11-08T08:00:39,504 ############################ 2023-11-08T08:00:39,504 Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1], 2023-11-08T08:00:39,505 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,506 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,507 package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added 2023-11-08T08:00:39,510 to the `packages` configuration field. 2023-11-08T08:00:39,515 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,518 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,522 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,524 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,531 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,535 If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are 2023-11-08T08:00:39,536 already explicitly excluding 'alpaca_eval.models_configs.gpt4' via 2023-11-08T08:00:39,537 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,538 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,539 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,550 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,551 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,555 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,556 even if it does not contain any `.py` files. 2023-11-08T08:00:39,559 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,563 directory, all directories are treated like packages. 2023-11-08T08:00:39,563 ******************************************************************************** 2023-11-08T08:00:39,564 !! 2023-11-08T08:00:39,570 check.warn(importable) 2023-11-08T08:00:39,575 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration. 2023-11-08T08:00:39,575 !! 2023-11-08T08:00:39,577 ******************************************************************************** 2023-11-08T08:00:39,577 ############################ 2023-11-08T08:00:39,578 # Package would be ignored # 2023-11-08T08:00:39,579 ############################ 2023-11-08T08:00:39,579 Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1], 2023-11-08T08:00:39,580 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,582 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,586 package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added 2023-11-08T08:00:39,590 to the `packages` configuration field. 2023-11-08T08:00:39,592 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,599 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,599 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,601 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,606 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,614 If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are 2023-11-08T08:00:39,615 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via 2023-11-08T08:00:39,616 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,623 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,623 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,628 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,635 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,640 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,641 even if it does not contain any `.py` files. 2023-11-08T08:00:39,643 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,646 directory, all directories are treated like packages. 2023-11-08T08:00:39,647 ******************************************************************************** 2023-11-08T08:00:39,655 !! 2023-11-08T08:00:39,656 check.warn(importable) 2023-11-08T08:00:39,656 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration. 2023-11-08T08:00:39,663 !! 2023-11-08T08:00:39,666 ******************************************************************************** 2023-11-08T08:00:39,671 ############################ 2023-11-08T08:00:39,671 # Package would be ignored # 2023-11-08T08:00:39,674 ############################ 2023-11-08T08:00:39,675 Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1], 2023-11-08T08:00:39,676 but it is absent from setuptools' `packages` configuration. 2023-11-08T08:00:39,678 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T08:00:39,678 package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added 2023-11-08T08:00:39,679 to the `packages` configuration field. 2023-11-08T08:00:39,683 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T08:00:39,686 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T08:00:39,687 instead of `find_packages(...)`/`find:`). 2023-11-08T08:00:39,690 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T08:00:39,699 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T08:00:39,700 If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are 2023-11-08T08:00:39,701 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via 2023-11-08T08:00:39,702 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T08:00:39,707 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T08:00:39,708 combination with a more fine grained `package-data` configuration. 2023-11-08T08:00:39,709 You can read more about "package data files" on setuptools documentation page: 2023-11-08T08:00:39,714 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T08:00:39,717 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T08:00:39,718 even if it does not contain any `.py` files. 2023-11-08T08:00:39,722 On the other hand, currently there is no concept of package data 2023-11-08T08:00:39,723 directory, all directories are treated like packages. 2023-11-08T08:00:39,724 ******************************************************************************** 2023-11-08T08:00:39,725 !! 2023-11-08T08:00:39,726 check.warn(importable) 2023-11-08T08:00:39,727 creating build/lib/alpaca_eval/evaluators_configs 2023-11-08T08:00:39,728 copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs 2023-11-08T08:00:39,729 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T08:00:39,730 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T08:00:39,731 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T08:00:39,731 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T08:00:39,732 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T08:00:39,733 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T08:00:39,734 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T08:00:39,735 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T08:00:39,736 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T08:00:39,739 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T08:00:39,746 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,747 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,750 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,751 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,752 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,753 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,754 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,755 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,756 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,756 copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,758 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,759 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,760 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,760 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:39,761 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T08:00:39,762 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T08:00:39,763 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T08:00:39,764 creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T08:00:39,765 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T08:00:39,766 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T08:00:39,766 creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T08:00:39,767 copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T08:00:39,768 creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T08:00:39,769 copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T08:00:39,770 creating build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T08:00:39,770 copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T08:00:39,771 copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T08:00:39,772 creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T08:00:39,774 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T08:00:39,775 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T08:00:39,776 creating build/lib/alpaca_eval/evaluators_configs/claude 2023-11-08T08:00:39,776 copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude 2023-11-08T08:00:39,777 copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude 2023-11-08T08:00:39,783 creating build/lib/alpaca_eval/evaluators_configs/claude_2 2023-11-08T08:00:39,783 copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2 2023-11-08T08:00:39,790 creating build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T08:00:39,791 copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T08:00:39,792 copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T08:00:39,793 creating build/lib/alpaca_eval/evaluators_configs/cohere 2023-11-08T08:00:39,794 copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere 2023-11-08T08:00:39,794 creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T08:00:39,795 copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T08:00:39,796 creating build/lib/alpaca_eval/evaluators_configs/gpt4 2023-11-08T08:00:39,803 copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4 2023-11-08T08:00:39,803 creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T08:00:39,810 copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T08:00:39,811 copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T08:00:39,812 creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T08:00:39,813 copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T08:00:39,813 creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T08:00:39,814 copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T08:00:39,815 creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T08:00:39,816 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T08:00:39,817 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T08:00:39,817 creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T08:00:39,818 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T08:00:39,819 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T08:00:39,819 creating build/lib/alpaca_eval/evaluators_configs/test 2023-11-08T08:00:39,820 copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test 2023-11-08T08:00:39,821 creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T08:00:39,822 copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T08:00:39,823 copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T08:00:39,824 creating build/lib/alpaca_eval/leaderboards 2023-11-08T08:00:39,824 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:39,825 copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:39,826 copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:39,827 copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:39,827 copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:39,828 creating build/lib/alpaca_eval/leaderboards/evaluators 2023-11-08T08:00:39,835 copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators 2023-11-08T08:00:39,839 creating build/lib/alpaca_eval/models_configs 2023-11-08T08:00:39,839 creating build/lib/alpaca_eval/models_configs/airoboros-33b 2023-11-08T08:00:39,840 copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-11-08T08:00:39,841 copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-11-08T08:00:39,841 creating build/lib/alpaca_eval/models_configs/airoboros-65b 2023-11-08T08:00:39,842 copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b 2023-11-08T08:00:39,847 creating build/lib/alpaca_eval/models_configs/alpaca-7b 2023-11-08T08:00:39,852 copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-11-08T08:00:39,853 copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-11-08T08:00:39,854 creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T08:00:39,855 copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T08:00:39,855 copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T08:00:39,856 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T08:00:39,857 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T08:00:39,858 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T08:00:39,859 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T08:00:39,859 creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T08:00:39,861 copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T08:00:39,862 copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T08:00:39,863 creating build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T08:00:39,867 copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T08:00:39,867 copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T08:00:39,868 creating build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T08:00:39,869 copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T08:00:39,870 creating build/lib/alpaca_eval/models_configs/bedrock_claude 2023-11-08T08:00:39,874 copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude 2023-11-08T08:00:39,875 creating build/lib/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T08:00:39,876 copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T08:00:39,882 creating build/lib/alpaca_eval/models_configs/causallm-14b 2023-11-08T08:00:39,883 copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b 2023-11-08T08:00:39,884 copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b 2023-11-08T08:00:39,884 creating build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T08:00:39,885 copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T08:00:39,886 copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T08:00:39,887 creating build/lib/alpaca_eval/models_configs/chatgpt 2023-11-08T08:00:39,887 copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt 2023-11-08T08:00:39,888 creating build/lib/alpaca_eval/models_configs/claude 2023-11-08T08:00:39,889 copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude 2023-11-08T08:00:39,890 copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude 2023-11-08T08:00:39,894 creating build/lib/alpaca_eval/models_configs/claude-2 2023-11-08T08:00:39,895 copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2 2023-11-08T08:00:39,896 creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T08:00:39,897 copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T08:00:39,897 creating build/lib/alpaca_eval/models_configs/cohere 2023-11-08T08:00:39,898 copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere 2023-11-08T08:00:39,899 copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere 2023-11-08T08:00:39,906 creating build/lib/alpaca_eval/models_configs/evo-7b 2023-11-08T08:00:39,907 copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b 2023-11-08T08:00:39,908 creating build/lib/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T08:00:39,909 copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T08:00:39,910 creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T08:00:39,910 copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T08:00:39,911 creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T08:00:39,912 copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T08:00:39,913 creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T08:00:39,914 copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T08:00:39,915 creating build/lib/alpaca_eval/models_configs/gpt4 2023-11-08T08:00:39,916 copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4 2023-11-08T08:00:39,917 copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4 2023-11-08T08:00:39,917 creating build/lib/alpaca_eval/models_configs/guanaco-13b 2023-11-08T08:00:39,918 copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b 2023-11-08T08:00:39,919 creating build/lib/alpaca_eval/models_configs/guanaco-33b 2023-11-08T08:00:39,919 copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b 2023-11-08T08:00:39,920 creating build/lib/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T08:00:39,921 copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T08:00:39,922 creating build/lib/alpaca_eval/models_configs/guanaco-65b 2023-11-08T08:00:39,922 copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b 2023-11-08T08:00:39,923 creating build/lib/alpaca_eval/models_configs/guanaco-7b 2023-11-08T08:00:39,924 copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-11-08T08:00:39,925 copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-11-08T08:00:39,926 creating build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T08:00:39,926 copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T08:00:39,927 copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T08:00:39,928 creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T08:00:39,929 copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T08:00:39,930 creating build/lib/alpaca_eval/models_configs/jina-chat 2023-11-08T08:00:39,931 copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat 2023-11-08T08:00:39,932 copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat 2023-11-08T08:00:39,933 creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T08:00:39,934 copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T08:00:39,934 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T08:00:39,935 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T08:00:39,936 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T08:00:39,937 creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T08:00:39,937 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T08:00:39,938 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T08:00:39,939 creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T08:00:39,940 copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T08:00:39,941 copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T08:00:39,942 creating build/lib/alpaca_eval/models_configs/minotaur-13b 2023-11-08T08:00:39,947 copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-11-08T08:00:39,947 copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-11-08T08:00:39,948 creating build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T08:00:39,949 copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T08:00:39,949 copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T08:00:39,950 creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T08:00:39,951 copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T08:00:39,952 creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T08:00:39,952 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T08:00:39,953 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T08:00:39,954 creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T08:00:39,954 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T08:00:39,955 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T08:00:39,955 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T08:00:39,966 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T08:00:39,967 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T08:00:39,968 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T08:00:39,974 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T08:00:39,975 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T08:00:39,982 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T08:00:39,986 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T08:00:39,987 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T08:00:39,988 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T08:00:39,989 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T08:00:39,989 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T08:00:39,990 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T08:00:39,991 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T08:00:39,992 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T08:00:39,993 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T08:00:39,994 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T08:00:39,995 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T08:00:39,995 creating build/lib/alpaca_eval/models_configs/openchat-13b 2023-11-08T08:00:39,996 copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-11-08T08:00:39,997 copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-11-08T08:00:39,998 creating build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T08:00:39,999 copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T08:00:40,000 creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T08:00:40,000 copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T08:00:40,001 creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T08:00:40,006 copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T08:00:40,011 creating build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T08:00:40,012 copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T08:00:40,018 creating build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T08:00:40,019 copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T08:00:40,026 creating build/lib/alpaca_eval/models_configs/platolm-7b 2023-11-08T08:00:40,028 copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b 2023-11-08T08:00:40,032 copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b 2023-11-08T08:00:40,042 creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T08:00:40,047 copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T08:00:40,051 creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T08:00:40,053 copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T08:00:40,062 creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T08:00:40,063 copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T08:00:40,069 creating build/lib/alpaca_eval/models_configs/text_davinci_001 2023-11-08T08:00:40,071 copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001 2023-11-08T08:00:40,083 creating build/lib/alpaca_eval/models_configs/text_davinci_003 2023-11-08T08:00:40,084 copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-11-08T08:00:40,088 copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-11-08T08:00:40,092 creating build/lib/alpaca_eval/models_configs/ultralm-13b 2023-11-08T08:00:40,096 copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-11-08T08:00:40,100 copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-11-08T08:00:40,104 creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T08:00:40,110 copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T08:00:40,115 copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T08:00:40,123 creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T08:00:40,126 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T08:00:40,129 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T08:00:40,133 creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T08:00:40,134 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T08:00:40,143 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T08:00:40,146 creating build/lib/alpaca_eval/models_configs/vicuna-13b 2023-11-08T08:00:40,155 copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b 2023-11-08T08:00:40,167 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T08:00:40,175 copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T08:00:40,185 creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T08:00:40,187 copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T08:00:40,191 creating build/lib/alpaca_eval/models_configs/vicuna-7b 2023-11-08T08:00:40,199 copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-11-08T08:00:40,212 copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-11-08T08:00:40,221 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T08:00:40,222 copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T08:00:40,231 creating build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T08:00:40,232 copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T08:00:40,237 copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T08:00:40,244 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T08:00:40,247 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T08:00:40,255 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T08:00:40,257 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T08:00:40,266 creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T08:00:40,267 copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T08:00:40,275 creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T08:00:40,277 copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T08:00:40,281 creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T08:00:40,283 copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T08:00:40,287 copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T08:00:40,295 creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T08:00:40,296 copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T08:00:40,300 copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T08:00:40,304 creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T08:00:40,306 copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T08:00:40,356 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-11-08T08:00:40,357 !! 2023-11-08T08:00:40,362 ******************************************************************************** 2023-11-08T08:00:40,365 Please avoid running ``setup.py`` directly. 2023-11-08T08:00:40,366 Instead, use pypa/build, pypa/installer or other 2023-11-08T08:00:40,368 standards-based tools. 2023-11-08T08:00:40,372 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-11-08T08:00:40,372 ******************************************************************************** 2023-11-08T08:00:40,374 !! 2023-11-08T08:00:40,375 self.initialize_options() 2023-11-08T08:00:40,411 installing to build/bdist.linux-armv7l/wheel 2023-11-08T08:00:40,412 running install 2023-11-08T08:00:40,448 running install_lib 2023-11-08T08:00:40,486 creating build/bdist.linux-armv7l 2023-11-08T08:00:40,489 creating build/bdist.linux-armv7l/wheel 2023-11-08T08:00:40,492 creating build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,494 copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,501 copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,503 copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,507 copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,511 copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,515 copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,522 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards 2023-11-08T08:00:40,527 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:40,529 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:40,533 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:40,542 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:40,545 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T08:00:40,549 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-11-08T08:00:40,550 copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-11-08T08:00:40,554 copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:40,566 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs 2023-11-08T08:00:40,572 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-11-08T08:00:40,573 copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-11-08T08:00:40,576 copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-11-08T08:00:40,579 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T08:00:40,580 copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T08:00:40,584 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T08:00:40,585 copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T08:00:40,589 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-11-08T08:00:40,592 copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-11-08T08:00:40,594 copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-11-08T08:00:40,604 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T08:00:40,605 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T08:00:40,609 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T08:00:40,611 copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T08:00:40,615 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-11-08T08:00:40,616 copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-11-08T08:00:40,620 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T08:00:40,622 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T08:00:40,625 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T08:00:40,627 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude 2023-11-08T08:00:40,629 copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude 2023-11-08T08:00:40,644 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-11-08T08:00:40,645 copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-11-08T08:00:40,652 copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-11-08T08:00:40,657 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T08:00:40,660 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T08:00:40,675 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T08:00:40,676 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T08:00:40,680 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T08:00:40,685 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-11-08T08:00:40,686 copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-11-08T08:00:40,695 copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-11-08T08:00:40,698 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T08:00:40,699 copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T08:00:40,702 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T08:00:40,704 copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T08:00:40,709 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-11-08T08:00:40,711 copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-11-08T08:00:40,716 copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-11-08T08:00:40,725 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b 2023-11-08T08:00:40,726 copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b 2023-11-08T08:00:40,729 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T08:00:40,730 copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T08:00:40,733 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T08:00:40,734 copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T08:00:40,737 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T08:00:40,739 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T08:00:40,742 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T08:00:40,743 copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T08:00:40,752 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T08:00:40,753 copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T08:00:40,756 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T08:00:40,763 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T08:00:40,772 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T08:00:40,775 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-11-08T08:00:40,776 copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-11-08T08:00:40,793 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T08:00:40,794 copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T08:00:40,797 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T08:00:40,798 copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T08:00:40,805 copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T08:00:40,811 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T08:00:40,823 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T08:00:40,826 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T08:00:40,828 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T08:00:40,830 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T08:00:40,841 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T08:00:40,850 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-11-08T08:00:40,852 copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-11-08T08:00:40,860 copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-11-08T08:00:40,865 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T08:00:40,866 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T08:00:40,868 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T08:00:40,871 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-11-08T08:00:40,872 copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-11-08T08:00:40,875 copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-11-08T08:00:40,878 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T08:00:40,882 copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T08:00:40,891 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T08:00:40,895 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T08:00:40,898 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T08:00:40,901 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-11-08T08:00:40,902 copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-11-08T08:00:40,905 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T08:00:40,906 copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T08:00:40,917 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T08:00:40,918 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T08:00:40,922 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T08:00:40,923 copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T08:00:40,926 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T08:00:40,931 copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T08:00:40,934 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T08:00:40,942 copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T08:00:40,945 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T08:00:40,946 copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T08:00:40,949 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T08:00:40,951 copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T08:00:40,953 copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T08:00:40,957 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T08:00:40,958 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T08:00:40,960 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T08:00:40,963 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T08:00:40,964 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T08:00:40,966 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T08:00:40,970 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2023-11-08T08:00:40,971 copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2023-11-08T08:00:40,974 copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2023-11-08T08:00:40,977 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T08:00:40,978 copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T08:00:40,981 copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T08:00:40,985 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T08:00:40,986 copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T08:00:40,990 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-11-08T08:00:40,991 copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-11-08T08:00:40,993 copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-11-08T08:00:40,996 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T08:00:40,997 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T08:00:41,000 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T08:00:41,002 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2023-11-08T08:00:41,003 copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2023-11-08T08:00:41,008 copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2023-11-08T08:00:41,011 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T08:00:41,013 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T08:00:41,016 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T08:00:41,017 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T08:00:41,020 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T08:00:41,022 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-11-08T08:00:41,023 copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-11-08T08:00:41,026 copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-11-08T08:00:41,028 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T08:00:41,030 copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T08:00:41,032 copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T08:00:41,035 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T08:00:41,037 copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T08:00:41,040 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T08:00:41,041 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T08:00:41,044 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T08:00:41,046 copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T08:00:41,049 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-11-08T08:00:41,050 copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-11-08T08:00:41,053 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T08:00:41,054 copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T08:00:41,057 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T08:00:41,058 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T08:00:41,061 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T08:00:41,064 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T08:00:41,065 copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T08:00:41,069 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T08:00:41,070 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T08:00:41,073 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T08:00:41,076 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T08:00:41,077 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T08:00:41,080 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T08:00:41,084 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-11-08T08:00:41,086 copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-11-08T08:00:41,095 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-11-08T08:00:41,096 copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-11-08T08:00:41,100 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T08:00:41,101 copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T08:00:41,104 copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T08:00:41,107 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-11-08T08:00:41,108 copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-11-08T08:00:41,111 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-11-08T08:00:41,113 copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-11-08T08:00:41,115 copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-11-08T08:00:41,118 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T08:00:41,119 copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T08:00:41,122 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T08:00:41,124 copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T08:00:41,127 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T08:00:41,128 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T08:00:41,131 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T08:00:41,134 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-11-08T08:00:41,135 copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-11-08T08:00:41,138 copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-11-08T08:00:41,141 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-11-08T08:00:41,142 copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-11-08T08:00:41,145 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T08:00:41,147 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T08:00:41,149 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T08:00:41,152 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T08:00:41,154 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T08:00:41,156 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T08:00:41,159 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T08:00:41,160 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T08:00:41,163 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T08:00:41,165 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-11-08T08:00:41,166 copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-11-08T08:00:41,169 copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-11-08T08:00:41,172 creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T08:00:41,173 copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T08:00:41,176 copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T08:00:41,179 copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T08:00:41,183 creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,184 copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,187 copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,189 copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,191 copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,194 copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,196 copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,198 copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,201 copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,204 copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,208 copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T08:00:41,212 copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:41,215 copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:41,218 copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T08:00:41,224 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-11-08T08:00:41,226 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-11-08T08:00:41,228 copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-11-08T08:00:41,232 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T08:00:41,234 copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T08:00:41,238 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T08:00:41,240 copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T08:00:41,244 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T08:00:41,246 copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T08:00:41,250 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-11-08T08:00:41,251 copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-11-08T08:00:41,255 copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-11-08T08:00:41,259 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T08:00:41,261 copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T08:00:41,266 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T08:00:41,268 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T08:00:41,273 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T08:00:41,277 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T08:00:41,279 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T08:00:41,283 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-11-08T08:00:41,285 copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-11-08T08:00:41,290 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-11-08T08:00:41,292 copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-11-08T08:00:41,304 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T08:00:41,305 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T08:00:41,308 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T08:00:41,312 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T08:00:41,313 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T08:00:41,317 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T08:00:41,321 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,323 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,326 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,330 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,333 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,337 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,340 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,344 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,348 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,351 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,355 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,358 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,362 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,366 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T08:00:41,370 copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-11-08T08:00:41,375 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T08:00:41,387 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T08:00:41,392 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T08:00:41,399 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T08:00:41,401 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T08:00:41,408 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T08:00:41,412 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T08:00:41,414 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T08:00:41,418 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T08:00:41,422 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T08:00:41,424 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T08:00:41,427 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T08:00:41,431 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T08:00:41,433 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T08:00:41,437 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T08:00:41,439 copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T08:00:41,443 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T08:00:41,445 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T08:00:41,448 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T08:00:41,452 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T08:00:41,454 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T08:00:41,458 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T08:00:41,461 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T08:00:41,462 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T08:00:41,465 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T08:00:41,470 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-11-08T08:00:41,471 copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-11-08T08:00:41,475 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T08:00:41,476 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T08:00:41,479 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T08:00:41,482 running install_egg_info 2023-11-08T08:00:41,531 Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.3.2-py3.11.egg-info 2023-11-08T08:00:41,555 running install_scripts 2023-11-08T08:00:41,615 creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.3.2.dist-info/WHEEL 2023-11-08T08:00:41,619 creating '/tmp/pip-wheel-hklqz8l8/alpaca_eval-0.3.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-11-08T08:00:41,621 adding 'alpaca_eval/__init__.py' 2023-11-08T08:00:41,624 adding 'alpaca_eval/analyze.py' 2023-11-08T08:00:41,626 adding 'alpaca_eval/completion_parsers.py' 2023-11-08T08:00:41,628 adding 'alpaca_eval/constants.py' 2023-11-08T08:00:41,631 adding 'alpaca_eval/main.py' 2023-11-08T08:00:41,632 adding 'alpaca_eval/metrics.py' 2023-11-08T08:00:41,635 adding 'alpaca_eval/plotting.py' 2023-11-08T08:00:41,637 adding 'alpaca_eval/processors.py' 2023-11-08T08:00:41,639 adding 'alpaca_eval/types.py' 2023-11-08T08:00:41,642 adding 'alpaca_eval/utils.py' 2023-11-08T08:00:41,644 adding 'alpaca_eval/annotators/__init__.py' 2023-11-08T08:00:41,647 adding 'alpaca_eval/annotators/base.py' 2023-11-08T08:00:41,650 adding 'alpaca_eval/annotators/pairwise_evaluator.py' 2023-11-08T08:00:41,652 adding 'alpaca_eval/decoders/__init__.py' 2023-11-08T08:00:41,654 adding 'alpaca_eval/decoders/anthropic.py' 2023-11-08T08:00:41,655 adding 'alpaca_eval/decoders/bedrock_anthropic.py' 2023-11-08T08:00:41,657 adding 'alpaca_eval/decoders/cohere.py' 2023-11-08T08:00:41,659 adding 'alpaca_eval/decoders/huggingface_api.py' 2023-11-08T08:00:41,661 adding 'alpaca_eval/decoders/huggingface_local.py' 2023-11-08T08:00:41,662 adding 'alpaca_eval/decoders/jinachat.py' 2023-11-08T08:00:41,665 adding 'alpaca_eval/decoders/openai.py' 2023-11-08T08:00:41,667 adding 'alpaca_eval/decoders/replicate.py' 2023-11-08T08:00:41,669 adding 'alpaca_eval/decoders/vllm_local.py' 2023-11-08T08:00:41,672 adding 'alpaca_eval/evaluators_configs/README.md' 2023-11-08T08:00:41,674 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt' 2023-11-08T08:00:41,676 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml' 2023-11-08T08:00:41,678 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml' 2023-11-08T08:00:41,680 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml' 2023-11-08T08:00:41,681 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt' 2023-11-08T08:00:41,683 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml' 2023-11-08T08:00:41,685 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt' 2023-11-08T08:00:41,686 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt' 2023-11-08T08:00:41,687 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt' 2023-11-08T08:00:41,689 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt' 2023-11-08T08:00:41,690 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt' 2023-11-08T08:00:41,692 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt' 2023-11-08T08:00:41,693 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt' 2023-11-08T08:00:41,695 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt' 2023-11-08T08:00:41,696 adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml' 2023-11-08T08:00:41,697 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt' 2023-11-08T08:00:41,699 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt' 2023-11-08T08:00:41,700 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt' 2023-11-08T08:00:41,702 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt' 2023-11-08T08:00:41,704 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt' 2023-11-08T08:00:41,705 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml' 2023-11-08T08:00:41,706 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt' 2023-11-08T08:00:41,708 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml' 2023-11-08T08:00:41,709 adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml' 2023-11-08T08:00:41,711 adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml' 2023-11-08T08:00:41,712 adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt' 2023-11-08T08:00:41,714 adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml' 2023-11-08T08:00:41,715 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt' 2023-11-08T08:00:41,716 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml' 2023-11-08T08:00:41,718 adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt' 2023-11-08T08:00:41,719 adding 'alpaca_eval/evaluators_configs/claude/configs.yaml' 2023-11-08T08:00:41,721 adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml' 2023-11-08T08:00:41,722 adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml' 2023-11-08T08:00:41,724 adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt' 2023-11-08T08:00:41,725 adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml' 2023-11-08T08:00:41,727 adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml' 2023-11-08T08:00:41,729 adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml' 2023-11-08T08:00:41,731 adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt' 2023-11-08T08:00:41,732 adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml' 2023-11-08T08:00:41,733 adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml' 2023-11-08T08:00:41,735 adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml' 2023-11-08T08:00:41,737 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml' 2023-11-08T08:00:41,738 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt' 2023-11-08T08:00:41,740 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt' 2023-11-08T08:00:41,741 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml' 2023-11-08T08:00:41,743 adding 'alpaca_eval/evaluators_configs/test/configs.yaml' 2023-11-08T08:00:41,744 adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt' 2023-11-08T08:00:41,745 adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml' 2023-11-08T08:00:41,748 adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv' 2023-11-08T08:00:41,749 adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv' 2023-11-08T08:00:41,750 adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv' 2023-11-08T08:00:41,751 adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv' 2023-11-08T08:00:41,753 adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv' 2023-11-08T08:00:41,756 adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml' 2023-11-08T08:00:41,757 adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt' 2023-11-08T08:00:41,759 adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml' 2023-11-08T08:00:41,760 adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml' 2023-11-08T08:00:41,762 adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt' 2023-11-08T08:00:41,763 adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml' 2023-11-08T08:00:41,764 adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt' 2023-11-08T08:00:41,766 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml' 2023-11-08T08:00:41,768 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml' 2023-11-08T08:00:41,769 adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml' 2023-11-08T08:00:41,770 adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt' 2023-11-08T08:00:41,772 adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml' 2023-11-08T08:00:41,773 adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt' 2023-11-08T08:00:41,775 adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml' 2023-11-08T08:00:41,776 adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml' 2023-11-08T08:00:41,778 adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml' 2023-11-08T08:00:41,780 adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml' 2023-11-08T08:00:41,781 adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt' 2023-11-08T08:00:41,782 adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml' 2023-11-08T08:00:41,783 adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt' 2023-11-08T08:00:41,785 adding 'alpaca_eval/models_configs/chatgpt/configs.yaml' 2023-11-08T08:00:41,786 adding 'alpaca_eval/models_configs/claude/configs.yaml' 2023-11-08T08:00:41,787 adding 'alpaca_eval/models_configs/claude/prompt.txt' 2023-11-08T08:00:41,789 adding 'alpaca_eval/models_configs/claude-2/configs.yaml' 2023-11-08T08:00:41,791 adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml' 2023-11-08T08:00:41,792 adding 'alpaca_eval/models_configs/cohere/configs.yaml' 2023-11-08T08:00:41,793 adding 'alpaca_eval/models_configs/cohere/prompt.txt' 2023-11-08T08:00:41,795 adding 'alpaca_eval/models_configs/evo-7b/configs.yaml' 2023-11-08T08:00:41,797 adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml' 2023-11-08T08:00:41,798 adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml' 2023-11-08T08:00:41,800 adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml' 2023-11-08T08:00:41,801 adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml' 2023-11-08T08:00:41,803 adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt' 2023-11-08T08:00:41,804 adding 'alpaca_eval/models_configs/gpt4/configs.yaml' 2023-11-08T08:00:41,806 adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml' 2023-11-08T08:00:41,808 adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml' 2023-11-08T08:00:41,809 adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml' 2023-11-08T08:00:41,811 adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml' 2023-11-08T08:00:41,813 adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml' 2023-11-08T08:00:41,814 adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt' 2023-11-08T08:00:41,815 adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml' 2023-11-08T08:00:41,816 adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt' 2023-11-08T08:00:41,818 adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml' 2023-11-08T08:00:41,819 adding 'alpaca_eval/models_configs/jina-chat/configs.yaml' 2023-11-08T08:00:41,820 adding 'alpaca_eval/models_configs/jina-chat/prompt.txt' 2023-11-08T08:00:41,822 adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml' 2023-11-08T08:00:41,823 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml' 2023-11-08T08:00:41,825 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt' 2023-11-08T08:00:41,826 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml' 2023-11-08T08:00:41,827 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt' 2023-11-08T08:00:41,829 adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml' 2023-11-08T08:00:41,830 adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt' 2023-11-08T08:00:41,831 adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml' 2023-11-08T08:00:41,833 adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt' 2023-11-08T08:00:41,834 adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml' 2023-11-08T08:00:41,835 adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt' 2023-11-08T08:00:41,837 adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml' 2023-11-08T08:00:41,839 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml' 2023-11-08T08:00:41,840 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt' 2023-11-08T08:00:41,841 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml' 2023-11-08T08:00:41,843 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt' 2023-11-08T08:00:41,844 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml' 2023-11-08T08:00:41,845 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt' 2023-11-08T08:00:41,847 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml' 2023-11-08T08:00:41,848 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt' 2023-11-08T08:00:41,850 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml' 2023-11-08T08:00:41,851 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt' 2023-11-08T08:00:41,853 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml' 2023-11-08T08:00:41,854 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt' 2023-11-08T08:00:41,856 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml' 2023-11-08T08:00:41,857 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt' 2023-11-08T08:00:41,858 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml' 2023-11-08T08:00:41,860 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt' 2023-11-08T08:00:41,861 adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml' 2023-11-08T08:00:41,862 adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt' 2023-11-08T08:00:41,864 adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml' 2023-11-08T08:00:41,866 adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml' 2023-11-08T08:00:41,867 adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml' 2023-11-08T08:00:41,869 adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml' 2023-11-08T08:00:41,871 adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml' 2023-11-08T08:00:41,872 adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml' 2023-11-08T08:00:41,873 adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt' 2023-11-08T08:00:41,875 adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml' 2023-11-08T08:00:41,877 adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml' 2023-11-08T08:00:41,878 adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml' 2023-11-08T08:00:41,880 adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml' 2023-11-08T08:00:41,881 adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml' 2023-11-08T08:00:41,882 adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt' 2023-11-08T08:00:41,884 adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml' 2023-11-08T08:00:41,885 adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt' 2023-11-08T08:00:41,886 adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml' 2023-11-08T08:00:41,887 adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt' 2023-11-08T08:00:41,889 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml' 2023-11-08T08:00:41,890 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt' 2023-11-08T08:00:41,892 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml' 2023-11-08T08:00:41,893 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt' 2023-11-08T08:00:41,894 adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml' 2023-11-08T08:00:41,899 adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml' 2023-11-08T08:00:41,900 adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml' 2023-11-08T08:00:41,902 adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml' 2023-11-08T08:00:41,903 adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt' 2023-11-08T08:00:41,904 adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml' 2023-11-08T08:00:41,906 adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml' 2023-11-08T08:00:41,907 adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt' 2023-11-08T08:00:41,909 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml' 2023-11-08T08:00:41,910 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml' 2023-11-08T08:00:41,912 adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml' 2023-11-08T08:00:41,913 adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml' 2023-11-08T08:00:41,915 adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml' 2023-11-08T08:00:41,916 adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt' 2023-11-08T08:00:41,917 adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml' 2023-11-08T08:00:41,919 adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt' 2023-11-08T08:00:41,920 adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml' 2023-11-08T08:00:41,923 adding 'alpaca_eval-0.3.2.dist-info/LICENSE' 2023-11-08T08:00:41,933 adding 'alpaca_eval-0.3.2.dist-info/METADATA' 2023-11-08T08:00:41,934 adding 'alpaca_eval-0.3.2.dist-info/WHEEL' 2023-11-08T08:00:41,935 adding 'alpaca_eval-0.3.2.dist-info/entry_points.txt' 2023-11-08T08:00:41,936 adding 'alpaca_eval-0.3.2.dist-info/top_level.txt' 2023-11-08T08:00:41,939 adding 'alpaca_eval-0.3.2.dist-info/RECORD' 2023-11-08T08:00:41,944 removing build/bdist.linux-armv7l/wheel 2023-11-08T08:00:42,142 Building wheel for alpaca-eval (setup.py): finished with status 'done' 2023-11-08T08:00:42,148 Created wheel for alpaca-eval: filename=alpaca_eval-0.3.2-py3-none-any.whl size=187592 sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 2023-11-08T08:00:42,149 Stored in directory: /tmp/pip-ephem-wheel-cache-j0jbcisl/wheels/c8/36/25/7f694bc15d6f0cedf3a35e0c74885a98a58b36848bad85487a 2023-11-08T08:00:42,178 Successfully built alpaca-eval 2023-11-08T08:00:42,186 Removed build tracker: '/tmp/pip-build-tracker-pq_55pdn'