2023-11-08T09:28:54,683 Created temporary directory: /tmp/pip-build-tracker-318v1l1x 2023-11-08T09:28:54,684 Initialized build tracking at /tmp/pip-build-tracker-318v1l1x 2023-11-08T09:28:54,684 Created build tracker: /tmp/pip-build-tracker-318v1l1x 2023-11-08T09:28:54,685 Entered build tracker: /tmp/pip-build-tracker-318v1l1x 2023-11-08T09:28:54,686 Created temporary directory: /tmp/pip-wheel-dghz_3nv 2023-11-08T09:28:54,689 Created temporary directory: /tmp/pip-ephem-wheel-cache-rwmu2vnp 2023-11-08T09:28:54,710 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-08T09:28:54,714 2 location(s) to search for versions of alpaca-eval: 2023-11-08T09:28:54,714 * https://pypi.org/simple/alpaca-eval/ 2023-11-08T09:28:54,714 * https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T09:28:54,715 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/ 2023-11-08T09:28:54,716 Getting page https://pypi.org/simple/alpaca-eval/ 2023-11-08T09:28:54,717 Found index url https://pypi.org/simple/ 2023-11-08T09:28:54,936 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json 2023-11-08T09:28:54,944 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T09:28:54,945 Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0 2023-11-08T09:28:54,946 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T09:28:54,947 Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1 2023-11-08T09:28:54,948 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T09:28:54,949 Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2 2023-11-08T09:28:54,949 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,951 Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3 2023-11-08T09:28:54,951 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,952 Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5 2023-11-08T09:28:54,953 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,954 Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6 2023-11-08T09:28:54,955 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,955 Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7 2023-11-08T09:28:54,956 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,957 Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8 2023-11-08T09:28:54,957 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,958 Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0 2023-11-08T09:28:54,959 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,960 Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1 2023-11-08T09:28:54,960 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,961 Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2 2023-11-08T09:28:54,962 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,963 Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3 2023-11-08T09:28:54,964 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,964 Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4 2023-11-08T09:28:54,965 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,966 Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5 2023-11-08T09:28:54,967 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,968 Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6 2023-11-08T09:28:54,968 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,969 Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7 2023-11-08T09:28:54,969 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,970 Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8 2023-11-08T09:28:54,971 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,972 Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9 2023-11-08T09:28:54,972 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,973 Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0 2023-11-08T09:28:54,974 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,975 Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1 2023-11-08T09:28:54,975 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,976 Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2 2023-11-08T09:28:54,977 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:54,978 Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3 2023-11-08T09:28:54,979 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T09:28:54,979 Getting page https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T09:28:54,980 Found index url https://www.piwheels.org/simple/ 2023-11-08T09:28:55,155 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html 2023-11-08T09:28:55,160 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,161 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,162 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,162 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,163 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,163 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,164 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,165 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,165 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,166 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,166 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,167 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,168 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,168 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-11-08T09:28:55,169 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T09:28:55,169 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T09:28:55,170 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-11-08T09:28:55,170 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/ 2023-11-08T09:28:55,171 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/ 2023-11-08T09:28:55,193 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates 2023-11-08T09:28:55,213 Collecting alpaca-eval==0.3.3 2023-11-08T09:28:55,215 Created temporary directory: /tmp/pip-unpack-wsckoo3i 2023-11-08T09:28:55,750 Downloading alpaca_eval-0.3.3.tar.gz (306 kB) 2023-11-08T09:28:56,308 Added alpaca-eval==0.3.3 from https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz to build tracker '/tmp/pip-build-tracker-318v1l1x' 2023-11-08T09:28:56,310 Running setup.py (path:/tmp/pip-wheel-dghz_3nv/alpaca-eval_28563a04df564dec82f50e6e9b882288/setup.py) egg_info for package alpaca-eval 2023-11-08T09:28:56,311 Created temporary directory: /tmp/pip-pip-egg-info-3em2swbw 2023-11-08T09:28:56,311 Preparing metadata (setup.py): started 2023-11-08T09:28:56,313 Running command python setup.py egg_info 2023-11-08T09:28:57,356 running egg_info 2023-11-08T09:28:57,358 creating /tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info 2023-11-08T09:28:57,382 writing /tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/PKG-INFO 2023-11-08T09:28:57,401 writing dependency_links to /tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/dependency_links.txt 2023-11-08T09:28:57,402 writing entry points to /tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/entry_points.txt 2023-11-08T09:28:57,411 writing requirements to /tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/requires.txt 2023-11-08T09:28:57,412 writing top-level names to /tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/top_level.txt 2023-11-08T09:28:57,413 writing manifest file '/tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T09:28:57,490 reading manifest file '/tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T09:28:57,492 reading manifest template 'MANIFEST.in' 2023-11-08T09:28:57,605 adding license file 'LICENSE' 2023-11-08T09:28:57,613 writing manifest file '/tmp/pip-pip-egg-info-3em2swbw/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T09:28:57,722 Preparing metadata (setup.py): finished with status 'done' 2023-11-08T09:28:57,730 Source in /tmp/pip-wheel-dghz_3nv/alpaca-eval_28563a04df564dec82f50e6e9b882288 has version 0.3.3, which satisfies requirement alpaca-eval==0.3.3 from https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz 2023-11-08T09:28:57,731 Removed alpaca-eval==0.3.3 from https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz from build tracker '/tmp/pip-build-tracker-318v1l1x' 2023-11-08T09:28:57,745 Created temporary directory: /tmp/pip-unpack-q31mlbwz 2023-11-08T09:28:57,746 Created temporary directory: /tmp/pip-unpack-8sqyoh69 2023-11-08T09:28:57,881 Building wheels for collected packages: alpaca-eval 2023-11-08T09:28:57,885 Created temporary directory: /tmp/pip-wheel-apd8zh5r 2023-11-08T09:28:57,886 Building wheel for alpaca-eval (setup.py): started 2023-11-08T09:28:57,887 Destination directory: /tmp/pip-wheel-apd8zh5r 2023-11-08T09:28:57,887 Running command python setup.py bdist_wheel 2023-11-08T09:28:58,886 running bdist_wheel 2023-11-08T09:28:58,978 running build 2023-11-08T09:28:58,979 running build_py 2023-11-08T09:28:59,005 creating build 2023-11-08T09:28:59,006 creating build/lib 2023-11-08T09:28:59,006 creating build/lib/alpaca_eval 2023-11-08T09:28:59,007 copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,010 copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,012 copying src/alpaca_eval/types.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,013 copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,015 copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,017 copying src/alpaca_eval/main.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,020 copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,022 copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,025 copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,027 copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval 2023-11-08T09:28:59,030 creating build/lib/alpaca_eval/annotators 2023-11-08T09:28:59,031 copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators 2023-11-08T09:28:59,034 copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators 2023-11-08T09:28:59,035 copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators 2023-11-08T09:28:59,039 creating build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,040 copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,042 copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,044 copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,045 copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,048 copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,049 copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,051 copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,053 copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,055 copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,057 copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders 2023-11-08T09:28:59,059 running egg_info 2023-11-08T09:28:59,113 writing src/alpaca_eval.egg-info/PKG-INFO 2023-11-08T09:28:59,133 writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt 2023-11-08T09:28:59,134 writing entry points to src/alpaca_eval.egg-info/entry_points.txt 2023-11-08T09:28:59,143 writing requirements to src/alpaca_eval.egg-info/requires.txt 2023-11-08T09:28:59,144 writing top-level names to src/alpaca_eval.egg-info/top_level.txt 2023-11-08T09:28:59,172 reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T09:28:59,178 reading manifest template 'MANIFEST.in' 2023-11-08T09:28:59,271 adding license file 'LICENSE' 2023-11-08T09:28:59,281 writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-11-08T09:28:59,284 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration. 2023-11-08T09:28:59,284 !! 2023-11-08T09:28:59,285 ******************************************************************************** 2023-11-08T09:28:59,286 ############################ 2023-11-08T09:28:59,286 # Package would be ignored # 2023-11-08T09:28:59,287 ############################ 2023-11-08T09:28:59,287 Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1], 2023-11-08T09:28:59,288 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,289 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,289 package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added 2023-11-08T09:28:59,290 to the `packages` configuration field. 2023-11-08T09:28:59,291 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,292 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,292 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,294 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,295 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,296 If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are 2023-11-08T09:28:59,296 already explicitly excluding 'alpaca_eval.evaluators_configs' via 2023-11-08T09:28:59,297 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,298 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,298 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,299 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,300 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,301 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,302 even if it does not contain any `.py` files. 2023-11-08T09:28:59,302 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,303 directory, all directories are treated like packages. 2023-11-08T09:28:59,303 ******************************************************************************** 2023-11-08T09:28:59,304 !! 2023-11-08T09:28:59,305 check.warn(importable) 2023-11-08T09:28:59,305 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,306 !! 2023-11-08T09:28:59,307 ******************************************************************************** 2023-11-08T09:28:59,307 ############################ 2023-11-08T09:28:59,308 # Package would be ignored # 2023-11-08T09:28:59,308 ############################ 2023-11-08T09:28:59,309 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1], 2023-11-08T09:28:59,309 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,309 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,310 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added 2023-11-08T09:28:59,310 to the `packages` configuration field. 2023-11-08T09:28:59,311 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,311 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,312 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,312 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,313 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,314 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are 2023-11-08T09:28:59,314 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via 2023-11-08T09:28:59,314 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,315 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,315 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,316 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,317 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,319 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,320 even if it does not contain any `.py` files. 2023-11-08T09:28:59,320 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,321 directory, all directories are treated like packages. 2023-11-08T09:28:59,321 ******************************************************************************** 2023-11-08T09:28:59,322 !! 2023-11-08T09:28:59,323 check.warn(importable) 2023-11-08T09:28:59,323 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration. 2023-11-08T09:28:59,324 !! 2023-11-08T09:28:59,325 ******************************************************************************** 2023-11-08T09:28:59,325 ############################ 2023-11-08T09:28:59,325 # Package would be ignored # 2023-11-08T09:28:59,326 ############################ 2023-11-08T09:28:59,326 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1], 2023-11-08T09:28:59,327 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,328 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,328 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added 2023-11-08T09:28:59,329 to the `packages` configuration field. 2023-11-08T09:28:59,330 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,331 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,332 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,333 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,333 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are 2023-11-08T09:28:59,334 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via 2023-11-08T09:28:59,334 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,334 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,335 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,335 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,336 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,337 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,337 even if it does not contain any `.py` files. 2023-11-08T09:28:59,338 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,338 directory, all directories are treated like packages. 2023-11-08T09:28:59,338 ******************************************************************************** 2023-11-08T09:28:59,339 !! 2023-11-08T09:28:59,344 check.warn(importable) 2023-11-08T09:28:59,344 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration. 2023-11-08T09:28:59,345 !! 2023-11-08T09:28:59,346 ******************************************************************************** 2023-11-08T09:28:59,346 ############################ 2023-11-08T09:28:59,347 # Package would be ignored # 2023-11-08T09:28:59,348 ############################ 2023-11-08T09:28:59,348 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1], 2023-11-08T09:28:59,349 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,350 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,350 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added 2023-11-08T09:28:59,351 to the `packages` configuration field. 2023-11-08T09:28:59,352 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,352 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,353 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,353 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,354 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,355 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are 2023-11-08T09:28:59,356 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via 2023-11-08T09:28:59,356 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,357 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,357 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,358 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,359 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,361 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,361 even if it does not contain any `.py` files. 2023-11-08T09:28:59,361 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,362 directory, all directories are treated like packages. 2023-11-08T09:28:59,362 ******************************************************************************** 2023-11-08T09:28:59,363 !! 2023-11-08T09:28:59,363 check.warn(importable) 2023-11-08T09:28:59,363 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration. 2023-11-08T09:28:59,364 !! 2023-11-08T09:28:59,364 ******************************************************************************** 2023-11-08T09:28:59,365 ############################ 2023-11-08T09:28:59,365 # Package would be ignored # 2023-11-08T09:28:59,365 ############################ 2023-11-08T09:28:59,366 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1], 2023-11-08T09:28:59,366 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,367 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,367 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added 2023-11-08T09:28:59,367 to the `packages` configuration field. 2023-11-08T09:28:59,368 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,369 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,369 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,370 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,371 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,372 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are 2023-11-08T09:28:59,373 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via 2023-11-08T09:28:59,373 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,374 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,375 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,376 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,377 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,378 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,379 even if it does not contain any `.py` files. 2023-11-08T09:28:59,379 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,380 directory, all directories are treated like packages. 2023-11-08T09:28:59,380 ******************************************************************************** 2023-11-08T09:28:59,381 !! 2023-11-08T09:28:59,381 check.warn(importable) 2023-11-08T09:28:59,382 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration. 2023-11-08T09:28:59,382 !! 2023-11-08T09:28:59,384 ******************************************************************************** 2023-11-08T09:28:59,384 ############################ 2023-11-08T09:28:59,385 # Package would be ignored # 2023-11-08T09:28:59,385 ############################ 2023-11-08T09:28:59,386 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1], 2023-11-08T09:28:59,386 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,387 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,387 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added 2023-11-08T09:28:59,388 to the `packages` configuration field. 2023-11-08T09:28:59,388 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,389 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,389 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,390 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,390 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,391 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are 2023-11-08T09:28:59,391 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via 2023-11-08T09:28:59,392 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,392 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,392 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,393 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,394 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,395 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,396 even if it does not contain any `.py` files. 2023-11-08T09:28:59,396 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,397 directory, all directories are treated like packages. 2023-11-08T09:28:59,397 ******************************************************************************** 2023-11-08T09:28:59,398 !! 2023-11-08T09:28:59,399 check.warn(importable) 2023-11-08T09:28:59,399 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,400 !! 2023-11-08T09:28:59,401 ******************************************************************************** 2023-11-08T09:28:59,401 ############################ 2023-11-08T09:28:59,402 # Package would be ignored # 2023-11-08T09:28:59,402 ############################ 2023-11-08T09:28:59,403 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1], 2023-11-08T09:28:59,403 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,404 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,405 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added 2023-11-08T09:28:59,405 to the `packages` configuration field. 2023-11-08T09:28:59,406 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,407 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,407 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,408 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,409 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,411 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are 2023-11-08T09:28:59,411 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via 2023-11-08T09:28:59,411 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,412 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,412 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,413 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,413 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,414 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,415 even if it does not contain any `.py` files. 2023-11-08T09:28:59,415 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,415 directory, all directories are treated like packages. 2023-11-08T09:28:59,416 ******************************************************************************** 2023-11-08T09:28:59,416 !! 2023-11-08T09:28:59,417 check.warn(importable) 2023-11-08T09:28:59,417 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,417 !! 2023-11-08T09:28:59,418 ******************************************************************************** 2023-11-08T09:28:59,418 ############################ 2023-11-08T09:28:59,419 # Package would be ignored # 2023-11-08T09:28:59,419 ############################ 2023-11-08T09:28:59,420 Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1], 2023-11-08T09:28:59,420 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,422 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,422 package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added 2023-11-08T09:28:59,423 to the `packages` configuration field. 2023-11-08T09:28:59,424 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,424 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,425 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,426 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,427 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,428 If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are 2023-11-08T09:28:59,428 already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via 2023-11-08T09:28:59,429 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,429 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,430 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,430 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,431 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,433 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,433 even if it does not contain any `.py` files. 2023-11-08T09:28:59,434 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,434 directory, all directories are treated like packages. 2023-11-08T09:28:59,435 ******************************************************************************** 2023-11-08T09:28:59,436 !! 2023-11-08T09:28:59,436 check.warn(importable) 2023-11-08T09:28:59,437 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration. 2023-11-08T09:28:59,437 !! 2023-11-08T09:28:59,438 ******************************************************************************** 2023-11-08T09:28:59,438 ############################ 2023-11-08T09:28:59,438 # Package would be ignored # 2023-11-08T09:28:59,439 ############################ 2023-11-08T09:28:59,439 Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1], 2023-11-08T09:28:59,439 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,440 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,440 package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added 2023-11-08T09:28:59,441 to the `packages` configuration field. 2023-11-08T09:28:59,441 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,442 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,442 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,443 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,444 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,445 If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are 2023-11-08T09:28:59,446 already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via 2023-11-08T09:28:59,446 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,447 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,447 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,449 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,450 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,451 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,452 even if it does not contain any `.py` files. 2023-11-08T09:28:59,452 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,453 directory, all directories are treated like packages. 2023-11-08T09:28:59,453 ******************************************************************************** 2023-11-08T09:28:59,454 !! 2023-11-08T09:28:59,455 check.warn(importable) 2023-11-08T09:28:59,455 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration. 2023-11-08T09:28:59,456 !! 2023-11-08T09:28:59,456 ******************************************************************************** 2023-11-08T09:28:59,457 ############################ 2023-11-08T09:28:59,457 # Package would be ignored # 2023-11-08T09:28:59,458 ############################ 2023-11-08T09:28:59,458 Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1], 2023-11-08T09:28:59,459 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,460 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,460 package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added 2023-11-08T09:28:59,461 to the `packages` configuration field. 2023-11-08T09:28:59,462 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,462 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,463 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,463 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,464 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,465 If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are 2023-11-08T09:28:59,465 already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via 2023-11-08T09:28:59,465 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,466 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,466 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,467 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,467 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,468 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,469 even if it does not contain any `.py` files. 2023-11-08T09:28:59,469 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,469 directory, all directories are treated like packages. 2023-11-08T09:28:59,470 ******************************************************************************** 2023-11-08T09:28:59,471 !! 2023-11-08T09:28:59,471 check.warn(importable) 2023-11-08T09:28:59,472 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration. 2023-11-08T09:28:59,473 !! 2023-11-08T09:28:59,474 ******************************************************************************** 2023-11-08T09:28:59,474 ############################ 2023-11-08T09:28:59,475 # Package would be ignored # 2023-11-08T09:28:59,476 ############################ 2023-11-08T09:28:59,476 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1], 2023-11-08T09:28:59,477 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,478 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,479 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added 2023-11-08T09:28:59,479 to the `packages` configuration field. 2023-11-08T09:28:59,480 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,481 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,481 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,483 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,484 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,485 If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are 2023-11-08T09:28:59,486 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via 2023-11-08T09:28:59,486 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,487 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,487 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,488 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,489 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,490 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,490 even if it does not contain any `.py` files. 2023-11-08T09:28:59,491 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,491 directory, all directories are treated like packages. 2023-11-08T09:28:59,491 ******************************************************************************** 2023-11-08T09:28:59,492 !! 2023-11-08T09:28:59,492 check.warn(importable) 2023-11-08T09:28:59,493 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration. 2023-11-08T09:28:59,493 !! 2023-11-08T09:28:59,494 ******************************************************************************** 2023-11-08T09:28:59,494 ############################ 2023-11-08T09:28:59,494 # Package would be ignored # 2023-11-08T09:28:59,495 ############################ 2023-11-08T09:28:59,495 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1], 2023-11-08T09:28:59,495 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,496 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,496 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added 2023-11-08T09:28:59,497 to the `packages` configuration field. 2023-11-08T09:28:59,498 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,498 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,499 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,500 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,501 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,502 If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are 2023-11-08T09:28:59,503 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via 2023-11-08T09:28:59,503 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,504 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,505 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,505 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,506 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,508 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,508 even if it does not contain any `.py` files. 2023-11-08T09:28:59,509 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,509 directory, all directories are treated like packages. 2023-11-08T09:28:59,510 ******************************************************************************** 2023-11-08T09:28:59,511 !! 2023-11-08T09:28:59,511 check.warn(importable) 2023-11-08T09:28:59,512 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration. 2023-11-08T09:28:59,512 !! 2023-11-08T09:28:59,513 ******************************************************************************** 2023-11-08T09:28:59,514 ############################ 2023-11-08T09:28:59,514 # Package would be ignored # 2023-11-08T09:28:59,515 ############################ 2023-11-08T09:28:59,515 Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1], 2023-11-08T09:28:59,515 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,516 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,517 package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added 2023-11-08T09:28:59,517 to the `packages` configuration field. 2023-11-08T09:28:59,518 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,518 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,519 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,519 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,520 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,521 If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are 2023-11-08T09:28:59,521 already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via 2023-11-08T09:28:59,521 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,522 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,522 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,523 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,524 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,526 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,526 even if it does not contain any `.py` files. 2023-11-08T09:28:59,527 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,527 directory, all directories are treated like packages. 2023-11-08T09:28:59,528 ******************************************************************************** 2023-11-08T09:28:59,529 !! 2023-11-08T09:28:59,529 check.warn(importable) 2023-11-08T09:28:59,530 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration. 2023-11-08T09:28:59,530 !! 2023-11-08T09:28:59,531 ******************************************************************************** 2023-11-08T09:28:59,532 ############################ 2023-11-08T09:28:59,532 # Package would be ignored # 2023-11-08T09:28:59,533 ############################ 2023-11-08T09:28:59,533 Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1], 2023-11-08T09:28:59,534 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,535 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,535 package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added 2023-11-08T09:28:59,535 to the `packages` configuration field. 2023-11-08T09:28:59,536 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,537 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,538 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,539 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,540 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,541 If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are 2023-11-08T09:28:59,541 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via 2023-11-08T09:28:59,541 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,541 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,542 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,542 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,543 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,544 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,544 even if it does not contain any `.py` files. 2023-11-08T09:28:59,545 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,545 directory, all directories are treated like packages. 2023-11-08T09:28:59,545 ******************************************************************************** 2023-11-08T09:28:59,546 !! 2023-11-08T09:28:59,546 check.warn(importable) 2023-11-08T09:28:59,547 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration. 2023-11-08T09:28:59,547 !! 2023-11-08T09:28:59,548 ******************************************************************************** 2023-11-08T09:28:59,548 ############################ 2023-11-08T09:28:59,549 # Package would be ignored # 2023-11-08T09:28:59,549 ############################ 2023-11-08T09:28:59,550 Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1], 2023-11-08T09:28:59,550 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,551 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,552 package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added 2023-11-08T09:28:59,552 to the `packages` configuration field. 2023-11-08T09:28:59,554 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,554 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,555 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,556 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,556 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,557 If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are 2023-11-08T09:28:59,558 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via 2023-11-08T09:28:59,558 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,559 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,559 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,560 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,561 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,563 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,563 even if it does not contain any `.py` files. 2023-11-08T09:28:59,564 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,564 directory, all directories are treated like packages. 2023-11-08T09:28:59,565 ******************************************************************************** 2023-11-08T09:28:59,566 !! 2023-11-08T09:28:59,566 check.warn(importable) 2023-11-08T09:28:59,566 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration. 2023-11-08T09:28:59,567 !! 2023-11-08T09:28:59,567 ******************************************************************************** 2023-11-08T09:28:59,568 ############################ 2023-11-08T09:28:59,568 # Package would be ignored # 2023-11-08T09:28:59,568 ############################ 2023-11-08T09:28:59,569 Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1], 2023-11-08T09:28:59,569 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,570 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,570 package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added 2023-11-08T09:28:59,570 to the `packages` configuration field. 2023-11-08T09:28:59,571 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,571 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,572 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,572 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,573 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,574 If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are 2023-11-08T09:28:59,574 already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via 2023-11-08T09:28:59,575 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,575 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,576 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,577 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,578 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,580 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,580 even if it does not contain any `.py` files. 2023-11-08T09:28:59,581 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,581 directory, all directories are treated like packages. 2023-11-08T09:28:59,581 ******************************************************************************** 2023-11-08T09:28:59,582 !! 2023-11-08T09:28:59,583 check.warn(importable) 2023-11-08T09:28:59,583 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration. 2023-11-08T09:28:59,584 !! 2023-11-08T09:28:59,585 ******************************************************************************** 2023-11-08T09:28:59,586 ############################ 2023-11-08T09:28:59,586 # Package would be ignored # 2023-11-08T09:28:59,587 ############################ 2023-11-08T09:28:59,587 Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1], 2023-11-08T09:28:59,588 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,589 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,590 package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added 2023-11-08T09:28:59,590 to the `packages` configuration field. 2023-11-08T09:28:59,591 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,591 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,592 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,592 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,593 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,594 If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are 2023-11-08T09:28:59,594 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via 2023-11-08T09:28:59,594 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,595 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,595 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,596 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,596 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,597 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,598 even if it does not contain any `.py` files. 2023-11-08T09:28:59,598 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,598 directory, all directories are treated like packages. 2023-11-08T09:28:59,599 ******************************************************************************** 2023-11-08T09:28:59,600 !! 2023-11-08T09:28:59,600 check.warn(importable) 2023-11-08T09:28:59,601 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,601 !! 2023-11-08T09:28:59,603 ******************************************************************************** 2023-11-08T09:28:59,603 ############################ 2023-11-08T09:28:59,604 # Package would be ignored # 2023-11-08T09:28:59,604 ############################ 2023-11-08T09:28:59,605 Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1], 2023-11-08T09:28:59,605 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,606 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,607 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added 2023-11-08T09:28:59,607 to the `packages` configuration field. 2023-11-08T09:28:59,608 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,609 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,609 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,610 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,611 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,612 If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are 2023-11-08T09:28:59,612 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via 2023-11-08T09:28:59,613 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,613 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,614 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,615 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,616 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,617 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,617 even if it does not contain any `.py` files. 2023-11-08T09:28:59,617 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,618 directory, all directories are treated like packages. 2023-11-08T09:28:59,618 ******************************************************************************** 2023-11-08T09:28:59,619 !! 2023-11-08T09:28:59,619 check.warn(importable) 2023-11-08T09:28:59,619 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration. 2023-11-08T09:28:59,620 !! 2023-11-08T09:28:59,620 ******************************************************************************** 2023-11-08T09:28:59,621 ############################ 2023-11-08T09:28:59,621 # Package would be ignored # 2023-11-08T09:28:59,622 ############################ 2023-11-08T09:28:59,622 Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1], 2023-11-08T09:28:59,622 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,623 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,623 package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added 2023-11-08T09:28:59,624 to the `packages` configuration field. 2023-11-08T09:28:59,625 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,625 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,626 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,627 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,628 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,629 If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are 2023-11-08T09:28:59,629 already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via 2023-11-08T09:28:59,630 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,631 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,631 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,632 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,633 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,634 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,635 even if it does not contain any `.py` files. 2023-11-08T09:28:59,635 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,636 directory, all directories are treated like packages. 2023-11-08T09:28:59,636 ******************************************************************************** 2023-11-08T09:28:59,637 !! 2023-11-08T09:28:59,638 check.warn(importable) 2023-11-08T09:28:59,638 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,639 !! 2023-11-08T09:28:59,640 ******************************************************************************** 2023-11-08T09:28:59,640 ############################ 2023-11-08T09:28:59,640 # Package would be ignored # 2023-11-08T09:28:59,641 ############################ 2023-11-08T09:28:59,641 Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1], 2023-11-08T09:28:59,641 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,642 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,642 package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added 2023-11-08T09:28:59,643 to the `packages` configuration field. 2023-11-08T09:28:59,643 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,644 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,644 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,645 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,645 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,646 If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are 2023-11-08T09:28:59,646 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via 2023-11-08T09:28:59,647 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,647 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,648 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,649 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,650 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,651 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,652 even if it does not contain any `.py` files. 2023-11-08T09:28:59,652 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,653 directory, all directories are treated like packages. 2023-11-08T09:28:59,654 ******************************************************************************** 2023-11-08T09:28:59,655 !! 2023-11-08T09:28:59,656 check.warn(importable) 2023-11-08T09:28:59,656 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,657 !! 2023-11-08T09:28:59,658 ******************************************************************************** 2023-11-08T09:28:59,658 ############################ 2023-11-08T09:28:59,659 # Package would be ignored # 2023-11-08T09:28:59,659 ############################ 2023-11-08T09:28:59,660 Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1], 2023-11-08T09:28:59,660 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,661 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,662 package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added 2023-11-08T09:28:59,662 to the `packages` configuration field. 2023-11-08T09:28:59,663 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,664 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,665 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,666 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,667 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,667 If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are 2023-11-08T09:28:59,668 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via 2023-11-08T09:28:59,668 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,669 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,669 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,670 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,671 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,672 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,673 even if it does not contain any `.py` files. 2023-11-08T09:28:59,673 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,673 directory, all directories are treated like packages. 2023-11-08T09:28:59,674 ******************************************************************************** 2023-11-08T09:28:59,675 !! 2023-11-08T09:28:59,675 check.warn(importable) 2023-11-08T09:28:59,676 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,676 !! 2023-11-08T09:28:59,677 ******************************************************************************** 2023-11-08T09:28:59,677 ############################ 2023-11-08T09:28:59,678 # Package would be ignored # 2023-11-08T09:28:59,678 ############################ 2023-11-08T09:28:59,679 Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1], 2023-11-08T09:28:59,679 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,680 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,681 package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added 2023-11-08T09:28:59,681 to the `packages` configuration field. 2023-11-08T09:28:59,682 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,683 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,683 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,684 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,685 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,686 If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are 2023-11-08T09:28:59,687 already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via 2023-11-08T09:28:59,687 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,688 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,688 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,689 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,691 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,692 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,692 even if it does not contain any `.py` files. 2023-11-08T09:28:59,693 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,694 directory, all directories are treated like packages. 2023-11-08T09:28:59,694 ******************************************************************************** 2023-11-08T09:28:59,695 !! 2023-11-08T09:28:59,695 check.warn(importable) 2023-11-08T09:28:59,696 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration. 2023-11-08T09:28:59,696 !! 2023-11-08T09:28:59,697 ******************************************************************************** 2023-11-08T09:28:59,697 ############################ 2023-11-08T09:28:59,698 # Package would be ignored # 2023-11-08T09:28:59,698 ############################ 2023-11-08T09:28:59,699 Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1], 2023-11-08T09:28:59,699 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,700 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,700 package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added 2023-11-08T09:28:59,701 to the `packages` configuration field. 2023-11-08T09:28:59,702 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,702 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,703 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,704 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,705 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,706 If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are 2023-11-08T09:28:59,706 already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via 2023-11-08T09:28:59,707 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,707 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,708 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,709 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,710 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,711 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,712 even if it does not contain any `.py` files. 2023-11-08T09:28:59,712 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,713 directory, all directories are treated like packages. 2023-11-08T09:28:59,713 ******************************************************************************** 2023-11-08T09:28:59,714 !! 2023-11-08T09:28:59,715 check.warn(importable) 2023-11-08T09:28:59,715 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration. 2023-11-08T09:28:59,716 !! 2023-11-08T09:28:59,717 ******************************************************************************** 2023-11-08T09:28:59,717 ############################ 2023-11-08T09:28:59,718 # Package would be ignored # 2023-11-08T09:28:59,718 ############################ 2023-11-08T09:28:59,719 Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1], 2023-11-08T09:28:59,719 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,721 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,721 package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added 2023-11-08T09:28:59,721 to the `packages` configuration field. 2023-11-08T09:28:59,722 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,723 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,723 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,724 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,725 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,726 If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are 2023-11-08T09:28:59,727 already explicitly excluding 'alpaca_eval.evaluators_configs.test' via 2023-11-08T09:28:59,727 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,728 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,728 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,729 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,730 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,732 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,732 even if it does not contain any `.py` files. 2023-11-08T09:28:59,733 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,733 directory, all directories are treated like packages. 2023-11-08T09:28:59,734 ******************************************************************************** 2023-11-08T09:28:59,735 !! 2023-11-08T09:28:59,735 check.warn(importable) 2023-11-08T09:28:59,736 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration. 2023-11-08T09:28:59,736 !! 2023-11-08T09:28:59,737 ******************************************************************************** 2023-11-08T09:28:59,737 ############################ 2023-11-08T09:28:59,738 # Package would be ignored # 2023-11-08T09:28:59,738 ############################ 2023-11-08T09:28:59,739 Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1], 2023-11-08T09:28:59,739 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,740 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,741 package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added 2023-11-08T09:28:59,741 to the `packages` configuration field. 2023-11-08T09:28:59,742 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,743 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,743 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,744 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,745 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,746 If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are 2023-11-08T09:28:59,747 already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via 2023-11-08T09:28:59,748 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,748 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,749 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,749 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,750 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,752 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,752 even if it does not contain any `.py` files. 2023-11-08T09:28:59,752 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,753 directory, all directories are treated like packages. 2023-11-08T09:28:59,753 ******************************************************************************** 2023-11-08T09:28:59,754 !! 2023-11-08T09:28:59,754 check.warn(importable) 2023-11-08T09:28:59,755 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration. 2023-11-08T09:28:59,755 !! 2023-11-08T09:28:59,756 ******************************************************************************** 2023-11-08T09:28:59,756 ############################ 2023-11-08T09:28:59,757 # Package would be ignored # 2023-11-08T09:28:59,757 ############################ 2023-11-08T09:28:59,758 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1], 2023-11-08T09:28:59,758 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,759 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,760 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added 2023-11-08T09:28:59,760 to the `packages` configuration field. 2023-11-08T09:28:59,761 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,761 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,762 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,763 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,764 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,765 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are 2023-11-08T09:28:59,765 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via 2023-11-08T09:28:59,766 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,766 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,767 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,768 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,769 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,770 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,771 even if it does not contain any `.py` files. 2023-11-08T09:28:59,771 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,772 directory, all directories are treated like packages. 2023-11-08T09:28:59,772 ******************************************************************************** 2023-11-08T09:28:59,773 !! 2023-11-08T09:28:59,774 check.warn(importable) 2023-11-08T09:28:59,774 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration. 2023-11-08T09:28:59,775 !! 2023-11-08T09:28:59,775 ******************************************************************************** 2023-11-08T09:28:59,776 ############################ 2023-11-08T09:28:59,776 # Package would be ignored # 2023-11-08T09:28:59,777 ############################ 2023-11-08T09:28:59,777 Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1], 2023-11-08T09:28:59,778 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,778 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,779 package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added 2023-11-08T09:28:59,779 to the `packages` configuration field. 2023-11-08T09:28:59,780 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,781 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,781 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,782 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,783 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,784 If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are 2023-11-08T09:28:59,784 already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via 2023-11-08T09:28:59,785 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,785 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,786 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,787 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,788 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,789 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,790 even if it does not contain any `.py` files. 2023-11-08T09:28:59,790 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,791 directory, all directories are treated like packages. 2023-11-08T09:28:59,791 ******************************************************************************** 2023-11-08T09:28:59,792 !! 2023-11-08T09:28:59,793 check.warn(importable) 2023-11-08T09:28:59,793 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration. 2023-11-08T09:28:59,794 !! 2023-11-08T09:28:59,795 ******************************************************************************** 2023-11-08T09:28:59,796 ############################ 2023-11-08T09:28:59,796 # Package would be ignored # 2023-11-08T09:28:59,797 ############################ 2023-11-08T09:28:59,797 Python recognizes 'alpaca_eval.models_configs' as an importable package[^1], 2023-11-08T09:28:59,798 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,799 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,799 package, please make sure that 'alpaca_eval.models_configs' is explicitly added 2023-11-08T09:28:59,800 to the `packages` configuration field. 2023-11-08T09:28:59,801 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,801 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,802 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,803 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,804 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,805 If you don't want 'alpaca_eval.models_configs' to be distributed and are 2023-11-08T09:28:59,805 already explicitly excluding 'alpaca_eval.models_configs' via 2023-11-08T09:28:59,805 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,806 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,806 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,807 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,808 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,809 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,810 even if it does not contain any `.py` files. 2023-11-08T09:28:59,810 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,811 directory, all directories are treated like packages. 2023-11-08T09:28:59,811 ******************************************************************************** 2023-11-08T09:28:59,812 !! 2023-11-08T09:28:59,813 check.warn(importable) 2023-11-08T09:28:59,813 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration. 2023-11-08T09:28:59,814 !! 2023-11-08T09:28:59,815 ******************************************************************************** 2023-11-08T09:28:59,815 ############################ 2023-11-08T09:28:59,816 # Package would be ignored # 2023-11-08T09:28:59,816 ############################ 2023-11-08T09:28:59,817 Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1], 2023-11-08T09:28:59,817 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,818 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,819 package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added 2023-11-08T09:28:59,819 to the `packages` configuration field. 2023-11-08T09:28:59,820 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,821 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,821 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,822 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,823 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,824 If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are 2023-11-08T09:28:59,825 already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via 2023-11-08T09:28:59,825 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,826 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,826 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,827 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,828 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,830 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,830 even if it does not contain any `.py` files. 2023-11-08T09:28:59,831 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,831 directory, all directories are treated like packages. 2023-11-08T09:28:59,832 ******************************************************************************** 2023-11-08T09:28:59,832 !! 2023-11-08T09:28:59,833 check.warn(importable) 2023-11-08T09:28:59,833 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration. 2023-11-08T09:28:59,834 !! 2023-11-08T09:28:59,835 ******************************************************************************** 2023-11-08T09:28:59,835 ############################ 2023-11-08T09:28:59,835 # Package would be ignored # 2023-11-08T09:28:59,836 ############################ 2023-11-08T09:28:59,836 Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1], 2023-11-08T09:28:59,837 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,837 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,838 package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added 2023-11-08T09:28:59,838 to the `packages` configuration field. 2023-11-08T09:28:59,839 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,839 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,840 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,841 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,842 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,842 If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are 2023-11-08T09:28:59,843 already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via 2023-11-08T09:28:59,843 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,844 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,844 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,845 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,846 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,848 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,848 even if it does not contain any `.py` files. 2023-11-08T09:28:59,849 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,849 directory, all directories are treated like packages. 2023-11-08T09:28:59,850 ******************************************************************************** 2023-11-08T09:28:59,851 !! 2023-11-08T09:28:59,851 check.warn(importable) 2023-11-08T09:28:59,852 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration. 2023-11-08T09:28:59,852 !! 2023-11-08T09:28:59,853 ******************************************************************************** 2023-11-08T09:28:59,854 ############################ 2023-11-08T09:28:59,855 # Package would be ignored # 2023-11-08T09:28:59,855 ############################ 2023-11-08T09:28:59,855 Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1], 2023-11-08T09:28:59,856 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,857 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,857 package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added 2023-11-08T09:28:59,858 to the `packages` configuration field. 2023-11-08T09:28:59,859 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,859 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,859 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,860 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,861 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,862 If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are 2023-11-08T09:28:59,863 already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via 2023-11-08T09:28:59,863 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,864 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,864 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,865 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,866 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,867 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,868 even if it does not contain any `.py` files. 2023-11-08T09:28:59,868 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,869 directory, all directories are treated like packages. 2023-11-08T09:28:59,869 ******************************************************************************** 2023-11-08T09:28:59,870 !! 2023-11-08T09:28:59,871 check.warn(importable) 2023-11-08T09:28:59,871 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration. 2023-11-08T09:28:59,872 !! 2023-11-08T09:28:59,873 ******************************************************************************** 2023-11-08T09:28:59,873 ############################ 2023-11-08T09:28:59,874 # Package would be ignored # 2023-11-08T09:28:59,874 ############################ 2023-11-08T09:28:59,875 Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1], 2023-11-08T09:28:59,875 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,876 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,877 package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added 2023-11-08T09:28:59,877 to the `packages` configuration field. 2023-11-08T09:28:59,878 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,879 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,879 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,880 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,881 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,882 If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are 2023-11-08T09:28:59,883 already explicitly excluding 'alpaca_eval.models_configs.claude' via 2023-11-08T09:28:59,883 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,884 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,885 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,886 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,886 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,888 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,888 even if it does not contain any `.py` files. 2023-11-08T09:28:59,889 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,889 directory, all directories are treated like packages. 2023-11-08T09:28:59,889 ******************************************************************************** 2023-11-08T09:28:59,890 !! 2023-11-08T09:28:59,891 check.warn(importable) 2023-11-08T09:28:59,891 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration. 2023-11-08T09:28:59,891 !! 2023-11-08T09:28:59,892 ******************************************************************************** 2023-11-08T09:28:59,893 ############################ 2023-11-08T09:28:59,893 # Package would be ignored # 2023-11-08T09:28:59,893 ############################ 2023-11-08T09:28:59,894 Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1], 2023-11-08T09:28:59,895 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,895 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,896 package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added 2023-11-08T09:28:59,896 to the `packages` configuration field. 2023-11-08T09:28:59,897 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,898 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,898 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,899 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,900 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,901 If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are 2023-11-08T09:28:59,901 already explicitly excluding 'alpaca_eval.models_configs.cohere' via 2023-11-08T09:28:59,902 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,902 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,903 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,904 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,905 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,907 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,907 even if it does not contain any `.py` files. 2023-11-08T09:28:59,908 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,908 directory, all directories are treated like packages. 2023-11-08T09:28:59,909 ******************************************************************************** 2023-11-08T09:28:59,910 !! 2023-11-08T09:28:59,910 check.warn(importable) 2023-11-08T09:28:59,911 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration. 2023-11-08T09:28:59,911 !! 2023-11-08T09:28:59,912 ******************************************************************************** 2023-11-08T09:28:59,913 ############################ 2023-11-08T09:28:59,913 # Package would be ignored # 2023-11-08T09:28:59,914 ############################ 2023-11-08T09:28:59,914 Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1], 2023-11-08T09:28:59,914 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,915 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,916 package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added 2023-11-08T09:28:59,916 to the `packages` configuration field. 2023-11-08T09:28:59,917 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,917 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,918 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,919 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,919 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,920 If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are 2023-11-08T09:28:59,921 already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via 2023-11-08T09:28:59,921 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,921 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,922 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,923 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,924 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,925 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,926 even if it does not contain any `.py` files. 2023-11-08T09:28:59,926 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,927 directory, all directories are treated like packages. 2023-11-08T09:28:59,927 ******************************************************************************** 2023-11-08T09:28:59,928 !! 2023-11-08T09:28:59,929 check.warn(importable) 2023-11-08T09:28:59,929 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration. 2023-11-08T09:28:59,930 !! 2023-11-08T09:28:59,931 ******************************************************************************** 2023-11-08T09:28:59,931 ############################ 2023-11-08T09:28:59,932 # Package would be ignored # 2023-11-08T09:28:59,932 ############################ 2023-11-08T09:28:59,933 Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1], 2023-11-08T09:28:59,933 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,934 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,935 package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added 2023-11-08T09:28:59,935 to the `packages` configuration field. 2023-11-08T09:28:59,936 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,937 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,938 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,938 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,939 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,940 If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are 2023-11-08T09:28:59,941 already explicitly excluding 'alpaca_eval.models_configs.gpt4' via 2023-11-08T09:28:59,941 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,942 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,942 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,943 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,945 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,946 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,946 even if it does not contain any `.py` files. 2023-11-08T09:28:59,947 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,947 directory, all directories are treated like packages. 2023-11-08T09:28:59,948 ******************************************************************************** 2023-11-08T09:28:59,948 !! 2023-11-08T09:28:59,949 check.warn(importable) 2023-11-08T09:28:59,949 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4_turbo' is absent from the `packages` configuration. 2023-11-08T09:28:59,950 !! 2023-11-08T09:28:59,951 ******************************************************************************** 2023-11-08T09:28:59,951 ############################ 2023-11-08T09:28:59,951 # Package would be ignored # 2023-11-08T09:28:59,952 ############################ 2023-11-08T09:28:59,952 Python recognizes 'alpaca_eval.models_configs.gpt4_turbo' as an importable package[^1], 2023-11-08T09:28:59,953 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,954 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,954 package, please make sure that 'alpaca_eval.models_configs.gpt4_turbo' is explicitly added 2023-11-08T09:28:59,955 to the `packages` configuration field. 2023-11-08T09:28:59,956 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,957 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,957 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,958 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,959 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,960 If you don't want 'alpaca_eval.models_configs.gpt4_turbo' to be distributed and are 2023-11-08T09:28:59,961 already explicitly excluding 'alpaca_eval.models_configs.gpt4_turbo' via 2023-11-08T09:28:59,961 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,962 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,962 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,963 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,964 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,966 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,967 even if it does not contain any `.py` files. 2023-11-08T09:28:59,967 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,968 directory, all directories are treated like packages. 2023-11-08T09:28:59,968 ******************************************************************************** 2023-11-08T09:28:59,969 !! 2023-11-08T09:28:59,969 check.warn(importable) 2023-11-08T09:28:59,970 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration. 2023-11-08T09:28:59,970 !! 2023-11-08T09:28:59,971 ******************************************************************************** 2023-11-08T09:28:59,971 ############################ 2023-11-08T09:28:59,972 # Package would be ignored # 2023-11-08T09:28:59,972 ############################ 2023-11-08T09:28:59,973 Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1], 2023-11-08T09:28:59,973 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,974 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,975 package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added 2023-11-08T09:28:59,975 to the `packages` configuration field. 2023-11-08T09:28:59,976 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,977 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,977 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,978 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,979 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:28:59,980 If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are 2023-11-08T09:28:59,981 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via 2023-11-08T09:28:59,981 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:28:59,981 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:28:59,982 combination with a more fine grained `package-data` configuration. 2023-11-08T09:28:59,983 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:28:59,984 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:28:59,985 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:28:59,986 even if it does not contain any `.py` files. 2023-11-08T09:28:59,986 On the other hand, currently there is no concept of package data 2023-11-08T09:28:59,987 directory, all directories are treated like packages. 2023-11-08T09:28:59,988 ******************************************************************************** 2023-11-08T09:28:59,989 !! 2023-11-08T09:28:59,989 check.warn(importable) 2023-11-08T09:28:59,990 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration. 2023-11-08T09:28:59,990 !! 2023-11-08T09:28:59,991 ******************************************************************************** 2023-11-08T09:28:59,992 ############################ 2023-11-08T09:28:59,992 # Package would be ignored # 2023-11-08T09:28:59,993 ############################ 2023-11-08T09:28:59,993 Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1], 2023-11-08T09:28:59,994 but it is absent from setuptools' `packages` configuration. 2023-11-08T09:28:59,995 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-08T09:28:59,996 package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added 2023-11-08T09:28:59,996 to the `packages` configuration field. 2023-11-08T09:28:59,997 Alternatively, you can also rely on setuptools' discovery methods 2023-11-08T09:28:59,997 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-08T09:28:59,998 instead of `find_packages(...)`/`find:`). 2023-11-08T09:28:59,998 You can read more about "package discovery" on setuptools documentation page: 2023-11-08T09:28:59,999 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-08T09:29:00,000 If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are 2023-11-08T09:29:00,000 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via 2023-11-08T09:29:00,001 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-08T09:29:00,001 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-08T09:29:00,002 combination with a more fine grained `package-data` configuration. 2023-11-08T09:29:00,003 You can read more about "package data files" on setuptools documentation page: 2023-11-08T09:29:00,004 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-08T09:29:00,005 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-08T09:29:00,006 even if it does not contain any `.py` files. 2023-11-08T09:29:00,006 On the other hand, currently there is no concept of package data 2023-11-08T09:29:00,007 directory, all directories are treated like packages. 2023-11-08T09:29:00,007 ******************************************************************************** 2023-11-08T09:29:00,008 !! 2023-11-08T09:29:00,008 check.warn(importable) 2023-11-08T09:29:00,009 creating build/lib/alpaca_eval/evaluators_configs 2023-11-08T09:29:00,009 copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs 2023-11-08T09:29:00,010 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T09:29:00,010 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T09:29:00,011 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T09:29:00,011 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T09:29:00,012 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T09:29:00,012 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T09:29:00,013 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T09:29:00,013 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T09:29:00,014 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T09:29:00,014 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T09:29:00,015 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,015 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,016 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,017 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,017 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,018 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,018 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,018 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,019 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,019 copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,020 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,020 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,020 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,021 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,021 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T09:29:00,022 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T09:29:00,022 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T09:29:00,023 creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T09:29:00,023 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T09:29:00,024 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T09:29:00,024 creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T09:29:00,025 copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T09:29:00,025 creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T09:29:00,026 copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T09:29:00,026 creating build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T09:29:00,027 copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T09:29:00,027 copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T09:29:00,028 creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T09:29:00,028 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T09:29:00,029 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T09:29:00,030 creating build/lib/alpaca_eval/evaluators_configs/claude 2023-11-08T09:29:00,030 copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude 2023-11-08T09:29:00,030 copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude 2023-11-08T09:29:00,031 creating build/lib/alpaca_eval/evaluators_configs/claude_2 2023-11-08T09:29:00,031 copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2 2023-11-08T09:29:00,031 creating build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T09:29:00,032 copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T09:29:00,032 copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T09:29:00,033 creating build/lib/alpaca_eval/evaluators_configs/cohere 2023-11-08T09:29:00,033 copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere 2023-11-08T09:29:00,033 creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,034 copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,034 creating build/lib/alpaca_eval/evaluators_configs/gpt4 2023-11-08T09:29:00,035 copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4 2023-11-08T09:29:00,035 creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T09:29:00,036 copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T09:29:00,036 copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T09:29:00,036 creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T09:29:00,037 copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T09:29:00,037 creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T09:29:00,038 copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T09:29:00,038 creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T09:29:00,039 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T09:29:00,039 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T09:29:00,040 creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T09:29:00,040 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T09:29:00,041 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T09:29:00,041 creating build/lib/alpaca_eval/evaluators_configs/test 2023-11-08T09:29:00,042 copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test 2023-11-08T09:29:00,042 creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T09:29:00,043 copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T09:29:00,043 copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T09:29:00,044 creating build/lib/alpaca_eval/leaderboards 2023-11-08T09:29:00,045 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,045 copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,045 copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,046 copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,046 copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,046 creating build/lib/alpaca_eval/leaderboards/evaluators 2023-11-08T09:29:00,047 copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators 2023-11-08T09:29:00,048 creating build/lib/alpaca_eval/models_configs 2023-11-08T09:29:00,048 creating build/lib/alpaca_eval/models_configs/airoboros-33b 2023-11-08T09:29:00,048 copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-11-08T09:29:00,049 copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-11-08T09:29:00,049 creating build/lib/alpaca_eval/models_configs/airoboros-65b 2023-11-08T09:29:00,050 copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b 2023-11-08T09:29:00,050 creating build/lib/alpaca_eval/models_configs/alpaca-7b 2023-11-08T09:29:00,051 copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-11-08T09:29:00,051 copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-11-08T09:29:00,052 creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T09:29:00,052 copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T09:29:00,053 copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T09:29:00,053 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T09:29:00,054 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T09:29:00,054 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T09:29:00,055 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T09:29:00,055 creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T09:29:00,055 copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T09:29:00,056 copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T09:29:00,056 creating build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T09:29:00,057 copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T09:29:00,058 copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T09:29:00,058 creating build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T09:29:00,059 copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T09:29:00,059 creating build/lib/alpaca_eval/models_configs/bedrock_claude 2023-11-08T09:29:00,060 copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude 2023-11-08T09:29:00,060 creating build/lib/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T09:29:00,061 copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T09:29:00,061 creating build/lib/alpaca_eval/models_configs/causallm-14b 2023-11-08T09:29:00,061 copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b 2023-11-08T09:29:00,062 copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b 2023-11-08T09:29:00,062 creating build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T09:29:00,063 copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T09:29:00,063 copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T09:29:00,064 creating build/lib/alpaca_eval/models_configs/chatgpt 2023-11-08T09:29:00,064 copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt 2023-11-08T09:29:00,065 creating build/lib/alpaca_eval/models_configs/claude 2023-11-08T09:29:00,065 copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude 2023-11-08T09:29:00,066 copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude 2023-11-08T09:29:00,066 creating build/lib/alpaca_eval/models_configs/claude-2 2023-11-08T09:29:00,066 copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2 2023-11-08T09:29:00,067 creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T09:29:00,067 copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T09:29:00,068 creating build/lib/alpaca_eval/models_configs/cohere 2023-11-08T09:29:00,068 copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere 2023-11-08T09:29:00,069 copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere 2023-11-08T09:29:00,069 creating build/lib/alpaca_eval/models_configs/evo-7b 2023-11-08T09:29:00,070 copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b 2023-11-08T09:29:00,070 creating build/lib/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T09:29:00,071 copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T09:29:00,071 creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T09:29:00,072 copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T09:29:00,072 creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T09:29:00,073 copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T09:29:00,073 creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,074 copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,074 creating build/lib/alpaca_eval/models_configs/gpt4 2023-11-08T09:29:00,075 copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4 2023-11-08T09:29:00,075 copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4 2023-11-08T09:29:00,076 creating build/lib/alpaca_eval/models_configs/gpt4_turbo 2023-11-08T09:29:00,077 copying src/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_turbo 2023-11-08T09:29:00,077 copying src/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_turbo 2023-11-08T09:29:00,078 creating build/lib/alpaca_eval/models_configs/guanaco-13b 2023-11-08T09:29:00,078 copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b 2023-11-08T09:29:00,078 creating build/lib/alpaca_eval/models_configs/guanaco-33b 2023-11-08T09:29:00,079 copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b 2023-11-08T09:29:00,079 creating build/lib/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T09:29:00,080 copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T09:29:00,080 creating build/lib/alpaca_eval/models_configs/guanaco-65b 2023-11-08T09:29:00,081 copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b 2023-11-08T09:29:00,081 creating build/lib/alpaca_eval/models_configs/guanaco-7b 2023-11-08T09:29:00,081 copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-11-08T09:29:00,082 copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-11-08T09:29:00,082 creating build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T09:29:00,083 copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T09:29:00,083 copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T09:29:00,084 creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T09:29:00,084 copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T09:29:00,084 creating build/lib/alpaca_eval/models_configs/jina-chat 2023-11-08T09:29:00,085 copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat 2023-11-08T09:29:00,085 copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat 2023-11-08T09:29:00,086 creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T09:29:00,086 copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T09:29:00,087 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T09:29:00,088 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T09:29:00,088 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T09:29:00,089 creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T09:29:00,089 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T09:29:00,089 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T09:29:00,090 creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T09:29:00,090 copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T09:29:00,091 copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T09:29:00,092 creating build/lib/alpaca_eval/models_configs/minotaur-13b 2023-11-08T09:29:00,092 copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-11-08T09:29:00,093 copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-11-08T09:29:00,093 creating build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T09:29:00,094 copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T09:29:00,094 copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T09:29:00,095 creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T09:29:00,095 copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T09:29:00,095 creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T09:29:00,096 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T09:29:00,096 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T09:29:00,097 creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T09:29:00,097 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T09:29:00,098 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T09:29:00,098 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T09:29:00,098 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T09:29:00,099 copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T09:29:00,099 creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T09:29:00,100 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T09:29:00,100 copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T09:29:00,101 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T09:29:00,101 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T09:29:00,102 copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T09:29:00,102 creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T09:29:00,103 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T09:29:00,103 copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T09:29:00,104 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T09:29:00,104 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T09:29:00,105 copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T09:29:00,105 creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T09:29:00,106 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T09:29:00,106 copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T09:29:00,107 creating build/lib/alpaca_eval/models_configs/openchat-13b 2023-11-08T09:29:00,107 copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-11-08T09:29:00,108 copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-11-08T09:29:00,108 creating build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T09:29:00,109 copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T09:29:00,109 creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T09:29:00,109 copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T09:29:00,110 creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T09:29:00,110 copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T09:29:00,111 creating build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T09:29:00,111 copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T09:29:00,112 creating build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T09:29:00,112 copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T09:29:00,112 creating build/lib/alpaca_eval/models_configs/platolm-7b 2023-11-08T09:29:00,113 copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b 2023-11-08T09:29:00,113 copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b 2023-11-08T09:29:00,114 creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T09:29:00,114 copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T09:29:00,115 creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T09:29:00,115 copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T09:29:00,116 creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T09:29:00,116 copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T09:29:00,117 creating build/lib/alpaca_eval/models_configs/text_davinci_001 2023-11-08T09:29:00,117 copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001 2023-11-08T09:29:00,117 creating build/lib/alpaca_eval/models_configs/text_davinci_003 2023-11-08T09:29:00,118 copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-11-08T09:29:00,118 copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-11-08T09:29:00,119 creating build/lib/alpaca_eval/models_configs/ultralm-13b 2023-11-08T09:29:00,119 copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-11-08T09:29:00,120 copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-11-08T09:29:00,121 creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T09:29:00,121 copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T09:29:00,122 copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T09:29:00,122 creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T09:29:00,122 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T09:29:00,123 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T09:29:00,124 creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T09:29:00,125 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T09:29:00,127 copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T09:29:00,128 creating build/lib/alpaca_eval/models_configs/vicuna-13b 2023-11-08T09:29:00,129 copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b 2023-11-08T09:29:00,131 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T09:29:00,132 copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T09:29:00,134 creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T09:29:00,135 copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T09:29:00,136 creating build/lib/alpaca_eval/models_configs/vicuna-7b 2023-11-08T09:29:00,137 copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-11-08T09:29:00,139 copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-11-08T09:29:00,141 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T09:29:00,142 copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T09:29:00,144 creating build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T09:29:00,145 copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T09:29:00,147 copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T09:29:00,149 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T09:29:00,150 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T09:29:00,151 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T09:29:00,152 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T09:29:00,154 creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T09:29:00,155 copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T09:29:00,158 creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T09:29:00,158 copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T09:29:00,160 creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T09:29:00,161 copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T09:29:00,163 copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T09:29:00,165 creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T09:29:00,166 copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T09:29:00,168 copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T09:29:00,170 creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T09:29:00,170 copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T09:29:00,198 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-11-08T09:29:00,198 !! 2023-11-08T09:29:00,199 ******************************************************************************** 2023-11-08T09:29:00,200 Please avoid running ``setup.py`` directly. 2023-11-08T09:29:00,200 Instead, use pypa/build, pypa/installer or other 2023-11-08T09:29:00,201 standards-based tools. 2023-11-08T09:29:00,201 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-11-08T09:29:00,202 ******************************************************************************** 2023-11-08T09:29:00,203 !! 2023-11-08T09:29:00,203 self.initialize_options() 2023-11-08T09:29:00,222 installing to build/bdist.linux-armv7l/wheel 2023-11-08T09:29:00,222 running install 2023-11-08T09:29:00,246 running install_lib 2023-11-08T09:29:00,270 creating build/bdist.linux-armv7l 2023-11-08T09:29:00,270 creating build/bdist.linux-armv7l/wheel 2023-11-08T09:29:00,272 creating build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,273 creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T09:29:00,274 copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T09:29:00,277 copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T09:29:00,278 copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-11-08T09:29:00,282 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-11-08T09:29:00,283 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T09:29:00,284 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T09:29:00,286 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-11-08T09:29:00,288 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T09:29:00,289 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T09:29:00,290 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-11-08T09:29:00,292 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T09:29:00,293 copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2 2023-11-08T09:29:00,296 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-11-08T09:29:00,297 copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-11-08T09:29:00,299 copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-11-08T09:29:00,304 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T09:29:00,305 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T09:29:00,307 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-11-08T09:29:00,309 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T09:29:00,310 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T09:29:00,312 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-11-08T09:29:00,314 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T09:29:00,315 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T09:29:00,316 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-11-08T09:29:00,318 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T09:29:00,319 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T09:29:00,321 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-11-08T09:29:00,323 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-11-08T09:29:00,324 copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-11-08T09:29:00,326 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T09:29:00,327 copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-11-08T09:29:00,329 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T09:29:00,330 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T09:29:00,332 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-11-08T09:29:00,334 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T09:29:00,335 copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-11-08T09:29:00,338 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T09:29:00,339 copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude 2023-11-08T09:29:00,341 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T09:29:00,342 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613 2023-11-08T09:29:00,344 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,345 copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,348 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-11-08T09:29:00,348 copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-11-08T09:29:00,351 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T09:29:00,352 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314 2023-11-08T09:29:00,354 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T09:29:00,354 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T09:29:00,356 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-11-08T09:29:00,358 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-11-08T09:29:00,359 copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-11-08T09:29:00,361 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T09:29:00,362 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T09:29:00,364 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-11-08T09:29:00,366 copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-11-08T09:29:00,368 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T09:29:00,369 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T09:29:00,371 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-11-08T09:29:00,373 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-11-08T09:29:00,374 copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-11-08T09:29:00,376 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T09:29:00,377 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T09:29:00,379 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-11-08T09:29:00,381 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,382 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,384 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,386 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,388 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,390 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,392 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,394 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,397 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,399 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,401 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,403 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,404 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,407 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-11-08T09:29:00,409 copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,411 copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,413 copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,415 copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,417 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards 2023-11-08T09:29:00,419 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-11-08T09:29:00,420 copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-11-08T09:29:00,422 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,423 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,425 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,427 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,430 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-11-08T09:29:00,431 copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,434 copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,436 copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,439 copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,442 copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,444 copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-11-08T09:29:00,448 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs 2023-11-08T09:29:00,450 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T09:29:00,451 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-11-08T09:29:00,453 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T09:29:00,454 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T09:29:00,456 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1 2023-11-08T09:29:00,458 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T09:29:00,459 copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b 2023-11-08T09:29:00,461 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T09:29:00,462 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-11-08T09:29:00,464 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T09:29:00,465 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T09:29:00,467 copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8 2023-11-08T09:29:00,470 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T09:29:00,471 copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1 2023-11-08T09:29:00,473 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-11-08T09:29:00,474 copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-11-08T09:29:00,476 copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-11-08T09:29:00,478 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T09:29:00,479 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T09:29:00,481 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9 2023-11-08T09:29:00,484 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-11-08T09:29:00,485 copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-11-08T09:29:00,487 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T09:29:00,488 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T09:29:00,490 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-11-08T09:29:00,493 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T09:29:00,494 copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2 2023-11-08T09:29:00,496 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-11-08T09:29:00,497 copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-11-08T09:29:00,499 copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-11-08T09:29:00,501 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2023-11-08T09:29:00,502 copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2023-11-08T09:29:00,504 copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b 2023-11-08T09:29:00,506 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T09:29:00,507 copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T09:29:00,509 copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1 2023-11-08T09:29:00,511 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-11-08T09:29:00,512 copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-11-08T09:29:00,514 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T09:29:00,516 copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T09:29:00,518 copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha 2023-11-08T09:29:00,520 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T09:29:00,521 copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-11-08T09:29:00,523 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-11-08T09:29:00,524 copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-11-08T09:29:00,526 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T09:29:00,527 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-11-08T09:29:00,530 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-11-08T09:29:00,531 copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-11-08T09:29:00,533 copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-11-08T09:29:00,535 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T09:29:00,536 copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-11-08T09:29:00,539 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T09:29:00,540 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-11-08T09:29:00,542 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T09:29:00,543 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-11-08T09:29:00,546 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-11-08T09:29:00,546 copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-11-08T09:29:00,549 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T09:29:00,550 copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b 2023-11-08T09:29:00,552 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T09:29:00,553 copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api 2023-11-08T09:29:00,556 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2023-11-08T09:29:00,557 copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2023-11-08T09:29:00,559 copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b 2023-11-08T09:29:00,561 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-11-08T09:29:00,562 copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-11-08T09:29:00,564 copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-11-08T09:29:00,566 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T09:29:00,567 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T09:29:00,569 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-11-08T09:29:00,571 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T09:29:00,572 copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b 2023-11-08T09:29:00,575 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T09:29:00,576 copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b 2023-11-08T09:29:00,578 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-11-08T09:29:00,579 copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-11-08T09:29:00,581 copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat 2023-11-08T09:29:00,584 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-11-08T09:29:00,585 copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-11-08T09:29:00,587 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T09:29:00,588 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T09:29:00,590 copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b 2023-11-08T09:29:00,592 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T09:29:00,593 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T09:29:00,595 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1 2023-11-08T09:29:00,597 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T09:29:00,598 copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-11-08T09:29:00,601 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T09:29:00,601 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T09:29:00,603 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0 2023-11-08T09:29:00,606 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude 2023-11-08T09:29:00,607 copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude 2023-11-08T09:29:00,609 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T09:29:00,610 copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta 2023-11-08T09:29:00,613 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b 2023-11-08T09:29:00,614 copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b 2023-11-08T09:29:00,616 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T09:29:00,618 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T09:29:00,620 copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1 2023-11-08T09:29:00,622 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T09:29:00,623 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2 2023-11-08T09:29:00,626 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-11-08T09:29:00,627 copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-11-08T09:29:00,630 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T09:29:00,631 copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-11-08T09:29:00,633 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T09:29:00,634 copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T09:29:00,636 copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16 2023-11-08T09:29:00,638 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T09:29:00,639 copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-11-08T09:29:00,641 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-11-08T09:29:00,642 copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-11-08T09:29:00,644 copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-11-08T09:29:00,646 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T09:29:00,647 copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T09:29:00,649 copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft 2023-11-08T09:29:00,651 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T09:29:00,652 copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0 2023-11-08T09:29:00,654 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T09:29:00,655 copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-11-08T09:29:00,657 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,658 copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct 2023-11-08T09:29:00,660 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T09:29:00,662 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T09:29:00,663 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-11-08T09:29:00,665 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T09:29:00,666 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T09:29:00,668 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-11-08T09:29:00,670 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T09:29:00,671 copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1 2023-11-08T09:29:00,674 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T09:29:00,675 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T09:29:00,677 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-11-08T09:29:00,679 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T09:29:00,680 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T09:29:00,681 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-11-08T09:29:00,683 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T09:29:00,684 copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-11-08T09:29:00,686 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T09:29:00,687 copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0 2023-11-08T09:29:00,689 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-11-08T09:29:00,690 copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-11-08T09:29:00,692 copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-11-08T09:29:00,694 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-11-08T09:29:00,695 copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-11-08T09:29:00,697 copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-11-08T09:29:00,699 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T09:29:00,699 copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-11-08T09:29:00,702 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T09:29:00,703 copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-11-08T09:29:00,705 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-11-08T09:29:00,706 copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-11-08T09:29:00,708 copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-11-08T09:29:00,710 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T09:29:00,711 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T09:29:00,712 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-11-08T09:29:00,715 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T09:29:00,716 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T09:29:00,718 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-11-08T09:29:00,720 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-11-08T09:29:00,721 copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-11-08T09:29:00,723 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T09:29:00,724 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T09:29:00,726 copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16 2023-11-08T09:29:00,728 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T09:29:00,728 copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-11-08T09:29:00,731 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-11-08T09:29:00,731 copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-11-08T09:29:00,733 copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-11-08T09:29:00,735 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T09:29:00,736 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T09:29:00,738 copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6 2023-11-08T09:29:00,740 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-11-08T09:29:00,741 copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-11-08T09:29:00,742 copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-11-08T09:29:00,744 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T09:29:00,745 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T09:29:00,747 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-11-08T09:29:00,749 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-11-08T09:29:00,750 copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-11-08T09:29:00,752 copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-11-08T09:29:00,754 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo 2023-11-08T09:29:00,755 copying build/lib/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo 2023-11-08T09:29:00,756 copying build/lib/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo 2023-11-08T09:29:00,759 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T09:29:00,760 copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T09:29:00,761 copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft 2023-11-08T09:29:00,763 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T09:29:00,764 copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-11-08T09:29:00,767 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-11-08T09:29:00,767 copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-11-08T09:29:00,769 creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,770 copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,772 copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,774 copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,776 copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,778 copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,780 copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,781 copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,783 copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,785 copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,787 copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-11-08T09:29:00,789 running install_egg_info 2023-11-08T09:29:00,819 Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.3.3-py3.11.egg-info 2023-11-08T09:29:00,832 running install_scripts 2023-11-08T09:29:00,870 creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.3.3.dist-info/WHEEL 2023-11-08T09:29:00,873 creating '/tmp/pip-wheel-apd8zh5r/alpaca_eval-0.3.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-11-08T09:29:00,875 adding 'alpaca_eval/__init__.py' 2023-11-08T09:29:00,878 adding 'alpaca_eval/analyze.py' 2023-11-08T09:29:00,880 adding 'alpaca_eval/completion_parsers.py' 2023-11-08T09:29:00,881 adding 'alpaca_eval/constants.py' 2023-11-08T09:29:00,884 adding 'alpaca_eval/main.py' 2023-11-08T09:29:00,886 adding 'alpaca_eval/metrics.py' 2023-11-08T09:29:00,889 adding 'alpaca_eval/plotting.py' 2023-11-08T09:29:00,891 adding 'alpaca_eval/processors.py' 2023-11-08T09:29:00,892 adding 'alpaca_eval/types.py' 2023-11-08T09:29:00,895 adding 'alpaca_eval/utils.py' 2023-11-08T09:29:00,896 adding 'alpaca_eval/annotators/__init__.py' 2023-11-08T09:29:00,900 adding 'alpaca_eval/annotators/base.py' 2023-11-08T09:29:00,903 adding 'alpaca_eval/annotators/pairwise_evaluator.py' 2023-11-08T09:29:00,905 adding 'alpaca_eval/decoders/__init__.py' 2023-11-08T09:29:00,906 adding 'alpaca_eval/decoders/anthropic.py' 2023-11-08T09:29:00,908 adding 'alpaca_eval/decoders/bedrock_anthropic.py' 2023-11-08T09:29:00,910 adding 'alpaca_eval/decoders/cohere.py' 2023-11-08T09:29:00,911 adding 'alpaca_eval/decoders/huggingface_api.py' 2023-11-08T09:29:00,913 adding 'alpaca_eval/decoders/huggingface_local.py' 2023-11-08T09:29:00,914 adding 'alpaca_eval/decoders/jinachat.py' 2023-11-08T09:29:00,917 adding 'alpaca_eval/decoders/openai.py' 2023-11-08T09:29:00,918 adding 'alpaca_eval/decoders/replicate.py' 2023-11-08T09:29:00,920 adding 'alpaca_eval/decoders/vllm_local.py' 2023-11-08T09:29:00,923 adding 'alpaca_eval/evaluators_configs/README.md' 2023-11-08T09:29:00,925 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt' 2023-11-08T09:29:00,926 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml' 2023-11-08T09:29:00,927 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml' 2023-11-08T09:29:00,929 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml' 2023-11-08T09:29:00,931 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt' 2023-11-08T09:29:00,932 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml' 2023-11-08T09:29:00,933 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt' 2023-11-08T09:29:00,935 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt' 2023-11-08T09:29:00,936 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt' 2023-11-08T09:29:00,938 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt' 2023-11-08T09:29:00,939 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt' 2023-11-08T09:29:00,941 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt' 2023-11-08T09:29:00,942 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt' 2023-11-08T09:29:00,944 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt' 2023-11-08T09:29:00,945 adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml' 2023-11-08T09:29:00,946 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt' 2023-11-08T09:29:00,948 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt' 2023-11-08T09:29:00,949 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt' 2023-11-08T09:29:00,951 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt' 2023-11-08T09:29:00,953 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt' 2023-11-08T09:29:00,954 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml' 2023-11-08T09:29:00,956 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt' 2023-11-08T09:29:00,957 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml' 2023-11-08T09:29:00,959 adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml' 2023-11-08T09:29:00,961 adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml' 2023-11-08T09:29:00,962 adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt' 2023-11-08T09:29:00,964 adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml' 2023-11-08T09:29:00,965 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt' 2023-11-08T09:29:00,967 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml' 2023-11-08T09:29:00,969 adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt' 2023-11-08T09:29:00,970 adding 'alpaca_eval/evaluators_configs/claude/configs.yaml' 2023-11-08T09:29:00,971 adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml' 2023-11-08T09:29:00,973 adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml' 2023-11-08T09:29:00,975 adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt' 2023-11-08T09:29:00,976 adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml' 2023-11-08T09:29:00,978 adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml' 2023-11-08T09:29:00,980 adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml' 2023-11-08T09:29:00,981 adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt' 2023-11-08T09:29:00,983 adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml' 2023-11-08T09:29:00,984 adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml' 2023-11-08T09:29:00,986 adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml' 2023-11-08T09:29:00,988 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml' 2023-11-08T09:29:00,989 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt' 2023-11-08T09:29:00,991 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt' 2023-11-08T09:29:00,992 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml' 2023-11-08T09:29:00,993 adding 'alpaca_eval/evaluators_configs/test/configs.yaml' 2023-11-08T09:29:00,995 adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt' 2023-11-08T09:29:00,996 adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml' 2023-11-08T09:29:00,999 adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv' 2023-11-08T09:29:01,000 adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv' 2023-11-08T09:29:01,001 adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv' 2023-11-08T09:29:01,003 adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv' 2023-11-08T09:29:01,004 adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv' 2023-11-08T09:29:01,008 adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml' 2023-11-08T09:29:01,009 adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt' 2023-11-08T09:29:01,011 adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml' 2023-11-08T09:29:01,012 adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml' 2023-11-08T09:29:01,013 adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt' 2023-11-08T09:29:01,015 adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml' 2023-11-08T09:29:01,016 adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt' 2023-11-08T09:29:01,018 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml' 2023-11-08T09:29:01,019 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml' 2023-11-08T09:29:01,021 adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml' 2023-11-08T09:29:01,022 adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt' 2023-11-08T09:29:01,023 adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml' 2023-11-08T09:29:01,024 adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt' 2023-11-08T09:29:01,026 adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml' 2023-11-08T09:29:01,028 adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml' 2023-11-08T09:29:01,029 adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml' 2023-11-08T09:29:01,031 adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml' 2023-11-08T09:29:01,032 adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt' 2023-11-08T09:29:01,033 adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml' 2023-11-08T09:29:01,035 adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt' 2023-11-08T09:29:01,036 adding 'alpaca_eval/models_configs/chatgpt/configs.yaml' 2023-11-08T09:29:01,038 adding 'alpaca_eval/models_configs/claude/configs.yaml' 2023-11-08T09:29:01,039 adding 'alpaca_eval/models_configs/claude/prompt.txt' 2023-11-08T09:29:01,040 adding 'alpaca_eval/models_configs/claude-2/configs.yaml' 2023-11-08T09:29:01,042 adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml' 2023-11-08T09:29:01,044 adding 'alpaca_eval/models_configs/cohere/configs.yaml' 2023-11-08T09:29:01,045 adding 'alpaca_eval/models_configs/cohere/prompt.txt' 2023-11-08T09:29:01,047 adding 'alpaca_eval/models_configs/evo-7b/configs.yaml' 2023-11-08T09:29:01,048 adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml' 2023-11-08T09:29:01,050 adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml' 2023-11-08T09:29:01,052 adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml' 2023-11-08T09:29:01,053 adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml' 2023-11-08T09:29:01,055 adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt' 2023-11-08T09:29:01,056 adding 'alpaca_eval/models_configs/gpt4/configs.yaml' 2023-11-08T09:29:01,058 adding 'alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt' 2023-11-08T09:29:01,059 adding 'alpaca_eval/models_configs/gpt4_turbo/configs.yaml' 2023-11-08T09:29:01,060 adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml' 2023-11-08T09:29:01,062 adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml' 2023-11-08T09:29:01,063 adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml' 2023-11-08T09:29:01,065 adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml' 2023-11-08T09:29:01,066 adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml' 2023-11-08T09:29:01,067 adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt' 2023-11-08T09:29:01,069 adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml' 2023-11-08T09:29:01,070 adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt' 2023-11-08T09:29:01,071 adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml' 2023-11-08T09:29:01,073 adding 'alpaca_eval/models_configs/jina-chat/configs.yaml' 2023-11-08T09:29:01,074 adding 'alpaca_eval/models_configs/jina-chat/prompt.txt' 2023-11-08T09:29:01,076 adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml' 2023-11-08T09:29:01,077 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml' 2023-11-08T09:29:01,078 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt' 2023-11-08T09:29:01,080 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml' 2023-11-08T09:29:01,081 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt' 2023-11-08T09:29:01,082 adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml' 2023-11-08T09:29:01,084 adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt' 2023-11-08T09:29:01,085 adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml' 2023-11-08T09:29:01,086 adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt' 2023-11-08T09:29:01,088 adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml' 2023-11-08T09:29:01,089 adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt' 2023-11-08T09:29:01,092 adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml' 2023-11-08T09:29:01,094 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml' 2023-11-08T09:29:01,095 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt' 2023-11-08T09:29:01,096 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml' 2023-11-08T09:29:01,097 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt' 2023-11-08T09:29:01,099 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml' 2023-11-08T09:29:01,100 adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt' 2023-11-08T09:29:01,102 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml' 2023-11-08T09:29:01,103 adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt' 2023-11-08T09:29:01,105 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml' 2023-11-08T09:29:01,106 adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt' 2023-11-08T09:29:01,108 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml' 2023-11-08T09:29:01,109 adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt' 2023-11-08T09:29:01,111 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml' 2023-11-08T09:29:01,112 adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt' 2023-11-08T09:29:01,113 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml' 2023-11-08T09:29:01,115 adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt' 2023-11-08T09:29:01,116 adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml' 2023-11-08T09:29:01,117 adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt' 2023-11-08T09:29:01,119 adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml' 2023-11-08T09:29:01,121 adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml' 2023-11-08T09:29:01,122 adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml' 2023-11-08T09:29:01,124 adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml' 2023-11-08T09:29:01,125 adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml' 2023-11-08T09:29:01,127 adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml' 2023-11-08T09:29:01,128 adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt' 2023-11-08T09:29:01,129 adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml' 2023-11-08T09:29:01,131 adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml' 2023-11-08T09:29:01,132 adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml' 2023-11-08T09:29:01,134 adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml' 2023-11-08T09:29:01,135 adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml' 2023-11-08T09:29:01,136 adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt' 2023-11-08T09:29:01,138 adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml' 2023-11-08T09:29:01,139 adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt' 2023-11-08T09:29:01,141 adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml' 2023-11-08T09:29:01,142 adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt' 2023-11-08T09:29:01,143 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml' 2023-11-08T09:29:01,144 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt' 2023-11-08T09:29:01,146 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml' 2023-11-08T09:29:01,147 adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt' 2023-11-08T09:29:01,149 adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml' 2023-11-08T09:29:01,150 adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml' 2023-11-08T09:29:01,152 adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml' 2023-11-08T09:29:01,153 adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml' 2023-11-08T09:29:01,154 adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt' 2023-11-08T09:29:01,156 adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml' 2023-11-08T09:29:01,158 adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml' 2023-11-08T09:29:01,159 adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt' 2023-11-08T09:29:01,160 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml' 2023-11-08T09:29:01,162 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml' 2023-11-08T09:29:01,163 adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml' 2023-11-08T09:29:01,165 adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml' 2023-11-08T09:29:01,167 adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml' 2023-11-08T09:29:01,168 adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt' 2023-11-08T09:29:01,170 adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml' 2023-11-08T09:29:01,171 adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt' 2023-11-08T09:29:01,172 adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml' 2023-11-08T09:29:01,175 adding 'alpaca_eval-0.3.3.dist-info/LICENSE' 2023-11-08T09:29:01,185 adding 'alpaca_eval-0.3.3.dist-info/METADATA' 2023-11-08T09:29:01,187 adding 'alpaca_eval-0.3.3.dist-info/WHEEL' 2023-11-08T09:29:01,188 adding 'alpaca_eval-0.3.3.dist-info/entry_points.txt' 2023-11-08T09:29:01,189 adding 'alpaca_eval-0.3.3.dist-info/top_level.txt' 2023-11-08T09:29:01,192 adding 'alpaca_eval-0.3.3.dist-info/RECORD' 2023-11-08T09:29:01,197 removing build/bdist.linux-armv7l/wheel 2023-11-08T09:29:01,386 Building wheel for alpaca-eval (setup.py): finished with status 'done' 2023-11-08T09:29:01,391 Created wheel for alpaca-eval: filename=alpaca_eval-0.3.3-py3-none-any.whl size=188258 sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 2023-11-08T09:29:01,392 Stored in directory: /tmp/pip-ephem-wheel-cache-rwmu2vnp/wheels/78/e9/2e/2427dd8015f2bbe9a2d8ab903a951972a2a5485584ec7cccd3 2023-11-08T09:29:01,420 Successfully built alpaca-eval 2023-11-08T09:29:01,427 Removed build tracker: '/tmp/pip-build-tracker-318v1l1x'