2023-09-25T23:17:46,991 Created temporary directory: /tmp/pip-build-tracker-8xe382mk 2023-09-25T23:17:46,992 Initialized build tracking at /tmp/pip-build-tracker-8xe382mk 2023-09-25T23:17:46,993 Created build tracker: /tmp/pip-build-tracker-8xe382mk 2023-09-25T23:17:46,993 Entered build tracker: /tmp/pip-build-tracker-8xe382mk 2023-09-25T23:17:46,994 Created temporary directory: /tmp/pip-wheel-lhzu9514 2023-09-25T23:17:46,997 Created temporary directory: /tmp/pip-ephem-wheel-cache-ja_cr3m1 2023-09-25T23:17:47,018 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-09-25T23:17:47,022 2 location(s) to search for versions of alpaca-eval: 2023-09-25T23:17:47,022 * https://pypi.org/simple/alpaca-eval/ 2023-09-25T23:17:47,022 * https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T23:17:47,023 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/ 2023-09-25T23:17:47,024 Getting page https://pypi.org/simple/alpaca-eval/ 2023-09-25T23:17:47,026 Found index url https://pypi.org/simple/ 2023-09-25T23:17:47,240 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json 2023-09-25T23:17:47,249 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T23:17:47,250 Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0 2023-09-25T23:17:47,250 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T23:17:47,251 Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1 2023-09-25T23:17:47,252 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T23:17:47,253 Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2 2023-09-25T23:17:47,254 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,255 Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3 2023-09-25T23:17:47,256 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,256 Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5 2023-09-25T23:17:47,257 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,258 Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6 2023-09-25T23:17:47,259 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,260 Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7 2023-09-25T23:17:47,260 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,261 Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8 2023-09-25T23:17:47,262 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,263 Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0 2023-09-25T23:17:47,263 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,264 Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1 2023-09-25T23:17:47,265 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,266 Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2 2023-09-25T23:17:47,266 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,267 Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3 2023-09-25T23:17:47,268 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,269 Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4 2023-09-25T23:17:47,269 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,270 Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5 2023-09-25T23:17:47,271 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,272 Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6 2023-09-25T23:17:47,272 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,273 Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7 2023-09-25T23:17:47,274 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,275 Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8 2023-09-25T23:17:47,275 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,276 Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9 2023-09-25T23:17:47,277 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,278 Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0 2023-09-25T23:17:47,278 Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,279 Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1 2023-09-25T23:17:47,280 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T23:17:47,281 Getting page https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T23:17:47,282 Found index url https://www.piwheels.org/simple/ 2023-09-25T23:17:47,459 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html 2023-09-25T23:17:47,463 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,464 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,464 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,464 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,465 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10) 2023-09-25T23:17:47,465 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T23:17:47,466 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T23:17:47,466 Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9) 2023-09-25T23:17:47,467 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/ 2023-09-25T23:17:47,468 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/ 2023-09-25T23:17:47,488 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates 2023-09-25T23:17:47,507 Collecting alpaca-eval==0.2.4 2023-09-25T23:17:47,509 Created temporary directory: /tmp/pip-unpack-50ufclca 2023-09-25T23:17:47,644 Downloading alpaca_eval-0.2.4.tar.gz (291 kB) 2023-09-25T23:17:48,061 Added alpaca-eval==0.2.4 from https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz to build tracker '/tmp/pip-build-tracker-8xe382mk' 2023-09-25T23:17:48,062 Running setup.py (path:/tmp/pip-wheel-lhzu9514/alpaca-eval_eb0598b36dea4bdaa51980214aed4228/setup.py) egg_info for package alpaca-eval 2023-09-25T23:17:48,063 Created temporary directory: /tmp/pip-pip-egg-info-kvyr232q 2023-09-25T23:17:48,064 Preparing metadata (setup.py): started 2023-09-25T23:17:48,065 Running command python setup.py egg_info 2023-09-25T23:17:49,080 running egg_info 2023-09-25T23:17:49,081 creating /tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info 2023-09-25T23:17:49,105 writing /tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/PKG-INFO 2023-09-25T23:17:49,123 writing dependency_links to /tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/dependency_links.txt 2023-09-25T23:17:49,124 writing entry points to /tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/entry_points.txt 2023-09-25T23:17:49,133 writing requirements to /tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/requires.txt 2023-09-25T23:17:49,134 writing top-level names to /tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/top_level.txt 2023-09-25T23:17:49,136 writing manifest file '/tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T23:17:49,213 reading manifest file '/tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T23:17:49,214 reading manifest template 'MANIFEST.in' 2023-09-25T23:17:49,296 adding license file 'LICENSE' 2023-09-25T23:17:49,302 writing manifest file '/tmp/pip-pip-egg-info-kvyr232q/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T23:17:49,410 Preparing metadata (setup.py): finished with status 'done' 2023-09-25T23:17:49,417 Source in /tmp/pip-wheel-lhzu9514/alpaca-eval_eb0598b36dea4bdaa51980214aed4228 has version 0.2.4, which satisfies requirement alpaca-eval==0.2.4 from https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz 2023-09-25T23:17:49,418 Removed alpaca-eval==0.2.4 from https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz from build tracker '/tmp/pip-build-tracker-8xe382mk' 2023-09-25T23:17:49,431 Created temporary directory: /tmp/pip-unpack-k3d8je48 2023-09-25T23:17:49,432 Created temporary directory: /tmp/pip-unpack-w3tdoelc 2023-09-25T23:17:49,563 Building wheels for collected packages: alpaca-eval 2023-09-25T23:17:49,567 Created temporary directory: /tmp/pip-wheel-cwg8is_0 2023-09-25T23:17:49,568 Building wheel for alpaca-eval (setup.py): started 2023-09-25T23:17:49,569 Destination directory: /tmp/pip-wheel-cwg8is_0 2023-09-25T23:17:49,570 Running command python setup.py bdist_wheel 2023-09-25T23:17:50,537 running bdist_wheel 2023-09-25T23:17:50,627 running build 2023-09-25T23:17:50,627 running build_py 2023-09-25T23:17:50,653 creating build 2023-09-25T23:17:50,654 creating build/lib 2023-09-25T23:17:50,654 creating build/lib/alpaca_eval 2023-09-25T23:17:50,655 copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,658 copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,659 copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,662 copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,664 copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,665 copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,668 copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,670 copying src/alpaca_eval/types.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,672 copying src/alpaca_eval/main.py -> build/lib/alpaca_eval 2023-09-25T23:17:50,675 creating build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,675 copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,678 copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,679 copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,681 copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,683 copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,685 copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,687 copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders 2023-09-25T23:17:50,689 creating build/lib/alpaca_eval/annotators 2023-09-25T23:17:50,690 copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators 2023-09-25T23:17:50,692 copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators 2023-09-25T23:17:50,694 copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators 2023-09-25T23:17:50,696 running egg_info 2023-09-25T23:17:50,749 writing src/alpaca_eval.egg-info/PKG-INFO 2023-09-25T23:17:50,767 writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt 2023-09-25T23:17:50,768 writing entry points to src/alpaca_eval.egg-info/entry_points.txt 2023-09-25T23:17:50,776 writing requirements to src/alpaca_eval.egg-info/requires.txt 2023-09-25T23:17:50,777 writing top-level names to src/alpaca_eval.egg-info/top_level.txt 2023-09-25T23:17:50,804 reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T23:17:50,809 reading manifest template 'MANIFEST.in' 2023-09-25T23:17:50,872 adding license file 'LICENSE' 2023-09-25T23:17:50,879 writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt' 2023-09-25T23:17:50,882 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration. 2023-09-25T23:17:50,883 !! 2023-09-25T23:17:50,884 ******************************************************************************** 2023-09-25T23:17:50,885 ############################ 2023-09-25T23:17:50,885 # Package would be ignored # 2023-09-25T23:17:50,885 ############################ 2023-09-25T23:17:50,886 Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1], 2023-09-25T23:17:50,886 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:50,887 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:50,888 package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added 2023-09-25T23:17:50,888 to the `packages` configuration field. 2023-09-25T23:17:50,889 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:50,890 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:50,890 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:50,891 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:50,892 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:50,894 If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are 2023-09-25T23:17:50,894 already explicitly excluding 'alpaca_eval.evaluators_configs' via 2023-09-25T23:17:50,895 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:50,895 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:50,896 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:50,897 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:50,897 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:50,899 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:50,899 even if it does not contain any `.py` files. 2023-09-25T23:17:50,900 On the other hand, currently there is no concept of package data 2023-09-25T23:17:50,900 directory, all directories are treated like packages. 2023-09-25T23:17:50,901 ******************************************************************************** 2023-09-25T23:17:50,902 !! 2023-09-25T23:17:50,902 check.warn(importable) 2023-09-25T23:17:50,903 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:50,904 !! 2023-09-25T23:17:50,905 ******************************************************************************** 2023-09-25T23:17:50,905 ############################ 2023-09-25T23:17:50,906 # Package would be ignored # 2023-09-25T23:17:50,906 ############################ 2023-09-25T23:17:50,907 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1], 2023-09-25T23:17:50,907 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:50,908 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:50,908 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added 2023-09-25T23:17:50,909 to the `packages` configuration field. 2023-09-25T23:17:50,909 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:50,910 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:50,910 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:50,911 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:50,911 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:50,912 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are 2023-09-25T23:17:50,912 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via 2023-09-25T23:17:50,913 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:50,913 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:50,914 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:50,915 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:50,916 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:50,917 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:50,918 even if it does not contain any `.py` files. 2023-09-25T23:17:50,918 On the other hand, currently there is no concept of package data 2023-09-25T23:17:50,919 directory, all directories are treated like packages. 2023-09-25T23:17:50,920 ******************************************************************************** 2023-09-25T23:17:50,921 !! 2023-09-25T23:17:50,921 check.warn(importable) 2023-09-25T23:17:50,922 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration. 2023-09-25T23:17:50,922 !! 2023-09-25T23:17:50,923 ******************************************************************************** 2023-09-25T23:17:50,924 ############################ 2023-09-25T23:17:50,924 # Package would be ignored # 2023-09-25T23:17:50,925 ############################ 2023-09-25T23:17:50,925 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1], 2023-09-25T23:17:50,926 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:50,927 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:50,927 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added 2023-09-25T23:17:50,927 to the `packages` configuration field. 2023-09-25T23:17:50,928 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:50,929 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:50,929 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:50,931 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:50,932 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:50,933 If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are 2023-09-25T23:17:50,933 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via 2023-09-25T23:17:50,933 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:50,934 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:50,934 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:50,935 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:50,936 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:50,937 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:50,937 even if it does not contain any `.py` files. 2023-09-25T23:17:50,937 On the other hand, currently there is no concept of package data 2023-09-25T23:17:50,938 directory, all directories are treated like packages. 2023-09-25T23:17:50,938 ******************************************************************************** 2023-09-25T23:17:50,939 !! 2023-09-25T23:17:50,939 check.warn(importable) 2023-09-25T23:17:50,940 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration. 2023-09-25T23:17:50,940 !! 2023-09-25T23:17:50,941 ******************************************************************************** 2023-09-25T23:17:50,942 ############################ 2023-09-25T23:17:50,942 # Package would be ignored # 2023-09-25T23:17:50,943 ############################ 2023-09-25T23:17:50,943 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1], 2023-09-25T23:17:50,944 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:50,945 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:50,945 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added 2023-09-25T23:17:50,946 to the `packages` configuration field. 2023-09-25T23:17:50,947 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:50,948 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:50,948 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:50,949 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:50,950 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:50,951 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are 2023-09-25T23:17:50,951 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via 2023-09-25T23:17:50,952 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:50,952 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:50,953 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:50,954 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:50,955 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:50,956 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:50,957 even if it does not contain any `.py` files. 2023-09-25T23:17:50,957 On the other hand, currently there is no concept of package data 2023-09-25T23:17:50,958 directory, all directories are treated like packages. 2023-09-25T23:17:50,959 ******************************************************************************** 2023-09-25T23:17:50,959 !! 2023-09-25T23:17:50,960 check.warn(importable) 2023-09-25T23:17:50,960 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:50,960 !! 2023-09-25T23:17:50,961 ******************************************************************************** 2023-09-25T23:17:50,961 ############################ 2023-09-25T23:17:50,962 # Package would be ignored # 2023-09-25T23:17:50,962 ############################ 2023-09-25T23:17:50,962 Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1], 2023-09-25T23:17:50,963 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:50,964 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:50,964 package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added 2023-09-25T23:17:50,964 to the `packages` configuration field. 2023-09-25T23:17:50,965 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:50,965 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:50,966 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:50,967 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:50,968 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:50,969 If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are 2023-09-25T23:17:50,969 already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via 2023-09-25T23:17:50,970 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:50,970 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:50,971 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:50,972 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:50,973 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:50,975 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:50,975 even if it does not contain any `.py` files. 2023-09-25T23:17:50,976 On the other hand, currently there is no concept of package data 2023-09-25T23:17:50,976 directory, all directories are treated like packages. 2023-09-25T23:17:50,977 ******************************************************************************** 2023-09-25T23:17:50,978 !! 2023-09-25T23:17:50,978 check.warn(importable) 2023-09-25T23:17:50,978 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:50,979 !! 2023-09-25T23:17:50,980 ******************************************************************************** 2023-09-25T23:17:50,981 ############################ 2023-09-25T23:17:50,981 # Package would be ignored # 2023-09-25T23:17:50,982 ############################ 2023-09-25T23:17:50,982 Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1], 2023-09-25T23:17:50,983 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:50,984 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:50,984 package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added 2023-09-25T23:17:50,985 to the `packages` configuration field. 2023-09-25T23:17:50,985 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:50,986 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:50,986 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:50,987 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:50,987 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:50,988 If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are 2023-09-25T23:17:50,988 already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via 2023-09-25T23:17:50,989 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:50,989 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:50,989 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:50,990 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:50,991 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:50,992 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:50,993 even if it does not contain any `.py` files. 2023-09-25T23:17:50,994 On the other hand, currently there is no concept of package data 2023-09-25T23:17:50,994 directory, all directories are treated like packages. 2023-09-25T23:17:50,995 ******************************************************************************** 2023-09-25T23:17:50,996 !! 2023-09-25T23:17:50,996 check.warn(importable) 2023-09-25T23:17:50,997 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration. 2023-09-25T23:17:50,997 !! 2023-09-25T23:17:50,998 ******************************************************************************** 2023-09-25T23:17:50,999 ############################ 2023-09-25T23:17:51,000 # Package would be ignored # 2023-09-25T23:17:51,000 ############################ 2023-09-25T23:17:51,001 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1], 2023-09-25T23:17:51,001 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,002 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,003 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added 2023-09-25T23:17:51,003 to the `packages` configuration field. 2023-09-25T23:17:51,004 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,004 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,005 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,006 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,007 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,008 If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are 2023-09-25T23:17:51,008 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via 2023-09-25T23:17:51,009 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,009 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,010 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,011 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,012 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,013 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,013 even if it does not contain any `.py` files. 2023-09-25T23:17:51,013 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,013 directory, all directories are treated like packages. 2023-09-25T23:17:51,014 ******************************************************************************** 2023-09-25T23:17:51,014 !! 2023-09-25T23:17:51,015 check.warn(importable) 2023-09-25T23:17:51,015 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration. 2023-09-25T23:17:51,015 !! 2023-09-25T23:17:51,016 ******************************************************************************** 2023-09-25T23:17:51,016 ############################ 2023-09-25T23:17:51,017 # Package would be ignored # 2023-09-25T23:17:51,017 ############################ 2023-09-25T23:17:51,017 Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1], 2023-09-25T23:17:51,018 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,019 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,019 package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added 2023-09-25T23:17:51,020 to the `packages` configuration field. 2023-09-25T23:17:51,021 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,021 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,022 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,023 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,024 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,025 If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are 2023-09-25T23:17:51,026 already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via 2023-09-25T23:17:51,026 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,026 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,027 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,028 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,029 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,030 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,031 even if it does not contain any `.py` files. 2023-09-25T23:17:51,031 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,032 directory, all directories are treated like packages. 2023-09-25T23:17:51,032 ******************************************************************************** 2023-09-25T23:17:51,033 !! 2023-09-25T23:17:51,034 check.warn(importable) 2023-09-25T23:17:51,034 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration. 2023-09-25T23:17:51,035 !! 2023-09-25T23:17:51,036 ******************************************************************************** 2023-09-25T23:17:51,036 ############################ 2023-09-25T23:17:51,037 # Package would be ignored # 2023-09-25T23:17:51,037 ############################ 2023-09-25T23:17:51,037 Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1], 2023-09-25T23:17:51,038 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,038 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,039 package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added 2023-09-25T23:17:51,039 to the `packages` configuration field. 2023-09-25T23:17:51,040 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,040 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,040 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,041 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,042 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,043 If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are 2023-09-25T23:17:51,043 already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via 2023-09-25T23:17:51,044 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,044 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,045 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,046 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,047 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,049 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,049 even if it does not contain any `.py` files. 2023-09-25T23:17:51,050 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,050 directory, all directories are treated like packages. 2023-09-25T23:17:51,051 ******************************************************************************** 2023-09-25T23:17:51,052 !! 2023-09-25T23:17:51,052 check.warn(importable) 2023-09-25T23:17:51,052 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration. 2023-09-25T23:17:51,053 !! 2023-09-25T23:17:51,054 ******************************************************************************** 2023-09-25T23:17:51,054 ############################ 2023-09-25T23:17:51,055 # Package would be ignored # 2023-09-25T23:17:51,055 ############################ 2023-09-25T23:17:51,056 Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1], 2023-09-25T23:17:51,056 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,057 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,058 package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added 2023-09-25T23:17:51,058 to the `packages` configuration field. 2023-09-25T23:17:51,059 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,060 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,060 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,061 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,062 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,063 If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are 2023-09-25T23:17:51,063 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via 2023-09-25T23:17:51,063 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,064 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,064 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,065 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,065 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,066 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,067 even if it does not contain any `.py` files. 2023-09-25T23:17:51,067 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,067 directory, all directories are treated like packages. 2023-09-25T23:17:51,068 ******************************************************************************** 2023-09-25T23:17:51,069 !! 2023-09-25T23:17:51,069 check.warn(importable) 2023-09-25T23:17:51,069 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration. 2023-09-25T23:17:51,070 !! 2023-09-25T23:17:51,071 ******************************************************************************** 2023-09-25T23:17:51,071 ############################ 2023-09-25T23:17:51,072 # Package would be ignored # 2023-09-25T23:17:51,072 ############################ 2023-09-25T23:17:51,073 Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1], 2023-09-25T23:17:51,073 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,075 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,075 package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added 2023-09-25T23:17:51,076 to the `packages` configuration field. 2023-09-25T23:17:51,076 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,077 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,077 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,078 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,079 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,080 If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are 2023-09-25T23:17:51,080 already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via 2023-09-25T23:17:51,081 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,081 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,082 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,083 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,084 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,086 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,087 even if it does not contain any `.py` files. 2023-09-25T23:17:51,315 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,316 directory, all directories are treated like packages. 2023-09-25T23:17:51,316 ******************************************************************************** 2023-09-25T23:17:51,317 !! 2023-09-25T23:17:51,317 check.warn(importable) 2023-09-25T23:17:51,317 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration. 2023-09-25T23:17:51,318 !! 2023-09-25T23:17:51,318 ******************************************************************************** 2023-09-25T23:17:51,319 ############################ 2023-09-25T23:17:51,319 # Package would be ignored # 2023-09-25T23:17:51,319 ############################ 2023-09-25T23:17:51,320 Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1], 2023-09-25T23:17:51,320 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,321 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,321 package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added 2023-09-25T23:17:51,321 to the `packages` configuration field. 2023-09-25T23:17:51,322 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,323 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,323 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,324 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,325 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,326 If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are 2023-09-25T23:17:51,327 already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via 2023-09-25T23:17:51,327 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,328 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,328 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,329 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,331 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,332 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,332 even if it does not contain any `.py` files. 2023-09-25T23:17:51,333 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,333 directory, all directories are treated like packages. 2023-09-25T23:17:51,334 ******************************************************************************** 2023-09-25T23:17:51,335 !! 2023-09-25T23:17:51,335 check.warn(importable) 2023-09-25T23:17:51,336 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:51,336 !! 2023-09-25T23:17:51,337 ******************************************************************************** 2023-09-25T23:17:51,338 ############################ 2023-09-25T23:17:51,338 # Package would be ignored # 2023-09-25T23:17:51,339 ############################ 2023-09-25T23:17:51,339 Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1], 2023-09-25T23:17:51,340 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,341 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,342 package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added 2023-09-25T23:17:51,342 to the `packages` configuration field. 2023-09-25T23:17:51,343 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,343 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,344 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,344 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,345 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,346 If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are 2023-09-25T23:17:51,346 already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via 2023-09-25T23:17:51,347 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,347 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,347 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,348 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,349 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,350 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,351 even if it does not contain any `.py` files. 2023-09-25T23:17:51,352 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,352 directory, all directories are treated like packages. 2023-09-25T23:17:51,352 ******************************************************************************** 2023-09-25T23:17:51,353 !! 2023-09-25T23:17:51,354 check.warn(importable) 2023-09-25T23:17:51,354 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration. 2023-09-25T23:17:51,355 !! 2023-09-25T23:17:51,356 ******************************************************************************** 2023-09-25T23:17:51,356 ############################ 2023-09-25T23:17:51,356 # Package would be ignored # 2023-09-25T23:17:51,357 ############################ 2023-09-25T23:17:51,358 Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1], 2023-09-25T23:17:51,358 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,359 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,359 package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added 2023-09-25T23:17:51,360 to the `packages` configuration field. 2023-09-25T23:17:51,361 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,362 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,362 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,363 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,364 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,365 If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are 2023-09-25T23:17:51,366 already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via 2023-09-25T23:17:51,366 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,367 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,367 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,368 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,370 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,372 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,373 even if it does not contain any `.py` files. 2023-09-25T23:17:51,373 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,374 directory, all directories are treated like packages. 2023-09-25T23:17:51,374 ******************************************************************************** 2023-09-25T23:17:51,375 !! 2023-09-25T23:17:51,376 check.warn(importable) 2023-09-25T23:17:51,376 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:51,377 !! 2023-09-25T23:17:51,377 ******************************************************************************** 2023-09-25T23:17:51,378 ############################ 2023-09-25T23:17:51,378 # Package would be ignored # 2023-09-25T23:17:51,379 ############################ 2023-09-25T23:17:51,379 Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1], 2023-09-25T23:17:51,379 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,380 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,381 package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added 2023-09-25T23:17:51,381 to the `packages` configuration field. 2023-09-25T23:17:51,382 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,383 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,383 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,384 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,385 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,386 If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are 2023-09-25T23:17:51,387 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via 2023-09-25T23:17:51,387 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,388 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,388 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,389 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,390 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,391 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,392 even if it does not contain any `.py` files. 2023-09-25T23:17:51,392 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,393 directory, all directories are treated like packages. 2023-09-25T23:17:51,393 ******************************************************************************** 2023-09-25T23:17:51,394 !! 2023-09-25T23:17:51,395 check.warn(importable) 2023-09-25T23:17:51,395 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:51,396 !! 2023-09-25T23:17:51,397 ******************************************************************************** 2023-09-25T23:17:51,397 ############################ 2023-09-25T23:17:51,398 # Package would be ignored # 2023-09-25T23:17:51,398 ############################ 2023-09-25T23:17:51,399 Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1], 2023-09-25T23:17:51,399 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,400 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,400 package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added 2023-09-25T23:17:51,401 to the `packages` configuration field. 2023-09-25T23:17:51,402 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,402 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,403 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,403 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,404 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,405 If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are 2023-09-25T23:17:51,406 already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via 2023-09-25T23:17:51,406 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,406 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,407 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,408 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,409 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,410 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,410 even if it does not contain any `.py` files. 2023-09-25T23:17:51,411 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,411 directory, all directories are treated like packages. 2023-09-25T23:17:51,412 ******************************************************************************** 2023-09-25T23:17:51,413 !! 2023-09-25T23:17:51,414 check.warn(importable) 2023-09-25T23:17:51,414 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:51,415 !! 2023-09-25T23:17:51,416 ******************************************************************************** 2023-09-25T23:17:51,416 ############################ 2023-09-25T23:17:51,416 # Package would be ignored # 2023-09-25T23:17:51,417 ############################ 2023-09-25T23:17:51,417 Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1], 2023-09-25T23:17:51,418 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,419 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,420 package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added 2023-09-25T23:17:51,420 to the `packages` configuration field. 2023-09-25T23:17:51,422 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,422 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,423 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,424 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,424 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,425 If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are 2023-09-25T23:17:51,426 already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via 2023-09-25T23:17:51,426 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,426 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,427 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,428 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,428 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,430 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,430 even if it does not contain any `.py` files. 2023-09-25T23:17:51,431 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,431 directory, all directories are treated like packages. 2023-09-25T23:17:51,431 ******************************************************************************** 2023-09-25T23:17:51,433 !! 2023-09-25T23:17:51,433 check.warn(importable) 2023-09-25T23:17:51,434 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration. 2023-09-25T23:17:51,434 !! 2023-09-25T23:17:51,435 ******************************************************************************** 2023-09-25T23:17:51,436 ############################ 2023-09-25T23:17:51,436 # Package would be ignored # 2023-09-25T23:17:51,437 ############################ 2023-09-25T23:17:51,437 Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1], 2023-09-25T23:17:51,438 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,439 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,439 package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added 2023-09-25T23:17:51,440 to the `packages` configuration field. 2023-09-25T23:17:51,441 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,441 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,442 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,443 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,444 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,445 If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are 2023-09-25T23:17:51,445 already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via 2023-09-25T23:17:51,446 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,446 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,447 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,448 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,449 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,451 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,451 even if it does not contain any `.py` files. 2023-09-25T23:17:51,451 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,452 directory, all directories are treated like packages. 2023-09-25T23:17:51,452 ******************************************************************************** 2023-09-25T23:17:51,453 !! 2023-09-25T23:17:51,454 check.warn(importable) 2023-09-25T23:17:51,454 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration. 2023-09-25T23:17:51,454 !! 2023-09-25T23:17:51,455 ******************************************************************************** 2023-09-25T23:17:51,456 ############################ 2023-09-25T23:17:51,456 # Package would be ignored # 2023-09-25T23:17:51,457 ############################ 2023-09-25T23:17:51,457 Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1], 2023-09-25T23:17:51,458 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,459 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,459 package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added 2023-09-25T23:17:51,460 to the `packages` configuration field. 2023-09-25T23:17:51,461 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,461 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,462 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,463 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,464 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,465 If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are 2023-09-25T23:17:51,465 already explicitly excluding 'alpaca_eval.evaluators_configs.test' via 2023-09-25T23:17:51,466 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,466 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,467 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,468 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,468 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,470 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,471 even if it does not contain any `.py` files. 2023-09-25T23:17:51,471 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,472 directory, all directories are treated like packages. 2023-09-25T23:17:51,472 ******************************************************************************** 2023-09-25T23:17:51,473 !! 2023-09-25T23:17:51,474 check.warn(importable) 2023-09-25T23:17:51,474 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration. 2023-09-25T23:17:51,475 !! 2023-09-25T23:17:51,476 ******************************************************************************** 2023-09-25T23:17:51,477 ############################ 2023-09-25T23:17:51,477 # Package would be ignored # 2023-09-25T23:17:51,478 ############################ 2023-09-25T23:17:51,479 Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1], 2023-09-25T23:17:51,479 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,480 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,480 package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added 2023-09-25T23:17:51,481 to the `packages` configuration field. 2023-09-25T23:17:51,482 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,482 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,483 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,483 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,484 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,485 If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are 2023-09-25T23:17:51,485 already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via 2023-09-25T23:17:51,486 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,486 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,487 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,488 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,489 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,490 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,491 even if it does not contain any `.py` files. 2023-09-25T23:17:51,492 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,492 directory, all directories are treated like packages. 2023-09-25T23:17:51,493 ******************************************************************************** 2023-09-25T23:17:51,494 !! 2023-09-25T23:17:51,495 check.warn(importable) 2023-09-25T23:17:51,496 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration. 2023-09-25T23:17:51,497 !! 2023-09-25T23:17:51,499 ******************************************************************************** 2023-09-25T23:17:51,500 ############################ 2023-09-25T23:17:51,501 # Package would be ignored # 2023-09-25T23:17:51,502 ############################ 2023-09-25T23:17:51,503 Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1], 2023-09-25T23:17:51,505 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,506 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,506 package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added 2023-09-25T23:17:51,507 to the `packages` configuration field. 2023-09-25T23:17:51,508 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,508 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,509 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,510 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,511 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,512 If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are 2023-09-25T23:17:51,513 already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via 2023-09-25T23:17:51,513 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,513 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,514 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,515 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,515 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,517 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,517 even if it does not contain any `.py` files. 2023-09-25T23:17:51,517 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,518 directory, all directories are treated like packages. 2023-09-25T23:17:51,518 ******************************************************************************** 2023-09-25T23:17:51,519 !! 2023-09-25T23:17:51,520 check.warn(importable) 2023-09-25T23:17:51,520 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration. 2023-09-25T23:17:51,521 !! 2023-09-25T23:17:51,522 ******************************************************************************** 2023-09-25T23:17:51,522 ############################ 2023-09-25T23:17:51,523 # Package would be ignored # 2023-09-25T23:17:51,523 ############################ 2023-09-25T23:17:51,524 Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1], 2023-09-25T23:17:51,525 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,526 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,527 package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added 2023-09-25T23:17:51,528 to the `packages` configuration field. 2023-09-25T23:17:51,529 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,530 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,531 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,533 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,535 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,537 If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are 2023-09-25T23:17:51,538 already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via 2023-09-25T23:17:51,540 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,541 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,542 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,545 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,548 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,552 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,554 even if it does not contain any `.py` files. 2023-09-25T23:17:51,556 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,558 directory, all directories are treated like packages. 2023-09-25T23:17:51,560 ******************************************************************************** 2023-09-25T23:17:51,566 !! 2023-09-25T23:17:51,568 check.warn(importable) 2023-09-25T23:17:51,571 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration. 2023-09-25T23:17:51,573 !! 2023-09-25T23:17:51,575 ******************************************************************************** 2023-09-25T23:17:51,576 ############################ 2023-09-25T23:17:51,577 # Package would be ignored # 2023-09-25T23:17:51,578 ############################ 2023-09-25T23:17:51,579 Python recognizes 'alpaca_eval.models_configs' as an importable package[^1], 2023-09-25T23:17:51,580 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,582 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,583 package, please make sure that 'alpaca_eval.models_configs' is explicitly added 2023-09-25T23:17:51,584 to the `packages` configuration field. 2023-09-25T23:17:51,586 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,587 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,587 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,589 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,590 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,592 If you don't want 'alpaca_eval.models_configs' to be distributed and are 2023-09-25T23:17:51,593 already explicitly excluding 'alpaca_eval.models_configs' via 2023-09-25T23:17:51,594 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,595 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,596 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,597 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,599 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,602 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,603 even if it does not contain any `.py` files. 2023-09-25T23:17:51,604 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,604 directory, all directories are treated like packages. 2023-09-25T23:17:51,605 ******************************************************************************** 2023-09-25T23:17:51,606 !! 2023-09-25T23:17:51,606 check.warn(importable) 2023-09-25T23:17:51,607 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.chatgpt' is absent from the `packages` configuration. 2023-09-25T23:17:51,607 !! 2023-09-25T23:17:51,608 ******************************************************************************** 2023-09-25T23:17:51,609 ############################ 2023-09-25T23:17:51,610 # Package would be ignored # 2023-09-25T23:17:51,610 ############################ 2023-09-25T23:17:51,611 Python recognizes 'alpaca_eval.models_configs.chatgpt' as an importable package[^1], 2023-09-25T23:17:51,612 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,614 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,615 package, please make sure that 'alpaca_eval.models_configs.chatgpt' is explicitly added 2023-09-25T23:17:51,616 to the `packages` configuration field. 2023-09-25T23:17:51,618 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,619 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,620 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,622 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,624 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,625 If you don't want 'alpaca_eval.models_configs.chatgpt' to be distributed and are 2023-09-25T23:17:51,626 already explicitly excluding 'alpaca_eval.models_configs.chatgpt' via 2023-09-25T23:17:51,626 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,627 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,627 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,628 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,629 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,632 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,632 even if it does not contain any `.py` files. 2023-09-25T23:17:51,633 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,634 directory, all directories are treated like packages. 2023-09-25T23:17:51,634 ******************************************************************************** 2023-09-25T23:17:51,636 !! 2023-09-25T23:17:51,636 check.warn(importable) 2023-09-25T23:17:51,637 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration. 2023-09-25T23:17:51,638 !! 2023-09-25T23:17:51,639 ******************************************************************************** 2023-09-25T23:17:51,640 ############################ 2023-09-25T23:17:51,641 # Package would be ignored # 2023-09-25T23:17:51,642 ############################ 2023-09-25T23:17:51,643 Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1], 2023-09-25T23:17:51,644 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,646 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,647 package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added 2023-09-25T23:17:51,649 to the `packages` configuration field. 2023-09-25T23:17:51,651 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,653 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,655 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,658 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,661 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,665 If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are 2023-09-25T23:17:51,667 already explicitly excluding 'alpaca_eval.models_configs.claude' via 2023-09-25T23:17:51,669 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,670 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,671 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,673 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,674 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,677 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,677 even if it does not contain any `.py` files. 2023-09-25T23:17:51,678 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,678 directory, all directories are treated like packages. 2023-09-25T23:17:51,679 ******************************************************************************** 2023-09-25T23:17:51,680 !! 2023-09-25T23:17:51,681 check.warn(importable) 2023-09-25T23:17:51,682 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration. 2023-09-25T23:17:51,682 !! 2023-09-25T23:17:51,684 ******************************************************************************** 2023-09-25T23:17:51,684 ############################ 2023-09-25T23:17:51,685 # Package would be ignored # 2023-09-25T23:17:51,685 ############################ 2023-09-25T23:17:51,686 Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1], 2023-09-25T23:17:51,687 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,688 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,689 package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added 2023-09-25T23:17:51,689 to the `packages` configuration field. 2023-09-25T23:17:51,691 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,691 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,692 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,693 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,695 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,696 If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are 2023-09-25T23:17:51,697 already explicitly excluding 'alpaca_eval.models_configs.cohere' via 2023-09-25T23:17:51,698 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,698 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,699 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,701 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,702 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,704 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,705 even if it does not contain any `.py` files. 2023-09-25T23:17:51,706 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,707 directory, all directories are treated like packages. 2023-09-25T23:17:51,707 ******************************************************************************** 2023-09-25T23:17:51,709 !! 2023-09-25T23:17:51,709 check.warn(importable) 2023-09-25T23:17:51,710 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration. 2023-09-25T23:17:51,711 !! 2023-09-25T23:17:51,712 ******************************************************************************** 2023-09-25T23:17:51,713 ############################ 2023-09-25T23:17:51,714 # Package would be ignored # 2023-09-25T23:17:51,714 ############################ 2023-09-25T23:17:51,715 Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1], 2023-09-25T23:17:51,716 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,718 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,718 package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added 2023-09-25T23:17:51,719 to the `packages` configuration field. 2023-09-25T23:17:51,720 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,721 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,722 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,723 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,724 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,725 If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are 2023-09-25T23:17:51,726 already explicitly excluding 'alpaca_eval.models_configs.gpt4' via 2023-09-25T23:17:51,727 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,727 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,728 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,729 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,731 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,733 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,733 even if it does not contain any `.py` files. 2023-09-25T23:17:51,735 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,735 directory, all directories are treated like packages. 2023-09-25T23:17:51,736 ******************************************************************************** 2023-09-25T23:17:51,737 !! 2023-09-25T23:17:51,738 check.warn(importable) 2023-09-25T23:17:51,739 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration. 2023-09-25T23:17:51,740 !! 2023-09-25T23:17:51,741 ******************************************************************************** 2023-09-25T23:17:51,742 ############################ 2023-09-25T23:17:51,743 # Package would be ignored # 2023-09-25T23:17:51,744 ############################ 2023-09-25T23:17:51,967 Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1], 2023-09-25T23:17:51,968 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:51,970 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:51,971 package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added 2023-09-25T23:17:51,973 to the `packages` configuration field. 2023-09-25T23:17:51,975 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:51,976 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:51,977 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:51,980 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:51,982 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:51,984 If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are 2023-09-25T23:17:51,985 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via 2023-09-25T23:17:51,986 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:51,988 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:51,989 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:51,991 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:51,993 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:51,996 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:51,997 even if it does not contain any `.py` files. 2023-09-25T23:17:51,997 On the other hand, currently there is no concept of package data 2023-09-25T23:17:51,998 directory, all directories are treated like packages. 2023-09-25T23:17:51,999 ******************************************************************************** 2023-09-25T23:17:52,000 !! 2023-09-25T23:17:52,001 check.warn(importable) 2023-09-25T23:17:52,002 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration. 2023-09-25T23:17:52,003 !! 2023-09-25T23:17:52,004 ******************************************************************************** 2023-09-25T23:17:52,005 ############################ 2023-09-25T23:17:52,006 # Package would be ignored # 2023-09-25T23:17:52,007 ############################ 2023-09-25T23:17:52,008 Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1], 2023-09-25T23:17:52,009 but it is absent from setuptools' `packages` configuration. 2023-09-25T23:17:52,010 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-25T23:17:52,011 package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added 2023-09-25T23:17:52,012 to the `packages` configuration field. 2023-09-25T23:17:52,014 Alternatively, you can also rely on setuptools' discovery methods 2023-09-25T23:17:52,015 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-25T23:17:52,015 instead of `find_packages(...)`/`find:`). 2023-09-25T23:17:52,017 You can read more about "package discovery" on setuptools documentation page: 2023-09-25T23:17:52,019 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-25T23:17:52,021 If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are 2023-09-25T23:17:52,021 already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via 2023-09-25T23:17:52,022 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-25T23:17:52,023 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-25T23:17:52,024 combination with a more fine grained `package-data` configuration. 2023-09-25T23:17:52,026 You can read more about "package data files" on setuptools documentation page: 2023-09-25T23:17:52,028 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-25T23:17:52,030 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-25T23:17:52,031 even if it does not contain any `.py` files. 2023-09-25T23:17:52,032 On the other hand, currently there is no concept of package data 2023-09-25T23:17:52,033 directory, all directories are treated like packages. 2023-09-25T23:17:52,034 ******************************************************************************** 2023-09-25T23:17:52,035 !! 2023-09-25T23:17:52,036 check.warn(importable) 2023-09-25T23:17:52,038 creating build/lib/alpaca_eval/evaluators_configs 2023-09-25T23:17:52,038 copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs 2023-09-25T23:17:52,039 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T23:17:52,040 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T23:17:52,041 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T23:17:52,042 creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T23:17:52,043 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T23:17:52,043 copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T23:17:52,044 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,045 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,046 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,046 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,047 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,048 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,049 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,050 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,051 copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,052 copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,053 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,053 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,054 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,055 copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,056 creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T23:17:52,057 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T23:17:52,058 copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T23:17:52,058 creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T23:17:52,059 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T23:17:52,060 copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T23:17:52,061 creating build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T23:17:52,062 copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T23:17:52,063 copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T23:17:52,064 creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T23:17:52,064 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T23:17:52,065 copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T23:17:52,066 creating build/lib/alpaca_eval/evaluators_configs/claude 2023-09-25T23:17:52,066 copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude 2023-09-25T23:17:52,067 copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude 2023-09-25T23:17:52,068 creating build/lib/alpaca_eval/evaluators_configs/claude_2 2023-09-25T23:17:52,069 copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2 2023-09-25T23:17:52,070 creating build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T23:17:52,070 copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T23:17:52,072 copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T23:17:52,072 creating build/lib/alpaca_eval/evaluators_configs/cohere 2023-09-25T23:17:52,073 copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere 2023-09-25T23:17:52,074 creating build/lib/alpaca_eval/evaluators_configs/gpt4 2023-09-25T23:17:52,075 copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4 2023-09-25T23:17:52,075 creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T23:17:52,076 copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T23:17:52,076 copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T23:17:52,076 creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T23:17:52,077 copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T23:17:52,078 creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T23:17:52,078 copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T23:17:52,079 creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T23:17:52,079 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T23:17:52,080 copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T23:17:52,080 creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T23:17:52,081 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T23:17:52,081 copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T23:17:52,082 creating build/lib/alpaca_eval/evaluators_configs/test 2023-09-25T23:17:52,083 copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test 2023-09-25T23:17:52,084 creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T23:17:52,085 copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T23:17:52,085 copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T23:17:52,086 creating build/lib/alpaca_eval/leaderboards 2023-09-25T23:17:52,086 creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,087 copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,088 copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,088 copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,089 copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,090 creating build/lib/alpaca_eval/leaderboards/evaluators 2023-09-25T23:17:52,090 copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators 2023-09-25T23:17:52,091 creating build/lib/alpaca_eval/models_configs 2023-09-25T23:17:52,091 creating build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-25T23:17:52,092 copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-25T23:17:52,092 copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b 2023-09-25T23:17:52,093 creating build/lib/alpaca_eval/models_configs/airoboros-65b 2023-09-25T23:17:52,093 copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b 2023-09-25T23:17:52,094 creating build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-25T23:17:52,094 copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-25T23:17:52,095 copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b 2023-09-25T23:17:52,096 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T23:17:52,096 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T23:17:52,097 creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T23:17:52,097 copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T23:17:52,098 creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-25T23:17:52,098 copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-25T23:17:52,099 copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-25T23:17:52,099 creating build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T23:17:52,100 copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T23:17:52,101 copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T23:17:52,101 creating build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T23:17:52,102 copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T23:17:52,102 creating build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-09-25T23:17:52,103 copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-09-25T23:17:52,104 copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b 2023-09-25T23:17:52,104 creating build/lib/alpaca_eval/models_configs/chatgpt 2023-09-25T23:17:52,105 copying src/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/models_configs/chatgpt 2023-09-25T23:17:52,105 creating build/lib/alpaca_eval/models_configs/claude 2023-09-25T23:17:52,106 copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude 2023-09-25T23:17:52,106 copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude 2023-09-25T23:17:52,107 creating build/lib/alpaca_eval/models_configs/claude-2 2023-09-25T23:17:52,107 copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2 2023-09-25T23:17:52,108 creating build/lib/alpaca_eval/models_configs/cohere 2023-09-25T23:17:52,108 copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere 2023-09-25T23:17:52,108 copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere 2023-09-25T23:17:52,109 creating build/lib/alpaca_eval/models_configs/cohere-chat 2023-09-25T23:17:52,109 copying src/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere-chat 2023-09-25T23:17:52,110 creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T23:17:52,111 copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T23:17:52,111 creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T23:17:52,112 copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T23:17:52,112 creating build/lib/alpaca_eval/models_configs/gpt4 2023-09-25T23:17:52,113 copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4 2023-09-25T23:17:52,114 copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4 2023-09-25T23:17:52,114 creating build/lib/alpaca_eval/models_configs/guanaco-13b 2023-09-25T23:17:52,115 copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b 2023-09-25T23:17:52,116 creating build/lib/alpaca_eval/models_configs/guanaco-33b 2023-09-25T23:17:52,117 copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b 2023-09-25T23:17:52,118 creating build/lib/alpaca_eval/models_configs/guanaco-65b 2023-09-25T23:17:52,119 copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b 2023-09-25T23:17:52,120 creating build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-25T23:17:52,121 copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-25T23:17:52,122 copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b 2023-09-25T23:17:52,123 creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-25T23:17:52,124 copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-25T23:17:52,125 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-25T23:17:52,127 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-25T23:17:52,128 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate 2023-09-25T23:17:52,130 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate 2023-09-25T23:17:52,132 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate 2023-09-25T23:17:52,133 creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt 2023-09-25T23:17:52,134 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt 2023-09-25T23:17:52,136 copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt 2023-09-25T23:17:52,137 creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-25T23:17:52,138 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-25T23:17:52,139 copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-25T23:17:52,141 creating build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-25T23:17:52,142 copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-25T23:17:52,143 copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b 2023-09-25T23:17:52,145 creating build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T23:17:52,146 copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T23:17:52,148 copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T23:17:52,149 creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T23:17:52,151 copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T23:17:52,152 creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T23:17:52,154 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T23:17:52,156 copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T23:17:52,156 creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T23:17:52,157 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T23:17:52,157 copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T23:17:52,158 creating build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-25T23:17:52,158 copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-25T23:17:52,159 copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b 2023-09-25T23:17:52,159 creating build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T23:17:52,160 copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T23:17:52,161 creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T23:17:52,161 copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T23:17:52,162 creating build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T23:17:52,163 copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T23:17:52,163 creating build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T23:17:52,164 copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T23:17:52,164 creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T23:17:52,165 copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T23:17:52,165 creating build/lib/alpaca_eval/models_configs/text_davinci_001 2023-09-25T23:17:52,165 copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001 2023-09-25T23:17:52,166 creating build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-25T23:17:52,166 copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-25T23:17:52,167 copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003 2023-09-25T23:17:52,167 creating build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-25T23:17:52,168 copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-25T23:17:52,168 copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b 2023-09-25T23:17:52,169 creating build/lib/alpaca_eval/models_configs/vicuna-13b 2023-09-25T23:17:52,169 copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b 2023-09-25T23:17:52,170 creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T23:17:52,170 copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T23:17:52,171 creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T23:17:52,171 copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T23:17:52,172 creating build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-25T23:17:52,172 copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-25T23:17:52,173 copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b 2023-09-25T23:17:52,173 creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T23:17:52,174 copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T23:17:52,174 creating build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T23:17:52,175 copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T23:17:52,176 copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T23:17:52,176 creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T23:17:52,177 copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T23:17:52,177 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-09-25T23:17:52,178 !! 2023-09-25T23:17:52,180 ******************************************************************************** 2023-09-25T23:17:52,180 Please avoid running ``setup.py`` directly. 2023-09-25T23:17:52,181 Instead, use pypa/build, pypa/installer or other 2023-09-25T23:17:52,182 standards-based tools. 2023-09-25T23:17:52,185 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-09-25T23:17:52,186 ******************************************************************************** 2023-09-25T23:17:52,187 !! 2023-09-25T23:17:52,188 self.initialize_options() 2023-09-25T23:17:52,189 installing to build/bdist.linux-armv7l/wheel 2023-09-25T23:17:52,190 running install 2023-09-25T23:17:52,210 running install_lib 2023-09-25T23:17:52,238 creating build/bdist.linux-armv7l 2023-09-25T23:17:52,238 creating build/bdist.linux-armv7l/wheel 2023-09-25T23:17:52,241 creating build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,243 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards 2023-09-25T23:17:52,245 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-09-25T23:17:52,247 copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators 2023-09-25T23:17:52,252 creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,254 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,258 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,263 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,267 copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval 2023-09-25T23:17:52,269 copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,271 creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,272 copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,275 copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,278 copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,282 copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,288 copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,294 copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,300 copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders 2023-09-25T23:17:52,308 copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,317 copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,335 creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T23:17:52,338 copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T23:17:52,340 copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T23:17:52,343 copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators 2023-09-25T23:17:52,347 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs 2023-09-25T23:17:52,348 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T23:17:52,350 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human 2023-09-25T23:17:52,353 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T23:17:52,354 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T23:17:52,356 copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b 2023-09-25T23:17:52,358 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-25T23:17:52,359 copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-25T23:17:52,362 copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b 2023-09-25T23:17:52,364 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T23:17:52,365 copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b 2023-09-25T23:17:52,368 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T23:17:52,369 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T23:17:52,371 copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b 2023-09-25T23:17:52,373 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T23:17:52,374 copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft 2023-09-25T23:17:52,377 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-25T23:17:52,378 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-25T23:17:52,380 copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf 2023-09-25T23:17:52,383 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-09-25T23:17:52,384 copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b 2023-09-25T23:17:52,386 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T23:17:52,387 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T23:17:52,389 copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b 2023-09-25T23:17:52,391 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-25T23:17:52,392 copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-25T23:17:52,394 copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003 2023-09-25T23:17:52,396 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-09-25T23:17:52,397 copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2 2023-09-25T23:17:52,399 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T23:17:52,400 copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b 2023-09-25T23:17:52,402 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-25T23:17:52,403 copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-25T23:17:52,405 copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b 2023-09-25T23:17:52,407 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T23:17:52,408 copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b 2023-09-25T23:17:52,410 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-09-25T23:17:52,411 copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b 2023-09-25T23:17:52,413 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-09-25T23:17:52,414 copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001 2023-09-25T23:17:52,416 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T23:17:52,417 copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k 2023-09-25T23:17:52,419 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-25T23:17:52,420 copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-25T23:17:52,627 copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b 2023-09-25T23:17:52,629 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-25T23:17:52,630 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-25T23:17:52,632 copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat 2023-09-25T23:17:52,634 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-25T23:17:52,635 copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-25T23:17:52,637 copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude 2023-09-25T23:17:52,639 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T23:17:52,640 copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct 2023-09-25T23:17:52,642 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-25T23:17:52,643 copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-25T23:17:52,645 copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b 2023-09-25T23:17:52,647 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T23:17:52,649 copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b 2023-09-25T23:17:52,652 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate 2023-09-25T23:17:52,653 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate 2023-09-25T23:17:52,656 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate 2023-09-25T23:17:52,658 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-25T23:17:52,659 copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf 2023-09-25T23:17:52,661 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T23:17:52,662 copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3 2023-09-25T23:17:52,664 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-25T23:17:52,665 copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-25T23:17:52,667 copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4 2023-09-25T23:17:52,669 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-09-25T23:17:52,670 copying build/lib/alpaca_eval/models_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatgpt 2023-09-25T23:17:52,672 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-09-25T23:17:52,673 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-09-25T23:17:52,675 copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b 2023-09-25T23:17:52,677 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt 2023-09-25T23:17:52,678 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt 2023-09-25T23:17:52,680 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt 2023-09-25T23:17:52,682 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-09-25T23:17:52,683 copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b 2023-09-25T23:17:52,685 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T23:17:52,686 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T23:17:52,688 copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b 2023-09-25T23:17:52,690 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T23:17:52,691 copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b 2023-09-25T23:17:52,694 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat 2023-09-25T23:17:52,695 copying build/lib/alpaca_eval/models_configs/cohere-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere-chat 2023-09-25T23:17:52,697 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-25T23:17:52,698 copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-25T23:17:52,700 copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b 2023-09-25T23:17:52,702 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-09-25T23:17:52,703 copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b 2023-09-25T23:17:52,705 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T23:17:52,706 copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3 2023-09-25T23:17:52,708 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T23:17:52,709 copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1 2023-09-25T23:17:52,711 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-25T23:17:52,712 copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf 2023-09-25T23:17:52,714 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-25T23:17:52,715 copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-25T23:17:52,717 copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b 2023-09-25T23:17:52,719 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T23:17:52,720 copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct 2023-09-25T23:17:52,722 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-25T23:17:52,723 copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-25T23:17:52,725 copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere 2023-09-25T23:17:52,727 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T23:17:52,728 copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b 2023-09-25T23:17:52,730 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T23:17:52,731 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T23:17:52,733 copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b 2023-09-25T23:17:52,735 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-09-25T23:17:52,736 copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b 2023-09-25T23:17:52,738 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-25T23:17:52,739 copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-25T23:17:52,741 copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b 2023-09-25T23:17:52,743 creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T23:17:52,744 copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3 2023-09-25T23:17:52,746 copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,748 copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,750 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-09-25T23:17:52,752 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T23:17:52,753 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T23:17:52,754 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn 2023-09-25T23:17:52,757 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T23:17:52,757 copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4 2023-09-25T23:17:52,760 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T23:17:52,761 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T23:17:52,763 copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn 2023-09-25T23:17:52,765 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-09-25T23:17:52,766 copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test 2023-09-25T23:17:52,768 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T23:17:52,769 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T23:17:52,771 copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003 2023-09-25T23:17:52,773 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-25T23:17:52,774 copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-25T23:17:52,776 copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude 2023-09-25T23:17:52,779 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T23:17:52,780 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T23:17:52,783 copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking 2023-09-25T23:17:52,786 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T23:17:52,788 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T23:17:52,791 copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4 2023-09-25T23:17:52,794 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T23:17:52,795 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T23:17:52,798 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4 2023-09-25T23:17:52,801 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-09-25T23:17:52,802 copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4 2023-09-25T23:17:52,805 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T23:17:52,807 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T23:17:52,809 copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt 2023-09-25T23:17:52,812 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T23:17:52,813 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T23:17:52,815 copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b 2023-09-25T23:17:52,818 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-09-25T23:17:52,819 copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2 2023-09-25T23:17:52,823 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T23:17:52,824 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T23:17:52,827 copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b 2023-09-25T23:17:52,830 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T23:17:52,831 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T23:17:52,834 copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4 2023-09-25T23:17:52,836 copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs 2023-09-25T23:17:52,840 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T23:17:52,841 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T23:17:52,843 copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4 2023-09-25T23:17:52,846 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,847 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,850 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,852 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,855 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,858 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,860 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,864 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,866 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,869 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,871 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,874 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,877 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,880 copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm 2023-09-25T23:17:52,884 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-09-25T23:17:52,885 copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere 2023-09-25T23:17:52,890 creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T23:17:52,892 copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4 2023-09-25T23:17:52,897 copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,904 copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,906 copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,908 copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval 2023-09-25T23:17:52,912 running install_egg_info 2023-09-25T23:17:52,942 Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.2.4-py3.11.egg-info 2023-09-25T23:17:52,956 running install_scripts 2023-09-25T23:17:52,998 creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.2.4.dist-info/WHEEL 2023-09-25T23:17:53,001 creating '/tmp/pip-wheel-cwg8is_0/alpaca_eval-0.2.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-09-25T23:17:53,003 adding 'alpaca_eval/__init__.py' 2023-09-25T23:17:53,006 adding 'alpaca_eval/analyze.py' 2023-09-25T23:17:53,007 adding 'alpaca_eval/completion_parsers.py' 2023-09-25T23:17:53,009 adding 'alpaca_eval/constants.py' 2023-09-25T23:17:53,012 adding 'alpaca_eval/main.py' 2023-09-25T23:17:53,013 adding 'alpaca_eval/metrics.py' 2023-09-25T23:17:53,016 adding 'alpaca_eval/plotting.py' 2023-09-25T23:17:53,017 adding 'alpaca_eval/types.py' 2023-09-25T23:17:53,019 adding 'alpaca_eval/utils.py' 2023-09-25T23:17:53,021 adding 'alpaca_eval/annotators/__init__.py' 2023-09-25T23:17:53,024 adding 'alpaca_eval/annotators/base.py' 2023-09-25T23:17:53,026 adding 'alpaca_eval/annotators/pairwise_evaluator.py' 2023-09-25T23:17:53,028 adding 'alpaca_eval/decoders/__init__.py' 2023-09-25T23:17:53,030 adding 'alpaca_eval/decoders/anthropic.py' 2023-09-25T23:17:53,031 adding 'alpaca_eval/decoders/cohere.py' 2023-09-25T23:17:53,032 adding 'alpaca_eval/decoders/huggingface_api.py' 2023-09-25T23:17:53,034 adding 'alpaca_eval/decoders/huggingface_local.py' 2023-09-25T23:17:53,036 adding 'alpaca_eval/decoders/openai.py' 2023-09-25T23:17:53,037 adding 'alpaca_eval/decoders/replicate.py' 2023-09-25T23:17:53,039 adding 'alpaca_eval/evaluators_configs/README.md' 2023-09-25T23:17:53,041 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt' 2023-09-25T23:17:53,042 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml' 2023-09-25T23:17:53,044 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt' 2023-09-25T23:17:53,045 adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml' 2023-09-25T23:17:53,047 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt' 2023-09-25T23:17:53,049 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt' 2023-09-25T23:17:53,050 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt' 2023-09-25T23:17:53,051 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt' 2023-09-25T23:17:53,053 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt' 2023-09-25T23:17:53,054 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt' 2023-09-25T23:17:53,056 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt' 2023-09-25T23:17:53,058 adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt' 2023-09-25T23:17:53,059 adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml' 2023-09-25T23:17:53,060 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt' 2023-09-25T23:17:53,062 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt' 2023-09-25T23:17:53,063 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt' 2023-09-25T23:17:53,065 adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt' 2023-09-25T23:17:53,067 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt' 2023-09-25T23:17:53,069 adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml' 2023-09-25T23:17:53,276 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt' 2023-09-25T23:17:53,277 adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml' 2023-09-25T23:17:53,279 adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt' 2023-09-25T23:17:53,281 adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml' 2023-09-25T23:17:53,283 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt' 2023-09-25T23:17:53,285 adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml' 2023-09-25T23:17:53,288 adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt' 2023-09-25T23:17:53,290 adding 'alpaca_eval/evaluators_configs/claude/configs.yaml' 2023-09-25T23:17:53,293 adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml' 2023-09-25T23:17:53,296 adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml' 2023-09-25T23:17:53,298 adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt' 2023-09-25T23:17:53,301 adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml' 2023-09-25T23:17:53,305 adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml' 2023-09-25T23:17:53,308 adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt' 2023-09-25T23:17:53,310 adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml' 2023-09-25T23:17:53,314 adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml' 2023-09-25T23:17:53,318 adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml' 2023-09-25T23:17:53,322 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml' 2023-09-25T23:17:53,325 adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt' 2023-09-25T23:17:53,326 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt' 2023-09-25T23:17:53,327 adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml' 2023-09-25T23:17:53,329 adding 'alpaca_eval/evaluators_configs/test/configs.yaml' 2023-09-25T23:17:53,330 adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt' 2023-09-25T23:17:53,331 adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml' 2023-09-25T23:17:53,334 adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv' 2023-09-25T23:17:53,335 adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv' 2023-09-25T23:17:53,336 adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv' 2023-09-25T23:17:53,337 adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv' 2023-09-25T23:17:53,339 adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv' 2023-09-25T23:17:53,342 adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml' 2023-09-25T23:17:53,343 adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt' 2023-09-25T23:17:53,345 adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml' 2023-09-25T23:17:53,346 adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml' 2023-09-25T23:17:53,347 adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt' 2023-09-25T23:17:53,349 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml' 2023-09-25T23:17:53,351 adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml' 2023-09-25T23:17:53,352 adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml' 2023-09-25T23:17:53,353 adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt' 2023-09-25T23:17:53,355 adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml' 2023-09-25T23:17:53,356 adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt' 2023-09-25T23:17:53,358 adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml' 2023-09-25T23:17:53,359 adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml' 2023-09-25T23:17:53,360 adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt' 2023-09-25T23:17:53,362 adding 'alpaca_eval/models_configs/chatgpt/configs.yaml' 2023-09-25T23:17:53,364 adding 'alpaca_eval/models_configs/claude/configs.yaml' 2023-09-25T23:17:53,365 adding 'alpaca_eval/models_configs/claude/prompt.txt' 2023-09-25T23:17:53,367 adding 'alpaca_eval/models_configs/claude-2/configs.yaml' 2023-09-25T23:17:53,368 adding 'alpaca_eval/models_configs/cohere/configs.yaml' 2023-09-25T23:17:53,369 adding 'alpaca_eval/models_configs/cohere/prompt.txt' 2023-09-25T23:17:53,371 adding 'alpaca_eval/models_configs/cohere-chat/configs.yaml' 2023-09-25T23:17:53,373 adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml' 2023-09-25T23:17:53,374 adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml' 2023-09-25T23:17:53,376 adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt' 2023-09-25T23:17:53,377 adding 'alpaca_eval/models_configs/gpt4/configs.yaml' 2023-09-25T23:17:53,379 adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml' 2023-09-25T23:17:53,380 adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml' 2023-09-25T23:17:53,382 adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml' 2023-09-25T23:17:53,384 adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml' 2023-09-25T23:17:53,385 adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt' 2023-09-25T23:17:53,387 adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml' 2023-09-25T23:17:53,388 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml' 2023-09-25T23:17:53,390 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate/configs.yaml' 2023-09-25T23:17:53,390 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate/prompt.txt' 2023-09-25T23:17:53,392 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt/configs.yaml' 2023-09-25T23:17:53,393 adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf-replicate-noprompt/prompt.txt' 2023-09-25T23:17:53,395 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml' 2023-09-25T23:17:53,396 adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt' 2023-09-25T23:17:53,397 adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml' 2023-09-25T23:17:53,398 adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt' 2023-09-25T23:17:53,400 adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml' 2023-09-25T23:17:53,401 adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt' 2023-09-25T23:17:53,403 adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml' 2023-09-25T23:17:53,404 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml' 2023-09-25T23:17:53,405 adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt' 2023-09-25T23:17:53,407 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml' 2023-09-25T23:17:53,408 adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt' 2023-09-25T23:17:53,410 adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml' 2023-09-25T23:17:53,411 adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt' 2023-09-25T23:17:53,413 adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml' 2023-09-25T23:17:53,414 adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml' 2023-09-25T23:17:53,416 adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml' 2023-09-25T23:17:53,418 adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml' 2023-09-25T23:17:53,419 adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml' 2023-09-25T23:17:53,421 adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml' 2023-09-25T23:17:53,422 adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml' 2023-09-25T23:17:53,424 adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt' 2023-09-25T23:17:53,425 adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml' 2023-09-25T23:17:53,426 adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt' 2023-09-25T23:17:53,428 adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml' 2023-09-25T23:17:53,430 adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml' 2023-09-25T23:17:53,431 adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml' 2023-09-25T23:17:53,433 adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml' 2023-09-25T23:17:53,434 adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt' 2023-09-25T23:17:53,436 adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml' 2023-09-25T23:17:53,438 adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml' 2023-09-25T23:17:53,439 adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt' 2023-09-25T23:17:53,440 adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml' 2023-09-25T23:17:53,443 adding 'alpaca_eval-0.2.4.dist-info/LICENSE' 2023-09-25T23:17:53,453 adding 'alpaca_eval-0.2.4.dist-info/METADATA' 2023-09-25T23:17:53,454 adding 'alpaca_eval-0.2.4.dist-info/WHEEL' 2023-09-25T23:17:53,455 adding 'alpaca_eval-0.2.4.dist-info/entry_points.txt' 2023-09-25T23:17:53,456 adding 'alpaca_eval-0.2.4.dist-info/top_level.txt' 2023-09-25T23:17:53,459 adding 'alpaca_eval-0.2.4.dist-info/RECORD' 2023-09-25T23:17:53,470 removing build/bdist.linux-armv7l/wheel 2023-09-25T23:17:53,695 Building wheel for alpaca-eval (setup.py): finished with status 'done' 2023-09-25T23:17:53,700 Created wheel for alpaca-eval: filename=alpaca_eval-0.2.4-py3-none-any.whl size=153988 sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e 2023-09-25T23:17:53,701 Stored in directory: /tmp/pip-ephem-wheel-cache-ja_cr3m1/wheels/98/49/46/c471844c31c1c4563135dccd6c29881f9ebdff392eb1c51261 2023-09-25T23:17:53,731 Successfully built alpaca-eval 2023-09-25T23:17:53,750 Removed build tracker: '/tmp/pip-build-tracker-8xe382mk'