2024-01-11T00:31:47,765 Created temporary directory: /tmp/pip-build-tracker-2pbl3ci3
2024-01-11T00:31:47,767 Initialized build tracking at /tmp/pip-build-tracker-2pbl3ci3
2024-01-11T00:31:47,767 Created build tracker: /tmp/pip-build-tracker-2pbl3ci3
2024-01-11T00:31:47,768 Entered build tracker: /tmp/pip-build-tracker-2pbl3ci3
2024-01-11T00:31:47,769 Created temporary directory: /tmp/pip-wheel-bkeiaqpi
2024-01-11T00:31:47,772 Created temporary directory: /tmp/pip-ephem-wheel-cache-x440vzqh
2024-01-11T00:31:47,796 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-01-11T00:31:47,799 2 location(s) to search for versions of alpaca-eval:
2024-01-11T00:31:47,799 * https://pypi.org/simple/alpaca-eval/
2024-01-11T00:31:47,799 * https://www.piwheels.org/simple/alpaca-eval/
2024-01-11T00:31:47,800 Fetching project page and analyzing links: https://pypi.org/simple/alpaca-eval/
2024-01-11T00:31:47,801 Getting page https://pypi.org/simple/alpaca-eval/
2024-01-11T00:31:47,803 Found index url https://pypi.org/simple/
2024-01-11T00:31:48,020 Fetched page https://pypi.org/simple/alpaca-eval/ as application/vnd.pypi.simple.v1+json
2024-01-11T00:31:48,031   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fd/9d/5d7891b928060c03500fc3aee23bb1a1d0c34efa195ea7520430e802d077/alpaca_eval-0.1.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-11T00:31:48,032   Found link https://files.pythonhosted.org/packages/86/4d/27aa7b7157476138185b963fef7e26d77ad975a37760835569316330b8ff/alpaca_eval-0.1.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.0
2024-01-11T00:31:48,033   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/d7/82/a29134ff0ac88c5e5f0578244fa6e4058784b119bfa7d73567aed567210a/alpaca_eval-0.1.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-11T00:31:48,034   Found link https://files.pythonhosted.org/packages/ee/3b/3af60ddd73acc529391e3c4598c201044b8fa914eef66a05f3706777fb5d/alpaca_eval-0.1.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.1
2024-01-11T00:31:48,034   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/8f/52/4461410412859ba526445fe9f218ace1a0fad2c376d74ab8885358c8c22f/alpaca_eval-0.1.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-11T00:31:48,035   Found link https://files.pythonhosted.org/packages/cd/98/112b910bea59d085b99d6e514623bf822ba7440169f9a9e45507b926fe16/alpaca_eval-0.1.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.9), version: 0.1.2
2024-01-11T00:31:48,036   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f6/ed/be9de2521451f12a1b94b37add934f794c13b40f063468efd3343334f830/alpaca_eval-0.1.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,037   Found link https://files.pythonhosted.org/packages/aa/4b/0356aadf22e8fa09b452c5969144411ecd2f85836816e681f5d097e04a4f/alpaca_eval-0.1.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.3
2024-01-11T00:31:48,038   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4a/af/379e26368722f80b1846a67c6f3276bc12abbe7aa7253ee01b24045bf66f/alpaca_eval-0.1.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,039   Found link https://files.pythonhosted.org/packages/18/8a/d423f1d1aec1cb7bfae8e05c5bc42f6cef1d8a25f7f16a8e62273722d3f1/alpaca_eval-0.1.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.5
2024-01-11T00:31:48,040   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/f9/4b/d38f646b6cd6656484a0c24ff964d7da028ec67315a4bcebdb6bb98913b8/alpaca_eval-0.1.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,041   Found link https://files.pythonhosted.org/packages/a9/93/aa283517163b81448844b2707e7a25f15ea80c2d1bb57f6cff97cc758791/alpaca_eval-0.1.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.6
2024-01-11T00:31:48,042   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/37/e6/7478aaee6801f2325357167d4ddeb5bc0cff73c0d2ec34bed9cf5eeee38c/alpaca_eval-0.1.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,043   Found link https://files.pythonhosted.org/packages/f4/4b/75241f0cda36757f180224973fd27793dd20dc1d93da37bf741520dd05e8/alpaca_eval-0.1.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.7
2024-01-11T00:31:48,044   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/39/4b/83f4f626c6c3482bfc547eda37ad60cc80ff0ad1a919673b925c78fc9019/alpaca_eval-0.1.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,044   Found link https://files.pythonhosted.org/packages/48/c3/8da8427afbd5837bd787b0b8557f4289950fbc6a425a46cafc1858d5f859/alpaca_eval-0.1.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.1.8
2024-01-11T00:31:48,045   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/fa/75/4130b70e461afc9f29ab655d6b8244cd9ca2c44494891032156c5426da24/alpaca_eval-0.2.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,046   Found link https://files.pythonhosted.org/packages/29/07/86e7229298395524a300eec72e61a255fceb6e3634f40357210004fa61d4/alpaca_eval-0.2.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.0
2024-01-11T00:31:48,047   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/e9/a50ef198232caaf3d549710e5619267f8a134634eb9f04290470e539b997/alpaca_eval-0.2.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,048   Found link https://files.pythonhosted.org/packages/09/5d/4368a2a648341c1378cf7566695622ecd36b82d7215ae4f4daee75200c3b/alpaca_eval-0.2.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.1
2024-01-11T00:31:48,048   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/70/6d/d3e03b80ca756da467c95280b5e095b597b4644fcd690626171a4bef2ec8/alpaca_eval-0.2.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,049   Found link https://files.pythonhosted.org/packages/9a/5c/dedf5b566629bced236f27851186c018b15a5a718a60aa2490299a15bfda/alpaca_eval-0.2.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.2
2024-01-11T00:31:48,050   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/0c/2d/7e1d82b7b18830158c19406035ab69fd4bde99d4217c9e4172d702beaab5/alpaca_eval-0.2.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,051   Found link https://files.pythonhosted.org/packages/99/29/ae64c5c752783fd05d10d0180fd7c1e69bcb08ddc0caea8d7b558835a66b/alpaca_eval-0.2.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.3
2024-01-11T00:31:48,052   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/2f/b8/a11e3f6d7f00a55a0cd626372c88df9e8159342585cd87e700c2fec6dfcc/alpaca_eval-0.2.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,052   Found link https://files.pythonhosted.org/packages/6f/bf/f088196fd61892983a33115beaa6454f71ea4e46a4c70b34344f7406fedd/alpaca_eval-0.2.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.4
2024-01-11T00:31:48,053   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/16/42/e516c82d9364e8ee77f75ada785fbe6c5d546580159fd7ad0b0f1efc0b3b/alpaca_eval-0.2.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,054   Found link https://files.pythonhosted.org/packages/07/92/2ae8750c8662d9cb5ae2e7abc4527ec78ba11826f32e1077922e7d88d1e2/alpaca_eval-0.2.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.5
2024-01-11T00:31:48,055   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b6/1a/68d6d1096e85a573575c704382822dec7c06dd5768b2952880a6e53e9f11/alpaca_eval-0.2.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,056   Found link https://files.pythonhosted.org/packages/4d/69/0149ab6583ba376f271d26caf0fccf0097f96fde16d6469adc547ee63703/alpaca_eval-0.2.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.6
2024-01-11T00:31:48,057   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/b1/e9/4829b974971edba088a5b1e3c184836f7e25e71e66c2e71d92152961a90c/alpaca_eval-0.2.7-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,057   Found link https://files.pythonhosted.org/packages/aa/38/a6efa2a335953ee4a62d29bb0a5dcc4c24f015e83ec58a9327b46c77fc51/alpaca_eval-0.2.7.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.7
2024-01-11T00:31:48,058   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c9/35/f7d6eb3909fd36ecbf927186a2c23cd257c45dc95dd1314dc2169a7aa9d9/alpaca_eval-0.2.8-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,059   Found link https://files.pythonhosted.org/packages/65/bf/28254d345bbf58e0c99b292a86ac05caf82eafec88b7bc1e1a03f18c0b5f/alpaca_eval-0.2.8.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.8
2024-01-11T00:31:48,060   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/4b/87/eae7c719fe2ad67f013200533c7dbd35d01619140895aa77bfcdf392870c/alpaca_eval-0.2.9-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,061   Found link https://files.pythonhosted.org/packages/af/1b/7eea897f149fede8e4f1b7461716c61803dfb3c95aa0f361e0d8592fb07d/alpaca_eval-0.2.9.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.2.9
2024-01-11T00:31:48,062   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/c0/c8/00288103144245a129d9106fd9d49a51db6c77d352ac2d989c6912160a15/alpaca_eval-0.3.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,063   Found link https://files.pythonhosted.org/packages/16/f4/5bfeef4351314d3d49600604942026d207e442a3276d7544fb3beb7fe17f/alpaca_eval-0.3.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.0
2024-01-11T00:31:48,063   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/5a/e5/7dbd893f8b1528ab40f27ed4b5dbd6afc32dbd614d18c028255c1c07f42f/alpaca_eval-0.3.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,064   Found link https://files.pythonhosted.org/packages/c1/f0/ae2290067dda3cfaa9cbcd0f8da0dd5bb1c23675c8e8c4c4af849f0c97ae/alpaca_eval-0.3.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.1
2024-01-11T00:31:48,065   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/03/27/f65157dc7db0df0d002874c129af647fe587c45bc0169d23a87b50174bd0/alpaca_eval-0.3.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,066   Found link https://files.pythonhosted.org/packages/76/c8/53b49bf0623806a93b9bc75d578d02ff86e10c8a5d4996e846894300c40b/alpaca_eval-0.3.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.2
2024-01-11T00:31:48,067   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/64/c0/ceb4e00db9f07badd18024dc4a911caa87b6feb19dfab50399a659ae5f1b/alpaca_eval-0.3.3-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,068   Found link https://files.pythonhosted.org/packages/4f/a7/4595a73480ce89dee2d1ebf85fb36d8fcf6f21b9c4b60dbd580079358ef2/alpaca_eval-0.3.3.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.3
2024-01-11T00:31:48,073   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/80/59/b1bb1df315ed6d9a84a77a019db5b9edf5abb48d80bc16f6c9835b68186a/alpaca_eval-0.3.4-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,074   Found link https://files.pythonhosted.org/packages/67/be/caa06bd28d538f07427879c79ae649da34404f8dcf67be9cda5136226afa/alpaca_eval-0.3.4.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.4
2024-01-11T00:31:48,074   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/89/40/4e2ddabd9609db1bf884f950621b435af2754ed37304ebc566517ced9d86/alpaca_eval-0.3.5-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,075   Found link https://files.pythonhosted.org/packages/83/c5/90a3d342dfd097bbc84d58076ea05a4148aec628d6de28782a7e180879b4/alpaca_eval-0.3.5.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.5
2024-01-11T00:31:48,076   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/ee/2f/d7c91bc3c70f9020e6010ff414375e7b475c6f168574b94ec23650b95b7b/alpaca_eval-0.3.6-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,077   Found link https://files.pythonhosted.org/packages/12/6f/7e345fb595ec5378d3da0a3fd17d3bd94b37b246c95394993aa37bc2abee/alpaca_eval-0.3.6.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.3.6
2024-01-11T00:31:48,077   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/43/91/d2d1f08c7ce6f627c66c5a6a5d47f501e702ebe540267e03151c34eac082/alpaca_eval-0.5.0-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,078   Found link https://files.pythonhosted.org/packages/78/2a/95c2ba6fe3fc66da12e86c711583df5004d25e4eeb428af243eb40954d4a/alpaca_eval-0.5.0.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.0
2024-01-11T00:31:48,079   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/e7/c7/67577cbf164d90c91cbd460f143387b428cec049065368693019c86d2412/alpaca_eval-0.5.1-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,080   Found link https://files.pythonhosted.org/packages/a3/81/4186401c96e55db8e462ea5456603f994d5e3bed5e9a428f2a41bf3bd38e/alpaca_eval-0.5.1.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.1
2024-01-11T00:31:48,081   Skipping link: No binaries permitted for alpaca-eval: https://files.pythonhosted.org/packages/a2/89/d47f73736995134411200dceeb3f455260ecc07f0d34bee635bf587d0a12/alpaca_eval-0.5.2-py3-none-any.whl (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,082   Found link https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz (from https://pypi.org/simple/alpaca-eval/) (requires-python:>=3.10), version: 0.5.2
2024-01-11T00:31:48,083 Fetching project page and analyzing links: https://www.piwheels.org/simple/alpaca-eval/
2024-01-11T00:31:48,084 Getting page https://www.piwheels.org/simple/alpaca-eval/
2024-01-11T00:31:48,085 Found index url https://www.piwheels.org/simple/
2024-01-11T00:31:48,247 Fetched page https://www.piwheels.org/simple/alpaca-eval/ as text/html
2024-01-11T00:31:48,255   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.1-py3-none-any.whl#sha256=19af763a4390ce064773f2b409d40209b55b49948110fd3cf1477e7fa410dd65 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,256   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.5.0-py3-none-any.whl#sha256=4bf0c751090df0cd0b37fb935ce30fe391f8b256ca5ff2302f45e39d03468396 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,256   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.6-py3-none-any.whl#sha256=453bcbfc1eec99a3068649b6efb85e00a3e26912b60b4a0d439ebe56c051cba9 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,257   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.5-py3-none-any.whl#sha256=00709a1e520d0bd07ca5598dc3fec0f4a61118a9675723e2eb448aceeee0c508 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,257   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.4-py3-none-any.whl#sha256=7083c7153e538041d80856a6cf7ece514e0f163dd91261dc979a904d209985f4 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,258   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.3-py3-none-any.whl#sha256=9723941ee443eab60916fbf9fc129ba0b9ece0179ccb97dd574e68c7255d2182 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,258   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.2-py3-none-any.whl#sha256=b08f7260fb71a93e80ad50795a94e54ff35d365c5f1ad40d87db82a853d4e0a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,259   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.1-py3-none-any.whl#sha256=82fbc4b8c3fea5cc2e6d7c5c7c32eb36092aa47dbdf8225c5069c1479409e053 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,260   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.3.0-py3-none-any.whl#sha256=70fd1cfb27a5421b68ceecc02f31691e832804ce3e360144c86d89caa12dafd6 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,260   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.9-py3-none-any.whl#sha256=ecebfa9bd0b7d1741e549a88b943c4f024b45975bc3f8e986e78d3476d97db4b (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,261   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.8-py3-none-any.whl#sha256=e52b1dbd640713c41e240f11011ab289fed6491f5230583d5fb52cb8a24bd8ad (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,261   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.7-py3-none-any.whl#sha256=a50234f0e8d456a7c30c7f8179c82516373a4dd306445b4f2867185681de6b32 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,262   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.6-py3-none-any.whl#sha256=dd7a9012cd908852d2b3ecc482e1129d023a1c41fe06ccfe9be3ea73b679601f (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,262   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.5-py3-none-any.whl#sha256=6d68f00a54039949a0795d48bfb627673099cfd99878ad61eaae29ddf041e482 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,263   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.4-py3-none-any.whl#sha256=8a59ca86bd4194363506475d788a5a874cd9c78f09eb8b8d381f9752be29105e (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,264   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.3-py3-none-any.whl#sha256=3f846a154206a76d2d4bdc7cde2d44efb0dfb8fc043e958d3bc5a843c66699a8 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,265   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.2-py3-none-any.whl#sha256=e9420e02fd3ac157af1befda63ef6c13a03399bf62f0019b9f70ea5a11fd7124 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,265   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.1-py3-none-any.whl#sha256=67183147d5d4b11e7ce21e439a5a5053ac043f566356ef8c1f95e9206c9c0284 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,266   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.2.0-py3-none-any.whl#sha256=632c0f398516f00dbf24244564c20e6404b2c987144da3e7c7b688b36e262e64 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,266   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.8-py3-none-any.whl#sha256=1e7e2227c0de398310ef2153ee3e48672bcb5f2e05094cbb345b96ab2300d4d0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.10)
2024-01-11T00:31:48,267   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.2-py3-none-any.whl#sha256=a1cda0a4217d0e80680cd5825d32ad2cee7dc50ae9c63754b6e5fc0a81dbf39a (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-11T00:31:48,268   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.1-py3-none-any.whl#sha256=18ffaabdcb2f954f51c44e5299cd4f5f3e9586efa353028b557f9551c39fe239 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-11T00:31:48,268   Skipping link: No binaries permitted for alpaca-eval: https://www.piwheels.org/simple/alpaca-eval/alpaca_eval-0.1.0-py3-none-any.whl#sha256=7db4009f6eac15d2b362d2b28bda705a172c0d7ca756d6e8a996b403d370ecd0 (from https://www.piwheels.org/simple/alpaca-eval/) (requires-python:>=3.9)
2024-01-11T00:31:48,269 Skipping link: not a file: https://www.piwheels.org/simple/alpaca-eval/
2024-01-11T00:31:48,269 Skipping link: not a file: https://pypi.org/simple/alpaca-eval/
2024-01-11T00:31:48,291 Given no hashes to check 1 links for project 'alpaca-eval': discarding no candidates
2024-01-11T00:31:48,309 Collecting alpaca-eval==0.5.2
2024-01-11T00:31:48,312   Created temporary directory: /tmp/pip-unpack-75f3f1tl
2024-01-11T00:31:48,623   Downloading alpaca_eval-0.5.2.tar.gz (335 kB)
2024-01-11T00:31:49,324   Added alpaca-eval==0.5.2 from https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz to build tracker '/tmp/pip-build-tracker-2pbl3ci3'
2024-01-11T00:31:49,326   Running setup.py (path:/tmp/pip-wheel-bkeiaqpi/alpaca-eval_d90a695358dc4c369ffd534133307a9f/setup.py) egg_info for package alpaca-eval
2024-01-11T00:31:49,327   Created temporary directory: /tmp/pip-pip-egg-info-9b43zufk
2024-01-11T00:31:49,327   Preparing metadata (setup.py): started
2024-01-11T00:31:49,329   Running command python setup.py egg_info
2024-01-11T00:31:50,390   running egg_info
2024-01-11T00:31:50,391   creating /tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info
2024-01-11T00:31:50,414   writing /tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/PKG-INFO
2024-01-11T00:31:50,432   writing dependency_links to /tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/dependency_links.txt
2024-01-11T00:31:50,434   writing entry points to /tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/entry_points.txt
2024-01-11T00:31:50,442   writing requirements to /tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/requires.txt
2024-01-11T00:31:50,443   writing top-level names to /tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/top_level.txt
2024-01-11T00:31:50,444   writing manifest file '/tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/SOURCES.txt'
2024-01-11T00:31:50,522   reading manifest file '/tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/SOURCES.txt'
2024-01-11T00:31:50,523   reading manifest template 'MANIFEST.in'
2024-01-11T00:31:50,670   adding license file 'LICENSE'
2024-01-11T00:31:50,680   writing manifest file '/tmp/pip-pip-egg-info-9b43zufk/alpaca_eval.egg-info/SOURCES.txt'
2024-01-11T00:31:50,788   Preparing metadata (setup.py): finished with status 'done'
2024-01-11T00:31:50,796   Source in /tmp/pip-wheel-bkeiaqpi/alpaca-eval_d90a695358dc4c369ffd534133307a9f has version 0.5.2, which satisfies requirement alpaca-eval==0.5.2 from https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz
2024-01-11T00:31:50,797   Removed alpaca-eval==0.5.2 from https://files.pythonhosted.org/packages/36/e5/b36f3d67111fcb07d011de66bdc17b003e5ea5676db838f8fd3e747eb4bf/alpaca_eval-0.5.2.tar.gz from build tracker '/tmp/pip-build-tracker-2pbl3ci3'
2024-01-11T00:31:50,810 Created temporary directory: /tmp/pip-unpack-49_i6xtn
2024-01-11T00:31:50,811 Created temporary directory: /tmp/pip-unpack-_pesvupl
2024-01-11T00:31:50,955 Building wheels for collected packages: alpaca-eval
2024-01-11T00:31:50,959   Created temporary directory: /tmp/pip-wheel-vspz4cbn
2024-01-11T00:31:50,960   Building wheel for alpaca-eval (setup.py): started
2024-01-11T00:31:50,961   Destination directory: /tmp/pip-wheel-vspz4cbn
2024-01-11T00:31:50,962   Running command python setup.py bdist_wheel
2024-01-11T00:31:51,971   running bdist_wheel
2024-01-11T00:31:52,070   running build
2024-01-11T00:31:52,071   running build_py
2024-01-11T00:31:52,097   creating build
2024-01-11T00:31:52,097   creating build/lib
2024-01-11T00:31:52,098   creating build/lib/alpaca_eval
2024-01-11T00:31:52,099   copying src/alpaca_eval/types.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,101   copying src/alpaca_eval/completion_parsers.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,103   copying src/alpaca_eval/analyze.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,106   copying src/alpaca_eval/__init__.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,107   copying src/alpaca_eval/metrics.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,110   copying src/alpaca_eval/processors.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,112   copying src/alpaca_eval/constants.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,114   copying src/alpaca_eval/main.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,116   copying src/alpaca_eval/plotting.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,119   copying src/alpaca_eval/utils.py -> build/lib/alpaca_eval
2024-01-11T00:31:52,122   creating build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,123   copying src/alpaca_eval/decoders/jinachat.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,125   copying src/alpaca_eval/decoders/vllm_local.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,127   copying src/alpaca_eval/decoders/google.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,129   copying src/alpaca_eval/decoders/cohere.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,130   copying src/alpaca_eval/decoders/bedrock_anthropic.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,132   copying src/alpaca_eval/decoders/huggingface_api.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,134   copying src/alpaca_eval/decoders/anthropic.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,136   copying src/alpaca_eval/decoders/__init__.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,137   copying src/alpaca_eval/decoders/replicate.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,139   copying src/alpaca_eval/decoders/openai.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,141   copying src/alpaca_eval/decoders/huggingface_local.py -> build/lib/alpaca_eval/decoders
2024-01-11T00:31:52,143   creating build/lib/alpaca_eval/annotators
2024-01-11T00:31:52,144   copying src/alpaca_eval/annotators/base.py -> build/lib/alpaca_eval/annotators
2024-01-11T00:31:52,147   copying src/alpaca_eval/annotators/__init__.py -> build/lib/alpaca_eval/annotators
2024-01-11T00:31:52,148   copying src/alpaca_eval/annotators/pairwise_evaluator.py -> build/lib/alpaca_eval/annotators
2024-01-11T00:31:52,151   running egg_info
2024-01-11T00:31:52,204   writing src/alpaca_eval.egg-info/PKG-INFO
2024-01-11T00:31:52,223   writing dependency_links to src/alpaca_eval.egg-info/dependency_links.txt
2024-01-11T00:31:52,224   writing entry points to src/alpaca_eval.egg-info/entry_points.txt
2024-01-11T00:31:52,233   writing requirements to src/alpaca_eval.egg-info/requires.txt
2024-01-11T00:31:52,235   writing top-level names to src/alpaca_eval.egg-info/top_level.txt
2024-01-11T00:31:52,263   reading manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-01-11T00:31:52,271   reading manifest template 'MANIFEST.in'
2024-01-11T00:31:52,392   adding license file 'LICENSE'
2024-01-11T00:31:52,404   writing manifest file 'src/alpaca_eval.egg-info/SOURCES.txt'
2024-01-11T00:31:52,408   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs' is absent from the `packages` configuration.
2024-01-11T00:31:52,408   !!

2024-01-11T00:31:52,410           ********************************************************************************
2024-01-11T00:31:52,410           ############################
2024-01-11T00:31:52,411           # Package would be ignored #
2024-01-11T00:31:52,412           ############################
2024-01-11T00:31:52,412           Python recognizes 'alpaca_eval.evaluators_configs' as an importable package[^1],
2024-01-11T00:31:52,413           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,414           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,414           package, please make sure that 'alpaca_eval.evaluators_configs' is explicitly added
2024-01-11T00:31:52,415           to the `packages` configuration field.

2024-01-11T00:31:52,416           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,416           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,417           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,418           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,419           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,420           If you don't want 'alpaca_eval.evaluators_configs' to be distributed and are
2024-01-11T00:31:52,420           already explicitly excluding 'alpaca_eval.evaluators_configs' via
2024-01-11T00:31:52,421           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,421           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,422           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,423           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,424           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,425           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,425                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,425                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,426                 directory, all directories are treated like packages.
2024-01-11T00:31:52,426           ********************************************************************************

2024-01-11T00:31:52,427   !!
2024-01-11T00:31:52,427     check.warn(importable)
2024-01-11T00:31:52,427   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-01-11T00:31:52,428   !!

2024-01-11T00:31:52,429           ********************************************************************************
2024-01-11T00:31:52,429           ############################
2024-01-11T00:31:52,430           # Package would be ignored #
2024-01-11T00:31:52,430           ############################
2024-01-11T00:31:52,430           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' as an importable package[^1],
2024-01-11T00:31:52,431           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,432           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,432           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' is explicitly added
2024-01-11T00:31:52,433           to the `packages` configuration field.

2024-01-11T00:31:52,434           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,434           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,435           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,436           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,437           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,438           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' to be distributed and are
2024-01-11T00:31:52,439           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_cot_gpt4_turbo' via
2024-01-11T00:31:52,439           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,440           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,440           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,441           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,442           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,443           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,444                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,444                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,445                 directory, all directories are treated like packages.
2024-01-11T00:31:52,445           ********************************************************************************

2024-01-11T00:31:52,446   !!
2024-01-11T00:31:52,447     check.warn(importable)
2024-01-11T00:31:52,448   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is absent from the `packages` configuration.
2024-01-11T00:31:52,448   !!

2024-01-11T00:31:52,449           ********************************************************************************
2024-01-11T00:31:52,450           ############################
2024-01-11T00:31:52,450           # Package would be ignored #
2024-01-11T00:31:52,450           ############################
2024-01-11T00:31:52,450           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' as an importable package[^1],
2024-01-11T00:31:52,451           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,451           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,452           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' is explicitly added
2024-01-11T00:31:52,452           to the `packages` configuration field.

2024-01-11T00:31:52,453           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,453           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,454           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,454           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,455           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,456           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' to be distributed and are
2024-01-11T00:31:52,456           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_clf_gpt4_turbo' via
2024-01-11T00:31:52,457           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,457           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,458           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,459           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,460           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,461           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,462                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,463                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,463                 directory, all directories are treated like packages.
2024-01-11T00:31:52,464           ********************************************************************************

2024-01-11T00:31:52,465   !!
2024-01-11T00:31:52,465     check.warn(importable)
2024-01-11T00:31:52,466   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-01-11T00:31:52,466   !!

2024-01-11T00:31:52,467           ********************************************************************************
2024-01-11T00:31:52,467           ############################
2024-01-11T00:31:52,468           # Package would be ignored #
2024-01-11T00:31:52,468           ############################
2024-01-11T00:31:52,469           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' as an importable package[^1],
2024-01-11T00:31:52,469           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,470           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,471           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' is explicitly added
2024-01-11T00:31:52,471           to the `packages` configuration field.

2024-01-11T00:31:52,473           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,473           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,473           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,474           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,475           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,475           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' to be distributed and are
2024-01-11T00:31:52,476           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_cot_gpt4_turbo_fn' via
2024-01-11T00:31:52,476           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,476           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,477           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,477           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,478           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,479           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,479                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,480                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,480                 directory, all directories are treated like packages.
2024-01-11T00:31:52,480           ********************************************************************************

2024-01-11T00:31:52,482   !!
2024-01-11T00:31:52,482     check.warn(importable)
2024-01-11T00:31:52,482   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,483   !!

2024-01-11T00:31:52,484           ********************************************************************************
2024-01-11T00:31:52,485           ############################
2024-01-11T00:31:52,485           # Package would be ignored #
2024-01-11T00:31:52,486           ############################
2024-01-11T00:31:52,486           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' as an importable package[^1],
2024-01-11T00:31:52,487           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,488           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,488           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' is explicitly added
2024-01-11T00:31:52,489           to the `packages` configuration field.

2024-01-11T00:31:52,490           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,490           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,490           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,491           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,492           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,493           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' to be distributed and are
2024-01-11T00:31:52,493           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4' via
2024-01-11T00:31:52,494           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,495           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,495           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,496           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,498           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,499           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,499                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,499                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,500                 directory, all directories are treated like packages.
2024-01-11T00:31:52,500           ********************************************************************************

2024-01-11T00:31:52,501   !!
2024-01-11T00:31:52,501     check.warn(importable)
2024-01-11T00:31:52,501   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is absent from the `packages` configuration.
2024-01-11T00:31:52,502   !!

2024-01-11T00:31:52,502           ********************************************************************************
2024-01-11T00:31:52,503           ############################
2024-01-11T00:31:52,503           # Package would be ignored #
2024-01-11T00:31:52,503           ############################
2024-01-11T00:31:52,504           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' as an importable package[^1],
2024-01-11T00:31:52,504           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,505           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,505           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' is explicitly added
2024-01-11T00:31:52,506           to the `packages` configuration field.

2024-01-11T00:31:52,507           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,507           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,508           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,509           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,510           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,511           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' to be distributed and are
2024-01-11T00:31:52,511           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0314' via
2024-01-11T00:31:52,512           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,512           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,513           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,514           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,515           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,516           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,517                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,517                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,518                 directory, all directories are treated like packages.
2024-01-11T00:31:52,518           ********************************************************************************

2024-01-11T00:31:52,519   !!
2024-01-11T00:31:52,520     check.warn(importable)
2024-01-11T00:31:52,520   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is absent from the `packages` configuration.
2024-01-11T00:31:52,521   !!

2024-01-11T00:31:52,522           ********************************************************************************
2024-01-11T00:31:52,522           ############################
2024-01-11T00:31:52,523           # Package would be ignored #
2024-01-11T00:31:52,523           ############################
2024-01-11T00:31:52,524           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' as an importable package[^1],
2024-01-11T00:31:52,524           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,525           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,525           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' is explicitly added
2024-01-11T00:31:52,525           to the `packages` configuration field.

2024-01-11T00:31:52,526           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,526           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,527           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,527           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,528           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,529           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' to be distributed and are
2024-01-11T00:31:52,529           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_0613' via
2024-01-11T00:31:52,530           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,530           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,530           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,531           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,533           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,534           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,535                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,535                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,536                 directory, all directories are treated like packages.
2024-01-11T00:31:52,536           ********************************************************************************

2024-01-11T00:31:52,537   !!
2024-01-11T00:31:52,538     check.warn(importable)
2024-01-11T00:31:52,538   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is absent from the `packages` configuration.
2024-01-11T00:31:52,539   !!

2024-01-11T00:31:52,540           ********************************************************************************
2024-01-11T00:31:52,540           ############################
2024-01-11T00:31:52,541           # Package would be ignored #
2024-01-11T00:31:52,541           ############################
2024-01-11T00:31:52,542           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' as an importable package[^1],
2024-01-11T00:31:52,542           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,543           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,543           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' is explicitly added
2024-01-11T00:31:52,544           to the `packages` configuration field.

2024-01-11T00:31:52,545           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,545           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,546           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,547           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,548           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,549           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' to be distributed and are
2024-01-11T00:31:52,549           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_fn' via
2024-01-11T00:31:52,549           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,550           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,550           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,551           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,551           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,552           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,553                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,553                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,553                 directory, all directories are treated like packages.
2024-01-11T00:31:52,554           ********************************************************************************

2024-01-11T00:31:52,555   !!
2024-01-11T00:31:52,555     check.warn(importable)
2024-01-11T00:31:52,555   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is absent from the `packages` configuration.
2024-01-11T00:31:52,556   !!

2024-01-11T00:31:52,557           ********************************************************************************
2024-01-11T00:31:52,557           ############################
2024-01-11T00:31:52,558           # Package would be ignored #
2024-01-11T00:31:52,558           ############################
2024-01-11T00:31:52,559           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' as an importable package[^1],
2024-01-11T00:31:52,559           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,560           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,561           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' is explicitly added
2024-01-11T00:31:52,562           to the `packages` configuration field.

2024-01-11T00:31:52,563           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,563           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,564           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,565           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,566           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,567           If you don't want 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' to be distributed and are
2024-01-11T00:31:52,567           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_eval_gpt4_turbo_fn' via
2024-01-11T00:31:52,568           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,568           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,569           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,570           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,571           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,572           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,573                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,574                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,574                 directory, all directories are treated like packages.
2024-01-11T00:31:52,574           ********************************************************************************

2024-01-11T00:31:52,575   !!
2024-01-11T00:31:52,575     check.warn(importable)
2024-01-11T00:31:52,576   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm' is absent from the `packages` configuration.
2024-01-11T00:31:52,576   !!

2024-01-11T00:31:52,577           ********************************************************************************
2024-01-11T00:31:52,577           ############################
2024-01-11T00:31:52,577           # Package would be ignored #
2024-01-11T00:31:52,578           ############################
2024-01-11T00:31:52,578           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm' as an importable package[^1],
2024-01-11T00:31:52,578           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,579           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,579           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm' is explicitly added
2024-01-11T00:31:52,580           to the `packages` configuration field.

2024-01-11T00:31:52,581           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,581           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,581           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,582           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,583           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,585           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm' to be distributed and are
2024-01-11T00:31:52,585           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm' via
2024-01-11T00:31:52,586           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,586           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,587           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,588           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,589           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,590           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,591                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,591                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,592                 directory, all directories are treated like packages.
2024-01-11T00:31:52,592           ********************************************************************************

2024-01-11T00:31:52,593   !!
2024-01-11T00:31:52,593     check.warn(importable)
2024-01-11T00:31:52,594   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,594   !!

2024-01-11T00:31:52,595           ********************************************************************************
2024-01-11T00:31:52,596           ############################
2024-01-11T00:31:52,596           # Package would be ignored #
2024-01-11T00:31:52,597           ############################
2024-01-11T00:31:52,597           Python recognizes 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' as an importable package[^1],
2024-01-11T00:31:52,598           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,599           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,599           package, please make sure that 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' is explicitly added
2024-01-11T00:31:52,600           to the `packages` configuration field.

2024-01-11T00:31:52,601           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,601           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,601           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,602           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,603           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,603           If you don't want 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' to be distributed and are
2024-01-11T00:31:52,604           already explicitly excluding 'alpaca_eval.evaluators_configs.alpaca_farm_greedy_gpt4' via
2024-01-11T00:31:52,604           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,604           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,605           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,605           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,606           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,608           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,608                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,609                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,609                 directory, all directories are treated like packages.
2024-01-11T00:31:52,610           ********************************************************************************

2024-01-11T00:31:52,611   !!
2024-01-11T00:31:52,611     check.warn(importable)
2024-01-11T00:31:52,612   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.aviary_gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,612   !!

2024-01-11T00:31:52,613           ********************************************************************************
2024-01-11T00:31:52,614           ############################
2024-01-11T00:31:52,614           # Package would be ignored #
2024-01-11T00:31:52,615           ############################
2024-01-11T00:31:52,615           Python recognizes 'alpaca_eval.evaluators_configs.aviary_gpt4' as an importable package[^1],
2024-01-11T00:31:52,616           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,616           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,617           package, please make sure that 'alpaca_eval.evaluators_configs.aviary_gpt4' is explicitly added
2024-01-11T00:31:52,617           to the `packages` configuration field.

2024-01-11T00:31:52,618           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,619           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,619           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,620           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,621           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,622           If you don't want 'alpaca_eval.evaluators_configs.aviary_gpt4' to be distributed and are
2024-01-11T00:31:52,623           already explicitly excluding 'alpaca_eval.evaluators_configs.aviary_gpt4' via
2024-01-11T00:31:52,623           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,624           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,625           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,625           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,626           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,627           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,627                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,627                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,628                 directory, all directories are treated like packages.
2024-01-11T00:31:52,628           ********************************************************************************

2024-01-11T00:31:52,629   !!
2024-01-11T00:31:52,629     check.warn(importable)
2024-01-11T00:31:52,630   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude' is absent from the `packages` configuration.
2024-01-11T00:31:52,630   !!

2024-01-11T00:31:52,631           ********************************************************************************
2024-01-11T00:31:52,631           ############################
2024-01-11T00:31:52,632           # Package would be ignored #
2024-01-11T00:31:52,632           ############################
2024-01-11T00:31:52,633           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude' as an importable package[^1],
2024-01-11T00:31:52,633           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,634           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,635           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude' is explicitly added
2024-01-11T00:31:52,635           to the `packages` configuration field.

2024-01-11T00:31:52,637           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,637           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,638           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,639           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,641           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude' to be distributed and are
2024-01-11T00:31:52,641           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude' via
2024-01-11T00:31:52,642           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,642           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,643           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,644           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,645           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,646           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,646                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,647                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,648                 directory, all directories are treated like packages.
2024-01-11T00:31:52,648           ********************************************************************************

2024-01-11T00:31:52,649   !!
2024-01-11T00:31:52,650     check.warn(importable)
2024-01-11T00:31:52,650   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-01-11T00:31:52,651   !!

2024-01-11T00:31:52,651           ********************************************************************************
2024-01-11T00:31:52,652           ############################
2024-01-11T00:31:52,652           # Package would be ignored #
2024-01-11T00:31:52,652           ############################
2024-01-11T00:31:52,653           Python recognizes 'alpaca_eval.evaluators_configs.bedrock_claude_2' as an importable package[^1],
2024-01-11T00:31:52,653           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,654           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,654           package, please make sure that 'alpaca_eval.evaluators_configs.bedrock_claude_2' is explicitly added
2024-01-11T00:31:52,655           to the `packages` configuration field.

2024-01-11T00:31:52,655           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,656           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,656           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,657           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,657           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,658           If you don't want 'alpaca_eval.evaluators_configs.bedrock_claude_2' to be distributed and are
2024-01-11T00:31:52,659           already explicitly excluding 'alpaca_eval.evaluators_configs.bedrock_claude_2' via
2024-01-11T00:31:52,659           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,660           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,660           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,661           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,663           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,664           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,665                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,665                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,666                 directory, all directories are treated like packages.
2024-01-11T00:31:52,666           ********************************************************************************

2024-01-11T00:31:52,667   !!
2024-01-11T00:31:52,668     check.warn(importable)
2024-01-11T00:31:52,668   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt' is absent from the `packages` configuration.
2024-01-11T00:31:52,669   !!

2024-01-11T00:31:52,670           ********************************************************************************
2024-01-11T00:31:52,670           ############################
2024-01-11T00:31:52,671           # Package would be ignored #
2024-01-11T00:31:52,671           ############################
2024-01-11T00:31:52,671           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt' as an importable package[^1],
2024-01-11T00:31:52,672           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,673           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,674           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt' is explicitly added
2024-01-11T00:31:52,674           to the `packages` configuration field.

2024-01-11T00:31:52,675           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,676           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,676           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,677           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,677           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,678           If you don't want 'alpaca_eval.evaluators_configs.chatgpt' to be distributed and are
2024-01-11T00:31:52,678           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt' via
2024-01-11T00:31:52,679           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,679           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,679           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,680           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,682                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,682                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,683                 directory, all directories are treated like packages.
2024-01-11T00:31:52,683           ********************************************************************************

2024-01-11T00:31:52,684   !!
2024-01-11T00:31:52,685     check.warn(importable)
2024-01-11T00:31:52,685   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.chatgpt_fn' is absent from the `packages` configuration.
2024-01-11T00:31:52,686   !!

2024-01-11T00:31:52,687           ********************************************************************************
2024-01-11T00:31:52,687           ############################
2024-01-11T00:31:52,688           # Package would be ignored #
2024-01-11T00:31:52,688           ############################
2024-01-11T00:31:52,689           Python recognizes 'alpaca_eval.evaluators_configs.chatgpt_fn' as an importable package[^1],
2024-01-11T00:31:52,689           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,691           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,691           package, please make sure that 'alpaca_eval.evaluators_configs.chatgpt_fn' is explicitly added
2024-01-11T00:31:52,692           to the `packages` configuration field.

2024-01-11T00:31:52,693           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,693           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,693           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,694           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,695           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,696           If you don't want 'alpaca_eval.evaluators_configs.chatgpt_fn' to be distributed and are
2024-01-11T00:31:52,697           already explicitly excluding 'alpaca_eval.evaluators_configs.chatgpt_fn' via
2024-01-11T00:31:52,697           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,697           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,698           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,699           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,700           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,701           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,702                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,702                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,703                 directory, all directories are treated like packages.
2024-01-11T00:31:52,703           ********************************************************************************

2024-01-11T00:31:52,704   !!
2024-01-11T00:31:52,704     check.warn(importable)
2024-01-11T00:31:52,705   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude' is absent from the `packages` configuration.
2024-01-11T00:31:52,705   !!

2024-01-11T00:31:52,706           ********************************************************************************
2024-01-11T00:31:52,706           ############################
2024-01-11T00:31:52,706           # Package would be ignored #
2024-01-11T00:31:52,707           ############################
2024-01-11T00:31:52,707           Python recognizes 'alpaca_eval.evaluators_configs.claude' as an importable package[^1],
2024-01-11T00:31:52,707           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,708           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,708           package, please make sure that 'alpaca_eval.evaluators_configs.claude' is explicitly added
2024-01-11T00:31:52,709           to the `packages` configuration field.

2024-01-11T00:31:52,710           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,710           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,711           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,711           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,712           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,713           If you don't want 'alpaca_eval.evaluators_configs.claude' to be distributed and are
2024-01-11T00:31:52,714           already explicitly excluding 'alpaca_eval.evaluators_configs.claude' via
2024-01-11T00:31:52,715           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,715           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,716           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,717           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,717           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,719           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,719                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,720                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,720                 directory, all directories are treated like packages.
2024-01-11T00:31:52,720           ********************************************************************************

2024-01-11T00:31:52,721   !!
2024-01-11T00:31:52,722     check.warn(importable)
2024-01-11T00:31:52,722   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_2' is absent from the `packages` configuration.
2024-01-11T00:31:52,723   !!

2024-01-11T00:31:52,724           ********************************************************************************
2024-01-11T00:31:52,725           ############################
2024-01-11T00:31:52,725           # Package would be ignored #
2024-01-11T00:31:52,726           ############################
2024-01-11T00:31:52,726           Python recognizes 'alpaca_eval.evaluators_configs.claude_2' as an importable package[^1],
2024-01-11T00:31:52,727           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,727           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,728           package, please make sure that 'alpaca_eval.evaluators_configs.claude_2' is explicitly added
2024-01-11T00:31:52,728           to the `packages` configuration field.

2024-01-11T00:31:52,729           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,729           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,729           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,730           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,731           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,731           If you don't want 'alpaca_eval.evaluators_configs.claude_2' to be distributed and are
2024-01-11T00:31:52,732           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_2' via
2024-01-11T00:31:52,732           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,733           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,733           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,734           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,735           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,737           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,737                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,738                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,738                 directory, all directories are treated like packages.
2024-01-11T00:31:52,739           ********************************************************************************

2024-01-11T00:31:52,740   !!
2024-01-11T00:31:52,740     check.warn(importable)
2024-01-11T00:31:52,741   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.claude_ranking' is absent from the `packages` configuration.
2024-01-11T00:31:52,741   !!

2024-01-11T00:31:52,743           ********************************************************************************
2024-01-11T00:31:52,743           ############################
2024-01-11T00:31:52,743           # Package would be ignored #
2024-01-11T00:31:52,744           ############################
2024-01-11T00:31:52,744           Python recognizes 'alpaca_eval.evaluators_configs.claude_ranking' as an importable package[^1],
2024-01-11T00:31:52,745           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,746           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,746           package, please make sure that 'alpaca_eval.evaluators_configs.claude_ranking' is explicitly added
2024-01-11T00:31:52,746           to the `packages` configuration field.

2024-01-11T00:31:52,747           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,748           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,748           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,749           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,750           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,751           If you don't want 'alpaca_eval.evaluators_configs.claude_ranking' to be distributed and are
2024-01-11T00:31:52,752           already explicitly excluding 'alpaca_eval.evaluators_configs.claude_ranking' via
2024-01-11T00:31:52,753           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,753           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,754           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,754           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,755           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,756           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,756                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,756                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,757                 directory, all directories are treated like packages.
2024-01-11T00:31:52,757           ********************************************************************************

2024-01-11T00:31:52,758   !!
2024-01-11T00:31:52,758     check.warn(importable)
2024-01-11T00:31:52,758   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.cohere' is absent from the `packages` configuration.
2024-01-11T00:31:52,759   !!

2024-01-11T00:31:52,760           ********************************************************************************
2024-01-11T00:31:52,760           ############################
2024-01-11T00:31:52,760           # Package would be ignored #
2024-01-11T00:31:52,761           ############################
2024-01-11T00:31:52,761           Python recognizes 'alpaca_eval.evaluators_configs.cohere' as an importable package[^1],
2024-01-11T00:31:52,762           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,763           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,763           package, please make sure that 'alpaca_eval.evaluators_configs.cohere' is explicitly added
2024-01-11T00:31:52,764           to the `packages` configuration field.

2024-01-11T00:31:52,765           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,766           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,766           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,767           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,768           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,769           If you don't want 'alpaca_eval.evaluators_configs.cohere' to be distributed and are
2024-01-11T00:31:52,769           already explicitly excluding 'alpaca_eval.evaluators_configs.cohere' via
2024-01-11T00:31:52,769           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,770           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,770           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,771           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,772           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,774           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,774                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,775                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,775                 directory, all directories are treated like packages.
2024-01-11T00:31:52,776           ********************************************************************************

2024-01-11T00:31:52,777   !!
2024-01-11T00:31:52,777     check.warn(importable)
2024-01-11T00:31:52,778   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-01-11T00:31:52,778   !!

2024-01-11T00:31:52,779           ********************************************************************************
2024-01-11T00:31:52,779           ############################
2024-01-11T00:31:52,780           # Package would be ignored #
2024-01-11T00:31:52,780           ############################
2024-01-11T00:31:52,780           Python recognizes 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-01-11T00:31:52,781           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,781           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,782           package, please make sure that 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' is explicitly added
2024-01-11T00:31:52,782           to the `packages` configuration field.

2024-01-11T00:31:52,783           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,783           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,783           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,784           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,785           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,786           If you don't want 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' to be distributed and are
2024-01-11T00:31:52,787           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt35_turbo_instruct' via
2024-01-11T00:31:52,787           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,788           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,788           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,789           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,791           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,792           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,793                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,793                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,794                 directory, all directories are treated like packages.
2024-01-11T00:31:52,795           ********************************************************************************

2024-01-11T00:31:52,795   !!
2024-01-11T00:31:52,796     check.warn(importable)
2024-01-11T00:31:52,796   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,797   !!

2024-01-11T00:31:52,798           ********************************************************************************
2024-01-11T00:31:52,798           ############################
2024-01-11T00:31:52,799           # Package would be ignored #
2024-01-11T00:31:52,799           ############################
2024-01-11T00:31:52,800           Python recognizes 'alpaca_eval.evaluators_configs.gpt4' as an importable package[^1],
2024-01-11T00:31:52,800           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,801           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,802           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4' is explicitly added
2024-01-11T00:31:52,803           to the `packages` configuration field.

2024-01-11T00:31:52,804           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,804           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,805           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,805           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,806           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,806           If you don't want 'alpaca_eval.evaluators_configs.gpt4' to be distributed and are
2024-01-11T00:31:52,807           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4' via
2024-01-11T00:31:52,807           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,807           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,808           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,808           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,809           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,810           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,811                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,811                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,811                 directory, all directories are treated like packages.
2024-01-11T00:31:52,812           ********************************************************************************

2024-01-11T00:31:52,813   !!
2024-01-11T00:31:52,813     check.warn(importable)
2024-01-11T00:31:52,814   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-01-11T00:31:52,814   !!

2024-01-11T00:31:52,815           ********************************************************************************
2024-01-11T00:31:52,816           ############################
2024-01-11T00:31:52,816           # Package would be ignored #
2024-01-11T00:31:52,817           ############################
2024-01-11T00:31:52,817           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo' as an importable package[^1],
2024-01-11T00:31:52,818           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,819           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,820           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo' is explicitly added
2024-01-11T00:31:52,820           to the `packages` configuration field.

2024-01-11T00:31:52,821           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,821           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,822           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,823           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,824           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,825           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo' to be distributed and are
2024-01-11T00:31:52,825           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo' via
2024-01-11T00:31:52,826           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,826           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,827           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,828           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,829           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,830           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,831                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,831                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,831                 directory, all directories are treated like packages.
2024-01-11T00:31:52,832           ********************************************************************************

2024-01-11T00:31:52,832   !!
2024-01-11T00:31:52,833     check.warn(importable)
2024-01-11T00:31:52,833   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is absent from the `packages` configuration.
2024-01-11T00:31:52,833   !!

2024-01-11T00:31:52,834           ********************************************************************************
2024-01-11T00:31:52,834           ############################
2024-01-11T00:31:52,835           # Package would be ignored #
2024-01-11T00:31:52,835           ############################
2024-01-11T00:31:52,835           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' as an importable package[^1],
2024-01-11T00:31:52,836           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,837           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,837           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' is explicitly added
2024-01-11T00:31:52,837           to the `packages` configuration field.

2024-01-11T00:31:52,838           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,839           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,840           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,841           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,842           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,843           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' to be distributed and are
2024-01-11T00:31:52,843           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_clf' via
2024-01-11T00:31:52,844           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,845           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,845           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,846           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,847           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,848           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,849                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,849                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,850                 directory, all directories are treated like packages.
2024-01-11T00:31:52,850           ********************************************************************************

2024-01-11T00:31:52,851   !!
2024-01-11T00:31:52,852     check.warn(importable)
2024-01-11T00:31:52,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is absent from the `packages` configuration.
2024-01-11T00:31:52,853   !!

2024-01-11T00:31:52,854           ********************************************************************************
2024-01-11T00:31:52,854           ############################
2024-01-11T00:31:52,855           # Package would be ignored #
2024-01-11T00:31:52,855           ############################
2024-01-11T00:31:52,856           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' as an importable package[^1],
2024-01-11T00:31:52,856           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,857           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,857           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' is explicitly added
2024-01-11T00:31:52,857           to the `packages` configuration field.

2024-01-11T00:31:52,858           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,858           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,859           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,859           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,860           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,861           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' to be distributed and are
2024-01-11T00:31:52,861           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_clf' via
2024-01-11T00:31:52,862           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,862           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,862           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,863           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,864           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,865           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,866                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,866                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,867                 directory, all directories are treated like packages.
2024-01-11T00:31:52,867           ********************************************************************************

2024-01-11T00:31:52,869   !!
2024-01-11T00:31:52,869     check.warn(importable)
2024-01-11T00:31:52,870   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is absent from the `packages` configuration.
2024-01-11T00:31:52,870   !!

2024-01-11T00:31:52,871           ********************************************************************************
2024-01-11T00:31:52,872           ############################
2024-01-11T00:31:52,872           # Package would be ignored #
2024-01-11T00:31:52,872           ############################
2024-01-11T00:31:52,873           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' as an importable package[^1],
2024-01-11T00:31:52,873           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,874           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,875           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' is explicitly added
2024-01-11T00:31:52,875           to the `packages` configuration field.

2024-01-11T00:31:52,876           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,877           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,877           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,878           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,880           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,880           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' to be distributed and are
2024-01-11T00:31:52,881           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_cot_logprob' via
2024-01-11T00:31:52,881           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,881           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,882           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,882           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,883           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,884           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,884                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,885                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,885                 directory, all directories are treated like packages.
2024-01-11T00:31:52,885           ********************************************************************************

2024-01-11T00:31:52,886   !!
2024-01-11T00:31:52,886     check.warn(importable)
2024-01-11T00:31:52,887   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is absent from the `packages` configuration.
2024-01-11T00:31:52,887   !!

2024-01-11T00:31:52,888           ********************************************************************************
2024-01-11T00:31:52,889           ############################
2024-01-11T00:31:52,889           # Package would be ignored #
2024-01-11T00:31:52,890           ############################
2024-01-11T00:31:52,890           Python recognizes 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' as an importable package[^1],
2024-01-11T00:31:52,891           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,892           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,892           package, please make sure that 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' is explicitly added
2024-01-11T00:31:52,893           to the `packages` configuration field.

2024-01-11T00:31:52,894           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,895           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,895           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,896           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,897           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,898           If you don't want 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' to be distributed and are
2024-01-11T00:31:52,898           already explicitly excluding 'alpaca_eval.evaluators_configs.gpt4_turbo_logprob' via
2024-01-11T00:31:52,899           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,899           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,900           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,901           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,902           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,903           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,904                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,905                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,905                 directory, all directories are treated like packages.
2024-01-11T00:31:52,906           ********************************************************************************

2024-01-11T00:31:52,906   !!
2024-01-11T00:31:52,907     check.warn(importable)
2024-01-11T00:31:52,907   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.guanaco_33b' is absent from the `packages` configuration.
2024-01-11T00:31:52,907   !!

2024-01-11T00:31:52,908           ********************************************************************************
2024-01-11T00:31:52,908           ############################
2024-01-11T00:31:52,909           # Package would be ignored #
2024-01-11T00:31:52,909           ############################
2024-01-11T00:31:52,910           Python recognizes 'alpaca_eval.evaluators_configs.guanaco_33b' as an importable package[^1],
2024-01-11T00:31:52,910           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,911           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,911           package, please make sure that 'alpaca_eval.evaluators_configs.guanaco_33b' is explicitly added
2024-01-11T00:31:52,912           to the `packages` configuration field.

2024-01-11T00:31:52,913           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,913           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,913           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,914           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,916           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,917           If you don't want 'alpaca_eval.evaluators_configs.guanaco_33b' to be distributed and are
2024-01-11T00:31:52,917           already explicitly excluding 'alpaca_eval.evaluators_configs.guanaco_33b' via
2024-01-11T00:31:52,918           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,918           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,919           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,920           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,921           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,922           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,923                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,923                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,924                 directory, all directories are treated like packages.
2024-01-11T00:31:52,924           ********************************************************************************

2024-01-11T00:31:52,925   !!
2024-01-11T00:31:52,926     check.warn(importable)
2024-01-11T00:31:52,926   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,927   !!

2024-01-11T00:31:52,928           ********************************************************************************
2024-01-11T00:31:52,928           ############################
2024-01-11T00:31:52,929           # Package would be ignored #
2024-01-11T00:31:52,929           ############################
2024-01-11T00:31:52,930           Python recognizes 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' as an importable package[^1],
2024-01-11T00:31:52,930           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,932           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,932           package, please make sure that 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' is explicitly added
2024-01-11T00:31:52,932           to the `packages` configuration field.

2024-01-11T00:31:52,933           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,933           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,934           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,935           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,935           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,936           If you don't want 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' to be distributed and are
2024-01-11T00:31:52,936           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_aviary_gpt4' via
2024-01-11T00:31:52,937           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,937           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,937           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,938           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,939           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,940           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,941                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,941                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,942                 directory, all directories are treated like packages.
2024-01-11T00:31:52,942           ********************************************************************************

2024-01-11T00:31:52,944   !!
2024-01-11T00:31:52,944     check.warn(importable)
2024-01-11T00:31:52,945   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,945   !!

2024-01-11T00:31:52,946           ********************************************************************************
2024-01-11T00:31:52,947           ############################
2024-01-11T00:31:52,947           # Package would be ignored #
2024-01-11T00:31:52,948           ############################
2024-01-11T00:31:52,949           Python recognizes 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' as an importable package[^1],
2024-01-11T00:31:52,949           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,950           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,950           package, please make sure that 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' is explicitly added
2024-01-11T00:31:52,951           to the `packages` configuration field.

2024-01-11T00:31:52,952           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,952           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,953           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,954           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,955           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,956           If you don't want 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' to be distributed and are
2024-01-11T00:31:52,956           already explicitly excluding 'alpaca_eval.evaluators_configs.improved_lmsys_gpt4' via
2024-01-11T00:31:52,957           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,958           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,958           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,959           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,959           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,960           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,961                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,961                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,961                 directory, all directories are treated like packages.
2024-01-11T00:31:52,962           ********************************************************************************

2024-01-11T00:31:52,962   !!
2024-01-11T00:31:52,963     check.warn(importable)
2024-01-11T00:31:52,963   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.lmsys_gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:52,963   !!

2024-01-11T00:31:52,964           ********************************************************************************
2024-01-11T00:31:52,964           ############################
2024-01-11T00:31:52,965           # Package would be ignored #
2024-01-11T00:31:52,965           ############################
2024-01-11T00:31:52,966           Python recognizes 'alpaca_eval.evaluators_configs.lmsys_gpt4' as an importable package[^1],
2024-01-11T00:31:52,966           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,967           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,968           package, please make sure that 'alpaca_eval.evaluators_configs.lmsys_gpt4' is explicitly added
2024-01-11T00:31:52,968           to the `packages` configuration field.

2024-01-11T00:31:52,969           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,970           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,970           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,971           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,972           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,973           If you don't want 'alpaca_eval.evaluators_configs.lmsys_gpt4' to be distributed and are
2024-01-11T00:31:52,974           already explicitly excluding 'alpaca_eval.evaluators_configs.lmsys_gpt4' via
2024-01-11T00:31:52,975           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,975           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,975           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,976           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,977           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,979           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,979                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,980                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,980                 directory, all directories are treated like packages.
2024-01-11T00:31:52,981           ********************************************************************************

2024-01-11T00:31:52,982   !!
2024-01-11T00:31:52,983     check.warn(importable)
2024-01-11T00:31:52,983   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is absent from the `packages` configuration.
2024-01-11T00:31:52,984   !!

2024-01-11T00:31:52,985           ********************************************************************************
2024-01-11T00:31:52,985           ############################
2024-01-11T00:31:52,986           # Package would be ignored #
2024-01-11T00:31:52,986           ############################
2024-01-11T00:31:52,986           Python recognizes 'alpaca_eval.evaluators_configs.oasst_pythia_12b' as an importable package[^1],
2024-01-11T00:31:52,987           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:52,987           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:52,988           package, please make sure that 'alpaca_eval.evaluators_configs.oasst_pythia_12b' is explicitly added
2024-01-11T00:31:52,988           to the `packages` configuration field.

2024-01-11T00:31:52,989           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:52,989           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:52,989           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:52,990           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:52,991           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:52,992           If you don't want 'alpaca_eval.evaluators_configs.oasst_pythia_12b' to be distributed and are
2024-01-11T00:31:52,992           already explicitly excluding 'alpaca_eval.evaluators_configs.oasst_pythia_12b' via
2024-01-11T00:31:52,992           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:52,993           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:52,993           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:52,995           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:52,996           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:52,997           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:52,998                 even if it does not contain any `.py` files.
2024-01-11T00:31:52,998                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:52,999                 directory, all directories are treated like packages.
2024-01-11T00:31:52,999           ********************************************************************************

2024-01-11T00:31:53,000   !!
2024-01-11T00:31:53,001     check.warn(importable)
2024-01-11T00:31:53,001   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.test' is absent from the `packages` configuration.
2024-01-11T00:31:53,002   !!

2024-01-11T00:31:53,003           ********************************************************************************
2024-01-11T00:31:53,003           ############################
2024-01-11T00:31:53,004           # Package would be ignored #
2024-01-11T00:31:53,004           ############################
2024-01-11T00:31:53,004           Python recognizes 'alpaca_eval.evaluators_configs.test' as an importable package[^1],
2024-01-11T00:31:53,005           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,006           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,006           package, please make sure that 'alpaca_eval.evaluators_configs.test' is explicitly added
2024-01-11T00:31:53,007           to the `packages` configuration field.

2024-01-11T00:31:53,008           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,008           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,009           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,010           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,011           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,011           If you don't want 'alpaca_eval.evaluators_configs.test' to be distributed and are
2024-01-11T00:31:53,012           already explicitly excluding 'alpaca_eval.evaluators_configs.test' via
2024-01-11T00:31:53,012           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,012           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,013           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,013           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,014           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,015           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,015                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,016                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,016                 directory, all directories are treated like packages.
2024-01-11T00:31:53,017           ********************************************************************************

2024-01-11T00:31:53,017   !!
2024-01-11T00:31:53,018     check.warn(importable)
2024-01-11T00:31:53,018   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.text_davinci_003' is absent from the `packages` configuration.
2024-01-11T00:31:53,019   !!

2024-01-11T00:31:53,020           ********************************************************************************
2024-01-11T00:31:53,020           ############################
2024-01-11T00:31:53,021           # Package would be ignored #
2024-01-11T00:31:53,021           ############################
2024-01-11T00:31:53,022           Python recognizes 'alpaca_eval.evaluators_configs.text_davinci_003' as an importable package[^1],
2024-01-11T00:31:53,023           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,024           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,024           package, please make sure that 'alpaca_eval.evaluators_configs.text_davinci_003' is explicitly added
2024-01-11T00:31:53,024           to the `packages` configuration field.

2024-01-11T00:31:53,025           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,026           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,026           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,027           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,028           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,029           If you don't want 'alpaca_eval.evaluators_configs.text_davinci_003' to be distributed and are
2024-01-11T00:31:53,029           already explicitly excluding 'alpaca_eval.evaluators_configs.text_davinci_003' via
2024-01-11T00:31:53,030           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,030           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,031           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,032           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,033           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,035           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,035                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,036                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,036                 directory, all directories are treated like packages.
2024-01-11T00:31:53,036           ********************************************************************************

2024-01-11T00:31:53,037   !!
2024-01-11T00:31:53,037     check.warn(importable)
2024-01-11T00:31:53,038   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is absent from the `packages` configuration.
2024-01-11T00:31:53,038   !!

2024-01-11T00:31:53,039           ********************************************************************************
2024-01-11T00:31:53,039           ############################
2024-01-11T00:31:53,040           # Package would be ignored #
2024-01-11T00:31:53,040           ############################
2024-01-11T00:31:53,040           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' as an importable package[^1],
2024-01-11T00:31:53,041           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,041           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,042           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' is explicitly added
2024-01-11T00:31:53,042           to the `packages` configuration field.

2024-01-11T00:31:53,043           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,044           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,044           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,045           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,046           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,048           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' to be distributed and are
2024-01-11T00:31:53,048           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_cot_gpt4_turbo' via
2024-01-11T00:31:53,049           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,049           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,050           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,051           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,052           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,053           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,054                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,054                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,055                 directory, all directories are treated like packages.
2024-01-11T00:31:53,055           ********************************************************************************

2024-01-11T00:31:53,056   !!
2024-01-11T00:31:53,057     check.warn(importable)
2024-01-11T00:31:53,057   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is absent from the `packages` configuration.
2024-01-11T00:31:53,058   !!

2024-01-11T00:31:53,059           ********************************************************************************
2024-01-11T00:31:53,060           ############################
2024-01-11T00:31:53,061           # Package would be ignored #
2024-01-11T00:31:53,061           ############################
2024-01-11T00:31:53,061           Python recognizes 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' as an importable package[^1],
2024-01-11T00:31:53,062           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,062           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,063           package, please make sure that 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' is explicitly added
2024-01-11T00:31:53,063           to the `packages` configuration field.

2024-01-11T00:31:53,064           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,065           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,065           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,066           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,067           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,068           If you don't want 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' to be distributed and are
2024-01-11T00:31:53,068           already explicitly excluding 'alpaca_eval.evaluators_configs.weighted_alpaca_eval_gpt4_turbo' via
2024-01-11T00:31:53,069           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,069           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,070           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,071           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,072           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,073           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,074                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,074                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,075                 directory, all directories are treated like packages.
2024-01-11T00:31:53,075           ********************************************************************************

2024-01-11T00:31:53,076   !!
2024-01-11T00:31:53,077     check.warn(importable)
2024-01-11T00:31:53,077   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval' is absent from the `packages` configuration.
2024-01-11T00:31:53,078   !!

2024-01-11T00:31:53,079           ********************************************************************************
2024-01-11T00:31:53,079           ############################
2024-01-11T00:31:53,080           # Package would be ignored #
2024-01-11T00:31:53,080           ############################
2024-01-11T00:31:53,081           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval' as an importable package[^1],
2024-01-11T00:31:53,081           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,082           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,083           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval' is explicitly added
2024-01-11T00:31:53,083           to the `packages` configuration field.

2024-01-11T00:31:53,084           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,085           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,085           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,087           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,088           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,089           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval' to be distributed and are
2024-01-11T00:31:53,089           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval' via
2024-01-11T00:31:53,090           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,090           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,091           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,091           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,092           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,094           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,094                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,094                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,095                 directory, all directories are treated like packages.
2024-01-11T00:31:53,095           ********************************************************************************

2024-01-11T00:31:53,096   !!
2024-01-11T00:31:53,097     check.warn(importable)
2024-01-11T00:31:53,097   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.data_AlpacaEval_2' is absent from the `packages` configuration.
2024-01-11T00:31:53,097   !!

2024-01-11T00:31:53,098           ********************************************************************************
2024-01-11T00:31:53,099           ############################
2024-01-11T00:31:53,099           # Package would be ignored #
2024-01-11T00:31:53,100           ############################
2024-01-11T00:31:53,100           Python recognizes 'alpaca_eval.leaderboards.data_AlpacaEval_2' as an importable package[^1],
2024-01-11T00:31:53,101           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,102           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,102           package, please make sure that 'alpaca_eval.leaderboards.data_AlpacaEval_2' is explicitly added
2024-01-11T00:31:53,103           to the `packages` configuration field.

2024-01-11T00:31:53,104           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,104           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,105           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,106           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,107           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,108           If you don't want 'alpaca_eval.leaderboards.data_AlpacaEval_2' to be distributed and are
2024-01-11T00:31:53,108           already explicitly excluding 'alpaca_eval.leaderboards.data_AlpacaEval_2' via
2024-01-11T00:31:53,109           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,109           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,110           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,111           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,112           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,113           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,114                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,115                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,115                 directory, all directories are treated like packages.
2024-01-11T00:31:53,116           ********************************************************************************

2024-01-11T00:31:53,117   !!
2024-01-11T00:31:53,117     check.warn(importable)
2024-01-11T00:31:53,118   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.leaderboards.evaluators' is absent from the `packages` configuration.
2024-01-11T00:31:53,118   !!

2024-01-11T00:31:53,119           ********************************************************************************
2024-01-11T00:31:53,119           ############################
2024-01-11T00:31:53,120           # Package would be ignored #
2024-01-11T00:31:53,120           ############################
2024-01-11T00:31:53,121           Python recognizes 'alpaca_eval.leaderboards.evaluators' as an importable package[^1],
2024-01-11T00:31:53,121           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,122           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,122           package, please make sure that 'alpaca_eval.leaderboards.evaluators' is explicitly added
2024-01-11T00:31:53,123           to the `packages` configuration field.

2024-01-11T00:31:53,124           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,124           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,125           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,126           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,127           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,128           If you don't want 'alpaca_eval.leaderboards.evaluators' to be distributed and are
2024-01-11T00:31:53,128           already explicitly excluding 'alpaca_eval.leaderboards.evaluators' via
2024-01-11T00:31:53,129           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,129           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,130           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,131           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,132           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,133           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,134                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,135                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,135                 directory, all directories are treated like packages.
2024-01-11T00:31:53,136           ********************************************************************************

2024-01-11T00:31:53,137   !!
2024-01-11T00:31:53,137     check.warn(importable)
2024-01-11T00:31:53,138   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs' is absent from the `packages` configuration.
2024-01-11T00:31:53,138   !!

2024-01-11T00:31:53,139           ********************************************************************************
2024-01-11T00:31:53,139           ############################
2024-01-11T00:31:53,140           # Package would be ignored #
2024-01-11T00:31:53,140           ############################
2024-01-11T00:31:53,141           Python recognizes 'alpaca_eval.models_configs' as an importable package[^1],
2024-01-11T00:31:53,142           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,143           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,143           package, please make sure that 'alpaca_eval.models_configs' is explicitly added
2024-01-11T00:31:53,144           to the `packages` configuration field.

2024-01-11T00:31:53,145           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,146           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,146           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,147           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,148           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,149           If you don't want 'alpaca_eval.models_configs' to be distributed and are
2024-01-11T00:31:53,150           already explicitly excluding 'alpaca_eval.models_configs' via
2024-01-11T00:31:53,150           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,150           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,151           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,152           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,153           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,154           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,155                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,155                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,156                 directory, all directories are treated like packages.
2024-01-11T00:31:53,156           ********************************************************************************

2024-01-11T00:31:53,157   !!
2024-01-11T00:31:53,158     check.warn(importable)
2024-01-11T00:31:53,158   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude' is absent from the `packages` configuration.
2024-01-11T00:31:53,159   !!

2024-01-11T00:31:53,160           ********************************************************************************
2024-01-11T00:31:53,160           ############################
2024-01-11T00:31:53,161           # Package would be ignored #
2024-01-11T00:31:53,161           ############################
2024-01-11T00:31:53,162           Python recognizes 'alpaca_eval.models_configs.bedrock_claude' as an importable package[^1],
2024-01-11T00:31:53,162           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,163           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,164           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude' is explicitly added
2024-01-11T00:31:53,164           to the `packages` configuration field.

2024-01-11T00:31:53,165           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,166           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,166           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,167           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,168           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,169           If you don't want 'alpaca_eval.models_configs.bedrock_claude' to be distributed and are
2024-01-11T00:31:53,170           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude' via
2024-01-11T00:31:53,170           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,171           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,171           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,173           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,174           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,175           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,175                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,176                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,176                 directory, all directories are treated like packages.
2024-01-11T00:31:53,176           ********************************************************************************

2024-01-11T00:31:53,177   !!
2024-01-11T00:31:53,178     check.warn(importable)
2024-01-11T00:31:53,178   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.bedrock_claude_2' is absent from the `packages` configuration.
2024-01-11T00:31:53,179   !!

2024-01-11T00:31:53,179           ********************************************************************************
2024-01-11T00:31:53,180           ############################
2024-01-11T00:31:53,180           # Package would be ignored #
2024-01-11T00:31:53,181           ############################
2024-01-11T00:31:53,181           Python recognizes 'alpaca_eval.models_configs.bedrock_claude_2' as an importable package[^1],
2024-01-11T00:31:53,182           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,183           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,183           package, please make sure that 'alpaca_eval.models_configs.bedrock_claude_2' is explicitly added
2024-01-11T00:31:53,183           to the `packages` configuration field.

2024-01-11T00:31:53,184           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,185           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,185           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,187           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,188           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,189           If you don't want 'alpaca_eval.models_configs.bedrock_claude_2' to be distributed and are
2024-01-11T00:31:53,189           already explicitly excluding 'alpaca_eval.models_configs.bedrock_claude_2' via
2024-01-11T00:31:53,190           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,190           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,191           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,192           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,193           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,194           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,195                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,195                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,196                 directory, all directories are treated like packages.
2024-01-11T00:31:53,197           ********************************************************************************

2024-01-11T00:31:53,198   !!
2024-01-11T00:31:53,198     check.warn(importable)
2024-01-11T00:31:53,199   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.claude' is absent from the `packages` configuration.
2024-01-11T00:31:53,199   !!

2024-01-11T00:31:53,200           ********************************************************************************
2024-01-11T00:31:53,201           ############################
2024-01-11T00:31:53,202           # Package would be ignored #
2024-01-11T00:31:53,202           ############################
2024-01-11T00:31:53,203           Python recognizes 'alpaca_eval.models_configs.claude' as an importable package[^1],
2024-01-11T00:31:53,203           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,204           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,204           package, please make sure that 'alpaca_eval.models_configs.claude' is explicitly added
2024-01-11T00:31:53,205           to the `packages` configuration field.

2024-01-11T00:31:53,206           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,206           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,206           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,207           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,208           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,209           If you don't want 'alpaca_eval.models_configs.claude' to be distributed and are
2024-01-11T00:31:53,209           already explicitly excluding 'alpaca_eval.models_configs.claude' via
2024-01-11T00:31:53,210           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,210           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,211           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,212           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,213           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,214           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,215                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,215                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,215                 directory, all directories are treated like packages.
2024-01-11T00:31:53,216           ********************************************************************************

2024-01-11T00:31:53,217   !!
2024-01-11T00:31:53,217     check.warn(importable)
2024-01-11T00:31:53,218   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.cohere' is absent from the `packages` configuration.
2024-01-11T00:31:53,218   !!

2024-01-11T00:31:53,219           ********************************************************************************
2024-01-11T00:31:53,220           ############################
2024-01-11T00:31:53,221           # Package would be ignored #
2024-01-11T00:31:53,221           ############################
2024-01-11T00:31:53,222           Python recognizes 'alpaca_eval.models_configs.cohere' as an importable package[^1],
2024-01-11T00:31:53,222           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,223           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,223           package, please make sure that 'alpaca_eval.models_configs.cohere' is explicitly added
2024-01-11T00:31:53,224           to the `packages` configuration field.

2024-01-11T00:31:53,225           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,226           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,226           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,227           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,228           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,229           If you don't want 'alpaca_eval.models_configs.cohere' to be distributed and are
2024-01-11T00:31:53,229           already explicitly excluding 'alpaca_eval.models_configs.cohere' via
2024-01-11T00:31:53,230           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,230           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,231           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,231           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,233           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,234           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,234                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,235                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,236                 directory, all directories are treated like packages.
2024-01-11T00:31:53,236           ********************************************************************************

2024-01-11T00:31:53,238   !!
2024-01-11T00:31:53,238     check.warn(importable)
2024-01-11T00:31:53,239   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt35_turbo_instruct' is absent from the `packages` configuration.
2024-01-11T00:31:53,240   !!

2024-01-11T00:31:53,241           ********************************************************************************
2024-01-11T00:31:53,242           ############################
2024-01-11T00:31:53,242           # Package would be ignored #
2024-01-11T00:31:53,243           ############################
2024-01-11T00:31:53,244           Python recognizes 'alpaca_eval.models_configs.gpt35_turbo_instruct' as an importable package[^1],
2024-01-11T00:31:53,244           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,246           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,246           package, please make sure that 'alpaca_eval.models_configs.gpt35_turbo_instruct' is explicitly added
2024-01-11T00:31:53,247           to the `packages` configuration field.

2024-01-11T00:31:53,248           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,248           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,249           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,250           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,251           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,252           If you don't want 'alpaca_eval.models_configs.gpt35_turbo_instruct' to be distributed and are
2024-01-11T00:31:53,253           already explicitly excluding 'alpaca_eval.models_configs.gpt35_turbo_instruct' via
2024-01-11T00:31:53,254           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,254           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,255           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,256           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,257           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,259           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,260                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,260                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,261                 directory, all directories are treated like packages.
2024-01-11T00:31:53,262           ********************************************************************************

2024-01-11T00:31:53,263   !!
2024-01-11T00:31:53,263     check.warn(importable)
2024-01-11T00:31:53,264   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4' is absent from the `packages` configuration.
2024-01-11T00:31:53,264   !!

2024-01-11T00:31:53,265           ********************************************************************************
2024-01-11T00:31:53,266           ############################
2024-01-11T00:31:53,266           # Package would be ignored #
2024-01-11T00:31:53,267           ############################
2024-01-11T00:31:53,267           Python recognizes 'alpaca_eval.models_configs.gpt4' as an importable package[^1],
2024-01-11T00:31:53,268           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,269           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,270           package, please make sure that 'alpaca_eval.models_configs.gpt4' is explicitly added
2024-01-11T00:31:53,271           to the `packages` configuration field.

2024-01-11T00:31:53,272           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,272           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,273           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,275           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,276           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,277           If you don't want 'alpaca_eval.models_configs.gpt4' to be distributed and are
2024-01-11T00:31:53,278           already explicitly excluding 'alpaca_eval.models_configs.gpt4' via
2024-01-11T00:31:53,278           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,279           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,280           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,281           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,282           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,284           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,284                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,285                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,286                 directory, all directories are treated like packages.
2024-01-11T00:31:53,286           ********************************************************************************

2024-01-11T00:31:53,287   !!
2024-01-11T00:31:53,288     check.warn(importable)
2024-01-11T00:31:53,289   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0314' is absent from the `packages` configuration.
2024-01-11T00:31:53,289   !!

2024-01-11T00:31:53,291           ********************************************************************************
2024-01-11T00:31:53,292           ############################
2024-01-11T00:31:53,292           # Package would be ignored #
2024-01-11T00:31:53,293           ############################
2024-01-11T00:31:53,294           Python recognizes 'alpaca_eval.models_configs.gpt4_0314' as an importable package[^1],
2024-01-11T00:31:53,294           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,296           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,297           package, please make sure that 'alpaca_eval.models_configs.gpt4_0314' is explicitly added
2024-01-11T00:31:53,297           to the `packages` configuration field.

2024-01-11T00:31:53,299           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,299           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,300           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,301           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,302           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,303           If you don't want 'alpaca_eval.models_configs.gpt4_0314' to be distributed and are
2024-01-11T00:31:53,304           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0314' via
2024-01-11T00:31:53,305           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,305           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,306           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,307           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,308           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,310           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,311                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,311                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,312                 directory, all directories are treated like packages.
2024-01-11T00:31:53,313           ********************************************************************************

2024-01-11T00:31:53,314   !!
2024-01-11T00:31:53,314     check.warn(importable)
2024-01-11T00:31:53,315   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_0613' is absent from the `packages` configuration.
2024-01-11T00:31:53,316   !!

2024-01-11T00:31:53,317           ********************************************************************************
2024-01-11T00:31:53,317           ############################
2024-01-11T00:31:53,318           # Package would be ignored #
2024-01-11T00:31:53,319           ############################
2024-01-11T00:31:53,319           Python recognizes 'alpaca_eval.models_configs.gpt4_0613' as an importable package[^1],
2024-01-11T00:31:53,320           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,321           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,322           package, please make sure that 'alpaca_eval.models_configs.gpt4_0613' is explicitly added
2024-01-11T00:31:53,323           to the `packages` configuration field.

2024-01-11T00:31:53,324           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,325           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,325           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,326           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,328           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,329           If you don't want 'alpaca_eval.models_configs.gpt4_0613' to be distributed and are
2024-01-11T00:31:53,329           already explicitly excluding 'alpaca_eval.models_configs.gpt4_0613' via
2024-01-11T00:31:53,330           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,331           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,332           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,333           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,334           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,337           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,338                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,338                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,339                 directory, all directories are treated like packages.
2024-01-11T00:31:53,339           ********************************************************************************

2024-01-11T00:31:53,341   !!
2024-01-11T00:31:53,342     check.warn(importable)
2024-01-11T00:31:53,344   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_1106_preview' is absent from the `packages` configuration.
2024-01-11T00:31:53,345   !!

2024-01-11T00:31:53,349           ********************************************************************************
2024-01-11T00:31:53,350           ############################
2024-01-11T00:31:53,352           # Package would be ignored #
2024-01-11T00:31:53,353           ############################
2024-01-11T00:31:53,355           Python recognizes 'alpaca_eval.models_configs.gpt4_1106_preview' as an importable package[^1],
2024-01-11T00:31:53,356           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,358           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,359           package, please make sure that 'alpaca_eval.models_configs.gpt4_1106_preview' is explicitly added
2024-01-11T00:31:53,360           to the `packages` configuration field.

2024-01-11T00:31:53,362           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,363           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,364           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,366           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,367           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,369           If you don't want 'alpaca_eval.models_configs.gpt4_1106_preview' to be distributed and are
2024-01-11T00:31:53,370           already explicitly excluding 'alpaca_eval.models_configs.gpt4_1106_preview' via
2024-01-11T00:31:53,371           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,372           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,373           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,375           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,377           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,379           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,380                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,381                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,382                 directory, all directories are treated like packages.
2024-01-11T00:31:53,383           ********************************************************************************

2024-01-11T00:31:53,385   !!
2024-01-11T00:31:53,386     check.warn(importable)
2024-01-11T00:31:53,387   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.gpt4_turbo' is absent from the `packages` configuration.
2024-01-11T00:31:53,388   !!

2024-01-11T00:31:53,389           ********************************************************************************
2024-01-11T00:31:53,390           ############################
2024-01-11T00:31:53,391           # Package would be ignored #
2024-01-11T00:31:53,392           ############################
2024-01-11T00:31:53,392           Python recognizes 'alpaca_eval.models_configs.gpt4_turbo' as an importable package[^1],
2024-01-11T00:31:53,393           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,394           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,394           package, please make sure that 'alpaca_eval.models_configs.gpt4_turbo' is explicitly added
2024-01-11T00:31:53,395           to the `packages` configuration field.

2024-01-11T00:31:53,396           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,397           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,398           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,399           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,400           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,401           If you don't want 'alpaca_eval.models_configs.gpt4_turbo' to be distributed and are
2024-01-11T00:31:53,402           already explicitly excluding 'alpaca_eval.models_configs.gpt4_turbo' via
2024-01-11T00:31:53,403           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,403           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,404           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,406           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,407           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,409           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,410                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,411                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,411                 directory, all directories are treated like packages.
2024-01-11T00:31:53,412           ********************************************************************************

2024-01-11T00:31:53,414   !!
2024-01-11T00:31:53,414     check.warn(importable)
2024-01-11T00:31:53,415   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_001' is absent from the `packages` configuration.
2024-01-11T00:31:53,416   !!

2024-01-11T00:31:53,417           ********************************************************************************
2024-01-11T00:31:53,418           ############################
2024-01-11T00:31:53,418           # Package would be ignored #
2024-01-11T00:31:53,419           ############################
2024-01-11T00:31:53,420           Python recognizes 'alpaca_eval.models_configs.text_davinci_001' as an importable package[^1],
2024-01-11T00:31:53,420           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,422           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,422           package, please make sure that 'alpaca_eval.models_configs.text_davinci_001' is explicitly added
2024-01-11T00:31:53,423           to the `packages` configuration field.

2024-01-11T00:31:53,424           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,425           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,426           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,427           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,429           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,430           If you don't want 'alpaca_eval.models_configs.text_davinci_001' to be distributed and are
2024-01-11T00:31:53,431           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_001' via
2024-01-11T00:31:53,432           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,432           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,433           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,434           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,435           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,437           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,438                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,438                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,439                 directory, all directories are treated like packages.
2024-01-11T00:31:53,439           ********************************************************************************

2024-01-11T00:31:53,440   !!
2024-01-11T00:31:53,441     check.warn(importable)
2024-01-11T00:31:53,441   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'alpaca_eval.models_configs.text_davinci_003' is absent from the `packages` configuration.
2024-01-11T00:31:53,442   !!

2024-01-11T00:31:53,443           ********************************************************************************
2024-01-11T00:31:53,443           ############################
2024-01-11T00:31:53,444           # Package would be ignored #
2024-01-11T00:31:53,444           ############################
2024-01-11T00:31:53,445           Python recognizes 'alpaca_eval.models_configs.text_davinci_003' as an importable package[^1],
2024-01-11T00:31:53,445           but it is absent from setuptools' `packages` configuration.

2024-01-11T00:31:53,447           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-11T00:31:53,447           package, please make sure that 'alpaca_eval.models_configs.text_davinci_003' is explicitly added
2024-01-11T00:31:53,448           to the `packages` configuration field.

2024-01-11T00:31:53,449           Alternatively, you can also rely on setuptools' discovery methods
2024-01-11T00:31:53,449           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-11T00:31:53,450           instead of `find_packages(...)`/`find:`).

2024-01-11T00:31:53,451           You can read more about "package discovery" on setuptools documentation page:

2024-01-11T00:31:53,452           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-11T00:31:53,453           If you don't want 'alpaca_eval.models_configs.text_davinci_003' to be distributed and are
2024-01-11T00:31:53,454           already explicitly excluding 'alpaca_eval.models_configs.text_davinci_003' via
2024-01-11T00:31:53,454           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-11T00:31:53,455           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-11T00:31:53,455           combination with a more fine grained `package-data` configuration.

2024-01-11T00:31:53,457           You can read more about "package data files" on setuptools documentation page:

2024-01-11T00:31:53,458           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-11T00:31:53,459           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-11T00:31:53,460                 even if it does not contain any `.py` files.
2024-01-11T00:31:53,460                 On the other hand, currently there is no concept of package data
2024-01-11T00:31:53,461                 directory, all directories are treated like packages.
2024-01-11T00:31:53,462           ********************************************************************************

2024-01-11T00:31:53,463   !!
2024-01-11T00:31:53,463     check.warn(importable)
2024-01-11T00:31:53,464   creating build/lib/alpaca_eval/evaluators_configs
2024-01-11T00:31:53,464   copying src/alpaca_eval/evaluators_configs/README.md -> build/lib/alpaca_eval/evaluators_configs
2024-01-11T00:31:53,465   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-11T00:31:53,465   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-11T00:31:53,466   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-11T00:31:53,466   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-11T00:31:53,467   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-11T00:31:53,467   copying src/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-11T00:31:53,468   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-11T00:31:53,468   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-11T00:31:53,469   copying src/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-11T00:31:53,469   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-11T00:31:53,470   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-11T00:31:53,470   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-11T00:31:53,471   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-11T00:31:53,471   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-11T00:31:53,472   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-11T00:31:53,473   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-11T00:31:53,473   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-11T00:31:53,474   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-11T00:31:53,474   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-11T00:31:53,475   creating build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-11T00:31:53,476   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-11T00:31:53,476   copying src/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-11T00:31:53,477   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,477   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,478   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,478   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,479   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,480   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,480   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,481   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,481   copying src/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,482   copying src/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,482   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,483   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,483   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,484   copying src/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:53,484   creating build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-11T00:31:53,485   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-11T00:31:53,485   copying src/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-11T00:31:53,486   creating build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-11T00:31:53,486   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-11T00:31:53,487   copying src/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-11T00:31:53,488   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-11T00:31:53,488   copying src/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-11T00:31:53,489   creating build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-11T00:31:53,489   copying src/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-11T00:31:53,490   creating build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-11T00:31:53,490   copying src/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-11T00:31:53,491   copying src/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt
2024-01-11T00:31:53,492   creating build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-11T00:31:53,492   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-11T00:31:53,493   copying src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-11T00:31:53,493   creating build/lib/alpaca_eval/evaluators_configs/claude
2024-01-11T00:31:53,494   copying src/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude
2024-01-11T00:31:53,494   copying src/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude
2024-01-11T00:31:53,495   creating build/lib/alpaca_eval/evaluators_configs/claude_2
2024-01-11T00:31:53,495   copying src/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_2
2024-01-11T00:31:53,496   creating build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-11T00:31:53,496   copying src/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-11T00:31:53,497   copying src/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/claude_ranking
2024-01-11T00:31:53,497   creating build/lib/alpaca_eval/evaluators_configs/cohere
2024-01-11T00:31:53,498   copying src/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/cohere
2024-01-11T00:31:53,498   creating build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-11T00:31:53,499   copying src/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-11T00:31:53,499   creating build/lib/alpaca_eval/evaluators_configs/gpt4
2024-01-11T00:31:53,500   copying src/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4
2024-01-11T00:31:53,500   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-11T00:31:53,501   copying src/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-11T00:31:53,501   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-11T00:31:53,502   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-11T00:31:53,502   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-11T00:31:53,503   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-11T00:31:53,503   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-11T00:31:53,504   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-11T00:31:53,505   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-11T00:31:53,505   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-11T00:31:53,506   creating build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-11T00:31:53,506   copying src/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-11T00:31:53,507   creating build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-11T00:31:53,508   copying src/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-11T00:31:53,508   copying src/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-11T00:31:53,509   creating build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-11T00:31:53,509   copying src/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-11T00:31:53,510   creating build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-11T00:31:53,511   copying src/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-11T00:31:53,511   creating build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-11T00:31:53,512   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-11T00:31:53,512   copying src/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-11T00:31:53,513   creating build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-11T00:31:53,513   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-11T00:31:53,514   copying src/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-11T00:31:53,514   creating build/lib/alpaca_eval/evaluators_configs/test
2024-01-11T00:31:53,515   copying src/alpaca_eval/evaluators_configs/test/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/test
2024-01-11T00:31:53,515   creating build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-11T00:31:53,516   copying src/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-11T00:31:53,516   copying src/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-11T00:31:53,517   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-11T00:31:53,517   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-11T00:31:53,518   creating build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-11T00:31:53,518   copying src/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-11T00:31:53,519   creating build/lib/alpaca_eval/leaderboards
2024-01-11T00:31:53,519   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,520   copying src/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,521   copying src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,521   copying src/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,522   copying src/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,523   creating build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,523   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,524   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,525   copying src/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,525   creating build/lib/alpaca_eval/leaderboards/evaluators
2024-01-11T00:31:53,526   copying src/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/lib/alpaca_eval/leaderboards/evaluators
2024-01-11T00:31:53,526   creating build/lib/alpaca_eval/models_configs
2024-01-11T00:31:53,527   creating build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-11T00:31:53,527   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-11T00:31:53,528   copying src/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-11T00:31:53,529   creating build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-11T00:31:53,529   copying src/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-11T00:31:53,529   creating build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-11T00:31:53,530   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-11T00:31:53,530   copying src/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-11T00:31:53,531   creating build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-01-11T00:31:53,531   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-01-11T00:31:53,531   copying src/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-01-11T00:31:53,532   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-11T00:31:53,532   copying src/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-11T00:31:53,533   copying src/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-11T00:31:53,533   creating build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-11T00:31:53,534   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-11T00:31:53,534   copying src/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-11T00:31:53,535   creating build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-11T00:31:53,535   copying src/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-11T00:31:53,536   copying src/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/airoboros-33b
2024-01-11T00:31:53,536   creating build/lib/alpaca_eval/models_configs/airoboros-65b
2024-01-11T00:31:53,537   copying src/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/airoboros-65b
2024-01-11T00:31:53,537   creating build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-11T00:31:53,538   copying src/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-11T00:31:53,538   copying src/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b
2024-01-11T00:31:53,539   creating build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-11T00:31:53,539   copying src/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-11T00:31:53,540   copying src/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-11T00:31:53,540   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-11T00:31:53,541   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-11T00:31:53,541   creating build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-11T00:31:53,542   copying src/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-11T00:31:53,542   creating build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-11T00:31:53,543   copying src/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-11T00:31:53,544   copying src/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-11T00:31:53,544   creating build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-11T00:31:53,545   copying src/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-11T00:31:53,545   copying src/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/baize-v2-13b
2024-01-11T00:31:53,545   creating build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-01-11T00:31:53,546   copying src/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/baize-v2-7b
2024-01-11T00:31:53,546   creating build/lib/alpaca_eval/models_configs/bedrock_claude
2024-01-11T00:31:53,546   copying src/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude
2024-01-11T00:31:53,547   creating build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-01-11T00:31:53,547   copying src/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/lib/alpaca_eval/models_configs/bedrock_claude_2
2024-01-11T00:31:53,548   creating build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-11T00:31:53,548   copying src/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-11T00:31:53,549   copying src/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/lib/alpaca_eval/models_configs/causallm-14b
2024-01-11T00:31:53,549   creating build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-11T00:31:53,549   copying src/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-11T00:31:53,550   copying src/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/lib/alpaca_eval/models_configs/chatglm2-6b
2024-01-11T00:31:53,550   creating build/lib/alpaca_eval/models_configs/claude
2024-01-11T00:31:53,551   copying src/alpaca_eval/models_configs/claude/configs.yaml -> build/lib/alpaca_eval/models_configs/claude
2024-01-11T00:31:53,551   copying src/alpaca_eval/models_configs/claude/prompt.txt -> build/lib/alpaca_eval/models_configs/claude
2024-01-11T00:31:53,552   creating build/lib/alpaca_eval/models_configs/claude-2
2024-01-11T00:31:53,552   copying src/alpaca_eval/models_configs/claude-2/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2
2024-01-11T00:31:53,553   creating build/lib/alpaca_eval/models_configs/claude-2.1
2024-01-11T00:31:53,554   copying src/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/lib/alpaca_eval/models_configs/claude-2.1
2024-01-11T00:31:53,554   creating build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-11T00:31:53,555   copying src/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-11T00:31:53,555   creating build/lib/alpaca_eval/models_configs/cohere
2024-01-11T00:31:53,556   copying src/alpaca_eval/models_configs/cohere/configs.yaml -> build/lib/alpaca_eval/models_configs/cohere
2024-01-11T00:31:53,556   copying src/alpaca_eval/models_configs/cohere/prompt.txt -> build/lib/alpaca_eval/models_configs/cohere
2024-01-11T00:31:53,556   creating build/lib/alpaca_eval/models_configs/cut-13b
2024-01-11T00:31:53,557   copying src/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/cut-13b
2024-01-11T00:31:53,558   copying src/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/cut-13b
2024-01-11T00:31:53,558   creating build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-11T00:31:53,559   copying src/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-11T00:31:53,559   creating build/lib/alpaca_eval/models_configs/evo-7b
2024-01-11T00:31:53,560   copying src/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-7b
2024-01-11T00:31:53,560   creating build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-01-11T00:31:53,561   copying src/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/evo-v2-7b
2024-01-11T00:31:53,561   creating build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-11T00:31:53,561   copying src/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-11T00:31:53,562   creating build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-11T00:31:53,562   copying src/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-11T00:31:53,563   creating build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-11T00:31:53,563   copying src/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-11T00:31:53,564   copying src/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/lib/alpaca_eval/models_configs/gemini-pro
2024-01-11T00:31:53,564   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-01-11T00:31:53,564   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-01-11T00:31:53,565   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-01-11T00:31:53,565   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-01-11T00:31:53,566   creating build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-01-11T00:31:53,566   copying src/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-01-11T00:31:53,567   creating build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-11T00:31:53,567   copying src/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-11T00:31:53,568   creating build/lib/alpaca_eval/models_configs/gpt4
2024-01-11T00:31:53,568   copying src/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4
2024-01-11T00:31:53,569   copying src/alpaca_eval/models_configs/gpt4/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4
2024-01-11T00:31:53,569   creating build/lib/alpaca_eval/models_configs/gpt4_0314
2024-01-11T00:31:53,570   copying src/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0314
2024-01-11T00:31:53,570   creating build/lib/alpaca_eval/models_configs/gpt4_0613
2024-01-11T00:31:53,571   copying src/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_0613
2024-01-11T00:31:53,571   creating build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-11T00:31:53,572   copying src/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-11T00:31:53,572   creating build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-11T00:31:53,573   copying src/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-11T00:31:53,573   copying src/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/lib/alpaca_eval/models_configs/gpt4_turbo
2024-01-11T00:31:53,574   creating build/lib/alpaca_eval/models_configs/guanaco-13b
2024-01-11T00:31:53,574   copying src/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-13b
2024-01-11T00:31:53,575   creating build/lib/alpaca_eval/models_configs/guanaco-33b
2024-01-11T00:31:53,575   copying src/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b
2024-01-11T00:31:53,576   creating build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-01-11T00:31:53,577   copying src/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-33b-api
2024-01-11T00:31:53,577   creating build/lib/alpaca_eval/models_configs/guanaco-65b
2024-01-11T00:31:53,577   copying src/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-65b
2024-01-11T00:31:53,578   creating build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-11T00:31:53,578   copying src/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-11T00:31:53,579   copying src/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/guanaco-7b
2024-01-11T00:31:53,579   creating build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-11T00:31:53,579   copying src/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-11T00:31:53,580   copying src/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/lib/alpaca_eval/models_configs/humpback-llama-65b
2024-01-11T00:31:53,580   creating build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-11T00:31:53,581   copying src/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-11T00:31:53,581   creating build/lib/alpaca_eval/models_configs/jina-chat
2024-01-11T00:31:53,582   copying src/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/lib/alpaca_eval/models_configs/jina-chat
2024-01-11T00:31:53,582   copying src/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/lib/alpaca_eval/models_configs/jina-chat
2024-01-11T00:31:53,583   creating build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-11T00:31:53,583   copying src/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-11T00:31:53,584   creating build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-11T00:31:53,584   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-11T00:31:53,585   copying src/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-11T00:31:53,585   creating build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-11T00:31:53,586   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-11T00:31:53,586   copying src/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-11T00:31:53,587   creating build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-11T00:31:53,587   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-11T00:31:53,588   copying src/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-11T00:31:53,588   creating build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-11T00:31:53,589   copying src/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-11T00:31:53,589   creating build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-11T00:31:53,590   copying src/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-11T00:31:53,590   copying src/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/lib/alpaca_eval/models_configs/minichat-3b
2024-01-11T00:31:53,591   creating build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-11T00:31:53,591   copying src/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-11T00:31:53,592   copying src/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/minotaur-13b
2024-01-11T00:31:53,593   creating build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-11T00:31:53,593   copying src/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-11T00:31:53,593   copying src/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/nous-hermes-13b
2024-01-11T00:31:53,594   creating build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-11T00:31:53,594   copying src/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-11T00:31:53,595   creating build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-11T00:31:53,595   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-11T00:31:53,596   copying src/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-11T00:31:53,596   creating build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-11T00:31:53,597   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-11T00:31:53,597   copying src/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-11T00:31:53,598   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-11T00:31:53,598   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-11T00:31:53,599   copying src/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-11T00:31:53,601   creating build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-11T00:31:53,602   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-11T00:31:53,604   copying src/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-11T00:31:53,606   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-11T00:31:53,607   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-11T00:31:53,609   copying src/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-11T00:31:53,611   creating build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-11T00:31:53,612   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-11T00:31:53,614   copying src/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-11T00:31:53,615   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-11T00:31:53,616   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-11T00:31:53,618   copying src/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-11T00:31:53,620   creating build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-11T00:31:53,621   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-11T00:31:53,623   copying src/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-11T00:31:53,626   creating build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-11T00:31:53,626   copying src/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-11T00:31:53,628   copying src/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/openchat-13b
2024-01-11T00:31:53,630   creating build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-01-11T00:31:53,631   copying src/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-13b
2024-01-11T00:31:53,633   creating build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-11T00:31:53,633   copying src/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-11T00:31:53,635   creating build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-11T00:31:53,636   copying src/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-11T00:31:53,638   creating build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-01-11T00:31:53,639   copying src/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/openchat8192-13b
2024-01-11T00:31:53,641   creating build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-01-11T00:31:53,642   copying src/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/lib/alpaca_eval/models_configs/opencoderplus-15b
2024-01-11T00:31:53,644   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-11T00:31:53,645   copying src/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-11T00:31:53,647   creating build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-11T00:31:53,648   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-11T00:31:53,650   copying src/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-11T00:31:53,651   creating build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-11T00:31:53,652   copying src/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-11T00:31:53,654   creating build/lib/alpaca_eval/models_configs/phi-2
2024-01-11T00:31:53,655   copying src/alpaca_eval/models_configs/phi-2/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2
2024-01-11T00:31:53,657   copying src/alpaca_eval/models_configs/phi-2/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2
2024-01-11T00:31:53,659   creating build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-11T00:31:53,660   copying src/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-11T00:31:53,662   copying src/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-dpo
2024-01-11T00:31:53,664   creating build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-11T00:31:53,665   copying src/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-11T00:31:53,667   copying src/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/lib/alpaca_eval/models_configs/phi-2-sft
2024-01-11T00:31:53,669   creating build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-11T00:31:53,670   copying src/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-11T00:31:53,672   copying src/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/platolm-7b
2024-01-11T00:31:53,674   creating build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-11T00:31:53,675   copying src/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-11T00:31:53,677   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-11T00:31:53,678   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-11T00:31:53,680   creating build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-11T00:31:53,680   copying src/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-11T00:31:53,682   creating build/lib/alpaca_eval/models_configs/text_davinci_001
2024-01-11T00:31:53,683   copying src/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_001
2024-01-11T00:31:53,685   creating build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-11T00:31:53,686   copying src/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-11T00:31:53,688   copying src/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/lib/alpaca_eval/models_configs/text_davinci_003
2024-01-11T00:31:53,690   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-11T00:31:53,691   copying src/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-11T00:31:53,692   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-11T00:31:53,693   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-11T00:31:53,695   copying src/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-11T00:31:53,697   creating build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-11T00:31:53,698   copying src/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-11T00:31:53,700   creating build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-11T00:31:53,701   copying src/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-11T00:31:53,703   copying src/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b
2024-01-11T00:31:53,705   creating build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-11T00:31:53,706   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-11T00:31:53,708   copying src/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-11T00:31:53,709   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-11T00:31:53,710   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-11T00:31:53,712   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-11T00:31:53,714   creating build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-11T00:31:53,715   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-11T00:31:53,717   copying src/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-11T00:31:53,719   creating build/lib/alpaca_eval/models_configs/vicuna-13b
2024-01-11T00:31:53,720   copying src/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b
2024-01-11T00:31:53,722   creating build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-11T00:31:53,723   copying src/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-11T00:31:53,725   creating build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-11T00:31:53,726   copying src/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-11T00:31:53,728   creating build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-11T00:31:53,729   copying src/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-11T00:31:53,730   copying src/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/lib/alpaca_eval/models_configs/vicuna-7b
2024-01-11T00:31:53,732   creating build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-11T00:31:53,733   copying src/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-11T00:31:53,735   creating build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-11T00:31:53,736   copying src/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-11T00:31:53,738   copying src/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/lib/alpaca_eval/models_configs/wizardlm-13b
2024-01-11T00:31:53,740   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-11T00:31:53,741   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-11T00:31:53,743   creating build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-11T00:31:53,743   copying src/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-11T00:31:53,745   creating build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-11T00:31:53,746   copying src/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-11T00:31:53,748   creating build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-11T00:31:53,749   copying src/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-11T00:31:53,751   creating build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-11T00:31:53,752   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-11T00:31:53,754   copying src/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-11T00:31:53,756   creating build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-11T00:31:53,757   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-11T00:31:53,759   copying src/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/lib/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-11T00:31:53,761   creating build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-11T00:31:53,762   copying src/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/lib/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-11T00:31:53,790   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-01-11T00:31:53,791   !!

2024-01-11T00:31:53,792           ********************************************************************************
2024-01-11T00:31:53,793           Please avoid running ``setup.py`` directly.
2024-01-11T00:31:53,793           Instead, use pypa/build, pypa/installer or other
2024-01-11T00:31:53,794           standards-based tools.

2024-01-11T00:31:53,795           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-01-11T00:31:53,796           ********************************************************************************

2024-01-11T00:31:53,797   !!
2024-01-11T00:31:53,797     self.initialize_options()
2024-01-11T00:31:53,815   installing to build/bdist.linux-armv7l/wheel
2024-01-11T00:31:53,816   running install
2024-01-11T00:31:53,840   running install_lib
2024-01-11T00:31:53,863   creating build/bdist.linux-armv7l
2024-01-11T00:31:53,864   creating build/bdist.linux-armv7l/wheel
2024-01-11T00:31:53,865   creating build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:53,866   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards
2024-01-11T00:31:53,868   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,869   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,871   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,873   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval_2
2024-01-11T00:31:53,875   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-01-11T00:31:53,876   copying build/lib/alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/evaluators
2024-01-11T00:31:53,879   creating build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,880   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,881   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,883   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,885   copying build/lib/alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv -> build/bdist.linux-armv7l/wheel/alpaca_eval/leaderboards/data_AlpacaEval
2024-01-11T00:31:53,887   copying build/lib/alpaca_eval/types.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:53,889   copying build/lib/alpaca_eval/completion_parsers.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:53,892   creating build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,892   copying build/lib/alpaca_eval/decoders/jinachat.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,895   copying build/lib/alpaca_eval/decoders/vllm_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,896   copying build/lib/alpaca_eval/decoders/google.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,899   copying build/lib/alpaca_eval/decoders/cohere.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,900   copying build/lib/alpaca_eval/decoders/bedrock_anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,902   copying build/lib/alpaca_eval/decoders/huggingface_api.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,904   copying build/lib/alpaca_eval/decoders/anthropic.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,906   copying build/lib/alpaca_eval/decoders/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,908   copying build/lib/alpaca_eval/decoders/replicate.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,910   copying build/lib/alpaca_eval/decoders/openai.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,912   copying build/lib/alpaca_eval/decoders/huggingface_local.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/decoders
2024-01-11T00:31:53,914   copying build/lib/alpaca_eval/analyze.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:53,917   creating build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-11T00:31:53,918   copying build/lib/alpaca_eval/annotators/base.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-11T00:31:53,921   copying build/lib/alpaca_eval/annotators/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-11T00:31:53,922   copying build/lib/alpaca_eval/annotators/pairwise_evaluator.py -> build/bdist.linux-armv7l/wheel/alpaca_eval/annotators
2024-01-11T00:31:53,924   copying build/lib/alpaca_eval/__init__.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:53,926   copying build/lib/alpaca_eval/metrics.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:53,930   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs
2024-01-11T00:31:53,931   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-11T00:31:53,932   copying build/lib/alpaca_eval/models_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-11T00:31:53,933   copying build/lib/alpaca_eval/models_configs/claude/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude
2024-01-11T00:31:53,935   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-01-11T00:31:53,936   copying build/lib/alpaca_eval/models_configs/claude-2.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2.1
2024-01-11T00:31:53,938   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-11T00:31:53,939   copying build/lib/alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b-v1.3
2024-01-11T00:31:53,941   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-01-11T00:31:53,942   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-0301
2024-01-11T00:31:53,944   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-11T00:31:53,945   copying build/lib/alpaca_eval/models_configs/minotaur-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-11T00:31:53,947   copying build/lib/alpaca_eval/models_configs/minotaur-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minotaur-13b
2024-01-11T00:31:53,949   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-11T00:31:53,950   copying build/lib/alpaca_eval/models_configs/cut-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-11T00:31:53,951   copying build/lib/alpaca_eval/models_configs/cut-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cut-13b
2024-01-11T00:31:53,953   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-11T00:31:53,954   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-11T00:31:53,956   copying build/lib/alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baichuan-13b-chat
2024-01-11T00:31:53,959   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-11T00:31:53,960   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.1
2024-01-11T00:31:53,962   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-11T00:31:53,963   copying build/lib/alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b-v1.3
2024-01-11T00:31:53,965   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-11T00:31:53,966   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-11T00:31:53,967   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-70b
2024-01-11T00:31:53,969   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-11T00:31:53,970   copying build/lib/alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-beta
2024-01-11T00:31:53,972   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-01-11T00:31:53,973   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613
2024-01-11T00:31:53,975   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-11T00:31:53,976   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-13b
2024-01-11T00:31:53,978   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-11T00:31:53,979   copying build/lib/alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama2-70b
2024-01-11T00:31:53,981   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-11T00:31:53,982   copying build/lib/alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-40b-instruct
2024-01-11T00:31:53,985   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-11T00:31:53,985   copying build/lib/alpaca_eval/models_configs/alpaca-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-11T00:31:53,987   copying build/lib/alpaca_eval/models_configs/alpaca-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b
2024-01-11T00:31:53,989   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-11T00:31:53,990   copying build/lib/alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-w-13b
2024-01-11T00:31:53,992   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-11T00:31:53,993   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-11T00:31:53,995   copying build/lib/alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-pythia-12b
2024-01-11T00:31:53,997   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-11T00:31:53,998   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-11T00:31:54,000   copying build/lib/alpaca_eval/models_configs/nous-hermes-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/nous-hermes-13b
2024-01-11T00:31:54,002   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-11T00:31:54,003   copying build/lib/alpaca_eval/models_configs/vicuna-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-11T00:31:54,005   copying build/lib/alpaca_eval/models_configs/vicuna-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-7b
2024-01-11T00:31:54,007   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-11T00:31:54,008   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-11T00:31:54,009   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-65b-v8
2024-01-11T00:31:54,011   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-11T00:31:54,012   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0
2024-01-11T00:31:54,014   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-01-11T00:31:54,015   copying build/lib/alpaca_eval/models_configs/evo-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-v2-7b
2024-01-11T00:31:54,017   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-11T00:31:54,018   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-11T00:31:54,020   copying build/lib/alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-sft-llama-33b
2024-01-11T00:31:54,022   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-11T00:31:54,023   copying build/lib/alpaca_eval/models_configs/phi-2-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-11T00:31:54,024   copying build/lib/alpaca_eval/models_configs/phi-2-sft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-sft
2024-01-11T00:31:54,026   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-11T00:31:54,027   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k
2024-01-11T00:31:54,029   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-01-11T00:31:54,030   copying build/lib/alpaca_eval/models_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude_2
2024-01-11T00:31:54,033   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-11T00:31:54,033   copying build/lib/alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v3.1-13b
2024-01-11T00:31:54,036   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-11T00:31:54,037   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-11T00:31:54,038   copying build/lib/alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-7b-chat-hf
2024-01-11T00:31:54,040   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-11T00:31:54,041   copying build/lib/alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-13b-v0.1
2024-01-11T00:31:54,043   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-11T00:31:54,044   copying build/lib/alpaca_eval/models_configs/jina-chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-11T00:31:54,046   copying build/lib/alpaca_eval/models_configs/jina-chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/jina-chat
2024-01-11T00:31:54,048   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-11T00:31:54,049   copying build/lib/alpaca_eval/models_configs/gemini-pro/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-11T00:31:54,051   copying build/lib/alpaca_eval/models_configs/gemini-pro/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gemini-pro
2024-01-11T00:31:54,053   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-11T00:31:54,054   copying build/lib/alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/oasst-rlhf-llama-33b
2024-01-11T00:31:54,056   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-11T00:31:54,057   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-11T00:31:54,058   copying build/lib/alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-7b-v0.1
2024-01-11T00:31:54,061   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-11T00:31:54,061   copying build/lib/alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-1.5-3b
2024-01-11T00:31:54,063   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-01-11T00:31:54,064   copying build/lib/alpaca_eval/models_configs/baize-v2-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-7b
2024-01-11T00:31:54,067   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-11T00:31:54,067   copying build/lib/alpaca_eval/models_configs/openchat-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-11T00:31:54,069   copying build/lib/alpaca_eval/models_configs/openchat-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-13b
2024-01-11T00:31:54,071   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-11T00:31:54,072   copying build/lib/alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b-v1.2
2024-01-11T00:31:54,074   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-11T00:31:54,075   copying build/lib/alpaca_eval/models_configs/gpt4/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-11T00:31:54,077   copying build/lib/alpaca_eval/models_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4
2024-01-11T00:31:54,081   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-01-11T00:31:54,082   copying build/lib/alpaca_eval/models_configs/guanaco-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-13b
2024-01-11T00:31:54,085   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-01-11T00:31:54,086   copying build/lib/alpaca_eval/models_configs/text_davinci_001/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_001
2024-01-11T00:31:54,088   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-11T00:31:54,089   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-11T00:31:54,091   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0
2024-01-11T00:31:54,093   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-11T00:31:54,094   copying build/lib/alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-farm-ppo-human
2024-01-11T00:31:54,096   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-11T00:31:54,097   copying build/lib/alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pythia-12b-mix-sft
2024-01-11T00:31:54,099   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-11T00:31:54,099   copying build/lib/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0
2024-01-11T00:31:54,102   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-11T00:31:54,102   copying build/lib/alpaca_eval/models_configs/airoboros-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-11T00:31:54,104   copying build/lib/alpaca_eval/models_configs/airoboros-33b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-33b
2024-01-11T00:31:54,106   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-11T00:31:54,107   copying build/lib/alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/xwinlm-70b-v0.1
2024-01-11T00:31:54,110   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-11T00:31:54,111   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-11T00:31:54,112   copying build/lib/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1
2024-01-11T00:31:54,115   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-11T00:31:54,115   copying build/lib/alpaca_eval/models_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-11T00:31:54,117   copying build/lib/alpaca_eval/models_configs/cohere/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/cohere
2024-01-11T00:31:54,119   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-01-11T00:31:54,120   copying build/lib/alpaca_eval/models_configs/openchat8192-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat8192-13b
2024-01-11T00:31:54,123   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-11T00:31:54,123   copying build/lib/alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-13b-chat-hf
2024-01-11T00:31:54,126   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-11T00:31:54,127   copying build/lib/alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-zephyr-7b-beta
2024-01-11T00:31:54,129   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-01-11T00:31:54,130   copying build/lib/alpaca_eval/models_configs/evo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/evo-7b
2024-01-11T00:31:54,132   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-11T00:31:54,133   copying build/lib/alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude2-alpaca-13b
2024-01-11T00:31:54,136   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-11T00:31:54,137   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-11T00:31:54,138   copying build/lib/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16
2024-01-11T00:31:54,140   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-01-11T00:31:54,141   copying build/lib/alpaca_eval/models_configs/gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0314
2024-01-11T00:31:54,143   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-11T00:31:54,144   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-11T00:31:54,146   copying build/lib/alpaca_eval/models_configs/baize-v2-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/baize-v2-13b
2024-01-11T00:31:54,148   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-11T00:31:54,148   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-11T00:31:54,150   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1
2024-01-11T00:31:54,152   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-01-11T00:31:54,153   copying build/lib/alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt-3.5-turbo-1106
2024-01-11T00:31:54,155   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-01-11T00:31:54,156   copying build/lib/alpaca_eval/models_configs/opencoderplus-15b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/opencoderplus-15b
2024-01-11T00:31:54,158   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-11T00:31:54,159   copying build/lib/alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/falcon-7b-instruct
2024-01-11T00:31:54,161   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-11T00:31:54,162   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-11T00:31:54,164   copying build/lib/alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b-best-of-16
2024-01-11T00:31:54,166   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-01-11T00:31:54,167   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-01-11T00:31:54,169   copying build/lib/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B
2024-01-11T00:31:54,171   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-01-11T00:31:54,172   copying build/lib/alpaca_eval/models_configs/guanaco-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-65b
2024-01-11T00:31:54,174   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-01-11T00:31:54,175   copying build/lib/alpaca_eval/models_configs/airoboros-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/airoboros-65b
2024-01-11T00:31:54,178   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-01-11T00:31:54,179   copying build/lib/alpaca_eval/models_configs/openchat-v2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openchat-v2-13b
2024-01-11T00:31:54,181   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-11T00:31:54,181   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-7b
2024-01-11T00:31:54,183   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-11T00:31:54,184   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-11T00:31:54,186   copying build/lib/alpaca_eval/models_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_turbo
2024-01-11T00:31:54,188   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-11T00:31:54,189   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-11T00:31:54,191   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-7b-v6
2024-01-11T00:31:54,193   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-11T00:31:54,193   copying build/lib/alpaca_eval/models_configs/causallm-14b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-11T00:31:54,195   copying build/lib/alpaca_eval/models_configs/causallm-14b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/causallm-14b
2024-01-11T00:31:54,198   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-01-11T00:31:54,198   copying build/lib/alpaca_eval/models_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/bedrock_claude
2024-01-11T00:31:54,201   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-11T00:31:54,201   copying build/lib/alpaca_eval/models_configs/guanaco-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-11T00:31:54,203   copying build/lib/alpaca_eval/models_configs/guanaco-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-7b
2024-01-11T00:31:54,205   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-01-11T00:31:54,206   copying build/lib/alpaca_eval/models_configs/gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_0613
2024-01-11T00:31:54,208   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-11T00:31:54,209   copying build/lib/alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-33b-v1.3
2024-01-11T00:31:54,211   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-11T00:31:54,212   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-11T00:31:54,214   copying build/lib/alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/zephyr-7b-alpha
2024-01-11T00:31:54,216   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-11T00:31:54,217   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-11T00:31:54,219   copying build/lib/alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/alpaca-7b-neft
2024-01-11T00:31:54,221   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-11T00:31:54,222   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-11T00:31:54,223   copying build/lib/alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-70b-chat-hf
2024-01-11T00:31:54,226   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-01-11T00:31:54,226   copying build/lib/alpaca_eval/models_configs/guanaco-33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b
2024-01-11T00:31:54,228   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-01-11T00:31:54,229   copying build/lib/alpaca_eval/models_configs/guanaco-33b-api/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/guanaco-33b-api
2024-01-11T00:31:54,231   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-11T00:31:54,232   copying build/lib/alpaca_eval/models_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-11T00:31:54,234   copying build/lib/alpaca_eval/models_configs/text_davinci_003/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/text_davinci_003
2024-01-11T00:31:54,236   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-11T00:31:54,237   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-11T00:31:54,238   copying build/lib/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft
2024-01-11T00:31:54,241   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-11T00:31:54,241   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-11T00:31:54,243   copying build/lib/alpaca_eval/models_configs/humpback-llama-65b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/humpback-llama-65b
2024-01-11T00:31:54,246   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-11T00:31:54,247   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-11T00:31:54,249   copying build/lib/alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/tulu-2-dpo-70b
2024-01-11T00:31:54,251   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-11T00:31:54,252   copying build/lib/alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/deita-7b-v1.0
2024-01-11T00:31:54,254   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-11T00:31:54,255   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-11T00:31:54,257   copying build/lib/alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/LMCocktail-10.7B-v1
2024-01-11T00:31:54,259   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-11T00:31:54,260   copying build/lib/alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt35_turbo_instruct
2024-01-11T00:31:54,263   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-11T00:31:54,264   copying build/lib/alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/pairrm-tulu-2-13b
2024-01-11T00:31:54,266   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-11T00:31:54,267   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-11T00:31:54,269   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat
2024-01-11T00:31:54,271   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-11T00:31:54,271   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-11T00:31:54,273   copying build/lib/alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-falcon-40b-v9
2024-01-11T00:31:54,275   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-11T00:31:54,276   copying build/lib/alpaca_eval/models_configs/phi-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-11T00:31:54,278   copying build/lib/alpaca_eval/models_configs/phi-2/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2
2024-01-11T00:31:54,280   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-11T00:31:54,281   copying build/lib/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2
2024-01-11T00:31:54,283   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-11T00:31:54,284   copying build/lib/alpaca_eval/models_configs/minichat-3b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-11T00:31:54,286   copying build/lib/alpaca_eval/models_configs/minichat-3b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/minichat-3b
2024-01-11T00:31:54,288   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-11T00:31:54,289   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-11T00:31:54,290   copying build/lib/alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/Yi-34B-Chat-Verified
2024-01-11T00:31:54,292   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-11T00:31:54,293   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-11T00:31:54,295   copying build/lib/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama-30b-v7.1
2024-01-11T00:31:54,297   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-11T00:31:54,298   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-11T00:31:54,300   copying build/lib/alpaca_eval/models_configs/wizardlm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/wizardlm-13b
2024-01-11T00:31:54,302   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-11T00:31:54,303   copying build/lib/alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/gpt4_1106_preview
2024-01-11T00:31:54,306   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-01-11T00:31:54,307   copying build/lib/alpaca_eval/models_configs/vicuna-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/vicuna-13b
2024-01-11T00:31:54,309   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-11T00:31:54,310   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-11T00:31:54,312   copying build/lib/alpaca_eval/models_configs/phi-2-dpo/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/phi-2-dpo
2024-01-11T00:31:54,314   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-11T00:31:54,314   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-11T00:31:54,316   copying build/lib/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1
2024-01-11T00:31:54,318   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-11T00:31:54,319   copying build/lib/alpaca_eval/models_configs/ultralm-13b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-11T00:31:54,321   copying build/lib/alpaca_eval/models_configs/ultralm-13b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/ultralm-13b
2024-01-11T00:31:54,323   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-01-11T00:31:54,323   copying build/lib/alpaca_eval/models_configs/claude-2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/claude-2
2024-01-11T00:31:54,326   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-11T00:31:54,326   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-11T00:31:54,328   copying build/lib/alpaca_eval/models_configs/chatglm2-6b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/chatglm2-6b
2024-01-11T00:31:54,330   creating build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-11T00:31:54,331   copying build/lib/alpaca_eval/models_configs/platolm-7b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-11T00:31:54,333   copying build/lib/alpaca_eval/models_configs/platolm-7b/prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/models_configs/platolm-7b
2024-01-11T00:31:54,335   copying build/lib/alpaca_eval/processors.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:54,337   copying build/lib/alpaca_eval/constants.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:54,339   copying build/lib/alpaca_eval/main.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:54,342   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-01-11T00:31:54,344   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-11T00:31:54,345   copying build/lib/alpaca_eval/evaluators_configs/claude/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-11T00:31:54,347   copying build/lib/alpaca_eval/evaluators_configs/claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude
2024-01-11T00:31:54,349   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-01-11T00:31:54,350   copying build/lib/alpaca_eval/evaluators_configs/test/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/test
2024-01-11T00:31:54,353   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,354   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,356   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,358   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,361   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,362   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,365   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,367   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,369   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,371   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,373   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,374   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,376   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,378   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm
2024-01-11T00:31:54,380   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-11T00:31:54,381   copying build/lib/alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_lmsys_gpt4
2024-01-11T00:31:54,383   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-11T00:31:54,385   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-11T00:31:54,387   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo
2024-01-11T00:31:54,389   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-11T00:31:54,390   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-11T00:31:54,392   copying build/lib/alpaca_eval/evaluators_configs/chatgpt/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt
2024-01-11T00:31:54,395   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-11T00:31:54,396   copying build/lib/alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/improved_aviary_gpt4
2024-01-11T00:31:54,398   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-11T00:31:54,399   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_logprob
2024-01-11T00:31:54,401   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-11T00:31:54,402   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-11T00:31:54,404   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn
2024-01-11T00:31:54,406   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-11T00:31:54,407   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-11T00:31:54,409   copying build/lib/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4
2024-01-11T00:31:54,411   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-11T00:31:54,412   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-11T00:31:54,413   copying build/lib/alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_ranking
2024-01-11T00:31:54,415   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-11T00:31:54,416   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude_2
2024-01-11T00:31:54,419   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-11T00:31:54,419   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-11T00:31:54,421   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn
2024-01-11T00:31:54,424   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-01-11T00:31:54,425   copying build/lib/alpaca_eval/evaluators_configs/gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4
2024-01-11T00:31:54,427   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-11T00:31:54,428   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-11T00:31:54,430   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn
2024-01-11T00:31:54,432   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-01-11T00:31:54,433   copying build/lib/alpaca_eval/evaluators_configs/claude_2/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/claude_2
2024-01-11T00:31:54,436   copying build/lib/alpaca_eval/evaluators_configs/README.md -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs
2024-01-11T00:31:54,439   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-01-11T00:31:54,440   copying build/lib/alpaca_eval/evaluators_configs/cohere/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/cohere
2024-01-11T00:31:54,443   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-11T00:31:54,443   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-11T00:31:54,445   copying build/lib/alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/chatgpt_fn
2024-01-11T00:31:54,447   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-11T00:31:54,448   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613
2024-01-11T00:31:54,450   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-11T00:31:54,451   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo
2024-01-11T00:31:54,453   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-11T00:31:54,454   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-11T00:31:54,456   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4
2024-01-11T00:31:54,458   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-11T00:31:54,459   copying build/lib/alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/bedrock_claude
2024-01-11T00:31:54,462   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-11T00:31:54,462   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob
2024-01-11T00:31:54,465   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-11T00:31:54,466   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-11T00:31:54,468   copying build/lib/alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/lmsys_gpt4
2024-01-11T00:31:54,472   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-11T00:31:54,473   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-11T00:31:54,475   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf
2024-01-11T00:31:54,477   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-11T00:31:54,478   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-11T00:31:54,480   copying build/lib/alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt4_turbo_clf
2024-01-11T00:31:54,482   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-11T00:31:54,483   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-11T00:31:54,485   copying build/lib/alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/text_davinci_003
2024-01-11T00:31:54,487   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-11T00:31:54,488   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-11T00:31:54,490   copying build/lib/alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/aviary_gpt4
2024-01-11T00:31:54,492   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-11T00:31:54,493   copying build/lib/alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/gpt35_turbo_instruct
2024-01-11T00:31:54,495   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-11T00:31:54,496   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-11T00:31:54,498   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo
2024-01-11T00:31:54,500   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-11T00:31:54,500   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo
2024-01-11T00:31:54,503   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-11T00:31:54,503   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-11T00:31:54,505   copying build/lib/alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/oasst_pythia_12b
2024-01-11T00:31:54,507   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-11T00:31:54,508   copying build/lib/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314
2024-01-11T00:31:54,511   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-11T00:31:54,511   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-11T00:31:54,513   copying build/lib/alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/guanaco_33b
2024-01-11T00:31:54,515   creating build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-11T00:31:54,516   copying build/lib/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml -> build/bdist.linux-armv7l/wheel/alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo
2024-01-11T00:31:54,518   copying build/lib/alpaca_eval/plotting.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:54,521   copying build/lib/alpaca_eval/utils.py -> build/bdist.linux-armv7l/wheel/alpaca_eval
2024-01-11T00:31:54,523   running install_egg_info
2024-01-11T00:31:54,553   Copying src/alpaca_eval.egg-info to build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.2-py3.11.egg-info
2024-01-11T00:31:54,565   running install_scripts
2024-01-11T00:31:54,602   creating build/bdist.linux-armv7l/wheel/alpaca_eval-0.5.2.dist-info/WHEEL
2024-01-11T00:31:54,605   creating '/tmp/pip-wheel-vspz4cbn/alpaca_eval-0.5.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-01-11T00:31:54,607   adding 'alpaca_eval/__init__.py'
2024-01-11T00:31:54,610   adding 'alpaca_eval/analyze.py'
2024-01-11T00:31:54,613   adding 'alpaca_eval/completion_parsers.py'
2024-01-11T00:31:54,615   adding 'alpaca_eval/constants.py'
2024-01-11T00:31:54,618   adding 'alpaca_eval/main.py'
2024-01-11T00:31:54,620   adding 'alpaca_eval/metrics.py'
2024-01-11T00:31:54,622   adding 'alpaca_eval/plotting.py'
2024-01-11T00:31:54,624   adding 'alpaca_eval/processors.py'
2024-01-11T00:31:54,625   adding 'alpaca_eval/types.py'
2024-01-11T00:31:54,628   adding 'alpaca_eval/utils.py'
2024-01-11T00:31:54,629   adding 'alpaca_eval/annotators/__init__.py'
2024-01-11T00:31:54,633   adding 'alpaca_eval/annotators/base.py'
2024-01-11T00:31:54,635   adding 'alpaca_eval/annotators/pairwise_evaluator.py'
2024-01-11T00:31:54,637   adding 'alpaca_eval/decoders/__init__.py'
2024-01-11T00:31:54,639   adding 'alpaca_eval/decoders/anthropic.py'
2024-01-11T00:31:54,640   adding 'alpaca_eval/decoders/bedrock_anthropic.py'
2024-01-11T00:31:54,642   adding 'alpaca_eval/decoders/cohere.py'
2024-01-11T00:31:54,643   adding 'alpaca_eval/decoders/google.py'
2024-01-11T00:31:54,645   adding 'alpaca_eval/decoders/huggingface_api.py'
2024-01-11T00:31:54,646   adding 'alpaca_eval/decoders/huggingface_local.py'
2024-01-11T00:31:54,647   adding 'alpaca_eval/decoders/jinachat.py'
2024-01-11T00:31:54,650   adding 'alpaca_eval/decoders/openai.py'
2024-01-11T00:31:54,651   adding 'alpaca_eval/decoders/replicate.py'
2024-01-11T00:31:54,652   adding 'alpaca_eval/decoders/vllm_local.py'
2024-01-11T00:31:54,655   adding 'alpaca_eval/evaluators_configs/README.md'
2024-01-11T00:31:54,657   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt'
2024-01-11T00:31:54,658   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml'
2024-01-11T00:31:54,660   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt'
2024-01-11T00:31:54,661   adding 'alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml'
2024-01-11T00:31:54,662   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-01-11T00:31:54,664   adding 'alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml'
2024-01-11T00:31:54,665   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt'
2024-01-11T00:31:54,666   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml'
2024-01-11T00:31:54,668   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml'
2024-01-11T00:31:54,669   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml'
2024-01-11T00:31:54,671   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt'
2024-01-11T00:31:54,672   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml'
2024-01-11T00:31:54,674   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt'
2024-01-11T00:31:54,675   adding 'alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml'
2024-01-11T00:31:54,677   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt'
2024-01-11T00:31:54,679   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt'
2024-01-11T00:31:54,680   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt'
2024-01-11T00:31:54,681   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt'
2024-01-11T00:31:54,683   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt'
2024-01-11T00:31:54,684   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt'
2024-01-11T00:31:54,686   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt'
2024-01-11T00:31:54,688   adding 'alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt'
2024-01-11T00:31:54,689   adding 'alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml'
2024-01-11T00:31:54,690   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt'
2024-01-11T00:31:54,691   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt'
2024-01-11T00:31:54,693   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt'
2024-01-11T00:31:54,694   adding 'alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt'
2024-01-11T00:31:54,696   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt'
2024-01-11T00:31:54,697   adding 'alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml'
2024-01-11T00:31:54,699   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt'
2024-01-11T00:31:54,700   adding 'alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml'
2024-01-11T00:31:54,701   adding 'alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml'
2024-01-11T00:31:54,703   adding 'alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml'
2024-01-11T00:31:54,704   adding 'alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt'
2024-01-11T00:31:54,705   adding 'alpaca_eval/evaluators_configs/chatgpt/configs.yaml'
2024-01-11T00:31:54,707   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt'
2024-01-11T00:31:54,708   adding 'alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml'
2024-01-11T00:31:54,710   adding 'alpaca_eval/evaluators_configs/claude/basic_prompt.txt'
2024-01-11T00:31:54,711   adding 'alpaca_eval/evaluators_configs/claude/configs.yaml'
2024-01-11T00:31:54,713   adding 'alpaca_eval/evaluators_configs/claude_2/configs.yaml'
2024-01-11T00:31:54,714   adding 'alpaca_eval/evaluators_configs/claude_ranking/configs.yaml'
2024-01-11T00:31:54,716   adding 'alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt'
2024-01-11T00:31:54,717   adding 'alpaca_eval/evaluators_configs/cohere/configs.yaml'
2024-01-11T00:31:54,719   adding 'alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml'
2024-01-11T00:31:54,721   adding 'alpaca_eval/evaluators_configs/gpt4/configs.yaml'
2024-01-11T00:31:54,722   adding 'alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml'
2024-01-11T00:31:54,724   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt'
2024-01-11T00:31:54,725   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml'
2024-01-11T00:31:54,727   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt'
2024-01-11T00:31:54,728   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml'
2024-01-11T00:31:54,730   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml'
2024-01-11T00:31:54,731   adding 'alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml'
2024-01-11T00:31:54,733   adding 'alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt'
2024-01-11T00:31:54,734   adding 'alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml'
2024-01-11T00:31:54,736   adding 'alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml'
2024-01-11T00:31:54,738   adding 'alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml'
2024-01-11T00:31:54,739   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml'
2024-01-11T00:31:54,740   adding 'alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt'
2024-01-11T00:31:54,742   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt'
2024-01-11T00:31:54,743   adding 'alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml'
2024-01-11T00:31:54,745   adding 'alpaca_eval/evaluators_configs/test/configs.yaml'
2024-01-11T00:31:54,747   adding 'alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt'
2024-01-11T00:31:54,748   adding 'alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml'
2024-01-11T00:31:54,749   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml'
2024-01-11T00:31:54,751   adding 'alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml'
2024-01-11T00:31:54,753   adding 'alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv'
2024-01-11T00:31:54,755   adding 'alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv'
2024-01-11T00:31:54,756   adding 'alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv'
2024-01-11T00:31:54,757   adding 'alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv'
2024-01-11T00:31:54,758   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv'
2024-01-11T00:31:54,760   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv'
2024-01-11T00:31:54,761   adding 'alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv'
2024-01-11T00:31:54,763   adding 'alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv'
2024-01-11T00:31:54,767   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml'
2024-01-11T00:31:54,768   adding 'alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt'
2024-01-11T00:31:54,770   adding 'alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml'
2024-01-11T00:31:54,771   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml'
2024-01-11T00:31:54,772   adding 'alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt'
2024-01-11T00:31:54,774   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml'
2024-01-11T00:31:54,775   adding 'alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt'
2024-01-11T00:31:54,777   adding 'alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml'
2024-01-11T00:31:54,778   adding 'alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt'
2024-01-11T00:31:54,779   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml'
2024-01-11T00:31:54,780   adding 'alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt'
2024-01-11T00:31:54,782   adding 'alpaca_eval/models_configs/airoboros-33b/configs.yaml'
2024-01-11T00:31:54,783   adding 'alpaca_eval/models_configs/airoboros-33b/prompt.txt'
2024-01-11T00:31:54,785   adding 'alpaca_eval/models_configs/airoboros-65b/configs.yaml'
2024-01-11T00:31:54,787   adding 'alpaca_eval/models_configs/alpaca-7b/configs.yaml'
2024-01-11T00:31:54,788   adding 'alpaca_eval/models_configs/alpaca-7b/prompt.txt'
2024-01-11T00:31:54,789   adding 'alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml'
2024-01-11T00:31:54,790   adding 'alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt'
2024-01-11T00:31:54,792   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml'
2024-01-11T00:31:54,794   adding 'alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml'
2024-01-11T00:31:54,795   adding 'alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml'
2024-01-11T00:31:54,797   adding 'alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt'
2024-01-11T00:31:54,798   adding 'alpaca_eval/models_configs/baize-v2-13b/configs.yaml'
2024-01-11T00:31:54,799   adding 'alpaca_eval/models_configs/baize-v2-13b/prompt.txt'
2024-01-11T00:31:54,801   adding 'alpaca_eval/models_configs/baize-v2-7b/configs.yaml'
2024-01-11T00:31:54,803   adding 'alpaca_eval/models_configs/bedrock_claude/configs.yaml'
2024-01-11T00:31:54,804   adding 'alpaca_eval/models_configs/bedrock_claude_2/configs.yaml'
2024-01-11T00:31:54,806   adding 'alpaca_eval/models_configs/causallm-14b/configs.yaml'
2024-01-11T00:31:54,807   adding 'alpaca_eval/models_configs/causallm-14b/prompt.txt'
2024-01-11T00:31:54,809   adding 'alpaca_eval/models_configs/chatglm2-6b/configs.yaml'
2024-01-11T00:31:54,810   adding 'alpaca_eval/models_configs/chatglm2-6b/prompt.txt'
2024-01-11T00:31:54,811   adding 'alpaca_eval/models_configs/claude/configs.yaml'
2024-01-11T00:31:54,813   adding 'alpaca_eval/models_configs/claude/prompt.txt'
2024-01-11T00:31:54,814   adding 'alpaca_eval/models_configs/claude-2/configs.yaml'
2024-01-11T00:31:54,816   adding 'alpaca_eval/models_configs/claude-2.1/configs.yaml'
2024-01-11T00:31:54,817   adding 'alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml'
2024-01-11T00:31:54,819   adding 'alpaca_eval/models_configs/cohere/configs.yaml'
2024-01-11T00:31:54,820   adding 'alpaca_eval/models_configs/cohere/prompt.txt'
2024-01-11T00:31:54,821   adding 'alpaca_eval/models_configs/cut-13b/configs.yaml'
2024-01-11T00:31:54,822   adding 'alpaca_eval/models_configs/cut-13b/prompt.txt'
2024-01-11T00:31:54,824   adding 'alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml'
2024-01-11T00:31:54,825   adding 'alpaca_eval/models_configs/evo-7b/configs.yaml'
2024-01-11T00:31:54,827   adding 'alpaca_eval/models_configs/evo-v2-7b/configs.yaml'
2024-01-11T00:31:54,828   adding 'alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml'
2024-01-11T00:31:54,830   adding 'alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml'
2024-01-11T00:31:54,831   adding 'alpaca_eval/models_configs/gemini-pro/configs.yaml'
2024-01-11T00:31:54,832   adding 'alpaca_eval/models_configs/gemini-pro/prompt.txt'
2024-01-11T00:31:54,834   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml'
2024-01-11T00:31:54,835   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml'
2024-01-11T00:31:54,837   adding 'alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml'
2024-01-11T00:31:54,838   adding 'alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml'
2024-01-11T00:31:54,839   adding 'alpaca_eval/models_configs/gpt4/chatml_prompt.txt'
2024-01-11T00:31:54,841   adding 'alpaca_eval/models_configs/gpt4/configs.yaml'
2024-01-11T00:31:54,842   adding 'alpaca_eval/models_configs/gpt4_0314/configs.yaml'
2024-01-11T00:31:54,844   adding 'alpaca_eval/models_configs/gpt4_0613/configs.yaml'
2024-01-11T00:31:54,845   adding 'alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml'
2024-01-11T00:31:54,846   adding 'alpaca_eval/models_configs/gpt4_turbo/chatml_prompt.txt'
2024-01-11T00:31:54,848   adding 'alpaca_eval/models_configs/gpt4_turbo/configs.yaml'
2024-01-11T00:31:54,849   adding 'alpaca_eval/models_configs/guanaco-13b/configs.yaml'
2024-01-11T00:31:54,851   adding 'alpaca_eval/models_configs/guanaco-33b/configs.yaml'
2024-01-11T00:31:54,852   adding 'alpaca_eval/models_configs/guanaco-33b-api/configs.yaml'
2024-01-11T00:31:54,854   adding 'alpaca_eval/models_configs/guanaco-65b/configs.yaml'
2024-01-11T00:31:54,855   adding 'alpaca_eval/models_configs/guanaco-7b/configs.yaml'
2024-01-11T00:31:54,857   adding 'alpaca_eval/models_configs/guanaco-7b/prompt.txt'
2024-01-11T00:31:54,858   adding 'alpaca_eval/models_configs/humpback-llama-65b/configs.yaml'
2024-01-11T00:31:54,859   adding 'alpaca_eval/models_configs/humpback-llama-65b/prompt.txt'
2024-01-11T00:31:54,861   adding 'alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml'
2024-01-11T00:31:54,862   adding 'alpaca_eval/models_configs/jina-chat/configs.yaml'
2024-01-11T00:31:54,864   adding 'alpaca_eval/models_configs/jina-chat/prompt.txt'
2024-01-11T00:31:54,866   adding 'alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml'
2024-01-11T00:31:54,867   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml'
2024-01-11T00:31:54,868   adding 'alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt'
2024-01-11T00:31:54,870   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml'
2024-01-11T00:31:54,871   adding 'alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt'
2024-01-11T00:31:54,873   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml'
2024-01-11T00:31:54,874   adding 'alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt'
2024-01-11T00:31:54,876   adding 'alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml'
2024-01-11T00:31:54,877   adding 'alpaca_eval/models_configs/minichat-3b/configs.yaml'
2024-01-11T00:31:54,878   adding 'alpaca_eval/models_configs/minichat-3b/prompt.txt'
2024-01-11T00:31:54,880   adding 'alpaca_eval/models_configs/minotaur-13b/configs.yaml'
2024-01-11T00:31:54,881   adding 'alpaca_eval/models_configs/minotaur-13b/prompt.txt'
2024-01-11T00:31:54,883   adding 'alpaca_eval/models_configs/nous-hermes-13b/configs.yaml'
2024-01-11T00:31:54,884   adding 'alpaca_eval/models_configs/nous-hermes-13b/prompt.txt'
2024-01-11T00:31:54,885   adding 'alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml'
2024-01-11T00:31:54,887   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml'
2024-01-11T00:31:54,888   adding 'alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt'
2024-01-11T00:31:54,889   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml'
2024-01-11T00:31:54,891   adding 'alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt'
2024-01-11T00:31:54,892   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml'
2024-01-11T00:31:54,893   adding 'alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt'
2024-01-11T00:31:54,895   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml'
2024-01-11T00:31:54,896   adding 'alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt'
2024-01-11T00:31:54,897   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml'
2024-01-11T00:31:54,899   adding 'alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt'
2024-01-11T00:31:54,900   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml'
2024-01-11T00:31:54,901   adding 'alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt'
2024-01-11T00:31:54,903   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml'
2024-01-11T00:31:54,904   adding 'alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt'
2024-01-11T00:31:54,906   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml'
2024-01-11T00:31:54,907   adding 'alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt'
2024-01-11T00:31:54,909   adding 'alpaca_eval/models_configs/openchat-13b/configs.yaml'
2024-01-11T00:31:54,910   adding 'alpaca_eval/models_configs/openchat-13b/prompt.txt'
2024-01-11T00:31:54,912   adding 'alpaca_eval/models_configs/openchat-v2-13b/configs.yaml'
2024-01-11T00:31:54,913   adding 'alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml'
2024-01-11T00:31:54,915   adding 'alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml'
2024-01-11T00:31:54,916   adding 'alpaca_eval/models_configs/openchat8192-13b/configs.yaml'
2024-01-11T00:31:54,918   adding 'alpaca_eval/models_configs/opencoderplus-15b/configs.yaml'
2024-01-11T00:31:54,919   adding 'alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml'
2024-01-11T00:31:54,921   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml'
2024-01-11T00:31:54,922   adding 'alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt'
2024-01-11T00:31:54,924   adding 'alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml'
2024-01-11T00:31:54,925   adding 'alpaca_eval/models_configs/phi-2/configs.yaml'
2024-01-11T00:31:54,926   adding 'alpaca_eval/models_configs/phi-2/prompt.txt'
2024-01-11T00:31:54,928   adding 'alpaca_eval/models_configs/phi-2-dpo/configs.yaml'
2024-01-11T00:31:54,929   adding 'alpaca_eval/models_configs/phi-2-dpo/prompt.txt'
2024-01-11T00:31:54,931   adding 'alpaca_eval/models_configs/phi-2-sft/configs.yaml'
2024-01-11T00:31:54,932   adding 'alpaca_eval/models_configs/phi-2-sft/prompt.txt'
2024-01-11T00:31:54,933   adding 'alpaca_eval/models_configs/platolm-7b/configs.yaml'
2024-01-11T00:31:54,935   adding 'alpaca_eval/models_configs/platolm-7b/prompt.txt'
2024-01-11T00:31:54,936   adding 'alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml'
2024-01-11T00:31:54,938   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml'
2024-01-11T00:31:54,940   adding 'alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml'
2024-01-11T00:31:54,941   adding 'alpaca_eval/models_configs/text_davinci_001/configs.yaml'
2024-01-11T00:31:54,943   adding 'alpaca_eval/models_configs/text_davinci_003/configs.yaml'
2024-01-11T00:31:54,944   adding 'alpaca_eval/models_configs/text_davinci_003/prompt.txt'
2024-01-11T00:31:54,945   adding 'alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml'
2024-01-11T00:31:54,947   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml'
2024-01-11T00:31:54,948   adding 'alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt'
2024-01-11T00:31:54,949   adding 'alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml'
2024-01-11T00:31:54,951   adding 'alpaca_eval/models_configs/ultralm-13b/configs.yaml'
2024-01-11T00:31:54,952   adding 'alpaca_eval/models_configs/ultralm-13b/prompt.txt'
2024-01-11T00:31:54,953   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml'
2024-01-11T00:31:54,954   adding 'alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt'
2024-01-11T00:31:54,956   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml'
2024-01-11T00:31:54,957   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt'
2024-01-11T00:31:54,959   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml'
2024-01-11T00:31:54,960   adding 'alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt'
2024-01-11T00:31:54,961   adding 'alpaca_eval/models_configs/vicuna-13b/configs.yaml'
2024-01-11T00:31:54,963   adding 'alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml'
2024-01-11T00:31:54,964   adding 'alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml'
2024-01-11T00:31:54,966   adding 'alpaca_eval/models_configs/vicuna-7b/configs.yaml'
2024-01-11T00:31:54,967   adding 'alpaca_eval/models_configs/vicuna-7b/prompt.txt'
2024-01-11T00:31:54,969   adding 'alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml'
2024-01-11T00:31:54,970   adding 'alpaca_eval/models_configs/wizardlm-13b/configs.yaml'
2024-01-11T00:31:54,971   adding 'alpaca_eval/models_configs/wizardlm-13b/prompt.txt'
2024-01-11T00:31:54,973   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml'
2024-01-11T00:31:54,974   adding 'alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml'
2024-01-11T00:31:54,976   adding 'alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml'
2024-01-11T00:31:54,977   adding 'alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml'
2024-01-11T00:31:54,979   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml'
2024-01-11T00:31:54,980   adding 'alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt'
2024-01-11T00:31:54,981   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml'
2024-01-11T00:31:54,982   adding 'alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt'
2024-01-11T00:31:54,984   adding 'alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml'
2024-01-11T00:31:54,987   adding 'alpaca_eval-0.5.2.dist-info/LICENSE'
2024-01-11T00:31:54,998   adding 'alpaca_eval-0.5.2.dist-info/METADATA'
2024-01-11T00:31:54,999   adding 'alpaca_eval-0.5.2.dist-info/WHEEL'
2024-01-11T00:31:55,000   adding 'alpaca_eval-0.5.2.dist-info/entry_points.txt'
2024-01-11T00:31:55,001   adding 'alpaca_eval-0.5.2.dist-info/top_level.txt'
2024-01-11T00:31:55,005   adding 'alpaca_eval-0.5.2.dist-info/RECORD'
2024-01-11T00:31:55,012   removing build/bdist.linux-armv7l/wheel
2024-01-11T00:31:55,221   Building wheel for alpaca-eval (setup.py): finished with status 'done'
2024-01-11T00:31:55,226   Created wheel for alpaca-eval: filename=alpaca_eval-0.5.2-py3-none-any.whl size=235729 sha256=e32b833134b5b6f1764832fcfc486ec030b85ab26594d00fb100d516e96d8632
2024-01-11T00:31:55,228   Stored in directory: /tmp/pip-ephem-wheel-cache-x440vzqh/wheels/31/e6/55/f14e051b2409074437f5f6b0283b252a75b4fa29a1ca1dec16
2024-01-11T00:31:55,257 Successfully built alpaca-eval
2024-01-11T00:31:55,268 Removed build tracker: '/tmp/pip-build-tracker-2pbl3ci3'